2024-09-22T08:30:01.130 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T08:30:01.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T08:30:01.241 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073 branch: wip-skoduri-cloud-restore description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7915073' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-cloud-restore ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 8852379c050c686f4605f33f0129009b2029ca9d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8852379c050c686f4605f33f0129009b2029ca9d openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-cloud-restore sha1: 8852379c050c686f4605f33f0129009b2029ca9d owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 8852379c050c686f4605f33f0129009b2029ca9d sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-cloud-restore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8852379c050c686f4605f33f0129009b2029ca9d targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEQxl+RXnwN12Y338qZNpWMBLayObnuASotL08ngYLCHdxzddPpbB1vUyLSWEUsuPVAA8WbETH4p0+vt8dURMM= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD8rQba4ib5zuO2YWnEujwdrNr3wVChBWRgQuzo/fVOVaVyl1lDihrgbLSmLfRJuVHy7D7phNznq94s7Jur5NE= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-22_06:37:27 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T08:30:01.241 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa; will attempt to use it 2024-09-22T08:30:01.242 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa/tasks 2024-09-22T08:30:01.242 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T08:30:01.244 INFO:teuthology.task.internal:Checking packages... 2024-09-22T08:30:01.265 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8852379c050c686f4605f33f0129009b2029ca9d' 2024-09-22T08:30:01.265 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T08:30:01.265 INFO:teuthology.packaging:ref: None 2024-09-22T08:30:01.265 INFO:teuthology.packaging:tag: None 2024-09-22T08:30:01.265 INFO:teuthology.packaging:branch: wip-skoduri-cloud-restore 2024-09-22T08:30:01.265 INFO:teuthology.packaging:sha1: 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:30:01.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-cloud-restore 2024-09-22T08:30:01.420 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5106.g8852379c 2024-09-22T08:30:01.422 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T08:30:01.433 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T08:30:01.433 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T08:30:01.458 INFO:teuthology.task.internal:Saving configuration 2024-09-22T08:30:01.476 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T08:30:01.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T08:30:01.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:24:02.894461', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEQxl+RXnwN12Y338qZNpWMBLayObnuASotL08ngYLCHdxzddPpbB1vUyLSWEUsuPVAA8WbETH4p0+vt8dURMM='} 2024-09-22T08:30:01.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 08:24:02.892897', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD8rQba4ib5zuO2YWnEujwdrNr3wVChBWRgQuzo/fVOVaVyl1lDihrgbLSmLfRJuVHy7D7phNznq94s7Jur5NE='} 2024-09-22T08:30:01.538 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T08:30:01.544 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T08:30:01.544 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T08:30:01.544 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T08:30:01.661 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa180d6f640>, signals=[15]) 2024-09-22T08:30:01.661 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T08:30:01.666 INFO:teuthology.task.internal:Opening connections... 2024-09-22T08:30:01.667 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:30:01.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:30:01.741 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:30:01.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:30:01.818 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T08:30:01.824 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-22T08:30:01.843 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-22T08:30:01.843 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-22T08:30:01.901 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-09-22T08:30:01.901 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-09-22T08:30:01.901 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:30:01.902 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:30:01.903 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-22T08:30:01.919 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-22T08:30:01.938 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-22T08:30:01.939 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-22T08:30:01.995 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-22T08:30:01.995 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-22T08:30:01.995 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T08:30:01.996 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T08:30:01.996 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-22T08:30:02.020 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T08:30:02.029 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T08:30:02.035 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T08:30:02.035 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:30:02.037 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-22T08:30:02.054 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T08:30:02.060 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T08:30:02.060 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:30:02.095 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-22T08:30:02.213 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T08:30:02.267 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T08:30:02.281 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-22T08:30:02.281 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-22T08:30:02.282 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:30:02.282 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T08:30:02.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:30:02.299 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-22T08:30:02.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:30:02.300 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-22T08:30:02.357 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:30:02.357 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-503.el9.x86_64 2024-09-22T08:30:02.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-09-22T08:30:02.358 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-22T08:30:02.358 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-22T08:30:02.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-22T08:30:04.658 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-22T08:30:05.916 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-22T08:30:06.675 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-22T08:30:07.667 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-22T08:30:11.259 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-22T08:30:12.017 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-22T08:30:13.426 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-22T08:30:13.552 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-22T08:30:14.613 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-22T08:30:14.697 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-22T08:30:20.018 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-22T08:30:20.303 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-22T08:30:21.916 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:30:21.916 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:30:22.007 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-22T08:30:22.018 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-22T08:30:22.019 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:30:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-22T08:30:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-22T08:30:22.020 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-22T08:30:22.186 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 304 kB/s | 36 kB 00:00 2024-09-22T08:30:22.260 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T08:30:22.260 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T08:30:22.361 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T08:30:22.365 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T08:30:22.366 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:30:22.366 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-22T08:30:22.366 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T08:30:22.366 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-09-22T08:30:22.366 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:30:22.367 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 79 M 2024-09-22T08:30:22.367 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 126 M 2024-09-22T08:30:22.367 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-22T08:30:22.621 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 294 kB/s | 36 kB 00:00 2024-09-22T08:30:22.778 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 48 MB/s | 29 MB 00:00 2024-09-22T08:30:23.171 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-22T08:30:23.337 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-22T08:30:23.780 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-22T08:30:23.895 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-22T08:30:23.896 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:30:23.896 INFO:teuthology.orchestra.run.smithi117.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-22T08:30:24.574 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-22T08:30:24.949 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-22T08:30:24.949 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-22T08:30:25.911 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-22T08:30:25.911 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-22T08:30:25.921 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 8.7 MB/s | 29 MB 00:03 2024-09-22T08:30:25.922 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:30:25.922 INFO:teuthology.orchestra.run.smithi039.stdout:Total 22 MB/s | 79 MB 00:03 2024-09-22T08:30:26.629 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-22T08:30:26.999 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-22T08:30:26.999 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-22T08:30:28.004 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-22T08:30:28.004 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-22T08:30:28.350 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-22T08:30:29.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:30:29.180 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:30:30.553 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-22T08:30:31.200 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:30:31.289 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:30:31.922 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:30:32.048 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:30:34.041 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:30:34.177 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:30:36.882 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:30:36.914 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:30:39.306 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:30:39.353 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:30:41.740 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:30:44.495 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:20.158 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:20.199 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:20.497 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:20.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:31:20.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:31:20.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:31:21.309 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:31:21.310 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-22T08:31:21.681 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:31:21.779 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.779 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:31:21.779 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:31:21.779 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:31:21.779 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:31:21.779 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-22T08:31:21.779 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:31:21.780 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:31:21.837 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:21.838 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:31:21.838 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-22T08:31:21.877 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-22T08:31:21.878 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:31:21.879 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:31:21.880 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:31:21.880 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:31:21.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:31:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-22T08:31:23.488 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:23.529 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:23.786 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:31:23.825 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-22T08:31:23.828 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-22T08:31:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.sbM7GhbFH8 2024-09-22T08:31:23.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sbM7GhbFH8 2024-09-22T08:31:23.868 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:23.868 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T08:31:23.868 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T08:31:23.868 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T08:31:23.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.sbM7GhbFH8 2024-09-22T08:31:24.046 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.sbM7GhbFH8 is 6KB 2024-09-22T08:31:24.066 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.sbM7GhbFH8 2024-09-22T08:31:24.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:31:24.143 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:31:24.143 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:31:24.143 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:31:24.143 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:31:24.144 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:31:24.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T08:31:24.716 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T08:31:24.717 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T08:31:24.717 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:31:24.717 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-22T08:31:25.078 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:31:25.170 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:25.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:31:25.171 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T08:31:25.171 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T08:31:25.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T08:31:25.171 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T08:31:25.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T08:31:25.171 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T08:31:25.231 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T08:31:25.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T08:31:25.232 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-09-22T08:31:25.263 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-09-22T08:31:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-09-22T08:31:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-09-22T08:31:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 82.el9 2024-09-22T08:31:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-09-22T08:31:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8274670 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-09-22T08:31:25.265 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:31:25.266 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T08:31:25.267 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T08:31:25.267 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-508.el9.x86_64 2024-09-22T08:31:25.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T08:31:25.984 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-22T08:31:27.285 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T08:31:27.323 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-22T08:31:27.331 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-22T08:31:27.346 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.GCLx6P3iZ9 2024-09-22T08:31:27.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GCLx6P3iZ9 2024-09-22T08:31:27.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.GCLx6P3iZ9 2024-09-22T08:31:27.549 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.GCLx6P3iZ9 is 6KB 2024-09-22T08:31:27.598 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.GCLx6P3iZ9 2024-09-22T08:31:27.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T08:31:27.675 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T08:31:27.676 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T08:31:27.676 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T08:31:27.676 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T08:31:27.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T08:31:27.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-22T08:31:54.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-22T08:31:54.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-22T08:31:54.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:31:57.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T08:31:57.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:31:57.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:32:16.371 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-22T08:32:25.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:32:25.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:32:28.435 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-22T08:32:40.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:32:40.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:32:43.503 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-22T08:32:54.331 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T08:32:58.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:32:58.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:33:03.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-22T08:33:03.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:33:03.631 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-22T08:33:04.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-22T08:33:04.001 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:33:04.001 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-22T08:33:04.015 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:33:04.015 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:33:04.015 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:33:04.015 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:33:05.016 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-22T08:33:05.016 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:33:05.096 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-22T08:33:05.120 DEBUG:teuthology.parallel:result is None 2024-09-22T08:33:58.510 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T08:34:16.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:34:16.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:34:16.815 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-22T08:34:17.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:34:17.183 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T08:34:17.186 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-22T08:34:17.202 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-508.el9.x86_64 2024-09-22T08:34:17.202 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T08:34:17.203 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T08:34:17.203 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T08:34:18.203 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T08:34:18.204 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T08:34:18.283 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2024-09-22T08:34:18.307 DEBUG:teuthology.parallel:result is None 2024-09-22T08:34:18.307 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T08:34:18.314 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T08:34:18.315 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:34:18.317 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T08:34:18.337 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T08:34:18.344 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T08:34:18.354 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T08:34:18.354 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:34:18.376 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T08:34:18.659 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T08:34:18.665 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T08:34:18.666 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:34:18.668 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T08:34:18.701 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:34:18.704 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:34:18.714 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:34:18.716 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T08:34:18.717 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T08:34:18.724 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T08:34:18.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:34:18.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T08:34:18.786 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T08:34:18.795 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T08:34:18.795 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:34:18.827 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T08:34:18.843 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:34:18.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:34:18.974 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:34:19.057 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:34:19.100 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:34:19.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:34:19.167 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:34:19.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T08:34:19.265 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:34:19.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T08:34:19.393 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:34:19.393 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T08:34:19.459 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-22T08:34:19.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-22T08:34:19.513 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:34:19.551 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T08:34:19.957 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T08:34:19.964 INFO:teuthology.task.internal:Starting timer... 2024-09-22T08:34:19.964 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T08:34:19.974 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T08:34:19.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-09-22T08:34:20.031 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-09-22T08:34:20.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-22T08:34:20.078 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-22T08:34:20.080 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T08:34:20.080 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-09-22T08:34:20.101 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-09-22T08:34:20.101 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-22T08:34:20.145 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-22T08:34:20.146 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-22T08:34:20.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:34:20.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:34:20.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T08:34:20.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:34:20.213 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T08:34:20.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:34:20.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-22T08:34:20.294 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T08:34:20.303 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T08:34:20.306 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T08:34:20.425 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T08:34:20.435 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T08:34:20.436 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T08:38:04.268 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-22T08:38:04.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:38:04.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:38:04.343 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-22T08:38:04.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-22T08:38:04.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-22T08:38:04.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T08:38:04.491 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-22T08:38:04.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-22T08:38:04.569 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T08:38:04.582 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T08:38:04.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:38:04.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:38:04.585 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T08:38:04.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T08:38:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:38:04.627 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:38:04.637 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T08:38:04.651 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T08:38:04.653 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-09-22T08:38:04.664 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-09-22T08:38:04.675 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-22T08:38:04.679 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:38:04.686 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-22T08:38:04.693 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:38:04.700 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T08:38:04.714 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T08:38:04.751 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.779 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.783 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T08:38:04.784 INFO:teuthology.run_tasks:Running task install... 2024-09-22T08:38:04.792 DEBUG:teuthology.task.install:project ceph 2024-09-22T08:38:04.792 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}} 2024-09-22T08:38:04.792 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'} 2024-09-22T08:38:04.792 INFO:teuthology.task.install:Using flavor: default 2024-09-22T08:38:04.797 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T08:38:04.797 INFO:teuthology.task.install:extra packages: [] 2024-09-22T08:38:04.798 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:38:04.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:38:04.800 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'tag': None, 'wait_for_package': False} 2024-09-22T08:38:04.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:38:04.940 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:38:04.941 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:38:04.946 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/ 2024-09-22T08:38:04.946 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5106.g8852379c 2024-09-22T08:38:05.048 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:38:05.049 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:38:05.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:38:05.056 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-skoduri-cloud-restore/8852379c050c686f4605f33f0129009b2029ca9d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T08:38:05.056 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:38:05.056 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T08:38:05.076 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:38:05.076 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:38:05.082 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-22T08:38:05.083 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8852379c050c686f4605f33f0129009b2029ca9d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T08:38:05.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:38:05.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T08:38:05.219 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:38:05.223 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T08:38:05.285 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-09-22T08:38:05.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-09-22T08:38:05.287 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-22T08:38:05.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-22T08:38:05.510 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-22T08:38:05.533 INFO:teuthology.orchestra.run.smithi039.stdout:45 files removed 2024-09-22T08:38:05.537 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:38:05.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-22T08:38:06.083 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-22T08:38:06.140 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-22T08:38:06.376 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-22T08:38:06.441 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-22T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-22T08:38:06.725 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-22T08:38:07.193 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-22T08:38:09.202 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-22T08:38:10.725 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.3 MB 00:03 2024-09-22T08:38:14.886 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-22T08:38:16.717 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 20 MB 00:04 2024-09-22T08:38:16.928 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-22T08:38:18.082 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-22T08:38:22.602 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-22T08:38:23.529 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-22T08:38:24.385 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-22T08:38:25.673 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-22T08:38:25.697 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:38:25.698 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:38:25.788 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:38:25.816 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:38:25.817 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:38:25.818 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-22T08:38:25.819 INFO:teuthology.orchestra.run.smithi117.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:38:25.820 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:38:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi117.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:38:25.823 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:38:25.824 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:38:25.825 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:38:25.826 INFO:teuthology.orchestra.run.smithi117.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:38:25.827 INFO:teuthology.orchestra.run.smithi117.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:38:25.828 INFO:teuthology.orchestra.run.smithi117.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:38:25.829 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:38:25.830 INFO:teuthology.orchestra.run.smithi117.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:38:25.831 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:38:25.832 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:38:25.833 INFO:teuthology.orchestra.run.smithi117.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:38:25.834 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:38:25.835 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:38:25.836 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:38:25.837 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:38:25.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:38:25.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:38:25.840 INFO:teuthology.orchestra.run.smithi117.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:38:25.841 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:38:25.842 INFO:teuthology.orchestra.run.smithi117.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================================== 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout:Install 284 Packages 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-09-22T08:38:25.843 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:38:25.844 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 322 M 2024-09-22T08:38:25.844 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-22T08:38:26.480 INFO:teuthology.orchestra.run.smithi117.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-22T08:38:26.689 INFO:teuthology.orchestra.run.smithi117.stdout:(2/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 4.2 MB/s | 900 kB 00:00 2024-09-22T08:38:26.756 INFO:teuthology.orchestra.run.smithi117.stdout:(3/286): ceph-immutable-object-cache-19.3.0-510 2.1 MB/s | 145 kB 00:00 2024-09-22T08:38:26.881 INFO:teuthology.orchestra.run.smithi117.stdout:(4/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-22T08:38:26.981 INFO:teuthology.orchestra.run.smithi117.stdout:(5/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 11 MB/s | 2.4 MB 00:00 2024-09-22T08:38:27.023 INFO:teuthology.orchestra.run.smithi117.stdout:(6/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-22T08:38:27.357 INFO:teuthology.orchestra.run.smithi117.stdout:(7/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-22T08:38:27.582 INFO:teuthology.orchestra.run.smithi117.stdout:(8/286): ceph-common-19.3.0-5106.g8852379c.el9. 18 MB/s | 22 MB 00:01 2024-09-22T08:38:27.624 INFO:teuthology.orchestra.run.smithi117.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 608 kB/s | 25 kB 00:00 2024-09-22T08:38:27.991 INFO:teuthology.orchestra.run.smithi117.stdout:(10/286): ceph-osd-19.3.0-5106.g8852379c.el9.x8 18 MB/s | 17 MB 00:00 2024-09-22T08:38:28.116 INFO:teuthology.orchestra.run.smithi117.stdout:(11/286): ceph-radosgw-19.3.0-5106.g8852379c.el 14 MB/s | 11 MB 00:00 2024-09-22T08:38:28.141 INFO:teuthology.orchestra.run.smithi117.stdout:(12/286): libcephfs-devel-19.3.0-5106.g8852379c 212 kB/s | 32 kB 00:00 2024-09-22T08:38:28.175 INFO:teuthology.orchestra.run.smithi117.stdout:(13/286): libcephfs2-19.3.0-5106.g8852379c.el9. 13 MB/s | 755 kB 00:00 2024-09-22T08:38:28.200 INFO:teuthology.orchestra.run.smithi117.stdout:(14/286): libcephsqlite-19.3.0-5106.g8852379c.e 2.7 MB/s | 161 kB 00:00 2024-09-22T08:38:28.225 INFO:teuthology.orchestra.run.smithi117.stdout:(15/286): librados-devel-19.3.0-5106.g8852379c. 2.5 MB/s | 127 kB 00:00 2024-09-22T08:38:28.251 INFO:teuthology.orchestra.run.smithi117.stdout:(16/286): libradosstriper1-19.3.0-5106.g8852379 9.9 MB/s | 508 kB 00:00 2024-09-22T08:38:28.309 INFO:teuthology.orchestra.run.smithi117.stdout:(17/286): python3-ceph-argparse-19.3.0-5106.g88 777 kB/s | 45 kB 00:00 2024-09-22T08:38:28.402 INFO:teuthology.orchestra.run.smithi117.stdout:(18/286): python3-ceph-common-19.3.0-5106.g8852 1.6 MB/s | 148 kB 00:00 2024-09-22T08:38:28.485 INFO:teuthology.orchestra.run.smithi117.stdout:(19/286): librgw2-19.3.0-5106.g8852379c.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-22T08:38:28.510 INFO:teuthology.orchestra.run.smithi117.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 1.5 MB/s | 162 kB 00:00 2024-09-22T08:38:28.544 INFO:teuthology.orchestra.run.smithi117.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 5.3 MB/s | 320 kB 00:00 2024-09-22T08:38:28.569 INFO:teuthology.orchestra.run.smithi117.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 5.1 MB/s | 307 kB 00:00 2024-09-22T08:38:28.594 INFO:teuthology.orchestra.run.smithi117.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.9 MB/s | 99 kB 00:00 2024-09-22T08:38:28.703 INFO:teuthology.orchestra.run.smithi117.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 636 kB/s | 85 kB 00:00 2024-09-22T08:38:28.770 INFO:teuthology.orchestra.run.smithi117.stdout:(25/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 18 MB/s | 3.2 MB 00:00 2024-09-22T08:38:28.795 INFO:teuthology.orchestra.run.smithi117.stdout:(26/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-22T08:38:28.812 INFO:teuthology.orchestra.run.smithi117.stdout:(27/286): ceph-grafana-dashboards-19.3.0-5106.g 819 kB/s | 34 kB 00:00 2024-09-22T08:38:28.846 INFO:teuthology.orchestra.run.smithi117.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 3.0 MB/s | 154 kB 00:00 2024-09-22T08:38:29.321 INFO:teuthology.orchestra.run.smithi117.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-22T08:38:29.396 INFO:teuthology.orchestra.run.smithi117.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5106.g88 3.8 MB/s | 292 kB 00:00 2024-09-22T08:38:29.463 INFO:teuthology.orchestra.run.smithi117.stdout:(31/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 741 kB/s | 49 kB 00:00 2024-09-22T08:38:29.605 INFO:teuthology.orchestra.run.smithi117.stdout:(32/286): ceph-mgr-dashboard-19.3.0-5106.g88523 18 MB/s | 14 MB 00:00 2024-09-22T08:38:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:(33/286): ceph-prometheus-alerts-19.3.0-5106.g8 98 kB/s | 16 kB 00:00 2024-09-22T08:38:29.656 INFO:teuthology.orchestra.run.smithi117.stdout:(34/286): ceph-volume-19.3.0-5106.g8852379c.el9 5.6 MB/s | 285 kB 00:00 2024-09-22T08:38:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:(35/286): cephadm-19.3.0-5106.g8852379c.el9.noa 11 MB/s | 784 kB 00:00 2024-09-22T08:38:29.815 INFO:teuthology.orchestra.run.smithi117.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 726 kB/s | 85 kB 00:00 2024-09-22T08:38:29.840 INFO:teuthology.orchestra.run.smithi117.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.8 MB/s | 335 kB 00:00 2024-09-22T08:38:29.857 INFO:teuthology.orchestra.run.smithi117.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-22T08:38:30.250 INFO:teuthology.orchestra.run.smithi117.stdout:(39/286): ceph-test-19.3.0-5106.g8852379c.el9.x 17 MB/s | 46 MB 00:02 2024-09-22T08:38:30.274 INFO:teuthology.orchestra.run.smithi117.stdout:(40/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 604 kB/s | 262 kB 00:00 2024-09-22T08:38:30.299 INFO:teuthology.orchestra.run.smithi117.stdout:(41/286): fuse-2.9.9-16.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-09-22T08:38:30.341 INFO:teuthology.orchestra.run.smithi117.stdout:(42/286): libgfortran-11.5.0-2.el9.x86_64.rpm 8.5 MB/s | 801 kB 00:00 2024-09-22T08:38:30.367 INFO:teuthology.orchestra.run.smithi117.stdout:(43/286): libpciaccess-0.16-7.el9.x86_64.rpm 292 kB/s | 27 kB 00:00 2024-09-22T08:38:30.392 INFO:teuthology.orchestra.run.smithi117.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-22T08:38:30.417 INFO:teuthology.orchestra.run.smithi117.stdout:(45/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-22T08:38:30.459 INFO:teuthology.orchestra.run.smithi117.stdout:(46/286): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-22T08:38:30.484 INFO:teuthology.orchestra.run.smithi117.stdout:(47/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-22T08:38:30.510 INFO:teuthology.orchestra.run.smithi117.stdout:(48/286): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-22T08:38:30.535 INFO:teuthology.orchestra.run.smithi117.stdout:(49/286): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi117.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-22T08:38:30.577 INFO:teuthology.orchestra.run.smithi117.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-22T08:38:31.279 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T08:38:31.444 INFO:teuthology.orchestra.run.smithi117.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 716 kB/s | 650 kB 00:00 2024-09-22T08:38:31.477 INFO:teuthology.orchestra.run.smithi117.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 582 kB/s | 523 kB 00:00 2024-09-22T08:38:31.561 INFO:teuthology.orchestra.run.smithi117.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 606 kB/s | 71 kB 00:00 2024-09-22T08:38:31.594 INFO:teuthology.orchestra.run.smithi117.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 2.5 MB/s | 302 kB 00:00 2024-09-22T08:38:31.803 INFO:teuthology.orchestra.run.smithi117.stdout:(56/286): apache-commons-lang3-3.12.0-6.el9.noa 2.6 MB/s | 559 kB 00:00 2024-09-22T08:38:31.912 INFO:teuthology.orchestra.run.smithi117.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 800 kB/s | 87 kB 00:00 2024-09-22T08:38:31.937 INFO:teuthology.orchestra.run.smithi117.stdout:(58/286): apache-commons-io-2.8.0-8.el9.noarch. 754 kB/s | 283 kB 00:00 2024-09-22T08:38:32.021 INFO:teuthology.orchestra.run.smithi117.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-09-22T08:38:32.046 INFO:teuthology.orchestra.run.smithi117.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 214 kB/s | 23 kB 00:00 2024-09-22T08:38:32.138 INFO:teuthology.orchestra.run.smithi117.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T08:38:32.163 INFO:teuthology.orchestra.run.smithi117.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 127 kB/s | 15 kB 00:00 2024-09-22T08:38:32.247 INFO:teuthology.orchestra.run.smithi117.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 983 kB/s | 107 kB 00:00 2024-09-22T08:38:32.272 INFO:teuthology.orchestra.run.smithi117.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 491 kB/s | 53 kB 00:00 2024-09-22T08:38:32.381 INFO:teuthology.orchestra.run.smithi117.stdout:(65/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 564 kB/s | 61 kB 00:00 2024-09-22T08:38:32.489 INFO:teuthology.orchestra.run.smithi117.stdout:(66/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 260 kB/s | 28 kB 00:00 2024-09-22T08:38:32.531 INFO:teuthology.orchestra.run.smithi117.stdout:(67/286): colord-libs-1.4.5-4.el9.x86_64.rpm 808 kB/s | 229 kB 00:00 2024-09-22T08:38:32.598 INFO:teuthology.orchestra.run.smithi117.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.0 MB/s | 113 kB 00:00 2024-09-22T08:38:32.898 INFO:teuthology.orchestra.run.smithi117.stdout:(69/286): exiv2-0.27.5-2.el9.x86_64.rpm 3.2 MB/s | 980 kB 00:00 2024-09-22T08:38:33.024 INFO:teuthology.orchestra.run.smithi117.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-22T08:38:33.099 INFO:teuthology.orchestra.run.smithi117.stdout:(71/286): exempi-2.6.0-0.2.20211007gite23c213.e 925 kB/s | 525 kB 00:00 2024-09-22T08:38:33.141 INFO:teuthology.orchestra.run.smithi117.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-22T08:38:33.383 INFO:teuthology.orchestra.run.smithi117.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 769 kB/s | 218 kB 00:00 2024-09-22T08:38:33.500 INFO:teuthology.orchestra.run.smithi117.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 185 kB/s | 22 kB 00:00 2024-09-22T08:38:33.608 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:38:33.609 INFO:teuthology.orchestra.run.smithi117.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 674 kB/s | 73 kB 00:00 2024-09-22T08:38:33.609 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-22T08:38:33.642 INFO:teuthology.orchestra.run.smithi117.stdout:(76/286): flatpak-1.12.9-1.el9.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2024-09-22T08:38:33.709 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-22T08:38:33.733 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================================== 2024-09-22T08:38:33.733 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================================== 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.3.0-5106.g8852379c.el9 ceph 6.6 k 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 900 k 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5106.g8852379c.el9 ceph 145 k 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.3.0-5106.g8852379c.el9 ceph 1.5 M 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 154 k 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 14 M 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 7.4 M 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 49 k 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 11 M 2024-09-22T08:38:33.734 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.3.0-5106.g8852379c.el9 ceph 46 M 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 285 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 784 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 32 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 755 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.3.0-5106.g8852379c.el9 ceph 127 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.3.0-5106.g8852379c.el9 ceph 162 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.3.0-5106.g8852379c.el9 ceph 320 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 307 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.3.0-5106.g8852379c.el9 ceph 99 k 2024-09-22T08:38:33.735 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 85 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 170 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.5 M 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 3.2 M 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-22T08:38:33.736 INFO:teuthology.orchestra.run.smithi039.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-22T08:38:33.737 INFO:teuthology.orchestra.run.smithi039.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 22 M 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 34 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.3.0-5106.g8852379c.el9 ceph 2.4 M 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 292 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.3.0-5106.g8852379c.el9 ceph 4.8 M 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.3.0-5106.g8852379c.el9 ceph 17 M 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5106.g8852379c.el9 ceph-noarch 16 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.3.0-5106.g8852379c.el9 ceph 25 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-22T08:38:33.738 INFO:teuthology.orchestra.run.smithi039.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-22T08:38:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-22T08:38:33.740 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-22T08:38:33.741 INFO:teuthology.orchestra.run.smithi039.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.3.0-5106.g8852379c.el9 ceph 161 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-22T08:38:33.742 INFO:teuthology.orchestra.run.smithi039.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T08:38:33.743 INFO:teuthology.orchestra.run.smithi039.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 508 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.3.0-5106.g8852379c.el9 ceph 5.5 M 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-22T08:38:33.744 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T08:38:33.745 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-22T08:38:33.746 INFO:teuthology.orchestra.run.smithi039.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-22T08:38:33.747 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T08:38:33.748 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.3.0-5106.g8852379c.el9 ceph 45 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.3.0-5106.g8852379c.el9 ceph 148 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T08:38:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T08:38:33.750 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T08:38:33.751 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T08:38:33.752 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-22T08:38:33.753 INFO:teuthology.orchestra.run.smithi039.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-22T08:38:33.754 INFO:teuthology.orchestra.run.smithi039.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T08:38:33.755 INFO:teuthology.orchestra.run.smithi039.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================================== 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:Install 284 Packages 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 2 Packages 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 322 M 2024-09-22T08:38:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-22T08:38:33.770 INFO:teuthology.orchestra.run.smithi117.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 203 kB/s | 33 kB 00:00 2024-09-22T08:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 18 kB 00:00 2024-09-22T08:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 822 kB/s | 89 kB 00:00 2024-09-22T08:38:34.101 INFO:teuthology.orchestra.run.smithi117.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.1 MB/s | 124 kB 00:00 2024-09-22T08:38:34.210 INFO:teuthology.orchestra.run.smithi117.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2024-09-22T08:38:34.347 INFO:teuthology.orchestra.run.smithi039.stdout:(1/286): ceph-19.3.0-5106.g8852379c.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-22T08:38:34.581 INFO:teuthology.orchestra.run.smithi039.stdout:(2/286): ceph-fuse-19.3.0-5106.g8852379c.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-22T08:38:34.664 INFO:teuthology.orchestra.run.smithi039.stdout:(3/286): ceph-immutable-object-cache-19.3.0-510 1.7 MB/s | 145 kB 00:00 2024-09-22T08:38:34.668 INFO:teuthology.orchestra.run.smithi117.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 1.0 MB/s | 473 kB 00:00 2024-09-22T08:38:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:(4/286): ceph-base-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-22T08:38:34.785 INFO:teuthology.orchestra.run.smithi117.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 553 kB/s | 64 kB 00:00 2024-09-22T08:38:34.831 INFO:teuthology.orchestra.run.smithi039.stdout:(5/286): ceph-mgr-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-22T08:38:34.902 INFO:teuthology.orchestra.run.smithi117.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 292 kB/s | 34 kB 00:00 2024-09-22T08:38:34.915 INFO:teuthology.orchestra.run.smithi039.stdout:(6/286): ceph-mds-19.3.0-5106.g8852379c.el9.x86 9.5 MB/s | 2.4 MB 00:00 2024-09-22T08:38:35.165 INFO:teuthology.orchestra.run.smithi039.stdout:(7/286): ceph-mon-19.3.0-5106.g8852379c.el9.x86 14 MB/s | 4.8 MB 00:00 2024-09-22T08:38:35.382 INFO:teuthology.orchestra.run.smithi039.stdout:(8/286): ceph-common-19.3.0-5106.g8852379c.el9. 19 MB/s | 22 MB 00:01 2024-09-22T08:38:35.424 INFO:teuthology.orchestra.run.smithi039.stdout:(9/286): ceph-selinux-19.3.0-5106.g8852379c.el9 609 kB/s | 25 kB 00:00 2024-09-22T08:38:35.744 INFO:teuthology.orchestra.run.smithi117.stdout:(85/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.4 MB/s | 3.0 MB 00:02 2024-09-22T08:38:35.903 INFO:teuthology.orchestra.run.smithi117.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-22T08:38:35.916 INFO:teuthology.orchestra.run.smithi039.stdout:(10/286): ceph-osd-19.3.0-5106.g8852379c.el9.x8 17 MB/s | 17 MB 00:01 2024-09-22T08:38:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:(11/286): libcephfs-devel-19.3.0-5106.g8852379c 639 kB/s | 32 kB 00:00 2024-09-22T08:38:36.011 INFO:teuthology.orchestra.run.smithi117.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 305 kB/s | 33 kB 00:00 2024-09-22T08:38:36.083 INFO:teuthology.orchestra.run.smithi039.stdout:(12/286): ceph-radosgw-19.3.0-5106.g8852379c.el 12 MB/s | 11 MB 00:00 2024-09-22T08:38:36.125 INFO:teuthology.orchestra.run.smithi039.stdout:(13/286): libcephfs2-19.3.0-5106.g8852379c.el9. 4.7 MB/s | 755 kB 00:00 2024-09-22T08:38:36.212 INFO:teuthology.orchestra.run.smithi039.stdout:(14/286): libcephsqlite-19.3.0-5106.g8852379c.e 1.2 MB/s | 161 kB 00:00 2024-09-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi039.stdout:(15/286): librados-devel-19.3.0-5106.g8852379c. 890 kB/s | 127 kB 00:00 2024-09-22T08:38:36.301 INFO:teuthology.orchestra.run.smithi039.stdout:(16/286): libradosstriper1-19.3.0-5106.g8852379 5.6 MB/s | 508 kB 00:00 2024-09-22T08:38:36.393 INFO:teuthology.orchestra.run.smithi039.stdout:(17/286): python3-ceph-argparse-19.3.0-5106.g88 492 kB/s | 45 kB 00:00 2024-09-22T08:38:36.501 INFO:teuthology.orchestra.run.smithi039.stdout:(18/286): python3-ceph-common-19.3.0-5106.g8852 1.3 MB/s | 148 kB 00:00 2024-09-22T08:38:36.585 INFO:teuthology.orchestra.run.smithi039.stdout:(19/286): librgw2-19.3.0-5106.g8852379c.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-22T08:38:36.618 INFO:teuthology.orchestra.run.smithi039.stdout:(20/286): python3-cephfs-19.3.0-5106.g8852379c. 1.4 MB/s | 162 kB 00:00 2024-09-22T08:38:36.652 INFO:teuthology.orchestra.run.smithi039.stdout:(21/286): python3-rados-19.3.0-5106.g8852379c.e 4.7 MB/s | 320 kB 00:00 2024-09-22T08:38:36.694 INFO:teuthology.orchestra.run.smithi039.stdout:(22/286): python3-rbd-19.3.0-5106.g8852379c.el9 4.0 MB/s | 307 kB 00:00 2024-09-22T08:38:36.720 INFO:teuthology.orchestra.run.smithi039.stdout:(23/286): python3-rgw-19.3.0-5106.g8852379c.el9 1.4 MB/s | 99 kB 00:00 2024-09-22T08:38:36.761 INFO:teuthology.orchestra.run.smithi039.stdout:(24/286): rbd-fuse-19.3.0-5106.g8852379c.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-22T08:38:36.862 INFO:teuthology.orchestra.run.smithi039.stdout:(25/286): rbd-nbd-19.3.0-5106.g8852379c.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-22T08:38:36.920 INFO:teuthology.orchestra.run.smithi039.stdout:(26/286): rbd-mirror-19.3.0-5106.g8852379c.el9. 16 MB/s | 3.2 MB 00:00 2024-09-22T08:38:36.946 INFO:teuthology.orchestra.run.smithi039.stdout:(27/286): ceph-grafana-dashboards-19.3.0-5106.g 408 kB/s | 34 kB 00:00 2024-09-22T08:38:36.971 INFO:teuthology.orchestra.run.smithi039.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5106.g8852379 3.0 MB/s | 154 kB 00:00 2024-09-22T08:38:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 21 MB/s | 7.4 MB 00:00 2024-09-22T08:38:37.389 INFO:teuthology.orchestra.run.smithi039.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5106.g88 4.5 MB/s | 292 kB 00:00 2024-09-22T08:38:37.455 INFO:teuthology.orchestra.run.smithi039.stdout:(31/286): ceph-mgr-rook-19.3.0-5106.g8852379c.e 742 kB/s | 49 kB 00:00 2024-09-22T08:38:37.522 INFO:teuthology.orchestra.run.smithi039.stdout:(32/286): ceph-prometheus-alerts-19.3.0-5106.g8 247 kB/s | 16 kB 00:00 2024-09-22T08:38:37.589 INFO:teuthology.orchestra.run.smithi039.stdout:(33/286): ceph-volume-19.3.0-5106.g8852379c.el9 4.2 MB/s | 285 kB 00:00 2024-09-22T08:38:37.673 INFO:teuthology.orchestra.run.smithi039.stdout:(34/286): cephadm-19.3.0-5106.g8852379c.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-22T08:38:37.890 INFO:teuthology.orchestra.run.smithi039.stdout:(35/286): ceph-mgr-dashboard-19.3.0-5106.g88523 15 MB/s | 14 MB 00:00 2024-09-22T08:38:38.061 INFO:teuthology.orchestra.run.smithi117.stdout:(88/286): gtk3-3.24.31-5.el9.x86_64.rpm 2.4 MB/s | 4.9 MB 00:02 2024-09-22T08:38:38.299 INFO:teuthology.orchestra.run.smithi039.stdout:(36/286): ceph-test-19.3.0-5106.g8852379c.el9.x 16 MB/s | 46 MB 00:02 2024-09-22T08:38:38.440 INFO:teuthology.orchestra.run.smithi039.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 437 kB/s | 335 kB 00:00 2024-09-22T08:38:38.466 INFO:teuthology.orchestra.run.smithi039.stdout:(38/286): bluez-libs-5.56-6.el9.x86_64.rpm 147 kB/s | 85 kB 00:00 2024-09-22T08:38:38.482 INFO:teuthology.orchestra.run.smithi039.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 269 kB/s | 49 kB 00:00 2024-09-22T08:38:38.533 INFO:teuthology.orchestra.run.smithi039.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-09-22T08:38:38.558 INFO:teuthology.orchestra.run.smithi039.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.2 MB/s | 262 kB 00:00 2024-09-22T08:38:38.659 INFO:teuthology.orchestra.run.smithi039.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 215 kB/s | 27 kB 00:00 2024-09-22T08:38:38.684 INFO:teuthology.orchestra.run.smithi039.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-22T08:38:38.709 INFO:teuthology.orchestra.run.smithi039.stdout:(44/286): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-22T08:38:38.719 INFO:teuthology.orchestra.run.smithi117.stdout:(89/286): guava-30.1-6.el9.noarch.rpm 3.5 MB/s | 2.3 MB 00:00 2024-09-22T08:38:38.734 INFO:teuthology.orchestra.run.smithi039.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-22T08:38:38.760 INFO:teuthology.orchestra.run.smithi039.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-22T08:38:38.801 INFO:teuthology.orchestra.run.smithi039.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-22T08:38:38.827 INFO:teuthology.orchestra.run.smithi039.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-22T08:38:38.869 INFO:teuthology.orchestra.run.smithi039.stdout:(49/286): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-22T08:38:38.885 INFO:teuthology.orchestra.run.smithi117.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 1.3 MB/s | 219 kB 00:00 2024-09-22T08:38:38.903 INFO:teuthology.orchestra.run.smithi039.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-22T08:38:38.928 INFO:teuthology.orchestra.run.smithi039.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-22T08:38:39.004 INFO:teuthology.orchestra.run.smithi117.stdout:(91/286): httpcomponents-client-4.5.13-3.el9.no 5.4 MB/s | 657 kB 00:00 2024-09-22T08:38:39.104 INFO:teuthology.orchestra.run.smithi117.stdout:(92/286): gstreamer1-plugins-base-1.22.1-2.el9. 684 kB/s | 2.2 MB 00:03 2024-09-22T08:38:39.138 INFO:teuthology.orchestra.run.smithi117.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 4.6 MB/s | 632 kB 00:00 2024-09-22T08:38:39.246 INFO:teuthology.orchestra.run.smithi117.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 416 kB/s | 45 kB 00:00 2024-09-22T08:38:39.355 INFO:teuthology.orchestra.run.smithi117.stdout:(95/286): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 110 kB 00:00 2024-09-22T08:38:39.472 INFO:teuthology.orchestra.run.smithi117.stdout:(96/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.5 MB/s | 413 kB 00:00 2024-09-22T08:38:39.503 INFO:teuthology.orchestra.run.smithi039.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 911 kB/s | 523 kB 00:00 2024-09-22T08:38:39.528 INFO:teuthology.orchestra.run.smithi039.stdout:(53/286): adwaita-cursor-theme-40.1.1-3.el9.noa 986 kB/s | 650 kB 00:00 2024-09-22T08:38:39.862 INFO:teuthology.orchestra.run.smithi039.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 197 kB/s | 71 kB 00:00 2024-09-22T08:38:40.129 INFO:teuthology.orchestra.run.smithi039.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 503 kB/s | 302 kB 00:00 2024-09-22T08:38:40.305 INFO:teuthology.orchestra.run.smithi117.stdout:(97/286): java-11-openjdk-devel-11.0.20.1.1-2.e 4.0 MB/s | 3.3 MB 00:00 2024-09-22T08:38:40.371 INFO:teuthology.orchestra.run.smithi039.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 557 kB/s | 283 kB 00:00 2024-09-22T08:38:40.730 INFO:teuthology.orchestra.run.smithi039.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 931 kB/s | 559 kB 00:00 2024-09-22T08:38:40.788 INFO:teuthology.orchestra.run.smithi039.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 208 kB/s | 87 kB 00:00 2024-09-22T08:38:41.072 INFO:teuthology.orchestra.run.smithi039.stdout:(59/286): atinject-1.0.3-6.el9.noarch.rpm 82 kB/s | 23 kB 00:00 2024-09-22T08:38:41.155 INFO:teuthology.orchestra.run.smithi039.stdout:(60/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 458 kB/s | 195 kB 00:00 2024-09-22T08:38:41.422 INFO:teuthology.orchestra.run.smithi039.stdout:(61/286): avahi-glib-0.8-21.el9.x86_64.rpm 56 kB/s | 15 kB 00:00 2024-09-22T08:38:41.548 INFO:teuthology.orchestra.run.smithi039.stdout:(62/286): adwaita-icon-theme-40.1.1-3.el9.noarc 4.5 MB/s | 12 MB 00:02 2024-09-22T08:38:41.689 INFO:teuthology.orchestra.run.smithi039.stdout:(63/286): atk-2.36.0-5.el9.x86_64.rpm 472 kB/s | 292 kB 00:00 2024-09-22T08:38:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 156 kB/s | 53 kB 00:00 2024-09-22T08:38:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:(65/286): boost-program-options-1.75.0-8.el9.x8 217 kB/s | 107 kB 00:00 2024-09-22T08:38:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:(66/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 106 kB/s | 28 kB 00:00 2024-09-22T08:38:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 174 kB/s | 61 kB 00:00 2024-09-22T08:38:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:(68/286): colord-libs-1.4.5-4.el9.x86_64.rpm 387 kB/s | 229 kB 00:00 2024-09-22T08:38:42.447 INFO:teuthology.orchestra.run.smithi117.stdout:(98/286): adwaita-icon-theme-40.1.1-3.el9.noarc 1.0 MB/s | 12 MB 00:11 2024-09-22T08:38:42.547 INFO:teuthology.orchestra.run.smithi117.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 131 kB/s | 13 kB 00:00 2024-09-22T08:38:42.641 INFO:teuthology.orchestra.run.smithi039.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 245 kB/s | 113 kB 00:00 2024-09-22T08:38:42.655 INFO:teuthology.orchestra.run.smithi117.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 488 kB/s | 53 kB 00:00 2024-09-22T08:38:42.764 INFO:teuthology.orchestra.run.smithi117.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 222 kB/s | 24 kB 00:00 2024-09-22T08:38:42.833 INFO:teuthology.orchestra.run.smithi039.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 886 kB/s | 525 kB 00:00 2024-09-22T08:38:43.017 INFO:teuthology.orchestra.run.smithi039.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 1.3 MB/s | 980 kB 00:00 2024-09-22T08:38:43.317 INFO:teuthology.orchestra.run.smithi039.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 1.1 MB/s | 781 kB 00:00 2024-09-22T08:38:43.334 INFO:teuthology.orchestra.run.smithi117.stdout:(102/286): jsoup-1.13.1-10.el9.noarch.rpm 665 kB/s | 377 kB 00:00 2024-09-22T08:38:43.342 INFO:teuthology.orchestra.run.smithi039.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 640 kB/s | 325 kB 00:00 2024-09-22T08:38:43.465 INFO:teuthology.orchestra.run.smithi117.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 266 kB/s | 35 kB 00:00 2024-09-22T08:38:43.542 INFO:teuthology.orchestra.run.smithi039.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 415 kB/s | 218 kB 00:00 2024-09-22T08:38:43.617 INFO:teuthology.orchestra.run.smithi039.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 79 kB/s | 22 kB 00:00 2024-09-22T08:38:43.765 INFO:teuthology.orchestra.run.smithi117.stdout:(104/286): lcms2-2.12-3.el9.x86_64.rpm 559 kB/s | 168 kB 00:00 2024-09-22T08:38:43.882 INFO:teuthology.orchestra.run.smithi117.stdout:(105/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 95 kB/s | 11 kB 00:00 2024-09-22T08:38:43.976 INFO:teuthology.orchestra.run.smithi039.stdout:(76/286): flexiblas-3.0.4-8.el9.x86_64.rpm 91 kB/s | 33 kB 00:00 2024-09-22T08:38:44.001 INFO:teuthology.orchestra.run.smithi039.stdout:(77/286): flatpak-session-helper-1.12.9-1.el9.x 159 kB/s | 73 kB 00:00 2024-09-22T08:38:44.093 INFO:teuthology.orchestra.run.smithi039.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2024-09-22T08:38:44.174 INFO:teuthology.orchestra.run.smithi117.stdout:(106/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 83 kB/s | 24 kB 00:00 2024-09-22T08:38:44.282 INFO:teuthology.orchestra.run.smithi117.stdout:(107/286): libXcursor-1.2.0-7.el9.x86_64.rpm 284 kB/s | 31 kB 00:00 2024-09-22T08:38:44.293 INFO:teuthology.orchestra.run.smithi039.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 62 kB/s | 18 kB 00:00 2024-09-22T08:38:44.399 INFO:teuthology.orchestra.run.smithi117.stdout:(108/286): libXdamage-1.1.5-7.el9.x86_64.rpm 196 kB/s | 23 kB 00:00 2024-09-22T08:38:44.519 INFO:teuthology.orchestra.run.smithi039.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 209 kB/s | 89 kB 00:00 2024-09-22T08:38:44.711 INFO:teuthology.orchestra.run.smithi039.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 299 kB/s | 124 kB 00:00 2024-09-22T08:38:44.749 INFO:teuthology.orchestra.run.smithi117.stdout:(109/286): java-11-openjdk-headless-11.0.20.1.1 8.8 MB/s | 39 MB 00:04 2024-09-22T08:38:44.799 INFO:teuthology.orchestra.run.smithi117.stdout:(110/286): iso-codes-4.6.0-3.el9.noarch.rpm 634 kB/s | 3.5 MB 00:05 2024-09-22T08:38:44.825 INFO:teuthology.orchestra.run.smithi117.stdout:(111/286): libXfixes-5.0.3-16.el9.x86_64.rpm 46 kB/s | 20 kB 00:00 2024-09-22T08:38:44.858 INFO:teuthology.orchestra.run.smithi117.stdout:(112/286): libXi-1.7.10-8.el9.x86_64.rpm 365 kB/s | 40 kB 00:00 2024-09-22T08:38:44.861 INFO:teuthology.orchestra.run.smithi039.stdout:(82/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-22T08:38:44.886 INFO:teuthology.orchestra.run.smithi039.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 132 kB/s | 49 kB 00:00 2024-09-22T08:38:44.934 INFO:teuthology.orchestra.run.smithi117.stdout:(113/286): libXinerama-1.1.4-10.el9.x86_64.rpm 139 kB/s | 15 kB 00:00 2024-09-22T08:38:44.959 INFO:teuthology.orchestra.run.smithi117.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 213 kB/s | 28 kB 00:00 2024-09-22T08:38:44.984 INFO:teuthology.orchestra.run.smithi117.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 171 kB/s | 21 kB 00:00 2024-09-22T08:38:45.043 INFO:teuthology.orchestra.run.smithi117.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 175 kB/s | 19 kB 00:00 2024-09-22T08:38:45.068 INFO:teuthology.orchestra.run.smithi117.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 172 kB/s | 19 kB 00:00 2024-09-22T08:38:45.093 INFO:teuthology.orchestra.run.smithi117.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 280 kB/s | 30 kB 00:00 2024-09-22T08:38:45.143 INFO:teuthology.orchestra.run.smithi117.stdout:(119/286): libcanberra-0.30-27.el9.x86_64.rpm 859 kB/s | 86 kB 00:00 2024-09-22T08:38:45.161 INFO:teuthology.orchestra.run.smithi039.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 124 kB/s | 34 kB 00:00 2024-09-22T08:38:45.177 INFO:teuthology.orchestra.run.smithi117.stdout:(120/286): libcanberra-gtk3-0.30-27.el9.x86_64. 292 kB/s | 32 kB 00:00 2024-09-22T08:38:45.202 INFO:teuthology.orchestra.run.smithi117.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-22T08:38:45.212 INFO:teuthology.orchestra.run.smithi039.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 184 kB/s | 64 kB 00:00 2024-09-22T08:38:45.261 INFO:teuthology.orchestra.run.smithi117.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-09-22T08:38:45.295 INFO:teuthology.orchestra.run.smithi117.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 3.6 MB/s | 435 kB 00:00 2024-09-22T08:38:45.320 INFO:teuthology.orchestra.run.smithi117.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 264 kB/s | 31 kB 00:00 2024-09-22T08:38:45.320 INFO:teuthology.orchestra.run.smithi039.stdout:(86/286): google-guice-4.2.3-9.el9.noarch.rpm 776 kB/s | 473 kB 00:00 2024-09-22T08:38:45.370 INFO:teuthology.orchestra.run.smithi117.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 760 kB/s | 83 kB 00:00 2024-09-22T08:38:45.404 INFO:teuthology.orchestra.run.smithi117.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 135 kB 00:00 2024-09-22T08:38:45.429 INFO:teuthology.orchestra.run.smithi117.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 337 kB/s | 37 kB 00:00 2024-09-22T08:38:45.479 INFO:teuthology.orchestra.run.smithi117.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.3 MB/s | 142 kB 00:00 2024-09-22T08:38:45.521 INFO:teuthology.orchestra.run.smithi117.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-22T08:38:45.546 INFO:teuthology.orchestra.run.smithi117.stdout:(130/286): libgxps-0.3.2-3.el9.x86_64.rpm 673 kB/s | 79 kB 00:00 2024-09-22T08:38:45.587 INFO:teuthology.orchestra.run.smithi039.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 124 kB/s | 33 kB 00:00 2024-09-22T08:38:45.589 INFO:teuthology.orchestra.run.smithi117.stdout:(131/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 563 kB/s | 61 kB 00:00 2024-09-22T08:38:45.630 INFO:teuthology.orchestra.run.smithi117.stdout:(132/286): libldac-2.0.2.3-10.el9.x86_64.rpm 380 kB/s | 41 kB 00:00 2024-09-22T08:38:45.656 INFO:teuthology.orchestra.run.smithi117.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-22T08:38:45.698 INFO:teuthology.orchestra.run.smithi117.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 401 kB/s | 44 kB 00:00 2024-09-22T08:38:45.739 INFO:teuthology.orchestra.run.smithi117.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 308 kB/s | 34 kB 00:00 2024-09-22T08:38:45.773 INFO:teuthology.orchestra.run.smithi117.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-22T08:38:45.807 INFO:teuthology.orchestra.run.smithi117.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-22T08:38:45.849 INFO:teuthology.orchestra.run.smithi117.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-09-22T08:38:45.891 INFO:teuthology.orchestra.run.smithi117.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-22T08:38:45.916 INFO:teuthology.orchestra.run.smithi117.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 411 kB/s | 45 kB 00:00 2024-09-22T08:38:45.983 INFO:teuthology.orchestra.run.smithi117.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.5 MB/s | 206 kB 00:00 2024-09-22T08:38:46.008 INFO:teuthology.orchestra.run.smithi117.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2024-09-22T08:38:46.033 INFO:teuthology.orchestra.run.smithi117.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-09-22T08:38:46.083 INFO:teuthology.orchestra.run.smithi117.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 355 kB/s | 36 kB 00:00 2024-09-22T08:38:46.134 INFO:teuthology.orchestra.run.smithi117.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 2.5 MB/s | 324 kB 00:00 2024-09-22T08:38:46.138 INFO:teuthology.orchestra.run.smithi039.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.5 MB/s | 1.4 MB 00:00 2024-09-22T08:38:46.159 INFO:teuthology.orchestra.run.smithi117.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.1 MB/s | 144 kB 00:00 2024-09-22T08:38:46.201 INFO:teuthology.orchestra.run.smithi117.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.6 MB/s | 193 kB 00:00 2024-09-22T08:38:46.243 INFO:teuthology.orchestra.run.smithi117.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 306 kB/s | 33 kB 00:00 2024-09-22T08:38:46.268 INFO:teuthology.orchestra.run.smithi117.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 178 kB/s | 19 kB 00:00 2024-09-22T08:38:46.310 INFO:teuthology.orchestra.run.smithi117.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-09-22T08:38:46.352 INFO:teuthology.orchestra.run.smithi117.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 384 kB/s | 42 kB 00:00 2024-09-22T08:38:46.386 INFO:teuthology.orchestra.run.smithi117.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-22T08:38:46.419 INFO:teuthology.orchestra.run.smithi117.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.2 MB/s | 133 kB 00:00 2024-09-22T08:38:46.461 INFO:teuthology.orchestra.run.smithi117.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 116 kB/s | 13 kB 00:00 2024-09-22T08:38:46.495 INFO:teuthology.orchestra.run.smithi117.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 330 kB/s | 36 kB 00:00 2024-09-22T08:38:46.537 INFO:teuthology.orchestra.run.smithi117.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T08:38:46.571 INFO:teuthology.orchestra.run.smithi117.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-22T08:38:46.604 INFO:teuthology.orchestra.run.smithi117.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-22T08:38:46.646 INFO:teuthology.orchestra.run.smithi117.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 162 kB/s | 18 kB 00:00 2024-09-22T08:38:46.696 INFO:teuthology.orchestra.run.smithi039.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 1.5 MB/s | 2.2 MB 00:01 2024-09-22T08:38:46.713 INFO:teuthology.orchestra.run.smithi117.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 83 kB/s | 9.0 kB 00:00 2024-09-22T08:38:46.763 INFO:teuthology.orchestra.run.smithi117.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-22T08:38:46.805 INFO:teuthology.orchestra.run.smithi117.stdout:(162/286): maven-lib-3.6.3-15.el9.noarch.rpm 6.3 MB/s | 1.5 MB 00:00 2024-09-22T08:38:46.830 INFO:teuthology.orchestra.run.smithi117.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-22T08:38:46.880 INFO:teuthology.orchestra.run.smithi117.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 960 kB/s | 112 kB 00:00 2024-09-22T08:38:46.939 INFO:teuthology.orchestra.run.smithi117.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 104 kB/s | 11 kB 00:00 2024-09-22T08:38:46.989 INFO:teuthology.orchestra.run.smithi117.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 139 kB 00:00 2024-09-22T08:38:47.048 INFO:teuthology.orchestra.run.smithi117.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-22T08:38:47.107 INFO:teuthology.orchestra.run.smithi117.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 309 kB/s | 36 kB 00:00 2024-09-22T08:38:47.130 INFO:teuthology.orchestra.run.smithi039.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 3.2 MB/s | 4.9 MB 00:01 2024-09-22T08:38:47.157 INFO:teuthology.orchestra.run.smithi117.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 423 kB/s | 46 kB 00:00 2024-09-22T08:38:47.224 INFO:teuthology.orchestra.run.smithi117.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 276 kB/s | 32 kB 00:00 2024-09-22T08:38:47.230 INFO:teuthology.orchestra.run.smithi039.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 410 kB/s | 219 kB 00:00 2024-09-22T08:38:47.266 INFO:teuthology.orchestra.run.smithi117.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-22T08:38:47.358 INFO:teuthology.orchestra.run.smithi117.stdout:(172/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 16 MB/s | 8.8 MB 00:00 2024-09-22T08:38:47.383 INFO:teuthology.orchestra.run.smithi117.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.4 MB/s | 163 kB 00:00 2024-09-22T08:38:47.475 INFO:teuthology.orchestra.run.smithi117.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2024-09-22T08:38:47.500 INFO:teuthology.orchestra.run.smithi117.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-22T08:38:47.592 INFO:teuthology.orchestra.run.smithi117.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 4.4 MB/s | 531 kB 00:00 2024-09-22T08:38:47.597 INFO:teuthology.orchestra.run.smithi039.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 1.6 MB/s | 2.3 MB 00:01 2024-09-22T08:38:47.617 INFO:teuthology.orchestra.run.smithi117.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 632 kB/s | 74 kB 00:00 2024-09-22T08:38:47.709 INFO:teuthology.orchestra.run.smithi117.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 3.9 MB/s | 468 kB 00:00 2024-09-22T08:38:47.735 INFO:teuthology.orchestra.run.smithi117.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 2.1 MB/s | 246 kB 00:00 2024-09-22T08:38:47.814 INFO:teuthology.orchestra.run.smithi039.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 961 kB/s | 657 kB 00:00 2024-09-22T08:38:47.818 INFO:teuthology.orchestra.run.smithi117.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 981 kB/s | 107 kB 00:00 2024-09-22T08:38:47.843 INFO:teuthology.orchestra.run.smithi117.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 528 kB/s | 57 kB 00:00 2024-09-22T08:38:47.927 INFO:teuthology.orchestra.run.smithi117.stdout:(182/286): pipewire-jack-audio-connection-kit-1 84 kB/s | 9.1 kB 00:00 2024-09-22T08:38:47.931 INFO:teuthology.orchestra.run.smithi039.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 902 kB/s | 632 kB 00:00 2024-09-22T08:38:47.962 INFO:teuthology.orchestra.run.smithi117.stdout:(183/286): pipewire-jack-audio-connection-kit-l 1.1 MB/s | 135 kB 00:00 2024-09-22T08:38:48.071 INFO:teuthology.orchestra.run.smithi117.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 13 MB/s | 1.9 MB 00:00 2024-09-22T08:38:48.096 INFO:teuthology.orchestra.run.smithi117.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.4 MB/s | 192 kB 00:00 2024-09-22T08:38:48.156 INFO:teuthology.orchestra.run.smithi039.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 132 kB/s | 45 kB 00:00 2024-09-22T08:38:48.171 INFO:teuthology.orchestra.run.smithi117.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 257 kB/s | 26 kB 00:00 2024-09-22T08:38:48.196 INFO:teuthology.orchestra.run.smithi117.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 598 kB/s | 60 kB 00:00 2024-09-22T08:38:48.272 INFO:teuthology.orchestra.run.smithi117.stdout:(188/286): plexus-containers-component-annotati 183 kB/s | 18 kB 00:00 2024-09-22T08:38:48.305 INFO:teuthology.orchestra.run.smithi117.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 734 kB/s | 80 kB 00:00 2024-09-22T08:38:48.365 INFO:teuthology.orchestra.run.smithi039.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 253 kB/s | 110 kB 00:00 2024-09-22T08:38:48.381 INFO:teuthology.orchestra.run.smithi117.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 310 kB/s | 34 kB 00:00 2024-09-22T08:38:48.422 INFO:teuthology.orchestra.run.smithi117.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.1 MB/s | 254 kB 00:00 2024-09-22T08:38:48.490 INFO:teuthology.orchestra.run.smithi039.stdout:(97/286): iso-codes-4.6.0-3.el9.noarch.rpm 3.9 MB/s | 3.5 MB 00:00 2024-09-22T08:38:48.514 INFO:teuthology.orchestra.run.smithi117.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2024-09-22T08:38:48.650 INFO:teuthology.orchestra.run.smithi117.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 8.3 MB/s | 1.9 MB 00:00 2024-09-22T08:38:48.673 INFO:teuthology.orchestra.run.smithi117.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 959 kB/s | 152 kB 00:00 2024-09-22T08:38:48.774 INFO:teuthology.orchestra.run.smithi117.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-22T08:38:48.799 INFO:teuthology.orchestra.run.smithi117.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 661 kB/s | 83 kB 00:00 2024-09-22T08:38:48.840 INFO:teuthology.orchestra.run.smithi039.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 604 kB/s | 413 kB 00:00 2024-09-22T08:38:48.907 INFO:teuthology.orchestra.run.smithi117.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.0 MB/s | 679 kB 00:00 2024-09-22T08:38:49.024 INFO:teuthology.orchestra.run.smithi039.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 71 kB/s | 13 kB 00:00 2024-09-22T08:38:49.033 INFO:teuthology.orchestra.run.smithi117.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 1.9 MB/s | 245 kB 00:00 2024-09-22T08:38:49.150 INFO:teuthology.orchestra.run.smithi117.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-22T08:38:49.225 INFO:teuthology.orchestra.run.smithi117.stdout:(200/286): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-22T08:38:49.258 INFO:teuthology.orchestra.run.smithi117.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 236 kB/s | 26 kB 00:00 2024-09-22T08:38:49.334 INFO:teuthology.orchestra.run.smithi117.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 177 kB/s | 19 kB 00:00 2024-09-22T08:38:49.367 INFO:teuthology.orchestra.run.smithi117.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-22T08:38:49.374 INFO:teuthology.orchestra.run.smithi039.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 151 kB/s | 53 kB 00:00 2024-09-22T08:38:49.443 INFO:teuthology.orchestra.run.smithi117.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 320 kB/s | 35 kB 00:00 2024-09-22T08:38:49.560 INFO:teuthology.orchestra.run.smithi117.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.1 MB/s | 250 kB 00:00 2024-09-22T08:38:49.749 INFO:teuthology.orchestra.run.smithi039.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 64 kB/s | 24 kB 00:00 2024-09-22T08:38:49.810 INFO:teuthology.orchestra.run.smithi117.stdout:(206/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-22T08:38:49.835 INFO:teuthology.orchestra.run.smithi117.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 807 kB/s | 222 kB 00:00 2024-09-22T08:38:49.919 INFO:teuthology.orchestra.run.smithi117.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 712 kB/s | 77 kB 00:00 2024-09-22T08:38:49.944 INFO:teuthology.orchestra.run.smithi117.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 389 kB/s | 42 kB 00:00 2024-09-22T08:38:50.036 INFO:teuthology.orchestra.run.smithi117.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 2.3 MB/s | 269 kB 00:00 2024-09-22T08:38:50.061 INFO:teuthology.orchestra.run.smithi117.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-22T08:38:50.153 INFO:teuthology.orchestra.run.smithi117.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-22T08:38:50.179 INFO:teuthology.orchestra.run.smithi117.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-09-22T08:38:50.271 INFO:teuthology.orchestra.run.smithi117.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 459 kB/s | 54 kB 00:00 2024-09-22T08:38:50.366 INFO:teuthology.orchestra.run.smithi039.stdout:(102/286): jsoup-1.13.1-10.el9.noarch.rpm 611 kB/s | 377 kB 00:00 2024-09-22T08:38:50.388 INFO:teuthology.orchestra.run.smithi117.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-22T08:38:50.433 INFO:teuthology.orchestra.run.smithi039.stdout:(103/286): java-11-openjdk-devel-11.0.20.1.1-2. 1.6 MB/s | 3.3 MB 00:02 2024-09-22T08:38:50.505 INFO:teuthology.orchestra.run.smithi117.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-22T08:38:50.621 INFO:teuthology.orchestra.run.smithi117.stdout:(217/286): qatlib-service-24.02.0-1.el9.x86_64. 308 kB/s | 36 kB 00:00 2024-09-22T08:38:50.633 INFO:teuthology.orchestra.run.smithi039.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 133 kB/s | 35 kB 00:00 2024-09-22T08:38:50.738 INFO:teuthology.orchestra.run.smithi117.stdout:(218/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-22T08:38:50.833 INFO:teuthology.orchestra.run.smithi039.stdout:(105/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 55 kB/s | 11 kB 00:00 2024-09-22T08:38:50.855 INFO:teuthology.orchestra.run.smithi117.stdout:(219/286): rtkit-0.11-29.el9.x86_64.rpm 480 kB/s | 56 kB 00:00 2024-09-22T08:38:50.951 INFO:teuthology.orchestra.run.smithi039.stdout:(106/286): lcms2-2.12-3.el9.x86_64.rpm 324 kB/s | 168 kB 00:00 2024-09-22T08:38:51.072 INFO:teuthology.orchestra.run.smithi117.stdout:(220/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-22T08:38:51.092 INFO:teuthology.orchestra.run.smithi039.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 93 kB/s | 24 kB 00:00 2024-09-22T08:38:51.098 INFO:teuthology.orchestra.run.smithi117.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 2.1 MB/s | 510 kB 00:00 2024-09-22T08:38:51.189 INFO:teuthology.orchestra.run.smithi117.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 591 kB/s | 69 kB 00:00 2024-09-22T08:38:51.215 INFO:teuthology.orchestra.run.smithi117.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-22T08:38:51.226 INFO:teuthology.orchestra.run.smithi039.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 112 kB/s | 31 kB 00:00 2024-09-22T08:38:51.340 INFO:teuthology.orchestra.run.smithi117.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 2.5 MB/s | 383 kB 00:00 2024-09-22T08:38:51.359 INFO:teuthology.orchestra.run.smithi039.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 86 kB/s | 23 kB 00:00 2024-09-22T08:38:51.365 INFO:teuthology.orchestra.run.smithi117.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.0 MB/s | 152 kB 00:00 2024-09-22T08:38:51.457 INFO:teuthology.orchestra.run.smithi117.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 4.6 MB/s | 555 kB 00:00 2024-09-22T08:38:51.491 INFO:teuthology.orchestra.run.smithi117.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 7.4 MB/s | 944 kB 00:00 2024-09-22T08:38:51.510 INFO:teuthology.orchestra.run.smithi039.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 70 kB/s | 20 kB 00:00 2024-09-22T08:38:51.575 INFO:teuthology.orchestra.run.smithi117.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 455 kB/s | 53 kB 00:00 2024-09-22T08:38:51.608 INFO:teuthology.orchestra.run.smithi117.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-22T08:38:51.643 INFO:teuthology.orchestra.run.smithi039.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 140 kB/s | 40 kB 00:00 2024-09-22T08:38:51.683 INFO:teuthology.orchestra.run.smithi117.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 1.6 MB/s | 173 kB 00:00 2024-09-22T08:38:51.725 INFO:teuthology.orchestra.run.smithi117.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 2.6 MB/s | 306 kB 00:00 2024-09-22T08:38:51.784 INFO:teuthology.orchestra.run.smithi117.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 964 kB/s | 96 kB 00:00 2024-09-22T08:38:51.842 INFO:teuthology.orchestra.run.smithi117.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-22T08:38:51.893 INFO:teuthology.orchestra.run.smithi117.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 391 kB/s | 42 kB 00:00 2024-09-22T08:38:51.960 INFO:teuthology.orchestra.run.smithi117.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.2 MB/s | 385 kB 00:00 2024-09-22T08:38:52.002 INFO:teuthology.orchestra.run.smithi117.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.2 MB/s | 134 kB 00:00 2024-09-22T08:38:52.085 INFO:teuthology.orchestra.run.smithi117.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 6.7 MB/s | 859 kB 00:00 2024-09-22T08:38:52.110 INFO:teuthology.orchestra.run.smithi117.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-22T08:38:52.127 INFO:teuthology.orchestra.run.smithi039.stdout:(112/286): java-11-openjdk-headless-11.0.20.1.1 11 MB/s | 39 MB 00:03 2024-09-22T08:38:52.202 INFO:teuthology.orchestra.run.smithi117.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.2 MB/s | 505 kB 00:00 2024-09-22T08:38:52.236 INFO:teuthology.orchestra.run.smithi039.stdout:(113/286): libXinerama-1.1.4-10.el9.x86_64.rpm 21 kB/s | 15 kB 00:00 2024-09-22T08:38:52.328 INFO:teuthology.orchestra.run.smithi039.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 42 kB/s | 28 kB 00:00 2024-09-22T08:38:52.419 INFO:teuthology.orchestra.run.smithi117.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-22T08:38:52.428 INFO:teuthology.orchestra.run.smithi039.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 71 kB/s | 21 kB 00:00 2024-09-22T08:38:52.469 INFO:teuthology.orchestra.run.smithi117.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-22T08:38:52.495 INFO:teuthology.orchestra.run.smithi117.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-22T08:38:52.512 INFO:teuthology.orchestra.run.smithi117.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-22T08:38:52.528 INFO:teuthology.orchestra.run.smithi039.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 65 kB/s | 19 kB 00:00 2024-09-22T08:38:52.620 INFO:teuthology.orchestra.run.smithi039.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 64 kB/s | 19 kB 00:00 2024-09-22T08:38:52.629 INFO:teuthology.orchestra.run.smithi117.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-22T08:38:52.654 INFO:teuthology.orchestra.run.smithi117.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-22T08:38:52.679 INFO:teuthology.orchestra.run.smithi117.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-22T08:38:52.705 INFO:teuthology.orchestra.run.smithi117.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-22T08:38:52.730 INFO:teuthology.orchestra.run.smithi117.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-22T08:38:52.762 INFO:teuthology.orchestra.run.smithi039.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 91 kB/s | 30 kB 00:00 2024-09-22T08:38:52.772 INFO:teuthology.orchestra.run.smithi117.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-22T08:38:52.805 INFO:teuthology.orchestra.run.smithi117.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-22T08:38:52.831 INFO:teuthology.orchestra.run.smithi117.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-22T08:38:52.896 INFO:teuthology.orchestra.run.smithi039.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 116 kB/s | 32 kB 00:00 2024-09-22T08:38:52.897 INFO:teuthology.orchestra.run.smithi117.stdout:(252/286): openblas-openmp-0.3.26-2.el9.x86_64. 891 kB/s | 4.9 MB 00:05 2024-09-22T08:38:52.923 INFO:teuthology.orchestra.run.smithi117.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-09-22T08:38:52.957 INFO:teuthology.orchestra.run.smithi117.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 6.5 MB/s | 172 kB 00:00 2024-09-22T08:38:52.990 INFO:teuthology.orchestra.run.smithi117.stdout:(255/286): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-22T08:38:52.996 INFO:teuthology.orchestra.run.smithi039.stdout:(120/286): libcanberra-0.30-27.el9.x86_64.rpm 185 kB/s | 86 kB 00:00 2024-09-22T08:38:53.016 INFO:teuthology.orchestra.run.smithi117.stdout:(256/286): python3-certifi-2023.05.07-4.el9.noa 120 kB/s | 14 kB 00:00 2024-09-22T08:38:53.049 INFO:teuthology.orchestra.run.smithi117.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 3.9 MB/s | 358 kB 00:00 2024-09-22T08:38:53.083 INFO:teuthology.orchestra.run.smithi117.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.5 MB/s | 144 kB 00:00 2024-09-22T08:38:53.108 INFO:teuthology.orchestra.run.smithi117.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-22T08:38:53.133 INFO:teuthology.orchestra.run.smithi117.stdout:(260/286): python3-google-auth-2.34.0-1.el9.noa 1.5 MB/s | 220 kB 00:00 2024-09-22T08:38:53.158 INFO:teuthology.orchestra.run.smithi117.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-22T08:38:53.184 INFO:teuthology.orchestra.run.smithi117.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-22T08:38:53.188 INFO:teuthology.orchestra.run.smithi039.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 378 kB/s | 161 kB 00:00 2024-09-22T08:38:53.209 INFO:teuthology.orchestra.run.smithi117.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-22T08:38:53.234 INFO:teuthology.orchestra.run.smithi117.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-22T08:38:53.268 INFO:teuthology.orchestra.run.smithi117.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-22T08:38:53.293 INFO:teuthology.orchestra.run.smithi117.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:38:53.318 INFO:teuthology.orchestra.run.smithi117.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-22T08:38:53.352 INFO:teuthology.orchestra.run.smithi117.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-22T08:38:53.394 INFO:teuthology.orchestra.run.smithi117.stdout:(269/286): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-22T08:38:53.419 INFO:teuthology.orchestra.run.smithi117.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-09-22T08:38:53.438 INFO:teuthology.orchestra.run.smithi039.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 445 kB/s | 241 kB 00:00 2024-09-22T08:38:53.444 INFO:teuthology.orchestra.run.smithi117.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-22T08:38:53.463 INFO:teuthology.orchestra.run.smithi039.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 113 kB/s | 31 kB 00:00 2024-09-22T08:38:53.470 INFO:teuthology.orchestra.run.smithi117.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-22T08:38:53.495 INFO:teuthology.orchestra.run.smithi117.stdout:(273/286): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-09-22T08:38:53.529 INFO:teuthology.orchestra.run.smithi117.stdout:(274/286): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-22T08:38:53.554 INFO:teuthology.orchestra.run.smithi117.stdout:(275/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-09-22T08:38:53.579 INFO:teuthology.orchestra.run.smithi117.stdout:(276/286): python3-rsa-4.9-2.el9.noarch.rpm 548 kB/s | 59 kB 00:00 2024-09-22T08:38:53.580 INFO:teuthology.orchestra.run.smithi039.stdout:(124/286): libexif-0.6.22-6.el9.x86_64.rpm 746 kB/s | 435 kB 00:00 2024-09-22T08:38:53.604 INFO:teuthology.orchestra.run.smithi117.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 1.0 MB/s | 74 kB 00:00 2024-09-22T08:38:53.646 INFO:teuthology.orchestra.run.smithi117.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-22T08:38:53.663 INFO:teuthology.orchestra.run.smithi117.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-22T08:38:53.689 INFO:teuthology.orchestra.run.smithi117.stdout:(280/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-22T08:38:53.714 INFO:teuthology.orchestra.run.smithi117.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-22T08:38:53.739 INFO:teuthology.orchestra.run.smithi117.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-22T08:38:53.764 INFO:teuthology.orchestra.run.smithi117.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-22T08:38:53.781 INFO:teuthology.orchestra.run.smithi039.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 242 kB/s | 83 kB 00:00 2024-09-22T08:38:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T08:38:53.848 INFO:teuthology.orchestra.run.smithi039.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 137 kB/s | 37 kB 00:00 2024-09-22T08:38:53.898 INFO:teuthology.orchestra.run.smithi039.stdout:(127/286): libglvnd-1.3.4-1.el9.x86_64.rpm 312 kB/s | 135 kB 00:00 2024-09-22T08:38:53.999 INFO:teuthology.orchestra.run.smithi117.stdout:(285/286): librados2-19.3.0-5106.g8852379c.el9. 13 MB/s | 3.5 MB 00:00 2024-09-22T08:38:54.073 INFO:teuthology.orchestra.run.smithi117.stdout:(286/286): librbd1-19.3.0-5106.g8852379c.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-22T08:38:54.073 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:38:54.073 INFO:teuthology.orchestra.run.smithi117.stdout:Total 11 MB/s | 322 MB 00:28 2024-09-22T08:38:54.198 INFO:teuthology.orchestra.run.smithi039.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 341 kB/s | 142 kB 00:00 2024-09-22T08:38:54.240 INFO:teuthology.orchestra.run.smithi039.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 231 kB/s | 79 kB 00:00 2024-09-22T08:38:54.340 INFO:teuthology.orchestra.run.smithi039.stdout:(130/286): libgsf-1.14.47-5.el9.x86_64.rpm 520 kB/s | 256 kB 00:00 2024-09-22T08:38:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 141 kB/s | 41 kB 00:00 2024-09-22T08:38:54.558 INFO:teuthology.orchestra.run.smithi039.stdout:(132/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 170 kB/s | 61 kB 00:00 2024-09-22T08:38:54.758 INFO:teuthology.orchestra.run.smithi039.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 409 kB/s | 171 kB 00:00 2024-09-22T08:38:54.825 INFO:teuthology.orchestra.run.smithi039.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 126 kB/s | 34 kB 00:00 2024-09-22T08:38:54.867 INFO:teuthology.orchestra.run.smithi039.stdout:(135/286): libnotify-0.7.9-8.el9.x86_64.rpm 130 kB/s | 44 kB 00:00 2024-09-22T08:38:55.209 INFO:teuthology.orchestra.run.smithi039.stdout:(136/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-09-22T08:38:55.242 INFO:teuthology.orchestra.run.smithi039.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 384 kB/s | 160 kB 00:00 2024-09-22T08:38:55.334 INFO:teuthology.orchestra.run.smithi039.stdout:(138/286): libosinfo-1.10.0-1.el9.x86_64.rpm 554 kB/s | 319 kB 00:00 2024-09-22T08:38:55.593 INFO:teuthology.orchestra.run.smithi039.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 128 kB/s | 45 kB 00:00 2024-09-22T08:38:55.834 INFO:teuthology.orchestra.run.smithi039.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 413 kB/s | 206 kB 00:00 2024-09-22T08:38:55.901 INFO:teuthology.orchestra.run.smithi039.stdout:(141/286): librdkafka-1.6.1-102.el9.x86_64.rpm 956 kB/s | 662 kB 00:00 2024-09-22T08:38:56.027 INFO:teuthology.orchestra.run.smithi039.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 378 kB/s | 164 kB 00:00 2024-09-22T08:38:56.186 INFO:teuthology.orchestra.run.smithi039.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 125 kB/s | 36 kB 00:00 2024-09-22T08:38:56.428 INFO:teuthology.orchestra.run.smithi039.stdout:(144/286): libtiff-4.4.0-13.el9.x86_64.rpm 334 kB/s | 198 kB 00:00 2024-09-22T08:38:56.603 INFO:teuthology.orchestra.run.smithi039.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 345 kB/s | 144 kB 00:00 2024-09-22T08:38:56.646 INFO:teuthology.orchestra.run.smithi039.stdout:(146/286): libtracker-sparql-3.1.2-3.el9.x86_64 524 kB/s | 324 kB 00:00 2024-09-22T08:38:56.879 INFO:teuthology.orchestra.run.smithi039.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 121 kB/s | 33 kB 00:00 2024-09-22T08:38:57.004 INFO:teuthology.orchestra.run.smithi039.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 54 kB/s | 19 kB 00:00 2024-09-22T08:38:57.063 INFO:teuthology.orchestra.run.smithi039.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 70 kB/s | 13 kB 00:00 2024-09-22T08:38:57.088 INFO:teuthology.orchestra.run.smithi039.stdout:(150/286): libvorbis-1.3.7-5.el9.x86_64.rpm 293 kB/s | 193 kB 00:00 2024-09-22T08:38:57.206 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-22T08:38:57.380 INFO:teuthology.orchestra.run.smithi039.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 111 kB/s | 42 kB 00:00 2024-09-22T08:38:57.390 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-22T08:38:57.391 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-22T08:38:57.539 INFO:teuthology.orchestra.run.smithi039.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 296 kB/s | 133 kB 00:00 2024-09-22T08:38:57.572 INFO:teuthology.orchestra.run.smithi039.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 66 kB/s | 13 kB 00:00 2024-09-22T08:38:57.597 INFO:teuthology.orchestra.run.smithi039.stdout:(154/286): libwebp-1.2.0-8.el9.x86_64.rpm 519 kB/s | 277 kB 00:00 2024-09-22T08:38:57.815 INFO:teuthology.orchestra.run.smithi039.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 130 kB/s | 36 kB 00:00 2024-09-22T08:38:58.090 INFO:teuthology.orchestra.run.smithi039.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 565 kB/s | 292 kB 00:00 2024-09-22T08:38:58.115 INFO:teuthology.orchestra.run.smithi039.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 364 kB/s | 188 kB 00:00 2024-09-22T08:38:58.249 INFO:teuthology.orchestra.run.smithi039.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 348 kB/s | 151 kB 00:00 2024-09-22T08:38:58.357 INFO:teuthology.orchestra.run.smithi039.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 66 kB/s | 18 kB 00:00 2024-09-22T08:38:58.441 INFO:teuthology.orchestra.run.smithi039.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 47 kB/s | 9.0 kB 00:00 2024-09-22T08:38:58.893 INFO:teuthology.orchestra.run.smithi039.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 1.9 MB/s | 1.5 MB 00:00 2024-09-22T08:38:58.916 INFO:teuthology.orchestra.run.smithi039.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 318 kB/s | 151 kB 00:00 2024-09-22T08:38:59.017 INFO:teuthology.orchestra.run.smithi039.stdout:(163/286): maven-resolver-1.6.1-10.el9.noarch.r 784 kB/s | 517 kB 00:00 2024-09-22T08:38:59.208 INFO:teuthology.orchestra.run.smithi039.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 59 kB/s | 11 kB 00:00 2024-09-22T08:38:59.309 INFO:teuthology.orchestra.run.smithi039.stdout:(165/286): maven-wagon-3.4.2-7.el9.noarch.rpm 270 kB/s | 112 kB 00:00 2024-09-22T08:38:59.651 INFO:teuthology.orchestra.run.smithi039.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 314 kB/s | 139 kB 00:00 2024-09-22T08:38:59.726 INFO:teuthology.orchestra.run.smithi039.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 409 kB/s | 171 kB 00:00 2024-09-22T08:38:59.918 INFO:teuthology.orchestra.run.smithi039.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 136 kB/s | 36 kB 00:00 2024-09-22T08:39:00.068 INFO:teuthology.orchestra.run.smithi039.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 134 kB/s | 46 kB 00:00 2024-09-22T08:39:00.193 INFO:teuthology.orchestra.run.smithi039.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 117 kB/s | 32 kB 00:00 2024-09-22T08:39:00.335 INFO:teuthology.orchestra.run.smithi039.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 144 kB/s | 38 kB 00:00 2024-09-22T08:39:00.594 INFO:teuthology.orchestra.run.smithi039.stdout:(172/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 5.2 MB/s | 8.8 MB 00:01 2024-09-22T08:39:00.602 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-22T08:39:00.603 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-22T08:39:00.861 INFO:teuthology.orchestra.run.smithi039.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 311 kB/s | 163 kB 00:00 2024-09-22T08:39:01.094 INFO:teuthology.orchestra.run.smithi039.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 399 kB/s | 200 kB 00:00 2024-09-22T08:39:01.211 INFO:teuthology.orchestra.run.smithi039.stdout:(175/286): openblas-openmp-0.3.26-2.el9.x86_64. 4.9 MB/s | 4.9 MB 00:01 2024-09-22T08:39:01.387 INFO:teuthology.orchestra.run.smithi039.stdout:(176/286): orc-0.4.31-8.el9.x86_64.rpm 349 kB/s | 183 kB 00:00 2024-09-22T08:39:01.562 INFO:teuthology.orchestra.run.smithi039.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 211 kB/s | 74 kB 00:00 2024-09-22T08:39:01.779 INFO:teuthology.orchestra.run.smithi039.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 775 kB/s | 531 kB 00:00 2024-09-22T08:39:02.063 INFO:teuthology.orchestra.run.smithi039.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 693 kB/s | 468 kB 00:00 2024-09-22T08:39:02.221 INFO:teuthology.orchestra.run.smithi039.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 373 kB/s | 246 kB 00:00 2024-09-22T08:39:02.246 INFO:teuthology.orchestra.run.smithi039.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 228 kB/s | 107 kB 00:00 2024-09-22T08:39:02.422 INFO:teuthology.orchestra.run.smithi039.stdout:(182/286): pipewire-jack-audio-connection-kit-1 46 kB/s | 9.1 kB 00:00 2024-09-22T08:39:02.447 INFO:teuthology.orchestra.run.smithi039.stdout:(183/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 149 kB/s | 57 kB 00:00 2024-09-22T08:39:02.714 INFO:teuthology.orchestra.run.smithi039.stdout:(184/286): pipewire-jack-audio-connection-kit-l 289 kB/s | 135 kB 00:00 2024-09-22T08:39:03.006 INFO:teuthology.orchestra.run.smithi039.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 343 kB/s | 192 kB 00:00 2024-09-22T08:39:03.031 INFO:teuthology.orchestra.run.smithi039.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 81 kB/s | 26 kB 00:00 2024-09-22T08:39:03.198 INFO:teuthology.orchestra.run.smithi039.stdout:(187/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 2.5 MB/s | 1.9 MB 00:00 2024-09-22T08:39:03.307 INFO:teuthology.orchestra.run.smithi039.stdout:(188/286): plexus-containers-component-annotati 67 kB/s | 18 kB 00:00 2024-09-22T08:39:03.365 INFO:teuthology.orchestra.run.smithi039.stdout:(189/286): plexus-classworlds-2.6.0-11.el9.noar 167 kB/s | 60 kB 00:00 2024-09-22T08:39:03.599 INFO:teuthology.orchestra.run.smithi039.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 115 kB/s | 34 kB 00:00 2024-09-22T08:39:03.633 INFO:teuthology.orchestra.run.smithi039.stdout:(191/286): plexus-interpolation-1.26-11.el9.noa 183 kB/s | 80 kB 00:00 2024-09-22T08:39:03.883 INFO:teuthology.orchestra.run.smithi039.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 491 kB/s | 254 kB 00:00 2024-09-22T08:39:04.408 INFO:teuthology.orchestra.run.smithi039.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 1.3 MB/s | 1.1 MB 00:00 2024-09-22T08:39:04.450 INFO:teuthology.orchestra.run.smithi039.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 269 kB/s | 152 kB 00:00 2024-09-22T08:39:04.759 INFO:teuthology.orchestra.run.smithi039.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 1.7 MB/s | 1.9 MB 00:01 2024-09-22T08:39:04.884 INFO:teuthology.orchestra.run.smithi039.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 191 kB/s | 83 kB 00:00 2024-09-22T08:39:05.201 INFO:teuthology.orchestra.run.smithi039.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-22T08:39:05.443 INFO:teuthology.orchestra.run.smithi039.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 993 kB/s | 679 kB 00:00 2024-09-22T08:39:05.726 INFO:teuthology.orchestra.run.smithi039.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 466 kB/s | 245 kB 00:00 2024-09-22T08:39:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:(200/286): python3-babel-2.9.1-2.el9.noarch.rpm 6.0 MB/s | 6.0 MB 00:01 2024-09-22T08:39:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:(201/286): python3-jinja2-2.11.3-6.el9.noarch.r 488 kB/s | 248 kB 00:00 2024-09-22T08:39:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:(202/286): python3-jsonpatch-1.21-16.el9.noarch 99 kB/s | 26 kB 00:00 2024-09-22T08:39:06.177 INFO:teuthology.orchestra.run.smithi039.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 66 kB/s | 19 kB 00:00 2024-09-22T08:39:06.245 INFO:teuthology.orchestra.run.smithi039.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 134 kB/s | 35 kB 00:00 2024-09-22T08:39:06.470 INFO:teuthology.orchestra.run.smithi039.stdout:(205/286): python3-mako-1.1.4-6.el9.noarch.rpm 332 kB/s | 172 kB 00:00 2024-09-22T08:39:06.753 INFO:teuthology.orchestra.run.smithi039.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 493 kB/s | 250 kB 00:00 2024-09-22T08:39:07.012 INFO:teuthology.orchestra.run.smithi039.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 410 kB/s | 222 kB 00:00 2024-09-22T08:39:07.179 INFO:teuthology.orchestra.run.smithi039.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 181 kB/s | 77 kB 00:00 2024-09-22T08:39:07.246 INFO:teuthology.orchestra.run.smithi039.stdout:(209/286): python3-numpy-1.20.1-5.el9.x86_64.rp 4.8 MB/s | 5.1 MB 00:01 2024-09-22T08:39:07.363 INFO:teuthology.orchestra.run.smithi039.stdout:(210/286): python3-prettytable-0.7.2-27.el9.noa 120 kB/s | 42 kB 00:00 2024-09-22T08:39:07.713 INFO:teuthology.orchestra.run.smithi039.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 504 kB/s | 269 kB 00:00 2024-09-22T08:39:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 312 kB/s | 159 kB 00:00 2024-09-22T08:39:07.880 INFO:teuthology.orchestra.run.smithi039.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 539 kB/s | 279 kB 00:00 2024-09-22T08:39:08.064 INFO:teuthology.orchestra.run.smithi039.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 145 kB/s | 51 kB 00:00 2024-09-22T08:39:08.097 INFO:teuthology.orchestra.run.smithi039.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 157 kB/s | 54 kB 00:00 2024-09-22T08:39:08.381 INFO:teuthology.orchestra.run.smithi039.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 131 kB/s | 42 kB 00:00 2024-09-22T08:39:08.623 INFO:teuthology.orchestra.run.smithi039.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 420 kB/s | 221 kB 00:00 2024-09-22T08:39:08.648 INFO:teuthology.orchestra.run.smithi039.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 134 kB/s | 36 kB 00:00 2024-09-22T08:39:08.965 INFO:teuthology.orchestra.run.smithi039.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-09-22T08:39:08.998 INFO:teuthology.orchestra.run.smithi039.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 160 kB/s | 56 kB 00:00 2024-09-22T08:39:09.166 INFO:teuthology.orchestra.run.smithi039.stdout:(221/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-22T08:39:09.481 INFO:teuthology.orchestra.run.smithi039.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 143 kB/s | 69 kB 00:00 2024-09-22T08:39:09.683 INFO:teuthology.orchestra.run.smithi039.stdout:(223/286): sisu-0.3.4-10.el9.noarch.rpm 711 kB/s | 510 kB 00:00 2024-09-22T08:39:09.750 INFO:teuthology.orchestra.run.smithi039.stdout:(224/286): socat-1.7.4.1-6.el9.x86_64.rpm 521 kB/s | 304 kB 00:00 2024-09-22T08:39:10.125 INFO:teuthology.orchestra.run.smithi039.stdout:(225/286): sound-theme-freedesktop-0.8-17.el9.n 595 kB/s | 383 kB 00:00 2024-09-22T08:39:10.234 INFO:teuthology.orchestra.run.smithi039.stdout:(226/286): totem-pl-parser-3.26.6-2.el9.x86_64. 277 kB/s | 152 kB 00:00 2024-09-22T08:39:10.451 INFO:teuthology.orchestra.run.smithi039.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 792 kB/s | 555 kB 00:00 2024-09-22T08:39:10.489 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:39:10.584 INFO:teuthology.orchestra.run.smithi039.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 152 kB/s | 53 kB 00:00 2024-09-22T08:39:10.642 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:39:10.796 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-22T08:39:10.843 INFO:teuthology.orchestra.run.smithi039.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 1.3 MB/s | 944 kB 00:00 2024-09-22T08:39:10.866 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:39:10.893 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:39:10.943 INFO:teuthology.orchestra.run.smithi039.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 467 kB/s | 230 kB 00:00 2024-09-22T08:39:10.964 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:39:11.012 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:39:11.062 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:39:11.085 INFO:teuthology.orchestra.run.smithi039.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 345 kB/s | 173 kB 00:00 2024-09-22T08:39:11.112 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:39:11.137 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:39:11.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:39:11.360 INFO:teuthology.orchestra.run.smithi039.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 591 kB/s | 306 kB 00:00 2024-09-22T08:39:11.386 INFO:teuthology.orchestra.run.smithi039.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 218 kB/s | 96 kB 00:00 2024-09-22T08:39:11.556 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:39:11.646 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:39:11.661 INFO:teuthology.orchestra.run.smithi039.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 621 kB/s | 358 kB 00:00 2024-09-22T08:39:11.695 INFO:teuthology.orchestra.run.smithi039.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 127 kB/s | 42 kB 00:00 2024-09-22T08:39:11.768 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:39:11.797 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:39:11.897 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:39:11.903 INFO:teuthology.orchestra.run.smithi039.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 745 kB/s | 385 kB 00:00 2024-09-22T08:39:11.926 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:39:11.965 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:39:12.002 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:39:12.028 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:39:12.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:39:12.095 INFO:teuthology.orchestra.run.smithi039.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 310 kB/s | 134 kB 00:00 2024-09-22T08:39:12.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:39:12.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:39:12.174 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:39:12.237 INFO:teuthology.orchestra.run.smithi039.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 191 kB/s | 64 kB 00:00 2024-09-22T08:39:12.312 INFO:teuthology.orchestra.run.smithi039.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-22T08:39:12.320 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:39:12.363 INFO:teuthology.orchestra.run.smithi039.stdout:(240/286): xkeyboard-config-2.33-2.el9.noarch.r 1.3 MB/s | 859 kB 00:00 2024-09-22T08:39:12.413 INFO:teuthology.orchestra.run.smithi039.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-22T08:39:12.438 INFO:teuthology.orchestra.run.smithi039.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-22T08:39:12.463 INFO:teuthology.orchestra.run.smithi039.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-22T08:39:12.464 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:39:12.497 INFO:teuthology.orchestra.run.smithi039.stdout:(244/286): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-22T08:39:12.505 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:39:12.542 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:39:12.547 INFO:teuthology.orchestra.run.smithi039.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-22T08:39:12.570 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:39:12.581 INFO:teuthology.orchestra.run.smithi039.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-22T08:39:12.615 INFO:teuthology.orchestra.run.smithi039.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-22T08:39:12.656 INFO:teuthology.orchestra.run.smithi039.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-22T08:39:12.677 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:39:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:(249/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 850 kB/s | 505 kB 00:00 2024-09-22T08:39:12.704 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:39:12.749 INFO:teuthology.orchestra.run.smithi039.stdout:(250/286): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-22T08:39:12.767 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:39:12.782 INFO:teuthology.orchestra.run.smithi039.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-22T08:39:12.791 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:39:12.814 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:39:12.816 INFO:teuthology.orchestra.run.smithi039.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2024-09-22T08:39:12.840 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:39:12.841 INFO:teuthology.orchestra.run.smithi039.stdout:(253/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-22T08:39:12.867 INFO:teuthology.orchestra.run.smithi039.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-22T08:39:12.892 INFO:teuthology.orchestra.run.smithi039.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-22T08:39:12.925 INFO:teuthology.orchestra.run.smithi039.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-22T08:39:12.951 INFO:teuthology.orchestra.run.smithi039.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-22T08:39:12.976 INFO:teuthology.orchestra.run.smithi039.stdout:(258/286): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-09-22T08:39:13.009 INFO:teuthology.orchestra.run.smithi039.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-22T08:39:13.025 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:39:13.035 INFO:teuthology.orchestra.run.smithi039.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-22T08:39:13.056 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:39:13.060 INFO:teuthology.orchestra.run.smithi039.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-22T08:39:13.094 INFO:teuthology.orchestra.run.smithi039.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2024-09-22T08:39:13.119 INFO:teuthology.orchestra.run.smithi039.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-22T08:39:13.144 INFO:teuthology.orchestra.run.smithi039.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-22T08:39:13.166 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:39:13.170 INFO:teuthology.orchestra.run.smithi039.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-22T08:39:13.195 INFO:teuthology.orchestra.run.smithi039.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-22T08:39:13.203 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:39:13.220 INFO:teuthology.orchestra.run.smithi039.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-22T08:39:13.238 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:39:13.262 INFO:teuthology.orchestra.run.smithi039.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-22T08:39:13.296 INFO:teuthology.orchestra.run.smithi039.stdout:(269/286): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-22T08:39:13.313 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:39:13.321 INFO:teuthology.orchestra.run.smithi039.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-22T08:39:13.346 INFO:teuthology.orchestra.run.smithi039.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-22T08:39:13.368 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:39:13.372 INFO:teuthology.orchestra.run.smithi039.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-22T08:39:13.397 INFO:teuthology.orchestra.run.smithi039.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-22T08:39:13.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:39:13.422 INFO:teuthology.orchestra.run.smithi039.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-22T08:39:13.447 INFO:teuthology.orchestra.run.smithi039.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-22T08:39:13.451 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:39:13.476 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:39:13.489 INFO:teuthology.orchestra.run.smithi039.stdout:(276/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-22T08:39:13.503 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:39:13.523 INFO:teuthology.orchestra.run.smithi039.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-09-22T08:39:13.528 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:39:13.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:39:13.557 INFO:teuthology.orchestra.run.smithi039.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 2.7 MB/s | 90 kB 00:00 2024-09-22T08:39:13.582 INFO:teuthology.orchestra.run.smithi039.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-22T08:39:13.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:39:13.599 INFO:teuthology.orchestra.run.smithi039.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-22T08:39:13.614 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:39:13.632 INFO:teuthology.orchestra.run.smithi039.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-22T08:39:13.639 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:39:13.658 INFO:teuthology.orchestra.run.smithi039.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 3.4 MB/s | 206 kB 00:00 2024-09-22T08:39:13.684 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:39:13.691 INFO:teuthology.orchestra.run.smithi039.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-22T08:39:13.721 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:39:13.750 INFO:teuthology.orchestra.run.smithi039.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-22T08:39:13.792 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:39:13.847 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:39:13.877 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:39:13.924 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:39:13.959 INFO:teuthology.orchestra.run.smithi039.stdout:(285/286): librados2-19.3.0-5106.g8852379c.el9. 12 MB/s | 3.5 MB 00:00 2024-09-22T08:39:13.971 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:39:14.017 INFO:teuthology.orchestra.run.smithi039.stdout:(286/286): librbd1-19.3.0-5106.g8852379c.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-22T08:39:14.023 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:39:14.024 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-22T08:39:14.024 INFO:teuthology.orchestra.run.smithi039.stdout:Total 8.0 MB/s | 322 MB 00:40 2024-09-22T08:39:14.105 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:39:14.150 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:39:14.203 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:39:14.243 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:39:14.328 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:39:14.472 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:39:14.530 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:39:15.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:39:15.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:39:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:39:15.272 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:39:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:39:15.354 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:39:15.384 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:39:15.456 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:39:15.486 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:39:15.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:39:15.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:39:15.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:39:15.625 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:39:15.658 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:39:15.700 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:39:15.758 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:39:15.793 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:39:15.830 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:39:15.924 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:39:15.987 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:39:16.060 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:39:16.098 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:39:16.135 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:39:16.182 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:39:16.226 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:39:16.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:39:16.411 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:39:16.455 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:39:16.497 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:39:16.602 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:39:16.639 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:39:16.679 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:39:16.712 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:39:16.737 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:39:16.821 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:39:16.950 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:39:16.989 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:39:17.195 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:39:17.203 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-22T08:39:17.240 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:39:17.272 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:39:17.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:39:17.343 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:39:17.392 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:39:17.406 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:39:17.406 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:39:17.406 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:17.406 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-22T08:39:17.406 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-22T08:39:17.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:39:17.668 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:39:17.719 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:39:17.786 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:39:17.828 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:39:18.054 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:39:18.580 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:18.608 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:18.623 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:18.623 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:39:18.623 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:18.664 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:39:18.699 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:39:18.732 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:39:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:39:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:39:18.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:39:18.947 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:39:18.995 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:39:19.101 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:39:19.154 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:39:19.907 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:39:19.959 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:39:19.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:39:20.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:39:20.137 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:39:20.329 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:39:20.365 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:39:20.409 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:39:20.728 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-22T08:39:20.729 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-22T08:39:20.922 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:39:20.982 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:39:21.020 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:39:21.054 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:39:21.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:39:21.270 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:39:21.301 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:39:21.379 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:39:22.058 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:39:22.176 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:39:23.461 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:39:23.545 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:39:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:39:23.639 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:39:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:39:23.695 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:39:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:39:23.707 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:39:23.707 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:23.764 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:39:23.791 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:39:23.819 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:39:24.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:39:24.199 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:39:24.299 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:39:24.331 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:39:24.363 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:39:24.392 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:39:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:39:24.492 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:39:24.517 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:39:24.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:39:24.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:39:24.838 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:39:24.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:39:24.903 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:39:24.928 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:39:24.954 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:39:24.979 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:39:25.004 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:39:25.032 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:39:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:39:25.116 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:39:25.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:39:25.193 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:39:25.227 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:39:25.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:39:25.821 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:39:25.877 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:39:25.910 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:39:25.938 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:39:26.019 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:39:26.066 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:39:26.094 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:39:26.113 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:39:26.140 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:39:26.166 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:39:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:39:26.229 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:39:30.782 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-22T08:39:30.966 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-22T08:39:31.130 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-22T08:39:31.203 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-22T08:39:31.238 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-22T08:39:31.315 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-22T08:39:31.362 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-22T08:39:31.415 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-22T08:39:31.465 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-22T08:39:31.490 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-22T08:39:31.546 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-22T08:39:31.906 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-22T08:39:32.024 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:39:32.141 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:39:32.166 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:39:32.251 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:39:32.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:39:32.326 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-22T08:39:32.364 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-22T08:39:32.389 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-22T08:39:32.415 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-22T08:39:32.447 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-22T08:39:32.479 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-22T08:39:32.506 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-22T08:39:32.535 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-22T08:39:32.691 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-22T08:39:32.843 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-22T08:39:32.894 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-22T08:39:32.948 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-22T08:39:32.975 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:39:33.096 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:39:33.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:39:33.190 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 26/288 2024-09-22T08:39:33.214 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-22T08:39:33.236 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:39:33.258 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-22T08:39:33.424 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:39:33.453 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-22T08:39:33.569 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-22T08:39:33.601 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-22T08:39:33.645 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-22T08:39:33.723 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-22T08:39:33.806 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-22T08:39:33.853 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-22T08:39:33.898 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-22T08:39:33.921 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-22T08:39:33.948 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-22T08:39:33.973 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-22T08:39:33.998 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-22T08:39:34.027 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-22T08:39:34.059 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-22T08:39:34.084 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-22T08:39:34.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-22T08:39:34.174 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:39:34.246 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-22T08:39:34.311 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-22T08:39:34.344 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-22T08:39:34.387 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-22T08:39:34.429 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-22T08:39:34.468 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-22T08:39:34.554 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-22T08:39:34.587 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 52/288 2024-09-22T08:39:34.630 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 53/288 2024-09-22T08:39:34.672 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 54/288 2024-09-22T08:39:34.760 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-22T08:39:34.906 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-22T08:39:34.976 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-22T08:39:35.545 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-22T08:39:35.633 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-22T08:39:35.682 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-22T08:39:35.754 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-22T08:39:35.833 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-22T08:39:35.874 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-22T08:39:35.903 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-22T08:39:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-22T08:39:36.014 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-22T08:39:36.055 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-22T08:39:36.091 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-22T08:39:36.129 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 69/288 2024-09-22T08:39:36.170 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-22T08:39:36.202 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-22T08:39:36.253 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-22T08:39:36.312 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-22T08:39:36.354 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-22T08:39:36.391 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-22T08:39:36.489 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-22T08:39:36.558 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-22T08:39:36.808 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-22T08:39:36.909 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-22T08:39:36.946 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-22T08:39:36.996 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-22T08:39:37.041 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-22T08:39:37.082 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-22T08:39:37.229 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-22T08:39:37.275 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-22T08:39:37.317 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-22T08:39:37.426 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-22T08:39:37.475 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-22T08:39:37.515 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-22T08:39:37.556 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-22T08:39:37.581 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-22T08:39:37.681 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-22T08:39:37.782 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:39:37.817 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-22T08:39:37.821 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:39:37.848 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:39:37.859 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-22T08:39:37.892 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:39:37.923 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:39:37.959 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:39:38.078 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-22T08:39:38.118 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-22T08:39:38.150 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-22T08:39:38.180 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-22T08:39:38.223 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-22T08:39:38.249 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:39:38.263 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-22T08:39:38.264 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-22T08:39:38.264 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:39:38.463 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-22T08:39:38.474 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:39:38.498 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:39:38.560 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-22T08:39:38.578 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:39:38.608 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:39:38.617 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-22T08:39:38.648 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:39:38.674 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-22T08:39:38.700 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-22T08:39:39.199 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:39.243 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-22T08:39:39.243 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-22T08:39:39.243 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:39:39.285 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-22T08:39:39.320 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-22T08:39:39.353 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-22T08:39:39.396 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-22T08:39:39.429 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-22T08:39:39.521 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-22T08:39:39.585 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-22T08:39:39.624 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-22T08:39:39.734 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-22T08:39:39.798 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-22T08:39:40.583 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-22T08:39:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-22T08:39:40.681 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-22T08:39:40.796 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-22T08:39:40.843 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-22T08:39:40.987 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:39:41.032 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:39:41.043 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-22T08:39:41.087 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-22T08:39:41.135 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-22T08:39:41.590 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:39:41.627 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:39:41.688 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-22T08:39:41.724 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:39:41.725 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:39:41.725 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:39:41.725 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:41.757 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-22T08:39:41.770 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:39:41.799 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-22T08:39:41.842 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-22T08:39:41.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-22T08:39:42.067 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-22T08:39:42.097 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-22T08:39:42.177 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-22T08:39:42.898 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-22T08:39:43.035 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-22T08:39:44.404 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-22T08:39:44.483 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-22T08:39:44.541 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-22T08:39:44.594 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-22T08:39:44.629 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-22T08:39:44.667 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:39:44.679 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-22T08:39:44.679 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-22T08:39:44.680 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:39:44.736 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-22T08:39:44.762 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-22T08:39:44.791 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-22T08:39:45.131 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-22T08:39:45.178 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:39:45.279 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 145/288 2024-09-22T08:39:45.311 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 146/288 2024-09-22T08:39:45.343 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-22T08:39:45.381 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-22T08:39:45.446 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-22T08:39:45.480 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-22T08:39:45.505 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-22T08:39:45.549 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-22T08:39:45.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:39:45.849 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-22T08:39:45.897 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-22T08:39:45.933 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-22T08:39:45.967 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-22T08:39:45.993 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-22T08:39:46.018 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-22T08:39:46.043 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-22T08:39:46.071 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-22T08:39:46.107 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-22T08:39:46.148 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-22T08:39:46.191 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-22T08:39:46.247 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-22T08:39:46.291 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-22T08:39:46.770 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-22T08:39:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-22T08:39:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-22T08:39:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-22T08:39:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-22T08:39:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-22T08:39:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-22T08:39:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:39:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-22T08:39:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-22T08:39:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-22T08:39:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-22T08:39:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-22T08:39:51.147 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-22T08:39:51.148 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-22T08:39:51.148 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:51.334 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:39:51.350 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:39:51.350 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:39:51.350 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:39:51.350 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:52.809 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:39:52.836 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:39:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:39:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:39:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:39:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:39:52.837 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:53.060 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:39:53.084 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:53.527 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:39:53.551 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:39:53.655 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:39:56.584 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:39:56.695 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:39:56.753 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:39:56.815 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:39:57.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:39:57.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:39:57.136 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:39:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:39:57.365 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:39:57.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:39:57.447 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:39:58.327 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:39:58.371 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:39:58.738 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:39:58.778 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:39:58.809 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:39:58.836 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:39:58.871 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:39:58.908 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:39:58.935 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:39:58.961 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:39:58.987 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:39:59.011 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:39:59.037 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:39:59.063 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:39:59.075 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-22T08:39:59.090 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:39:59.112 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-22T08:39:59.129 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:39:59.147 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-22T08:39:59.156 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:39:59.189 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-22T08:39:59.192 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:39:59.222 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-22T08:39:59.227 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:39:59.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:39:59.258 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-22T08:39:59.292 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:39:59.326 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:39:59.363 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:39:59.402 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:39:59.444 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:39:59.489 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:39:59.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:39:59.543 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:39:59.597 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:39:59.628 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:39:59.658 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:39:59.688 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:39:59.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:39:59.798 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-22T08:39:59.828 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:39:59.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:39:59.909 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 184/288 2024-09-22T08:39:59.914 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:39:59.939 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 185/288 2024-09-22T08:39:59.941 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:39:59.968 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:40:00.001 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:40:00.122 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:40:00.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:40:00.272 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:40:00.304 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:40:00.413 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:40:00.460 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:40:00.475 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:40:00.507 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:40:00.660 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:40:00.980 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:01.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:01.026 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:01.026 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:40:01.026 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:01.252 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:40:01.330 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:40:01.376 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:40:01.412 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:40:01.437 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:40:01.889 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:01.925 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:01.941 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:02.427 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:40:02.471 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:40:02.473 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:40:02.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:40:02.599 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:40:02.628 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:40:02.820 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:40:02.880 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:40:02.915 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:40:02.937 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:40:02.966 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:40:03.036 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:40:03.057 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 186/288 2024-09-22T08:40:03.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:40:03.080 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:40:03.102 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:40:03.108 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:40:03.121 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:40:03.144 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:40:03.184 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 187/288 2024-09-22T08:40:03.184 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T08:40:03.184 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T08:40:03.184 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:03.217 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:40:03.592 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:40:03.617 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:40:03.650 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:40:03.718 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:40:03.750 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:40:07.010 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:40:07.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:40:08.040 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:40:08.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:40:08.189 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:40:08.343 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:40:08.374 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:40:08.398 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:40:08.399 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:08.399 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:40:08.399 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:40:08.399 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:40:08.399 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:08.450 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:40:08.462 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:40:08.485 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:40:08.513 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:40:08.562 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:40:08.585 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:40:08.601 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:40:08.601 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:40:08.601 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:40:09.638 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:40:09.638 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:09.638 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:40:09.638 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:40:09.638 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:40:09.639 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:09.680 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:40:09.704 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:40:09.704 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:09.704 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:40:09.704 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:10.032 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:40:10.055 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:40:10.056 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:10.056 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:40:10.056 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:40:10.056 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:40:10.056 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:13.061 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 188/288 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-09-22T08:40:13.062 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:13.241 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:40:13.257 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 189/288 2024-09-22T08:40:13.257 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T08:40:13.258 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:14.377 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:40:14.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:40:14.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:40:14.563 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:40:14.619 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:40:14.649 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:40:14.649 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:40:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:40:14.742 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:40:14.832 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 190/288 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T08:40:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:14.855 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:40:14.861 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:40:14.870 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:40:14.881 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:40:14.881 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:40:14.881 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:40:14.882 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:40:15.018 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:40:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:40:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 191/288 2024-09-22T08:40:15.100 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:15.100 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T08:40:15.100 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:40:15.101 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T08:40:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:15.568 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 192/288 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T08:40:15.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:15.698 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-22T08:40:18.770 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-22T08:40:18.896 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-22T08:40:18.954 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-22T08:40:19.024 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-22T08:40:19.221 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-22T08:40:19.272 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-22T08:40:19.354 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-22T08:40:19.453 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-22T08:40:19.594 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-22T08:40:19.649 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-22T08:40:19.700 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-22T08:40:20.656 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-22T08:40:20.704 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:40:21.080 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-22T08:40:21.136 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-22T08:40:21.175 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-22T08:40:21.203 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-22T08:40:21.238 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-22T08:40:21.275 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-22T08:40:21.302 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-22T08:40:21.328 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-22T08:40:21.354 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-22T08:40:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-22T08:40:21.404 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-22T08:40:21.430 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-22T08:40:21.465 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-22T08:40:21.495 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-22T08:40:21.523 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-22T08:40:21.558 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-22T08:40:21.594 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-22T08:40:21.625 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-22T08:40:21.659 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-22T08:40:21.693 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-22T08:40:21.730 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-22T08:40:21.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-22T08:40:21.820 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-22T08:40:21.881 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-22T08:40:21.921 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-22T08:40:21.970 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-22T08:40:22.023 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-22T08:40:22.054 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-22T08:40:22.084 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-22T08:40:22.113 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-22T08:40:22.139 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-22T08:40:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-22T08:40:22.364 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-22T08:40:22.391 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-22T08:40:22.426 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-22T08:40:22.459 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-22T08:40:22.598 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-22T08:40:22.659 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-22T08:40:22.729 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-22T08:40:22.763 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:40:22.888 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-22T08:40:22.929 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:40:22.945 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-22T08:40:22.974 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-22T08:40:22.997 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-22T08:40:23.397 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:23.427 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:23.445 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-22T08:40:23.445 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-22T08:40:23.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:23.689 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-22T08:40:23.760 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-22T08:40:23.803 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-22T08:40:23.840 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-22T08:40:23.865 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-22T08:40:24.315 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:24.344 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:24.361 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-22T08:40:24.879 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:40:24.969 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-22T08:40:25.012 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:40:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:40:25.028 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:40:25.029 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:40:25.030 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:40:25.043 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:40:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:40:25.052 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:40:25.053 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:40:25.054 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:40:25.055 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:40:25.056 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:40:25.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:40:25.058 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:40:25.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:40:25.060 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:40:25.061 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:40:25.062 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:40:25.063 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:40:25.064 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:40:25.065 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:40:25.066 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:40:25.067 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:40:25.068 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:40:25.069 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:40:25.272 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-22T08:40:25.337 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-22T08:40:25.362 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:40:25.384 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-22T08:40:25.413 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:40:25.486 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-22T08:40:25.516 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:40:25.527 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-22T08:40:25.549 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:40:25.575 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-22T08:40:25.600 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-22T08:40:26.073 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:40:26.099 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 265/288 2024-09-22T08:40:26.132 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 266/288 2024-09-22T08:40:26.202 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 267/288 2024-09-22T08:40:26.232 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-22T08:40:28.387 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:40:28.388 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.389 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.390 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:40:28.391 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:40:28.392 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:28.393 INFO:teuthology.orchestra.run.smithi117.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:40:28.394 INFO:teuthology.orchestra.run.smithi117.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.395 INFO:teuthology.orchestra.run.smithi117.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:40:28.396 INFO:teuthology.orchestra.run.smithi117.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.397 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:40:28.398 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:40:28.399 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.400 INFO:teuthology.orchestra.run.smithi117.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.401 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:40:28.402 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:40:28.403 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:40:28.404 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:40:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:40:28.406 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:40:28.407 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:40:28.408 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:40:28.409 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:40:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:40:28.410 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:28.410 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-22T08:40:28.840 DEBUG:teuthology.parallel:result is None 2024-09-22T08:40:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 268/288 2024-09-22T08:40:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:40:30.712 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 269/288 2024-09-22T08:40:30.738 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:40:30.863 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 270/288 2024-09-22T08:40:31.025 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 271/288 2024-09-22T08:40:31.049 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 272/288 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T08:40:31.074 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:31.125 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:40:31.136 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 273/288 2024-09-22T08:40:31.159 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 274/288 2024-09-22T08:40:31.197 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-22T08:40:31.285 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-22T08:40:31.319 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:40:31.335 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-22T08:40:31.335 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-22T08:40:31.335 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 278/288 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T08:40:32.370 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:32.412 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:40:32.436 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5106.g88523 279/288 2024-09-22T08:40:32.436 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:32.436 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T08:40:32.436 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:32.763 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 280/288 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T08:40:32.788 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:37.351 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 281/288 2024-09-22T08:40:37.392 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 282/288 2024-09-22T08:40:37.448 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 283/288 2024-09-22T08:40:37.565 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 284/288 2024-09-22T08:40:37.628 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:40:37.656 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-22T08:40:37.656 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:40:37.749 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-22T08:40:37.750 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:37.840 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:37.869 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-22T08:40:37.876 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-22T08:40:37.884 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-22T08:40:37.895 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-22T08:40:37.895 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:40:37.895 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-22T08:40:37.895 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:37.959 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:40:38.033 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-22T08:40:48.299 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.3.0-5106.g8852379c.el9.x86_64 1/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 3/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 4/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5106.g88523 5/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 6/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 7/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 8/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 9/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 10/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 11/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 12/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_ 13/288 2024-09-22T08:40:48.300 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 14/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 15/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.3.0-5106.g8852379c.el9.x86_6 16/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86 17/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 18/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5106.g8852379c.el 19/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.3.0-5106.g8852379c.el9. 20/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_6 21/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 22/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 23/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 24/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 25/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 26/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 27/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5106.g8852379c. 28/288 2024-09-22T08:40:48.301 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noa 29/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.n 30/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5106.g885 31/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el 32/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 33/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.e 34/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 35/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.3.0-5106.g8852379c.el9.noarch 36/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-22T08:40:48.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-22T08:40:48.303 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-22T08:40:48.304 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-22T08:40:48.305 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-22T08:40:48.306 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-22T08:40:48.307 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-22T08:40:48.308 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-22T08:40:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-22T08:40:48.310 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-22T08:40:48.311 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-22T08:40:48.312 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-22T08:40:48.313 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-22T08:40:48.314 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-22T08:40:48.315 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-22T08:40:48.316 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-22T08:40:48.317 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-22T08:40:48.318 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.3.0-5106.g8852379c.el9.x86_64 285/288 2024-09-22T08:40:48.319 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-22T08:40:48.320 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 287/288 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T08:40:51.700 INFO:teuthology.orchestra.run.smithi039.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: atinject-1.0.3-6.el9.noarch 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: atk-2.36.0-5.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T08:40:51.701 INFO:teuthology.orchestra.run.smithi039.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.3.0-5106.g8852379c.el9.noarch 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-22T08:40:51.703 INFO:teuthology.orchestra.run.smithi039.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T08:40:51.704 INFO:teuthology.orchestra.run.smithi039.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: guava-30.1-6.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-22T08:40:51.705 INFO:teuthology.orchestra.run.smithi039.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: lcms2-2.12-3.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-22T08:40:51.706 INFO:teuthology.orchestra.run.smithi039.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-22T08:40:51.708 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libsbc-1.4-9.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-22T08:40:51.709 INFO:teuthology.orchestra.run.smithi039.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-22T08:40:51.710 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.711 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: opus-1.3.1-10.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: orc-0.4.31-8.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-22T08:40:51.712 INFO:teuthology.orchestra.run.smithi039.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-22T08:40:51.713 INFO:teuthology.orchestra.run.smithi039.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.714 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T08:40:51.715 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T08:40:51.716 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T08:40:51.717 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T08:40:51.718 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.3.0-5106.g8852379c.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: rtkit-0.11-29.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-22T08:40:51.719 INFO:teuthology.orchestra.run.smithi039.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: upower-0.99.11-11.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-22T08:40:51.720 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T08:40:51.721 INFO:teuthology.orchestra.run.smithi039.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-22T08:40:51.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:51.721 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-22T08:40:52.218 DEBUG:teuthology.parallel:result is None 2024-09-22T08:40:52.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:40:52.357 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:40:52.421 INFO:teuthology.orchestra.run.smithi039.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:40:52.422 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:40:52.422 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:40:52.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:40:52.565 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T08:40:52.633 INFO:teuthology.orchestra.run.smithi117.stdout:19.3.0-5106.g8852379c.el9 2024-09-22T08:40:52.633 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5106.g8852379c.el9 2024-09-22T08:40:52.633 INFO:teuthology.task.install:The correct ceph version 19.3.0-5106.g8852379c is installed. 2024-09-22T08:40:52.635 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T08:40:52.635 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:52.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:40:52.680 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:52.680 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T08:40:52.727 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T08:40:52.727 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:52.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:40:52.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:40:52.847 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:52.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T08:40:52.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T08:40:52.969 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T08:40:52.969 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:52.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:40:53.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:40:53.088 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:53.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T08:40:53.129 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T08:40:53.209 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T08:40:53.209 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:53.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:40:53.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:40:53.327 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:53.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T08:40:53.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T08:40:53.445 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T08:40:53.515 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T08:40:53.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2024-09-22T08:40:53.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-22T08:40:53.556 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T08:40:53.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:40:53.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T08:40:53.635 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T08:40:53.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:40:53.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T08:40:53.725 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T08:40:53.725 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T08:40:53.725 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073', 'branch': 'wip-skoduri-cloud-restore', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7915073', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-cloud-restore'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-cloud-restore', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-cloud-restore', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8852379c050c686f4605f33f0129009b2029ca9d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8852379c050c686f4605f33f0129009b2029ca9d', 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCEQxl+RXnwN12Y338qZNpWMBLayObnuASotL08ngYLCHdxzddPpbB1vUyLSWEUsuPVAA8WbETH4p0+vt8dURMM=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD8rQba4ib5zuO2YWnEujwdrNr3wVChBWRgQuzo/fVOVaVyl1lDihrgbLSmLfRJuVHy7D7phNznq94s7Jur5NE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '8852379c050c686f4605f33f0129009b2029ca9d'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-22_06:37:27', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T08:40:53.726 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:40:53.756 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T08:40:53.785 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:40:53.825 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T08:40:53.865 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:53.865 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:40:53.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:40:53.931 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-22 08:40:39.082365844 +0000 2024-09-22T08:40:54.000 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-22 08:37:46.093571697 +0000 2024-09-22T08:40:54.001 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-22 08:37:46.093571697 +0000 2024-09-22T08:40:54.001 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-22 08:37:46.093571697 +0000 2024-09-22T08:40:54.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:40:54.079 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-22T08:40:54.079 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-22T08:40:54.079 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000568374 s, 901 kB/s 2024-09-22T08:40:54.080 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:40:54.150 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-22T08:40:54.219 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-22 08:40:39.083365826 +0000 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-22 08:37:46.441565539 +0000 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-22 08:37:46.441565539 +0000 2024-09-22T08:40:54.220 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-22 08:37:46.441565539 +0000 2024-09-22T08:40:54.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:40:54.298 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-22T08:40:54.298 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-22T08:40:54.298 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000283465 s, 1.8 MB/s 2024-09-22T08:40:54.299 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:40:54.369 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:54.438 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-22 08:40:39.083365826 +0000 2024-09-22T08:40:54.439 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-22 08:37:46.770559717 +0000 2024-09-22T08:40:54.439 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-22 08:37:46.770559717 +0000 2024-09-22T08:40:54.439 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-22 08:37:46.770559717 +0000 2024-09-22T08:40:54.439 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:40:54.516 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-22T08:40:54.516 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-22T08:40:54.516 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.00027618 s, 1.9 MB/s 2024-09-22T08:40:54.518 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:40:54.588 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-22T08:40:54.658 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-22 08:40:39.084365808 +0000 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-22 08:37:47.103553824 +0000 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-22 08:37:47.103553824 +0000 2024-09-22T08:40:54.659 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-22 08:37:47.103553824 +0000 2024-09-22T08:40:54.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:40:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-22T08:40:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-22T08:40:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000278321 s, 1.8 MB/s 2024-09-22T08:40:54.738 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:40:54.808 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:40:54.808 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:54.808 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T08:40:54.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T08:40:54.839 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-22 08:40:16.571615226 +0000 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-22 08:37:39.348541675 +0000 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-22 08:37:39.348541675 +0000 2024-09-22T08:40:54.909 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-22 08:37:39.348541675 +0000 2024-09-22T08:40:54.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T08:40:54.986 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-22T08:40:54.986 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-22T08:40:54.986 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000205516 s, 2.5 MB/s 2024-09-22T08:40:54.987 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T08:40:55.057 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-22T08:40:55.125 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T08:40:55.125 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-22 08:40:16.571615226 +0000 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-22 08:37:39.682535214 +0000 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-22 08:37:39.682535214 +0000 2024-09-22T08:40:55.126 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-22 08:37:39.682535214 +0000 2024-09-22T08:40:55.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T08:40:55.202 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-22T08:40:55.202 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-22T08:40:55.202 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000171955 s, 3.0 MB/s 2024-09-22T08:40:55.203 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T08:40:55.274 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-22 08:40:16.571615226 +0000 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-22 08:37:39.996529138 +0000 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-22 08:37:39.996529138 +0000 2024-09-22T08:40:55.343 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-22 08:37:39.996529138 +0000 2024-09-22T08:40:55.344 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T08:40:55.420 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-22T08:40:55.420 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-22T08:40:55.420 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000217363 s, 2.4 MB/s 2024-09-22T08:40:55.421 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T08:40:55.491 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-22T08:40:55.562 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T08:40:55.562 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-22 08:40:16.572615207 +0000 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-22 08:37:40.311523046 +0000 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-22 08:37:40.311523046 +0000 2024-09-22T08:40:55.563 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-22 08:37:40.311523046 +0000 2024-09-22T08:40:55.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T08:40:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-22T08:40:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-22T08:40:55.639 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000195314 s, 2.6 MB/s 2024-09-22T08:40:55.640 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T08:40:55.710 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:40:55.710 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:40:55.711 INFO:tasks.ceph:Generating config... 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-22T08:40:55.712 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-22T08:40:55.713 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-22T08:40:55.713 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-22T08:40:55.713 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-22T08:40:55.713 INFO:tasks.ceph:[client] setuser = ceph 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-22T08:40:55.713 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T08:40:55.713 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T08:40:55.714 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T08:40:55.715 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T08:40:55.715 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-22T08:40:55.715 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T08:40:55.715 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T08:40:55.715 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T08:40:55.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T08:40:55.785 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T08:40:55.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T08:40:55.848 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:40:55.888 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.c', '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]'), ('mon.b', '172.21.15.117')] 2024-09-22T08:40:55.889 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.117', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-22T08:40:55.890 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:55.890 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:40:55.958 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --addv c '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]' --add b 172.21.15.117 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:40:56.060 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:40:56.060 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-22T08:40:56.060811+0000 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 17 (quincy) 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 1 2024-09-22T08:40:56.061 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T08:40:56.062 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T08:40:56.062 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T08:40:56.062 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-22T08:40:56.063 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T08:40:56.092 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a... 2024-09-22T08:40:56.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:40:56.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T08:40:56.190 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-09-22T08:40:56.190 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2024-09-22T08:40:56.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.117" 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: mon client directed command retry = 5 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: ms inject socket failures = 5000 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: osd heartbeat grace = 40 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: rgw override bucket index max shards = 1 2024-09-22T08:40:56.193 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2024-09-22T08:40:56.194 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug trim objects = true 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.195 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: bdev async discard = True 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: bdev enable discard = True 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore allocator = bitmap 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 1/20 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 1/20 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug objclass = 20 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 4/10 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:40:56.196 INFO:teuthology.orchestra.run.smithi039.stdout: osd fast shutdown = False 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: osd shutdown pgref assert = True 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-09-22T08:40:56.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:40:56.198 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd crush smoke test = False 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: debug rgw = 20 2024-09-22T08:40:56.199 INFO:teuthology.orchestra.run.smithi039.stdout: debug rgw notification = 20 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw bucket counters cache = True 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw crypt require ssl = False 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw max chunk size = 4194304 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw obj stripe size = 6291456 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw s3 auth use sts = True 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw torrent flag = True 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: rgw user counters cache = True 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: setgroup = ceph 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout: setuser = ceph 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2024-09-22T08:40:56.200 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-22T08:40:56.201 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.202 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-22T08:40:56.203 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.117" 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: mon client directed command retry = 5 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: ms inject socket failures = 5000 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: osd heartbeat grace = 40 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: osd_max_pg_log_entries = 10 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: osd_min_pg_log_entries = 10 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: rgw override bucket index max shards = 1 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.204 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.205 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-22T08:40:56.206 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug objclass = 20 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: osd fast shutdown = False 2024-09-22T08:40:56.207 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-22T08:40:56.208 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T08:40:56.209 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd crush smoke test = False 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: debug rgw = 20 2024-09-22T08:40:56.210 INFO:teuthology.orchestra.run.smithi117.stdout: debug rgw notification = 20 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw bucket counters cache = True 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt require ssl = False 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt s3 kms backend = testing 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw max chunk size = 4194304 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw obj stripe size = 6291456 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw reshard progress judge interval = 10 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw s3 auth use sts = True 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw sts key = abcdefghijklmnop 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw torrent flag = True 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: rgw user counters cache = True 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: setgroup = ceph 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout: setuser = ceph 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-09-22T08:40:56.211 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-09-22T08:40:56.213 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T08:40:56.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T08:40:56.283 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T08:40:56.283 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:56.283 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T08:40:56.312 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:56.312 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T08:40:56.383 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:40:56.383 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:56.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:40:56.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:40:56.473 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:40:56.474 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:40:56.544 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:40:56.544 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:56.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T08:40:56.544 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T08:40:56.593 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:40:56.593 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:40:56.662 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T08:40:56.662 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T08:40:56.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:40:56.730 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T08:40:56.732 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:40:56.821 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T08:40:56.824 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T08:40:56.824 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T08:40:56.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T08:40:56.880 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T08:40:56.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T08:40:56.948 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T08:40:56.961 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T08:40:56.961 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T08:40:56.961 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T08:40:57.001 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:40:57.001 INFO:tasks.ceph:role: osd.0 2024-09-22T08:40:57.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:40:57.002 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:40:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:40:58.426 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-22T08:40:58.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-22T08:40:58.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T08:40:58.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T08:40:58.530 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T08:40:58.571 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:40:58.571 INFO:tasks.ceph:role: osd.1 2024-09-22T08:40:58.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:40:58.572 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:40:58.680 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:40:59.991 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-22T08:40:59.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-22T08:40:59.994 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T08:41:00.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T08:41:00.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T08:41:00.135 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:00.136 INFO:tasks.ceph:role: osd.2 2024-09-22T08:41:00.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:41:00.136 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:00.244 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:00.245 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:01.591 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-22T08:41:01.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-22T08:41:01.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-22T08:41:01.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T08:41:01.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T08:41:01.737 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:01.737 INFO:tasks.ceph:role: osd.3 2024-09-22T08:41:01.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T08:41:01.737 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:41:01.844 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:01.845 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:03.164 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-22T08:41:03.166 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-22T08:41:03.166 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-22T08:41:03.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T08:41:03.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:03.341+0000 7f14fbf58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T08:41:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:03.341+0000 7f14fbf58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T08:41:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:03.341+0000 7f14fbf58640 -1 bdev(0x5592fd503800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:03.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:03.342+0000 7f14fbf58640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T08:41:06.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T08:41:06.343 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:06.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:06.405+0000 7fbd333dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T08:41:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:06.405+0000 7fbd333dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T08:41:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:06.405+0000 7fbd333dd640 -1 bdev(0x556f32f2d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:06.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:06.406+0000 7fbd333dd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T08:41:09.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T08:41:09.879 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:09.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:09.941+0000 7f0650e2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T08:41:09.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:09.942+0000 7f0650e2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T08:41:09.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:09.942+0000 7f0650e2c640 -1 bdev(0x55d2e24d9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:09.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:09.942+0000 7f0650e2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T08:41:12.848 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T08:41:12.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:12.958+0000 7f80d8410640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T08:41:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:12.959+0000 7f80d8410640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T08:41:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:12.959+0000 7f80d8410640 -1 bdev(0x561276b05800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:12.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:41:12.959+0000 7f80d8410640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T08:41:16.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T08:41:16.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-22T08:41:16.485 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:16.486 INFO:tasks.ceph:role: osd.4 2024-09-22T08:41:16.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:41:16.486 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T08:41:16.534 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:16.534 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:16.535 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:17.046 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-22T08:41:17.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-22T08:41:17.048 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-22T08:41:17.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-22T08:41:17.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-22T08:41:17.247 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:17.247 INFO:tasks.ceph:role: osd.5 2024-09-22T08:41:17.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:41:17.247 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T08:41:17.334 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:17.335 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:17.795 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-22T08:41:17.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-22T08:41:17.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-22T08:41:17.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-22T08:41:17.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-22T08:41:17.979 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:17.980 INFO:tasks.ceph:role: osd.6 2024-09-22T08:41:17.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:41:17.980 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:18.066 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:18.557 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-22T08:41:18.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-22T08:41:18.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-22T08:41:18.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-22T08:41:18.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-22T08:41:18.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T08:41:18.795 INFO:tasks.ceph:role: osd.7 2024-09-22T08:41:18.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T08:41:18.796 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-22T08:41:18.881 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T08:41:18.882 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T08:41:18.882 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T08:41:18.882 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T08:41:19.400 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-22T08:41:19.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-22T08:41:19.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-22T08:41:19.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-22T08:41:19.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:19.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:19.668+0000 7fa445e1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-22T08:41:19.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:19.668+0000 7fa445e1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-22T08:41:19.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:19.668+0000 7fa445e1c640 -1 bdev(0x5606a184b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:19.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:19.669+0000 7fa445e1c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-22T08:41:23.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-22T08:41:23.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:23.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:23.227+0000 7fb384d25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-22T08:41:23.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:23.227+0000 7fb384d25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-22T08:41:23.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:23.227+0000 7fb384d25640 -1 bdev(0x55ff7de87800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:23.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:23.227+0000 7fb384d25640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-22T08:41:26.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-22T08:41:26.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:26.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:26.281+0000 7f7e5a411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-22T08:41:26.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:26.281+0000 7f7e5a411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-22T08:41:26.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:26.281+0000 7f7e5a411640 -1 bdev(0x55fcbd915800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:26.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:26.281+0000 7f7e5a411640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-22T08:41:29.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-22T08:41:29.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:29.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:29.575+0000 7f1d9341b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-22T08:41:29.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:29.575+0000 7f1d9341b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-22T08:41:29.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:29.575+0000 7f1d9341b640 -1 bdev(0x563bd68f9800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-22T08:41:29.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-22T08:41:29.575+0000 7f1d9341b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-22T08:41:32.483 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-22T08:41:32.527 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T08:41:32.528 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:32.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-22T08:41:32.574 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:32.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T08:41:32.659 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:32.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T08:41:32.741 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:32.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T08:41:32.822 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:32.822 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T08:41:32.903 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:32.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T08:41:32.948 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:32.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-22T08:41:33.030 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:33.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-22T08:41:33.110 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:33.111 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-22T08:41:33.190 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:33.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-22T08:41:33.268 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:33.268 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T08:41:33.299 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:33.300 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T08:41:33.337 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T08:41:33.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:41:33.342 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAY2O9mamyBKxAAMuVfgu/7gE9zDxBjt7pxAg== 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAf2O9m8Ch3FBAAWYnhKNTKsz/cg7yAAg4uRQ== 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAi2O9m+QpIGBAAF5tUKmWt4E9Cr95dk83bBA== 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAl2O9mEBk8OBAAtlCUnwbLm95TQnn4F0Qqlw== 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAo2O9mtsMxORAAGb6kF45pHDLO/ge/Ghar6Q== 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2024-09-22T08:41:33.380 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAY2O9maWD2MBAAEFJeUh0KxsKelIzxlXpIQw== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAv2O9mhG3iJxAA2j0fDBDY7S/0vZJsoi8VwQ== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAz2O9mtheTDRAAxSTvw5xyfZSSdffKDOKihg== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA22O9mnTDQEBAA/vUOy8Dw6fclQpERUVWseQ== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQA52O9mLA1UIhAAHFPlmjPR9zebJ7lPkS+PmA== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAY2O9mPgZ6NBAAtXUWuWzohocKtSJE8srOUQ== 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2024-09-22T08:41:33.381 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAY2O9mp5CBOBAA7pDELTNDqFS5/tUvZjvTzQ== 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAY2O9mamyBKxAAMuVfgu/7gE9zDxBjt7pxAg== 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAf2O9m8Ch3FBAAWYnhKNTKsz/cg7yAAg4uRQ== 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAi2O9m+QpIGBAAF5tUKmWt4E9Cr95dk83bBA== 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAl2O9mEBk8OBAAtlCUnwbLm95TQnn4F0Qqlw== 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-09-22T08:41:33.414 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAo2O9mtsMxORAAGb6kF45pHDLO/ge/Ghar6Q== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAY2O9maWD2MBAAEFJeUh0KxsKelIzxlXpIQw== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAv2O9mhG3iJxAA2j0fDBDY7S/0vZJsoi8VwQ== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAz2O9mtheTDRAAxSTvw5xyfZSSdffKDOKihg== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA22O9mnTDQEBAA/vUOy8Dw6fclQpERUVWseQ== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA52O9mLA1UIhAAHFPlmjPR9zebJ7lPkS+PmA== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAY2O9mPgZ6NBAAtXUWuWzohocKtSJE8srOUQ== 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-09-22T08:41:33.415 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQAY2O9mp5CBOBAA7pDELTNDqFS5/tUvZjvTzQ== 2024-09-22T08:41:33.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:41:33.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:41:33.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.525 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:41:33.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T08:41:33.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:33.996 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:34.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:34.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T08:41:34.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:41:34.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:41:34.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:41:34.201 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T08:41:34.269 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T08:41:34.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T08:41:34.308 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:41:34.427 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T08:41:34.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-22T08:41:34.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:41:34.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-22T08:41:34.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-22T08:41:34.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T08:41:34.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-22T08:41:34.890 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:34.892 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T08:41:34.958 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T08:41:34.958 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T08:41:34.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T08:41:34.962 INFO:tasks.ceph.mon.a:Started 2024-09-22T08:41:34.962 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-22T08:41:34.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-22T08:41:34.964 INFO:tasks.ceph.mon.c:Started 2024-09-22T08:41:34.964 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-22T08:41:34.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-22T08:41:35.000 INFO:tasks.ceph.mon.b:Started 2024-09-22T08:41:35.000 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T08:41:35.001 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-22T08:41:35.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-22T08:41:35.003 INFO:tasks.ceph.mgr.y:Started 2024-09-22T08:41:35.003 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T08:41:35.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T08:41:35.005 INFO:tasks.ceph.mgr.x:Started 2024-09-22T08:41:35.005 DEBUG:tasks.ceph:set 0 configs 2024-09-22T08:41:35.005 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T08:41:35.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T08:41:40.395 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-09-22T08:41:40.408 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T08:41:40.408 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T08:41:40.408 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:40.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T08:41:40.449 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:40.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T08:41:40.529 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:40.529 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T08:41:40.611 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:41:40.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T08:41:40.691 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:40.691 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-22T08:41:40.737 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:40.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-22T08:41:40.821 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:40.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-22T08:41:40.901 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-22T08:41:40.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-22T08:41:40.982 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c251b8fa-97aa-48dc-a49b-7f742aad0e26 0 2024-09-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-09-22T08:41:41.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 157fcacc-9625-4803-8084-1b80c082b4bf 1 2024-09-22T08:41:41.468 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-22T08:41:41.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new e0413f5d-e2da-4de2-89f7-6d9454e32f4e 2 2024-09-22T08:41:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-09-22T08:41:41.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 5b750bea-dbeb-49e1-a7c2-e2e176e1154d 3 2024-09-22T08:41:41.897 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-09-22T08:41:41.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 362296d1-a0aa-4fdb-8e29-a5d226635219 4 2024-09-22T08:41:42.105 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-09-22T08:41:42.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new f88b1aa5-636a-4ee0-b9f9-d285898adb31 5 2024-09-22T08:41:42.314 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-09-22T08:41:42.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 6582865b-e919-4569-b8bd-e71f770b850d 6 2024-09-22T08:41:42.520 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-09-22T08:41:42.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 38bd038f-6f53-4506-9523-43f0bcf34dae 7 2024-09-22T08:41:42.734 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-09-22T08:41:42.746 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T08:41:42.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T08:41:42.748 INFO:tasks.ceph.osd.0:Started 2024-09-22T08:41:42.748 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T08:41:42.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T08:41:42.750 INFO:tasks.ceph.osd.1:Started 2024-09-22T08:41:42.751 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T08:41:42.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T08:41:42.753 INFO:tasks.ceph.osd.2:Started 2024-09-22T08:41:42.753 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T08:41:42.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T08:41:42.756 INFO:tasks.ceph.osd.3:Started 2024-09-22T08:41:42.756 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-22T08:41:42.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-22T08:41:42.758 INFO:tasks.ceph.osd.4:Started 2024-09-22T08:41:42.758 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-22T08:41:42.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-22T08:41:42.761 INFO:tasks.ceph.osd.5:Started 2024-09-22T08:41:42.761 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-22T08:41:42.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-22T08:41:42.763 INFO:tasks.ceph.osd.6:Started 2024-09-22T08:41:42.763 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-22T08:41:42.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-22T08:41:42.765 INFO:tasks.ceph.osd.7:Started 2024-09-22T08:41:42.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:41:43.001 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:41:43.001 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:41:42.722676+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:41:43.012 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T08:41:43.012 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T08:41:43.730 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-22T08:41:43.728+0000 7ff92622c640 -1 Falling back to public interface 2024-09-22T08:41:43.817 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:41:43.993 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-22T08:41:43.991+0000 7f49c9bb2640 -1 Falling back to public interface 2024-09-22T08:41:43.995 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-22T08:41:43.995 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:41:42.722676+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:41:44.005 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T08:41:44.223 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-22T08:41:44.222+0000 7f874a80d640 -1 Falling back to public interface 2024-09-22T08:41:44.236 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-22T08:41:44.235+0000 7f802a0d6640 -1 Falling back to public interface 2024-09-22T08:41:44.253 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-22T08:41:44.252+0000 7ffa5d4b2640 -1 Falling back to public interface 2024-09-22T08:41:44.478 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-22T08:41:44.476+0000 7f01d3343640 -1 Falling back to public interface 2024-09-22T08:41:44.495 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-22T08:41:44.494+0000 7f5ae6db2640 -1 Falling back to public interface 2024-09-22T08:41:44.756 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-22T08:41:44.753+0000 7fc6c460d640 -1 Falling back to public interface 2024-09-22T08:41:45.911 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-09-22T08:41:45.909+0000 7fc9c36dc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-22T08:41:45.912 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-09-22T08:41:45.912+0000 7fc9c36dc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-22T08:41:47.551 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-22T08:41:47.549+0000 7f49c9bb2640 -1 osd.5 0 log_to_monitors true 2024-09-22T08:41:47.561 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-22T08:41:47.559+0000 7ff92622c640 -1 osd.4 0 log_to_monitors true 2024-09-22T08:41:47.831 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-22T08:41:47.830+0000 7f802a0d6640 -1 osd.0 0 log_to_monitors true 2024-09-22T08:41:48.088 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-22T08:41:48.087+0000 7ffa5d4b2640 -1 osd.3 0 log_to_monitors true 2024-09-22T08:41:48.226 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-22T08:41:48.224+0000 7f01d3343640 -1 osd.6 0 log_to_monitors true 2024-09-22T08:41:48.264 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-22T08:41:48.263+0000 7f874a80d640 -1 osd.1 0 log_to_monitors true 2024-09-22T08:41:48.593 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-22T08:41:48.592+0000 7f5ae6db2640 -1 osd.2 0 log_to_monitors true 2024-09-22T08:41:48.781 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-22T08:41:48.779+0000 7fc6c460d640 -1 osd.7 0 log_to_monitors true 2024-09-22T08:41:50.812 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:41:51.171 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-22T08:41:51.169+0000 7f49c5b46640 -1 osd.5 0 waiting for initial osdmap 2024-09-22T08:41:51.182 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-09-22T08:41:51.181+0000 7f49bd965640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.188 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-22T08:41:51.186+0000 7ff9229d4640 -1 osd.4 0 waiting for initial osdmap 2024-09-22T08:41:51.195 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-22T08:41:51.193+0000 7f01cfaeb640 -1 osd.6 0 waiting for initial osdmap 2024-09-22T08:41:51.201 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-09-22T08:41:51.200+0000 7ff919fdf640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.204 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-09-22T08:41:51.203+0000 7f01c70f6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.296 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-22T08:41:51.295+0000 7f802606a640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T08:41:51.312 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-22T08:41:51.310+0000 7f801de89640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.339 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-22T08:41:51.338+0000 7ffa59446640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T08:41:51.351 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-22T08:41:51.350+0000 7ffa51265640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.384 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-22T08:41:51.383+0000 7f8746197640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T08:41:51.396 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-22T08:41:51.395+0000 7f873dfb6640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.408 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-22T08:41:51.408 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":13,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:41:50.347709+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:41:51.421 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T08:41:51.431 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-22T08:41:51.430+0000 7fc6c0864640 -1 osd.7 0 waiting for initial osdmap 2024-09-22T08:41:51.450 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-09-22T08:41:51.448+0000 7fc6b7e6f640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:51.712 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-22T08:41:51.711+0000 7f5ae2d46640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T08:41:51.726 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-22T08:41:51.725+0000 7f5adab65640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T08:41:58.226 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T08:41:58.549 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-22T08:41:58.550 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":17,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:41:55.182274+0000","last_up_change":"2024-09-22T08:41:52.173648+0000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:41:52.915090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6809","nonce":3239671675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6811","nonce":3239671675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6815","nonce":3239671675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6813","nonce":3239671675}]},"public_addr":"172.21.15.39:6809/3239671675","cluster_addr":"172.21.15.39:6811/3239671675","heartbeat_back_addr":"172.21.15.39:6815/3239671675","heartbeat_front_addr":"172.21.15.39:6813/3239671675","state":["exists","up"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6801","nonce":1561628689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6803","nonce":1561628689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6807","nonce":1561628689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6805","nonce":1561628689}]},"public_addr":"172.21.15.39:6801/1561628689","cluster_addr":"172.21.15.39:6803/1561628689","heartbeat_back_addr":"172.21.15.39:6807/1561628689","heartbeat_front_addr":"172.21.15.39:6805/1561628689","state":["exists","up"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6825","nonce":1117132609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6827","nonce":1117132609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6831","nonce":1117132609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6829","nonce":1117132609}]},"public_addr":"172.21.15.39:6825/1117132609","cluster_addr":"172.21.15.39:6827/1117132609","heartbeat_back_addr":"172.21.15.39:6831/1117132609","heartbeat_front_addr":"172.21.15.39:6829/1117132609","state":["exists","up"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6817","nonce":2957971359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6819","nonce":2957971359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6823","nonce":2957971359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6821","nonce":2957971359}]},"public_addr":"172.21.15.39:6817/2957971359","cluster_addr":"172.21.15.39:6819/2957971359","heartbeat_back_addr":"172.21.15.39:6823/2957971359","heartbeat_front_addr":"172.21.15.39:6821/2957971359","state":["exists","up"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6801","nonce":575457324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6803","nonce":575457324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6807","nonce":575457324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6805","nonce":575457324}]},"public_addr":"172.21.15.117:6801/575457324","cluster_addr":"172.21.15.117:6803/575457324","heartbeat_back_addr":"172.21.15.117:6807/575457324","heartbeat_front_addr":"172.21.15.117:6805/575457324","state":["exists","up"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6809","nonce":1279363323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6811","nonce":1279363323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6815","nonce":1279363323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6813","nonce":1279363323}]},"public_addr":"172.21.15.117:6809/1279363323","cluster_addr":"172.21.15.117:6811/1279363323","heartbeat_back_addr":"172.21.15.117:6815/1279363323","heartbeat_front_addr":"172.21.15.117:6813/1279363323","state":["exists","up"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6817","nonce":277639924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6819","nonce":277639924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6823","nonce":277639924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6821","nonce":277639924}]},"public_addr":"172.21.15.117:6817/277639924","cluster_addr":"172.21.15.117:6819/277639924","heartbeat_back_addr":"172.21.15.117:6823/277639924","heartbeat_front_addr":"172.21.15.117:6821/277639924","state":["exists","up"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6825","nonce":3276057253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6827","nonce":3276057253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6831","nonce":3276057253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6829","nonce":3276057253}]},"public_addr":"172.21.15.117:6825/3276057253","cluster_addr":"172.21.15.117:6827/3276057253","heartbeat_back_addr":"172.21.15.117:6831/3276057253","heartbeat_front_addr":"172.21.15.117:6829/3276057253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.833700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.259217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.566490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.067523+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.555351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.587557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.235117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.750747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:41:58.561 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-22T08:41:58.561 INFO:tasks.ceph:Creating RBD pool 2024-09-22T08:41:58.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T08:41:59.225 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'rbd' created 2024-09-22T08:41:59.238 DEBUG:teuthology.orchestra.run.smithi039:> rbd --cluster ceph pool init rbd 2024-09-22T08:41:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:41:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:02.259 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T08:42:02.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T08:42:02.260 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T08:42:02.586 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:02.599 INFO:teuthology.orchestra.run.smithi039.stdout:[{"version":9,"timestamp":"2024-09-22T08:41:51.712172+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4048.773529"}]}] 2024-09-22T08:42:02.599 INFO:tasks.ceph_manager:config epoch is 9 2024-09-22T08:42:02.599 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T08:42:02.599 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T08:42:02.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T08:42:02.967 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:02.979 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":63434186},{"type":"v1","addr":"172.21.15.39:6833","nonce":63434186}]},"active_addr":"172.21.15.39:6833/63434186","active_change":"2024-09-22T08:41:44.889608+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":237708649}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":4000722221}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3655352507}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":102123466}]}]} 2024-09-22T08:42:02.982 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T08:42:02.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T08:42:02.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:42:03.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:03.301 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":21,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:42:02.234224+0000","last_up_change":"2024-09-22T08:41:52.173648+0000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:41:52.915090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:41:58.877419+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6809","nonce":3239671675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6811","nonce":3239671675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6815","nonce":3239671675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6813","nonce":3239671675}]},"public_addr":"172.21.15.39:6809/3239671675","cluster_addr":"172.21.15.39:6811/3239671675","heartbeat_back_addr":"172.21.15.39:6815/3239671675","heartbeat_front_addr":"172.21.15.39:6813/3239671675","state":["exists","up"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6801","nonce":1561628689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6803","nonce":1561628689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6807","nonce":1561628689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6805","nonce":1561628689}]},"public_addr":"172.21.15.39:6801/1561628689","cluster_addr":"172.21.15.39:6803/1561628689","heartbeat_back_addr":"172.21.15.39:6807/1561628689","heartbeat_front_addr":"172.21.15.39:6805/1561628689","state":["exists","up"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6825","nonce":1117132609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6827","nonce":1117132609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6831","nonce":1117132609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6829","nonce":1117132609}]},"public_addr":"172.21.15.39:6825/1117132609","cluster_addr":"172.21.15.39:6827/1117132609","heartbeat_back_addr":"172.21.15.39:6831/1117132609","heartbeat_front_addr":"172.21.15.39:6829/1117132609","state":["exists","up"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6817","nonce":2957971359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6819","nonce":2957971359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6823","nonce":2957971359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6821","nonce":2957971359}]},"public_addr":"172.21.15.39:6817/2957971359","cluster_addr":"172.21.15.39:6819/2957971359","heartbeat_back_addr":"172.21.15.39:6823/2957971359","heartbeat_front_addr":"172.21.15.39:6821/2957971359","state":["exists","up"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6801","nonce":575457324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6803","nonce":575457324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6807","nonce":575457324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6805","nonce":575457324}]},"public_addr":"172.21.15.117:6801/575457324","cluster_addr":"172.21.15.117:6803/575457324","heartbeat_back_addr":"172.21.15.117:6807/575457324","heartbeat_front_addr":"172.21.15.117:6805/575457324","state":["exists","up"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6809","nonce":1279363323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6811","nonce":1279363323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6815","nonce":1279363323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6813","nonce":1279363323}]},"public_addr":"172.21.15.117:6809/1279363323","cluster_addr":"172.21.15.117:6811/1279363323","heartbeat_back_addr":"172.21.15.117:6815/1279363323","heartbeat_front_addr":"172.21.15.117:6813/1279363323","state":["exists","up"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6817","nonce":277639924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6819","nonce":277639924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6823","nonce":277639924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6821","nonce":277639924}]},"public_addr":"172.21.15.117:6817/277639924","cluster_addr":"172.21.15.117:6819/277639924","heartbeat_back_addr":"172.21.15.117:6823/277639924","heartbeat_front_addr":"172.21.15.117:6821/277639924","state":["exists","up"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6825","nonce":3276057253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6827","nonce":3276057253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6831","nonce":3276057253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6829","nonce":3276057253}]},"public_addr":"172.21.15.117:6825/3276057253","cluster_addr":"172.21.15.117:6827/3276057253","heartbeat_back_addr":"172.21.15.117:6831/3276057253","heartbeat_front_addr":"172.21.15.117:6829/3276057253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.833700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.259217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.566490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.067523+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.555351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.587557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.235117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.750747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:42:03.314 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T08:42:03.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T08:42:03.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:03.633 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":21,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T08:42:02.234224+0000","last_up_change":"2024-09-22T08:41:52.173648+0000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:41:52.915090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:41:58.877419+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6809","nonce":3239671675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6811","nonce":3239671675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6815","nonce":3239671675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6813","nonce":3239671675}]},"public_addr":"172.21.15.39:6809/3239671675","cluster_addr":"172.21.15.39:6811/3239671675","heartbeat_back_addr":"172.21.15.39:6815/3239671675","heartbeat_front_addr":"172.21.15.39:6813/3239671675","state":["exists","up"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6801","nonce":1561628689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6803","nonce":1561628689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6807","nonce":1561628689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6805","nonce":1561628689}]},"public_addr":"172.21.15.39:6801/1561628689","cluster_addr":"172.21.15.39:6803/1561628689","heartbeat_back_addr":"172.21.15.39:6807/1561628689","heartbeat_front_addr":"172.21.15.39:6805/1561628689","state":["exists","up"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6825","nonce":1117132609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6827","nonce":1117132609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6831","nonce":1117132609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6829","nonce":1117132609}]},"public_addr":"172.21.15.39:6825/1117132609","cluster_addr":"172.21.15.39:6827/1117132609","heartbeat_back_addr":"172.21.15.39:6831/1117132609","heartbeat_front_addr":"172.21.15.39:6829/1117132609","state":["exists","up"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6817","nonce":2957971359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6819","nonce":2957971359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6823","nonce":2957971359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6821","nonce":2957971359}]},"public_addr":"172.21.15.39:6817/2957971359","cluster_addr":"172.21.15.39:6819/2957971359","heartbeat_back_addr":"172.21.15.39:6823/2957971359","heartbeat_front_addr":"172.21.15.39:6821/2957971359","state":["exists","up"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6801","nonce":575457324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6803","nonce":575457324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6807","nonce":575457324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6805","nonce":575457324}]},"public_addr":"172.21.15.117:6801/575457324","cluster_addr":"172.21.15.117:6803/575457324","heartbeat_back_addr":"172.21.15.117:6807/575457324","heartbeat_front_addr":"172.21.15.117:6805/575457324","state":["exists","up"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6809","nonce":1279363323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6811","nonce":1279363323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6815","nonce":1279363323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6813","nonce":1279363323}]},"public_addr":"172.21.15.117:6809/1279363323","cluster_addr":"172.21.15.117:6811/1279363323","heartbeat_back_addr":"172.21.15.117:6815/1279363323","heartbeat_front_addr":"172.21.15.117:6813/1279363323","state":["exists","up"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6817","nonce":277639924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6819","nonce":277639924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6823","nonce":277639924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6821","nonce":277639924}]},"public_addr":"172.21.15.117:6817/277639924","cluster_addr":"172.21.15.117:6819/277639924","heartbeat_back_addr":"172.21.15.117:6823/277639924","heartbeat_front_addr":"172.21.15.117:6821/277639924","state":["exists","up"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6825","nonce":3276057253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6827","nonce":3276057253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6831","nonce":3276057253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6829","nonce":3276057253}]},"public_addr":"172.21.15.117:6825/3276057253","cluster_addr":"172.21.15.117:6827/3276057253","heartbeat_back_addr":"172.21.15.117:6831/3276057253","heartbeat_front_addr":"172.21.15.117:6829/3276057253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.833700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.259217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.566490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.067523+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.555351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.587557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.235117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.750747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T08:42:03.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T08:42:03.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T08:42:03.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T08:42:03.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T08:42:03.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-22T08:42:03.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-22T08:42:03.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-22T08:42:03.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-22T08:42:03.922 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:42:03.923 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:42:03.924 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.925 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:42:03.928 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2024-09-22T08:42:03.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:42:03.929 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:42:03.932 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:42:03.933 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:03.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:42:03.935 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-22T08:42:03.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:42:04.567 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.575 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.576 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.583 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-09-22T08:42:04.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-22T08:42:04.597 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-22T08:42:04.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-22T08:42:04.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-22T08:42:04.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-09-22T08:42:04.619 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:04.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-22T08:42:04.636 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-22T08:42:04.653 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-22T08:42:04.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-22T08:42:05.590 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T08:42:05.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T08:42:05.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T08:42:05.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T08:42:05.618 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T08:42:05.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T08:42:05.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T08:42:05.666 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T08:42:06.212 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-22T08:42:06.233 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.279 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-22T08:42:06.296 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.297 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.297 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.298 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-22T08:42:06.309 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.310 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2024-09-22T08:42:06.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-22T08:42:06.314 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-22T08:42:06.317 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-22T08:42:06.319 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2024-09-22T08:42:06.325 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-22T08:42:06.330 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.331 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-22T08:42:06.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-22T08:42:06.344 DEBUG:teuthology.parallel:result is None 2024-09-22T08:42:06.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T08:42:06.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:42:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:06.697 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T08:42:06.709 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T08:42:04.902797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235728,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2887680,"data_stored":1751942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.682104"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.205624+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T08:42:03.205624+0000","last_peered":"2024-09-22T08:42:03.205624+0000","last_clean":"2024-09-22T08:42:03.205624+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T08:42:03.205624+0000","last_undegraded":"2024-09-22T08:42:03.205624+0000","last_fullsized":"2024-09-22T08:42:03.205624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.254801+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T08:42:02.254801+0000","last_peered":"2024-09-22T08:42:02.254801+0000","last_clean":"2024-09-22T08:42:02.254801+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T08:42:02.254801+0000","last_undegraded":"2024-09-22T08:42:02.254801+0000","last_fullsized":"2024-09-22T08:42:02.254801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.332073+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T08:42:03.332073+0000","last_peered":"2024-09-22T08:42:03.332073+0000","last_clean":"2024-09-22T08:42:03.332073+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T08:42:03.332073+0000","last_undegraded":"2024-09-22T08:42:03.332073+0000","last_fullsized":"2024-09-22T08:42:03.332073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.254750+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T08:42:02.254750+0000","last_peered":"2024-09-22T08:42:02.254750+0000","last_clean":"2024-09-22T08:42:02.254750+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T08:42:02.254750+0000","last_undegraded":"2024-09-22T08:42:02.254750+0000","last_fullsized":"2024-09-22T08:42:02.254750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.253657+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T08:42:02.253657+0000","last_peered":"2024-09-22T08:42:02.253657+0000","last_clean":"2024-09-22T08:42:02.253657+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T08:42:02.253657+0000","last_undegraded":"2024-09-22T08:42:02.253657+0000","last_fullsized":"2024-09-22T08:42:02.253657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.511615+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T08:42:02.511615+0000","last_peered":"2024-09-22T08:42:02.511615+0000","last_clean":"2024-09-22T08:42:02.511615+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T08:42:02.511615+0000","last_undegraded":"2024-09-22T08:42:02.511615+0000","last_fullsized":"2024-09-22T08:42:02.511615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.332027+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T08:42:03.332027+0000","last_peered":"2024-09-22T08:42:03.332027+0000","last_clean":"2024-09-22T08:42:03.332027+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T08:42:03.332027+0000","last_undegraded":"2024-09-22T08:42:03.332027+0000","last_fullsized":"2024-09-22T08:42:03.332027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.252322+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T08:42:02.252322+0000","last_peered":"2024-09-22T08:42:02.252322+0000","last_clean":"2024-09-22T08:42:02.252322+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T08:42:02.252322+0000","last_undegraded":"2024-09-22T08:42:02.252322+0000","last_fullsized":"2024-09-22T08:42:02.252322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.331767+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T08:42:03.331767+0000","last_peered":"2024-09-22T08:42:03.331767+0000","last_clean":"2024-09-22T08:42:03.331767+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T08:42:03.331767+0000","last_undegraded":"2024-09-22T08:42:03.331767+0000","last_fullsized":"2024-09-22T08:42:03.331767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:42:06.710 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T08:42:07.023 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:07.024 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T08:42:07.035 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T08:42:06.903143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235728,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2887680,"data_stored":1751942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.673906"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.205624+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T08:42:03.205624+0000","last_peered":"2024-09-22T08:42:03.205624+0000","last_clean":"2024-09-22T08:42:03.205624+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T08:42:03.205624+0000","last_undegraded":"2024-09-22T08:42:03.205624+0000","last_fullsized":"2024-09-22T08:42:03.205624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.254801+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T08:42:02.254801+0000","last_peered":"2024-09-22T08:42:02.254801+0000","last_clean":"2024-09-22T08:42:02.254801+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T08:42:02.254801+0000","last_undegraded":"2024-09-22T08:42:02.254801+0000","last_fullsized":"2024-09-22T08:42:02.254801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.332073+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T08:42:03.332073+0000","last_peered":"2024-09-22T08:42:03.332073+0000","last_clean":"2024-09-22T08:42:03.332073+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T08:42:03.332073+0000","last_undegraded":"2024-09-22T08:42:03.332073+0000","last_fullsized":"2024-09-22T08:42:03.332073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.254750+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T08:42:02.254750+0000","last_peered":"2024-09-22T08:42:02.254750+0000","last_clean":"2024-09-22T08:42:02.254750+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T08:42:02.254750+0000","last_undegraded":"2024-09-22T08:42:02.254750+0000","last_fullsized":"2024-09-22T08:42:02.254750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.253657+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T08:42:02.253657+0000","last_peered":"2024-09-22T08:42:02.253657+0000","last_clean":"2024-09-22T08:42:02.253657+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T08:42:02.253657+0000","last_undegraded":"2024-09-22T08:42:02.253657+0000","last_fullsized":"2024-09-22T08:42:02.253657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.511615+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T08:42:02.511615+0000","last_peered":"2024-09-22T08:42:02.511615+0000","last_clean":"2024-09-22T08:42:02.511615+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T08:42:02.511615+0000","last_undegraded":"2024-09-22T08:42:02.511615+0000","last_fullsized":"2024-09-22T08:42:02.511615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.332027+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T08:42:03.332027+0000","last_peered":"2024-09-22T08:42:03.332027+0000","last_clean":"2024-09-22T08:42:03.332027+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T08:42:03.332027+0000","last_undegraded":"2024-09-22T08:42:03.332027+0000","last_fullsized":"2024-09-22T08:42:03.332027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:02.252322+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T08:42:02.252322+0000","last_peered":"2024-09-22T08:42:02.252322+0000","last_clean":"2024-09-22T08:42:02.252322+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T08:42:02.252322+0000","last_undegraded":"2024-09-22T08:42:02.252322+0000","last_fullsized":"2024-09-22T08:42:02.252322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T08:42:03.331767+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T08:42:03.331767+0000","last_peered":"2024-09-22T08:42:03.331767+0000","last_clean":"2024-09-22T08:42:03.331767+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T08:42:03.331767+0000","last_undegraded":"2024-09-22T08:42:03.331767+0000","last_fullsized":"2024-09-22T08:42:03.331767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T08:42:07.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T08:42:07.036 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T08:42:07.036 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T08:42:07.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T08:42:07.394 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T08:42:07.394 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T08:42:07.407 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T08:42:07.407 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-22T08:42:07.424 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-22T08:42:07.424 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-22T08:42:07.454 DEBUG:teuthology.orchestra.run.smithi039:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-22T08:42:07.748 INFO:teuthology.orchestra.run.smithi039.stderr:........+.+++++++++++++++++++++++++++++++++++++++++++++*..+.+...+.........+........+............+......+++++++++++++++++++++++++++++++++++++++++++++*......+......+.+...............+..+......+......................+............+.....+......+.........+......+.+...+.....+............+......+...+....+...+..................+...........+....+..+....+.....+..................+..........+..+............................+...+.........+..........................+....+...+...........+.+...........+..........+........+.+......+...............+..+.............+.....+.........+......+.........+...+..........+........+....+++++ 2024-09-22T08:42:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:.............+......+..+...+......+.+..+...+.......+..+................+.....+...+......+.+...+.....+++++++++++++++++++++++++++++++++++++++++++++*..............+.+...+.....+....+..+++++++++++++++++++++++++++++++++++++++++++++*..............+...+.......+.........+..+...+.+.....+...+...+...+......+.+.....+...+.......+.........+...+.....................+..+.......+.................+....+.........+..+.+.........+.........+...............+...............+......+.........+.....+.......+..............+++++ 2024-09-22T08:42:07.892 INFO:teuthology.orchestra.run.smithi039.stderr:----- 2024-09-22T08:42:07.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-22T08:42:07.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo update-ca-trust 2024-09-22T08:42:09.123 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-22T08:42:09.152 DEBUG:teuthology.orchestra.run.smithi039:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi039.front.sepia.ceph.com 2024-09-22T08:42:09.268 INFO:teuthology.orchestra.run.smithi039.stderr:.+..+.+..+.......+.........+++++++++++++++++++++++++++++++++++++++*..+.......+.....+......+.........+.+...+......+...+.....+.............+..............+++++++++++++++++++++++++++++++++++++++*.....+.....+.+.....+.+..+............+...+......+.+...+......+..+..........+..+.+......+..................+...........+......+.+........+.......+........+....+...............+...+.....+...+....+..+.............+..+....+.....+....+...+...+.....+....+.....+..............................+.......+.........+.........+...+..+.+..+....+.....+..........+...+.....+.+..+...+.........................+..++++++ 2024-09-22T08:42:09.268 INFO:teuthology.orchestra.run.smithi039.stderr:..+...+............+.....+.........+....+...+..+...+.......+.....+.+..+..................+++++++++++++++++++++++++++++++++++++++*...+......+.........+....+.....+++++++++++++++++++++++++++++++++++++++*..+.........+.....+...................+..+....+..+.........+...............+....+.....+.+...+.....+.+......+.........+.....+.+.....+.........+.........+...+.......+......+.....+......+..........+...+..+......+...................+........+.......+.........++++++ 2024-09-22T08:42:09.268 INFO:teuthology.orchestra.run.smithi039.stderr:----- 2024-09-22T08:42:09.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:42:09.270 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:42:09.339 DEBUG:teuthology.orchestra.run.smithi039:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:42:09.417 INFO:teuthology.orchestra.run.smithi039.stderr:Certificate request self-signature ok 2024-09-22T08:42:09.418 INFO:teuthology.orchestra.run.smithi039.stderr:subject=CN=smithi039.front.sepia.ceph.com 2024-09-22T08:42:09.427 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-22T08:42:09.497 DEBUG:teuthology.orchestra.run.smithi039:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-22T08:42:09.568 INFO:teuthology.orchestra.run.smithi039.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-22T08:42:09.569 DEBUG:teuthology.orchestra.run.smithi039:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-22T08:42:09.638 INFO:teuthology.run_tasks:Running task rgw... 2024-09-22T08:42:09.653 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-22T08:42:09.653 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-22T08:42:09.653 INFO:tasks.rgw:Creating data pools 2024-09-22T08:42:09.653 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-22T08:42:09.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-22T08:42:10.087 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-22T08:42:12.360 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'default.rgw.buckets.data' created 2024-09-22T08:42:12.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-22T08:42:13.380 INFO:teuthology.orchestra.run.smithi039.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-22T08:42:13.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-22T08:42:14.386 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'default.rgw.buckets.index' created 2024-09-22T08:42:14.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-22T08:42:15.421 INFO:teuthology.orchestra.run.smithi039.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-22T08:42:15.452 DEBUG:tasks.rgw:Pools created 2024-09-22T08:42:15.452 INFO:tasks.rgw:Configuring compression type = random 2024-09-22T08:42:15.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:42:15.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:42:15.453 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:42:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:17.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.469+0000 7fe3ee5d9640 0 -- 172.21.15.39:0/1237894720 >> [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] conn(0x7fe2c4077480 msgr2=0x7fe2c4079940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:17.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.474+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.475+0000 7fe3ee5d9640 0 -- 172.21.15.39:0/3608645599 >> [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] conn(0x7fe2b4077570 msgr2=0x7fe2b4079a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 realm 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.476+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.477+0000 7fe3f2926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:17.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.477+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.478+0000 7fe3f2926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-22T08:42:17.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.478+0000 7fe3f2926800 20 searching for the correct realm 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.693+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 zone default found 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 4 Realm: () 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 zonegroup default 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:17.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:17.694+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:19.457+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:19.457+0000 7fe3f2926800 20 rados->read ofs=0 len=0 2024-09-22T08:42:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:19.459+0000 7fe3f2926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:19.459+0000 7fe3f2926800 20 started sync module instance, tier type = 2024-09-22T08:42:19.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:19.459+0000 7fe3f2926800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=0 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=1 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=2 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=3 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=4 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=5 2024-09-22T08:42:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.493+0000 7fe3f2926800 20 add_watcher() i=6 2024-09-22T08:42:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.494+0000 7fe3f2926800 20 add_watcher() i=7 2024-09-22T08:42:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.494+0000 7fe3f2926800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.494+0000 7fe3f2926800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-22T08:42:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.494+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-22T08:42:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.494+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-22T08:42:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-22T08:42:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-22T08:42:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-22T08:42:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.495+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-22T08:42:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-22T08:42:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.496+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-22T08:42:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-22T08:42:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-22T08:42:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.497+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.498+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-22T08:42:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-22T08:42:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.499+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-22T08:42:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.500+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-22T08:42:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.501+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-22T08:42:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-22T08:42:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.502+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-22T08:42:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.503+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-22T08:42:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.504+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.505+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-22T08:42:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.506+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-22T08:42:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-22T08:42:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.507+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-22T08:42:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.508+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-22T08:42:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.509+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-22T08:42:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.510+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-22T08:42:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.511+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-22T08:42:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.512+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-22T08:42:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.513+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-22T08:42:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-22T08:42:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.514+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-22T08:42:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.515+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-22T08:42:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.516+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-22T08:42:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.517+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-22T08:42:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.518+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-22T08:42:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.519+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.520+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.521+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.522+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-22T08:42:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.523+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-22T08:42:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-22T08:42:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-22T08:42:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.524+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.525+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.526+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.527+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-22T08:42:21.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.528+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.529+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-22T08:42:21.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.530+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.531+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.532+0000 7fe3f2926800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-22T08:42:21.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.532+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-22T08:42:21.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.534+0000 7fe3f2926800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-22T08:42:21.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.537+0000 7fe2a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:21.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.537+0000 7fe3f2926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:21.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:21.537+0000 7fe3f2926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.505+0000 7fe3f2926800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.505+0000 7fe3f2926800 5 note: GC not initialized 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.505+0000 7fe20b7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.506+0000 7fe3f2926800 20 init_complete bucket index max shards: 1 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.506+0000 7fe3f2926800 20 Filter name: none 2024-09-22T08:42:24.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.506+0000 7fe2097fa640 20 reqs_thread_entry: start 2024-09-22T08:42:24.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.544+0000 7fe2a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:24.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.546+0000 7fe3f2926800 20 remove_watcher() i=0 2024-09-22T08:42:24.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.546+0000 7fe3f2926800 2 removed watcher, disabling cache 2024-09-22T08:42:24.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.548+0000 7fe3f2926800 20 remove_watcher() i=1 2024-09-22T08:42:24.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.549+0000 7fe3f2926800 20 remove_watcher() i=2 2024-09-22T08:42:24.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.551+0000 7fe3f2926800 20 remove_watcher() i=3 2024-09-22T08:42:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.552+0000 7fe3f2926800 20 remove_watcher() i=4 2024-09-22T08:42:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.554+0000 7fe3f2926800 20 remove_watcher() i=5 2024-09-22T08:42:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.555+0000 7fe3f2926800 20 remove_watcher() i=6 2024-09-22T08:42:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.556+0000 7fe3f2926800 20 remove_watcher() i=7 2024-09-22T08:42:24.578 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-22T08:42:24.579 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:42:24.579 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:42:24.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-22T08:42:24.579 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-22T08:42:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:24.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.675+0000 7fcb4f52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:24.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.675+0000 7fcb4f52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:24.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.679+0000 7fc9a9ffb640 20 reqs_thread_entry: start 2024-09-22T08:42:24.697 INFO:teuthology.orchestra.run.smithi039.stdout:{"id":"530e834e-7701-4a35-ad82-1b0744ba8777","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:42:24.697 DEBUG:tasks.util.rgw: json result: {'id': '530e834e-7701-4a35-ad82-1b0744ba8777', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:42:24.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-22T08:42:24.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-22T08:42:24.698 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-22T08:42:24.755 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:24.756 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.791+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.792+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.792+0000 7f9ce9135800 20 realm 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.792+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.793+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.793+0000 7f9ce9135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.793+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.793+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.793+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.794+0000 7f9ce9135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.794+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.794+0000 7f9ce9135800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-22T08:42:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.794+0000 7f9ce9135800 20 searching for the correct realm 2024-09-22T08:42:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:24.796+0000 7f9ce5622640 0 -- 172.21.15.39:0/1029186157 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f9cd003e030 msgr2=0x7f9cd0016430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:42:25.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.003+0000 7f9cdffff640 0 -- 172.21.15.39:0/1029186157 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f9ce00a07e0 msgr2=0x7f9ce0068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:42:25.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.210+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:42:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados_obj.operate() r=0 bl.length=436 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 zone default found 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 4 Realm: () 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:42:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 zonegroup default 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.211+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.212+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.212+0000 7f9ce9135800 20 rados->read ofs=0 len=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.212+0000 7f9ce9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.212+0000 7f9ce9135800 20 started sync module instance, tier type = 2024-09-22T08:42:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.212+0000 7f9ce9135800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:42:25.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=0 2024-09-22T08:42:25.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=1 2024-09-22T08:42:25.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=2 2024-09-22T08:42:25.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=3 2024-09-22T08:42:25.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=4 2024-09-22T08:42:25.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.226+0000 7f9ce9135800 20 add_watcher() i=5 2024-09-22T08:42:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.228+0000 7f9ce9135800 20 add_watcher() i=6 2024-09-22T08:42:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.228+0000 7f9ce9135800 20 add_watcher() i=7 2024-09-22T08:42:25.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.228+0000 7f9ce9135800 2 all 8 watchers are set, enabling cache 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9b9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9ce9135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9ce9135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9ce9135800 5 note: GC not initialized 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9b99fe3640 20 reqs_thread_entry: start 2024-09-22T08:42:25.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9ce9135800 20 init_complete bucket index max shards: 1 2024-09-22T08:42:25.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9ce9135800 20 Filter name: none 2024-09-22T08:42:25.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.230+0000 7f9b0b7fe640 20 reqs_thread_entry: start 2024-09-22T08:42:25.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.240+0000 7f9b9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:42:25.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.243+0000 7f9ce9135800 20 remove_watcher() i=0 2024-09-22T08:42:25.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.243+0000 7f9ce9135800 2 removed watcher, disabling cache 2024-09-22T08:42:25.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.244+0000 7f9ce9135800 20 remove_watcher() i=1 2024-09-22T08:42:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.245+0000 7f9ce9135800 20 remove_watcher() i=2 2024-09-22T08:42:25.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.247+0000 7f9ce9135800 20 remove_watcher() i=3 2024-09-22T08:42:25.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.249+0000 7f9ce9135800 20 remove_watcher() i=4 2024-09-22T08:42:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.250+0000 7f9ce9135800 20 remove_watcher() i=5 2024-09-22T08:42:25.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.251+0000 7f9ce9135800 20 remove_watcher() i=6 2024-09-22T08:42:25.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.252+0000 7f9ce9135800 20 remove_watcher() i=7 2024-09-22T08:42:25.264 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-22T08:42:25.264 DEBUG:tasks.util.rgw: json result: [] 2024-09-22T08:42:25.264 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-22T08:42:25.265 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:42:25.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-22T08:42:25.265 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-22T08:42:25.329 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:25.329 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:25.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.355+0000 7f668ad24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.355+0000 7f668ad24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.359+0000 7f65497e2640 20 reqs_thread_entry: start 2024-09-22T08:42:25.375 INFO:teuthology.orchestra.run.smithi039.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-22T08:42:25.375 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-22T08:42:25.376 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:42:25.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-22T08:42:25.376 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-22T08:42:25.442 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:25.443 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:25.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.468+0000 7fdda662f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.468+0000 7fdda662f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.472+0000 7fdbea7fc640 20 reqs_thread_entry: start 2024-09-22T08:42:25.490 INFO:teuthology.orchestra.run.smithi039.stdout:{"id":"530e834e-7701-4a35-ad82-1b0744ba8777","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:42:25.491 DEBUG:tasks.util.rgw: json result: {'id': '530e834e-7701-4a35-ad82-1b0744ba8777', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:42:25.491 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-22T08:42:25.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:42:25.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-22T08:42:25.491 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-22T08:42:25.555 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:25.556 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.582+0000 7f6be9346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.582+0000 7f6be9346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.586+0000 7f6a9cff9640 20 reqs_thread_entry: start 2024-09-22T08:42:25.602 INFO:teuthology.orchestra.run.smithi039.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-22T08:42:25.603 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-22T08:42:25.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:42:25.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-22T08:42:25.603 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-22T08:42:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:42:25.669 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:42:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.695+0000 7f0639a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:42:25.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.695+0000 7f0639a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:42:25.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T08:42:25.699+0000 7f04737fe640 20 reqs_thread_entry: start 2024-09-22T08:42:25.718 INFO:teuthology.orchestra.run.smithi039.stdout:{"id":"530e834e-7701-4a35-ad82-1b0744ba8777","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-22T08:42:25.719 DEBUG:tasks.util.rgw: json result: {'id': '530e834e-7701-4a35-ad82-1b0744ba8777', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-22T08:42:25.719 INFO:tasks.rgw:Starting rgw... 2024-09-22T08:42:25.719 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-22T08:42:25.719 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-22T08:42:25.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo echo -n https://smithi039.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-22T08:42:25.760 INFO:teuthology.orchestra.run.smithi039.stdout:https://smithi039.front.sepia.ceph.com:443 2024-09-22T08:42:25.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-22T08:42:25.840 DEBUG:teuthology.orchestra.run.smithi039:> sudo keytool -import -alias smithi039.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-22T08:42:26.058 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-22T08:42:26.221 INFO:teuthology.orchestra.run.smithi039.stderr:Certificate was added to keystore 2024-09-22T08:42:26.249 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-22T08:42:26.249 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-22T08:42:26.250 DEBUG:teuthology.orchestra.run.smithi039:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-22T08:42:26.252 INFO:tasks.rgw.client.0:Started 2024-09-22T08:42:26.252 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:26.252 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:26.296 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:42:26.296 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:26.296 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:26.297 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:42:26.297 INFO:teuthology.orchestra.run.smithi039.stderr:curl: (7) Failed to connect to smithi039.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:42:27.298 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:27.331 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:27.331 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:27.331 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:42:27.332 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:42:27.333 INFO:teuthology.orchestra.run.smithi039.stderr:curl: (7) Failed to connect to smithi039.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:42:29.334 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:29.367 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:29.367 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:29.368 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:42:29.368 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:42:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:curl: (7) Failed to connect to smithi039.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:42:33.370 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:33.404 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:33.404 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:33.405 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:42:33.406 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:42:33.406 INFO:teuthology.orchestra.run.smithi039.stderr:curl: (7) Failed to connect to smithi039.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:42:41.407 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:41.440 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:41.440 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:41.441 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-22T08:42:41.442 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-22T08:42:41.442 INFO:teuthology.orchestra.run.smithi039.stderr:curl: (7) Failed to connect to smithi039.front.sepia.ceph.com port 443: Connection refused 2024-09-22T08:42:50.575 INFO:tasks.rgw.client.0.smithi039.stdout:2024-09-22T08:42:50.293+0000 a1c2240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-22T08:42:57.443 DEBUG:teuthology.orchestra.run.smithi039:> curl https://smithi039.front.sepia.ceph.com:443/ 2024-09-22T08:42:57.483 INFO:teuthology.orchestra.run.smithi039.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-22T08:42:57.483 INFO:teuthology.orchestra.run.smithi039.stderr: Dload Upload Total Spent Left Speed 2024-09-22T08:42:58.512 INFO:teuthology.orchestra.run.smithi039.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 181 0 --:--:-- 0:00:01 --:--:-- 181 2024-09-22T08:42:58.513 INFO:teuthology.orchestra.run.smithi039.stdout:anonymous 2024-09-22T08:42:58.514 INFO:teuthology.run_tasks:Running task tox... 2024-09-22T08:42:58.527 INFO:tasks.tox:Deploying tox from pip... 2024-09-22T08:42:58.527 DEBUG:teuthology.orchestra.run.smithi039:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-22T08:43:00.951 DEBUG:teuthology.orchestra.run.smithi039:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-22T08:43:01.483 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting tox==3.15.0 2024-09-22T08:43:01.546 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-22T08:43:01.859 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-22T08:43:01.873 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-22T08:43:02.091 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting six<2,>=1.14.0 2024-09-22T08:43:02.104 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:43:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting pluggy<1,>=0.12.0 2024-09-22T08:43:02.211 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-22T08:43:02.313 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting packaging>=14 2024-09-22T08:43:02.326 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-22T08:43:02.548 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting filelock<4,>=3.0.0 2024-09-22T08:43:02.561 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-22T08:43:02.705 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting toml>=0.9.4 2024-09-22T08:43:02.718 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-22T08:43:02.815 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting py<2,>=1.4.17 2024-09-22T08:43:02.828 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-22T08:43:02.950 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting distlib<1,>=0.3.7 2024-09-22T08:43:02.963 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-22T08:43:03.084 INFO:teuthology.orchestra.run.smithi039.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-22T08:43:03.099 INFO:teuthology.orchestra.run.smithi039.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-22T08:43:03.216 INFO:teuthology.orchestra.run.smithi039.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-22T08:43:04.041 INFO:teuthology.orchestra.run.smithi039.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-22T08:43:04.239 INFO:teuthology.orchestra.run.smithi039.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-22T08:43:04.239 INFO:teuthology.orchestra.run.smithi039.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-22T08:43:04.301 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:43:04.317 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:43:04.317 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:43:04.318 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:43:04.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:43:04.347 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:43:04.347 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:43:04.416 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:43:04.416 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:43:04.485 INFO:tasks.workunit:timeout=3h 2024-09-22T08:43:04.485 INFO:tasks.workunit:cleanup=True 2024-09-22T08:43:04.485 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:43:04.555 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:44:05.563 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 92% (11740/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:44:06.341 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:06.342 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:44:06.346 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:44:06.426 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:44:06.428 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:44:06.428 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:44:07.025 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:44:07.089 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:44:07.133 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:44:07.134 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:44:07.135 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:44:07.175 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:44:07.179 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:44:07.179 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:44:07.249 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-22T08:44:07.250 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-22T08:44:07.250 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:44:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-22T08:44:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:44:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:44:09.699 INFO:tasks.workunit.client.0.smithi039.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T08:44:09.699 INFO:tasks.workunit.client.0.smithi039.stderr:++ deactivate nondestructive 2024-09-22T08:44:09.699 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ unset VIRTUAL_ENV 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ export VIRTUAL_ENV 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PATH 2024-09-22T08:44:09.700 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -z '' ']' 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ PS1='(rgw) ' 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PS1 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T08:44:09.701 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install pip --upgrade 2024-09-22T08:44:09.939 INFO:tasks.workunit.client.0.smithi039.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:44:10.129 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting pip 2024-09-22T08:44:10.191 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:44:10.367 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: pip 2024-09-22T08:44:10.367 INFO:tasks.workunit.client.0.smithi039.stdout: Attempting uninstall: pip 2024-09-22T08:44:10.367 INFO:tasks.workunit.client.0.smithi039.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:44:10.531 INFO:tasks.workunit.client.0.smithi039.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:44:10.536 INFO:tasks.workunit.client.0.smithi039.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:44:11.312 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed pip-24.2 2024-09-22T08:44:11.558 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install boto3 2024-09-22T08:44:12.485 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting boto3 2024-09-22T08:44:12.526 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:44:13.225 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:44:13.238 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:44:13.387 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:44:13.401 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:44:13.530 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:44:13.543 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:44:13.665 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:44:13.679 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:44:13.802 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:44:13.816 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:44:14.147 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:44:14.161 INFO:tasks.workunit.client.0.smithi039.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:44:14.233 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:44:14.305 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:44:14.512 INFO:tasks.workunit.client.0.smithi039.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.6/12.6 MB 63.9 MB/s eta 0:00:00 2024-09-22T08:44:14.525 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:44:14.589 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:44:14.657 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:44:14.849 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:44:14.916 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:44:15.051 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:44:16.148 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:44:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-22T08:44:16.412 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-22T08:44:16.449 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:16.449 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:16.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.488+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 realm 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.489+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.491+0000 7f5cdf53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:16.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.491+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.491+0000 7f5cdf53e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:16.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.491+0000 7f5cdf53e800 20 searching for the correct realm 2024-09-22T08:44:16.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.494+0000 7f5cdbac1640 0 -- 172.21.15.39:0/2342588331 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5cd0069050 msgr2=0x7f5cd00ab420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:16.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.701+0000 7f5cdaabf640 0 -- 172.21.15.39:0/2342588331 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5cd40523f0 msgr2=0x7f5cd4052850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:16.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.908+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:16.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:16.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 zone default found 2024-09-22T08:44:16.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 4 Realm: () 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 zonegroup default 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.909+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 started sync module instance, tier type = 2024-09-22T08:44:16.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.910+0000 7f5cdf53e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=0 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=1 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=2 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=3 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=4 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=5 2024-09-22T08:44:16.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.925+0000 7f5cdf53e800 20 add_watcher() i=6 2024-09-22T08:44:16.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.927+0000 7f5cdf53e800 20 add_watcher() i=7 2024-09-22T08:44:16.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.927+0000 7f5cdf53e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:16.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.928+0000 7f5b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:16.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:16.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:16.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 5 note: GC not initialized 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5b90fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 20 Filter name: none 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5b0a7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.929+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:44:16.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.930+0000 7f5cdf53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5cdf53e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5cdf53e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5cdf53e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93840112851200 notifier 4532 bl.length()=593 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-22T08:44:16.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.932+0000 7f5bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-22T08:44:16.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5cdf53e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:44:16.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5cdf53e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:44:16.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5cdf53e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-22T08:44:16.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93840112844832 notifier 4532 bl.length()=186 2024-09-22T08:44:16.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-22T08:44:16.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.959+0000 7f5bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-22T08:44:16.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.962+0000 7f5b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:16.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.964+0000 7f5cdf53e800 20 remove_watcher() i=0 2024-09-22T08:44:16.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.964+0000 7f5cdf53e800 2 removed watcher, disabling cache 2024-09-22T08:44:16.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.966+0000 7f5cdf53e800 20 remove_watcher() i=1 2024-09-22T08:44:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.967+0000 7f5cdf53e800 20 remove_watcher() i=2 2024-09-22T08:44:16.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.968+0000 7f5cdf53e800 20 remove_watcher() i=3 2024-09-22T08:44:16.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.969+0000 7f5cdf53e800 20 remove_watcher() i=4 2024-09-22T08:44:16.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.970+0000 7f5cdf53e800 20 remove_watcher() i=5 2024-09-22T08:44:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.972+0000 7f5cdf53e800 20 remove_watcher() i=6 2024-09-22T08:44:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:16.973+0000 7f5cdf53e800 20 remove_watcher() i=7 2024-09-22T08:44:17.207 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:17.207 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:17.381 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:17.382 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:17.485 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:17.485 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:17.710 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:17.710 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.108 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.109 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.220 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.220 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.291 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.291 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.321 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.322 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.422 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.422 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.574 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.574 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.610 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.610 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.700 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.700 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.725 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.725 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.783 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.784 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.809 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.809 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.882 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:18.882 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:18.906 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: recalculated bucket check stats are correct 2024-09-22T08:44:18.906 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:18.908 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:44:18.938 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:18.938 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:18.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.978+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.979+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.979+0000 7f6014a12800 20 realm 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.979+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.980+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.980+0000 7f6014a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.980+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.980+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:18.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.980+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:18.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.981+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:18.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.981+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:18.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.981+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:18.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.982+0000 7f6014a12800 20 searching for the correct realm 2024-09-22T08:44:18.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:18.983+0000 7f60108cc640 0 -- 172.21.15.39:0/4021793895 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5ff8069000 msgr2=0x7f5ff8084120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:19.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.191+0000 7f6007fff640 0 -- 172.21.15.39:0/4021793895 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f60080aa440 msgr2=0x7f60080aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:19.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.398+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 20 zone default found 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 4 Realm: () 2024-09-22T08:44:19.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.399+0000 7f6014a12800 20 zonegroup default 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.400+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.400+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.400+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.400+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.400+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.401+0000 7f6014a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.401+0000 7f6014a12800 20 started sync module instance, tier type = 2024-09-22T08:44:19.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.401+0000 7f6014a12800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=0 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=1 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=2 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=3 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=4 2024-09-22T08:44:19.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.413+0000 7f6014a12800 20 add_watcher() i=5 2024-09-22T08:44:19.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.417+0000 7f6014a12800 20 add_watcher() i=6 2024-09-22T08:44:19.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.418+0000 7f6014a12800 20 add_watcher() i=7 2024-09-22T08:44:19.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.418+0000 7f6014a12800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:19.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.419+0000 7f5ec6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 5 note: GC not initialized 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f5ec5fdb640 20 reqs_thread_entry: start 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:19.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 20 Filter name: none 2024-09-22T08:44:19.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f5e377fe640 20 reqs_thread_entry: start 2024-09-22T08:44:19.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:19.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.420+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:19.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.421+0000 7f6014a12800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:19.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.425+0000 7f5ec6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:19.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.428+0000 7f6014a12800 20 remove_watcher() i=0 2024-09-22T08:44:19.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.428+0000 7f6014a12800 2 removed watcher, disabling cache 2024-09-22T08:44:19.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.429+0000 7f6014a12800 20 remove_watcher() i=1 2024-09-22T08:44:19.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.432+0000 7f6014a12800 20 remove_watcher() i=2 2024-09-22T08:44:19.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.433+0000 7f6014a12800 20 remove_watcher() i=3 2024-09-22T08:44:19.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.434+0000 7f6014a12800 20 remove_watcher() i=4 2024-09-22T08:44:19.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.435+0000 7f6014a12800 20 remove_watcher() i=5 2024-09-22T08:44:19.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.436+0000 7f6014a12800 20 remove_watcher() i=6 2024-09-22T08:44:19.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.437+0000 7f6014a12800 20 remove_watcher() i=7 2024-09-22T08:44:19.451 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:44:19.480 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:19.480 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:19.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.520+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 realm 2024-09-22T08:44:19.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.521+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.523+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:19.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.523+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.523+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:19.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.523+0000 7f1a4bb23800 20 searching for the correct realm 2024-09-22T08:44:19.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.526+0000 7f1a4800d640 0 -- 172.21.15.39:0/1048959836 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f1a3c015070 msgr2=0x7f1a3c017050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:19.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.530+0000 7f1a4700b640 0 -- 172.21.15.39:0/1048959836 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f1a4007b910 msgr2=0x7f1a40089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:19.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:19.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:19.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:19.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:19.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:19.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:19.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.737+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 zone default found 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 4 Realm: () 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 zonegroup default 2024-09-22T08:44:19.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.738+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.739+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.739+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.739+0000 7f1a4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.739+0000 7f1a4bb23800 20 started sync module instance, tier type = 2024-09-22T08:44:19.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.739+0000 7f1a4bb23800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:19.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=0 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=1 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=2 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=3 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=4 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=5 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.753+0000 7f1a4bb23800 20 add_watcher() i=6 2024-09-22T08:44:19.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.754+0000 7f1a4bb23800 20 add_watcher() i=7 2024-09-22T08:44:19.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.754+0000 7f1a4bb23800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:19.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.755+0000 7f18fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:19.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:19.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:19.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 5 note: GC not initialized 2024-09-22T08:44:19.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f18fcfe1640 20 reqs_thread_entry: start 2024-09-22T08:44:19.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:19.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 20 Filter name: none 2024-09-22T08:44:19.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f18767fc640 20 reqs_thread_entry: start 2024-09-22T08:44:19.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.756+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.757+0000 7f1a4bb23800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.758+0000 7f1a4bb23800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:19.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.758+0000 7f1a4bb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:19.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.759+0000 7f18fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:19.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.762+0000 7f1a4bb23800 20 remove_watcher() i=0 2024-09-22T08:44:19.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.762+0000 7f1a4bb23800 2 removed watcher, disabling cache 2024-09-22T08:44:19.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.763+0000 7f1a4bb23800 20 remove_watcher() i=1 2024-09-22T08:44:19.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.764+0000 7f1a4bb23800 20 remove_watcher() i=2 2024-09-22T08:44:19.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.766+0000 7f1a4bb23800 20 remove_watcher() i=3 2024-09-22T08:44:19.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.767+0000 7f1a4bb23800 20 remove_watcher() i=4 2024-09-22T08:44:19.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.768+0000 7f1a4bb23800 20 remove_watcher() i=5 2024-09-22T08:44:19.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.769+0000 7f1a4bb23800 20 remove_watcher() i=6 2024-09-22T08:44:19.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.770+0000 7f1a4bb23800 20 remove_watcher() i=7 2024-09-22T08:44:19.782 INFO:tasks.workunit.client.0.smithi039.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-22T08:44:19.782 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-22T08:44:19.782 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:19.783 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:44:19.817 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:19.817 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:19.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.856+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 realm 2024-09-22T08:44:19.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:19.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:19.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.858+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.859+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:19.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.859+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:19.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.860+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:19.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.860+0000 7f5b1180f800 20 searching for the correct realm 2024-09-22T08:44:19.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:19.862+0000 7f5b0d749640 0 -- 172.21.15.39:0/1080482180 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5af4036410 msgr2=0x7f5af4036870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:20.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.069+0000 7f5b0c747640 0 -- 172.21.15.39:0/1080482180 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5b04094410 msgr2=0x7f5b04094870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.276+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.277+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:20.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.277+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.277+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:20.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.277+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:20.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 zone default found 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 4 Realm: () 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 zonegroup default 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:20.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.278+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.279+0000 7f5b1180f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:20.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.279+0000 7f5b1180f800 20 started sync module instance, tier type = 2024-09-22T08:44:20.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.279+0000 7f5b1180f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=0 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=1 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=2 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=3 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=4 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=5 2024-09-22T08:44:20.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.293+0000 7f5b1180f800 20 add_watcher() i=6 2024-09-22T08:44:20.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.294+0000 7f5b1180f800 20 add_watcher() i=7 2024-09-22T08:44:20.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.294+0000 7f5b1180f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:20.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.295+0000 7f59c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:20.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f5b1180f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:20.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f5b1180f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f5b1180f800 5 note: GC not initialized 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f59c27e4640 20 reqs_thread_entry: start 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f5b1180f800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f5b1180f800 20 Filter name: none 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.296+0000 7f59bb7fe640 20 reqs_thread_entry: start 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:20.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:20.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:20.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:20.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:20.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.297+0000 7f5b1180f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.298+0000 7f5b1180f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.298+0000 7f5b1180f800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:44:20.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.299+0000 7f59c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:20.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.301+0000 7f5b1180f800 20 remove_watcher() i=0 2024-09-22T08:44:20.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.301+0000 7f5b1180f800 2 removed watcher, disabling cache 2024-09-22T08:44:20.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.303+0000 7f5b1180f800 20 remove_watcher() i=1 2024-09-22T08:44:20.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.304+0000 7f5b1180f800 20 remove_watcher() i=2 2024-09-22T08:44:20.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.305+0000 7f5b1180f800 20 remove_watcher() i=3 2024-09-22T08:44:20.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.306+0000 7f5b1180f800 20 remove_watcher() i=4 2024-09-22T08:44:20.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.307+0000 7f5b1180f800 20 remove_watcher() i=5 2024-09-22T08:44:20.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.310+0000 7f5b1180f800 20 remove_watcher() i=6 2024-09-22T08:44:20.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:20.311+0000 7f5b1180f800 20 remove_watcher() i=7 2024-09-22T08:44:20.325 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:44:20.760 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:44:22.193 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:22.193 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:22.293 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:22.295 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:44:22.329 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:22.329 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:22.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.570+0000 7f18adaf6640 0 --2- 172.21.15.39:0/221116529 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55a7d6a5bba0 0x55a7d6a7aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T08:44:22.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.572+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 20 realm 2024-09-22T08:44:22.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.574+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.575+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.575+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.576+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:22.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.576+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.576+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:22.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.576+0000 7f18b080d800 20 searching for the correct realm 2024-09-22T08:44:22.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.578+0000 7f18adaf6640 0 -- 172.21.15.39:0/221116529 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f18a00adc50 msgr2=0x7f18a00ac6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:22.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.583+0000 7f18ae2f7640 0 -- 172.21.15.39:0/221116529 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f18a8035410 msgr2=0x7f18a8035850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:22.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.589+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 zone default found 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 4 Realm: () 2024-09-22T08:44:22.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 zonegroup default 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.590+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.591+0000 7f18b080d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.591+0000 7f18b080d800 20 started sync module instance, tier type = 2024-09-22T08:44:22.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.591+0000 7f18b080d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=0 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=1 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=2 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=3 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=4 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=5 2024-09-22T08:44:22.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.605+0000 7f18b080d800 20 add_watcher() i=6 2024-09-22T08:44:22.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.606+0000 7f18b080d800 20 add_watcher() i=7 2024-09-22T08:44:22.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.606+0000 7f18b080d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:22.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.608+0000 7f1764fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.608+0000 7f18b080d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.608+0000 7f18b080d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.608+0000 7f18b080d800 5 note: GC not initialized 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.608+0000 7f16df7fe640 20 reqs_thread_entry: start 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f18b080d800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f18b080d800 20 Filter name: none 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f16dd7fa640 20 reqs_thread_entry: start 2024-09-22T08:44:22.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.609+0000 7f18b080d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 INFO: main: starting shard=0 2024-09-22T08:44:22.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:22.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:44:22.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.610+0000 7f18b080d800 20 INFO: main: done 2024-09-22T08:44:22.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.611+0000 7f1764fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:22.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.614+0000 7f18b080d800 20 remove_watcher() i=0 2024-09-22T08:44:22.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.614+0000 7f18b080d800 2 removed watcher, disabling cache 2024-09-22T08:44:22.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.615+0000 7f18b080d800 20 remove_watcher() i=1 2024-09-22T08:44:22.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.616+0000 7f18b080d800 20 remove_watcher() i=2 2024-09-22T08:44:22.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.618+0000 7f18b080d800 20 remove_watcher() i=3 2024-09-22T08:44:22.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.619+0000 7f18b080d800 20 remove_watcher() i=4 2024-09-22T08:44:22.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.620+0000 7f18b080d800 20 remove_watcher() i=5 2024-09-22T08:44:22.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.621+0000 7f18b080d800 20 remove_watcher() i=6 2024-09-22T08:44:22.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.622+0000 7f18b080d800 20 remove_watcher() i=7 2024-09-22T08:44:22.637 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:22.637 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:22.663 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:22.663 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:22.688 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:22.689 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:22.773 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:22.775 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:44:22.806 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:22.806 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:22.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.845+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 realm 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:22.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.847+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.848+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:22.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.848+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:22.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.849+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:22.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.849+0000 7f8c4c52e800 20 searching for the correct realm 2024-09-22T08:44:22.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.851+0000 7f8c4896c640 0 -- 172.21.15.39:0/2377911739 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8c30023040 msgr2=0x7f8c300347e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:22.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:22.855+0000 7f8c4796a640 0 -- 172.21.15.39:0/2377911739 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8c40021430 msgr2=0x7f8c400218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:23.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.062+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 zone default found 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 4 Realm: () 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:23.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 zonegroup default 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.063+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 started sync module instance, tier type = 2024-09-22T08:44:23.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.064+0000 7f8c4c52e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:23.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=0 2024-09-22T08:44:23.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=1 2024-09-22T08:44:23.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=2 2024-09-22T08:44:23.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=3 2024-09-22T08:44:23.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=4 2024-09-22T08:44:23.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=5 2024-09-22T08:44:23.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.078+0000 7f8c4c52e800 20 add_watcher() i=6 2024-09-22T08:44:23.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.083+0000 7f8c4c52e800 20 add_watcher() i=7 2024-09-22T08:44:23.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.083+0000 7f8c4c52e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:23.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.085+0000 7f8afefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:23.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:23.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:23.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 5 note: GC not initialized 2024-09-22T08:44:23.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8afdfdb640 20 reqs_thread_entry: start 2024-09-22T08:44:23.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:23.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 20 Filter name: none 2024-09-22T08:44:23.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8a6f7fe640 20 reqs_thread_entry: start 2024-09-22T08:44:23.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.086+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 INFO: main: starting shard=0 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.087+0000 7f8c4c52e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.088+0000 7f8c4c52e800 20 INFO: main: done 2024-09-22T08:44:23.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.088+0000 7f8afefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:23.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.091+0000 7f8c4c52e800 20 remove_watcher() i=0 2024-09-22T08:44:23.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.091+0000 7f8c4c52e800 2 removed watcher, disabling cache 2024-09-22T08:44:23.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.092+0000 7f8c4c52e800 20 remove_watcher() i=1 2024-09-22T08:44:23.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.094+0000 7f8c4c52e800 20 remove_watcher() i=2 2024-09-22T08:44:23.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.095+0000 7f8c4c52e800 20 remove_watcher() i=3 2024-09-22T08:44:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.096+0000 7f8c4c52e800 20 remove_watcher() i=4 2024-09-22T08:44:23.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.098+0000 7f8c4c52e800 20 remove_watcher() i=5 2024-09-22T08:44:23.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.099+0000 7f8c4c52e800 20 remove_watcher() i=6 2024-09-22T08:44:23.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.100+0000 7f8c4c52e800 20 remove_watcher() i=7 2024-09-22T08:44:23.114 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:23.114 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:23.140 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:23.140 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:23.223 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:23.225 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:44:23.256 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:23.256 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:23.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.295+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 20 realm 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.297+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.298+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.298+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.299+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:23.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.299+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.300+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:23.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.300+0000 7f2bab816800 20 searching for the correct realm 2024-09-22T08:44:23.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.300+0000 7f2ba6fe7640 0 -- 172.21.15.39:0/2910555760 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f2ba002c040 msgr2=0x7f2ba00754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:23.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.505+0000 7f2ba6fe7640 0 -- 172.21.15.39:0/2910555760 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7f2ba001b040 msgr2=0x7f2ba006d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:23.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:23.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:23.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:23.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:23.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:23.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:23.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.715+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 zone default found 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 4 Realm: () 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:23.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 zonegroup default 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.716+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.717+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.717+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.717+0000 7f2bab816800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.717+0000 7f2bab816800 20 started sync module instance, tier type = 2024-09-22T08:44:23.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.717+0000 7f2bab816800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:23.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=0 2024-09-22T08:44:23.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=1 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=2 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=3 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=4 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=5 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.730+0000 7f2bab816800 20 add_watcher() i=6 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.731+0000 7f2bab816800 20 add_watcher() i=7 2024-09-22T08:44:23.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.731+0000 7f2bab816800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:23.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.733+0000 7f2a5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.733+0000 7f2bab816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.733+0000 7f2bab816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.733+0000 7f2bab816800 5 note: GC not initialized 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f29d7fff640 20 reqs_thread_entry: start 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f2bab816800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f2bab816800 20 Filter name: none 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f29d5ffb640 20 reqs_thread_entry: start 2024-09-22T08:44:23.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:23.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.734+0000 7f2bab816800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:23.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:23.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:23.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 INFO: main: starting shard=0 2024-09-22T08:44:23.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:23.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:44:23.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.735+0000 7f2bab816800 20 INFO: main: done 2024-09-22T08:44:23.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.736+0000 7f2a5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:23.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.739+0000 7f2bab816800 20 remove_watcher() i=0 2024-09-22T08:44:23.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.739+0000 7f2bab816800 2 removed watcher, disabling cache 2024-09-22T08:44:23.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.740+0000 7f2bab816800 20 remove_watcher() i=1 2024-09-22T08:44:23.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.741+0000 7f2bab816800 20 remove_watcher() i=2 2024-09-22T08:44:23.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.742+0000 7f2bab816800 20 remove_watcher() i=3 2024-09-22T08:44:23.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.743+0000 7f2bab816800 20 remove_watcher() i=4 2024-09-22T08:44:23.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.745+0000 7f2bab816800 20 remove_watcher() i=5 2024-09-22T08:44:23.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.746+0000 7f2bab816800 20 remove_watcher() i=6 2024-09-22T08:44:23.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.747+0000 7f2bab816800 20 remove_watcher() i=7 2024-09-22T08:44:23.761 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:23.761 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:23.785 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:23.785 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:23.866 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:23.868 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:44:23.899 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:23.899 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:23.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.938+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 realm 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:23.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:23.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.940+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.941+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:23.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.941+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:23.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.942+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:23.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.942+0000 7f696071f800 20 searching for the correct realm 2024-09-22T08:44:23.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.944+0000 7f695cb8c640 0 -- 172.21.15.39:0/2010777922 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6944045040 msgr2=0x7f6944045930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:23.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:23.949+0000 7f6953fff640 0 -- 172.21.15.39:0/2010777922 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f69540bdb40 msgr2=0x7f69540a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:24.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:24.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:24.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:24.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:24.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.156+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 zone default found 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 4 Realm: () 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 zonegroup default 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.157+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.158+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.158+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.158+0000 7f696071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.158+0000 7f696071f800 20 started sync module instance, tier type = 2024-09-22T08:44:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.158+0000 7f696071f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=0 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=1 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=2 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=3 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=4 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=5 2024-09-22T08:44:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.182+0000 7f696071f800 20 add_watcher() i=6 2024-09-22T08:44:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.183+0000 7f696071f800 20 add_watcher() i=7 2024-09-22T08:44:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.183+0000 7f696071f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.184+0000 7f68127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:24.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:24.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 5 note: GC not initialized 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f68117e2640 20 reqs_thread_entry: start 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 20 Filter name: none 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f6782ffd640 20 reqs_thread_entry: start 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.185+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:24.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 INFO: main: starting shard=0 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:44:24.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.186+0000 7f696071f800 20 INFO: main: done 2024-09-22T08:44:24.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.187+0000 7f68127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:24.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.190+0000 7f696071f800 20 remove_watcher() i=0 2024-09-22T08:44:24.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.190+0000 7f696071f800 2 removed watcher, disabling cache 2024-09-22T08:44:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.191+0000 7f696071f800 20 remove_watcher() i=1 2024-09-22T08:44:24.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.192+0000 7f696071f800 20 remove_watcher() i=2 2024-09-22T08:44:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.194+0000 7f696071f800 20 remove_watcher() i=3 2024-09-22T08:44:24.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.195+0000 7f696071f800 20 remove_watcher() i=4 2024-09-22T08:44:24.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.196+0000 7f696071f800 20 remove_watcher() i=5 2024-09-22T08:44:24.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.198+0000 7f696071f800 20 remove_watcher() i=6 2024-09-22T08:44:24.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:24.199+0000 7f696071f800 20 remove_watcher() i=7 2024-09-22T08:44:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:24.238 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:44:24.653 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:44:25.081 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-22T08:44:25.081 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:25.082 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:44:25.115 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:25.115 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:25.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.155+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 realm 2024-09-22T08:44:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.157+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.159+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.159+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.159+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.159+0000 7fcd00b42800 20 searching for the correct realm 2024-09-22T08:44:25.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.161+0000 7fccfc085640 0 -- 172.21.15.39:0/2828024492 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fccec035040 msgr2=0x7fccec01a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:25.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.366+0000 7fccfc886640 0 -- 172.21.15.39:0/2828024492 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fccf4015070 msgr2=0x7fccf4068790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:25.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:25.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:25.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:25.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:25.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:25.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:25.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:25.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.372+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:25.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 zone default found 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 4 Realm: () 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 zonegroup default 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.373+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.374+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.374+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.374+0000 7fcd00b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.374+0000 7fcd00b42800 20 started sync module instance, tier type = 2024-09-22T08:44:25.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.374+0000 7fcd00b42800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:25.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=0 2024-09-22T08:44:25.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=1 2024-09-22T08:44:25.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=2 2024-09-22T08:44:25.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=3 2024-09-22T08:44:25.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=4 2024-09-22T08:44:25.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.387+0000 7fcd00b42800 20 add_watcher() i=5 2024-09-22T08:44:25.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.388+0000 7fcd00b42800 20 add_watcher() i=6 2024-09-22T08:44:25.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.390+0000 7fcd00b42800 20 add_watcher() i=7 2024-09-22T08:44:25.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.390+0000 7fcd00b42800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.392+0000 7fcbb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.392+0000 7fcd00b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.392+0000 7fcd00b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.392+0000 7fcd00b42800 5 note: GC not initialized 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcbb27e4640 20 reqs_thread_entry: start 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 20 Filter name: none 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcbab7fe640 20 reqs_thread_entry: start 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:25.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:25.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:25.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.393+0000 7fcd00b42800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.394+0000 7fcd00b42800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:25.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.396+0000 7fcd00b42800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-22T08:44:25.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.396+0000 7fcd00b42800 1 NOTICE: finished all shards (4 entries found) 2024-09-22T08:44:25.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.396+0000 7fcbb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:25.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.399+0000 7fcd00b42800 20 remove_watcher() i=0 2024-09-22T08:44:25.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.399+0000 7fcd00b42800 2 removed watcher, disabling cache 2024-09-22T08:44:25.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.400+0000 7fcd00b42800 20 remove_watcher() i=1 2024-09-22T08:44:25.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.402+0000 7fcd00b42800 20 remove_watcher() i=2 2024-09-22T08:44:25.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.403+0000 7fcd00b42800 20 remove_watcher() i=3 2024-09-22T08:44:25.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.404+0000 7fcd00b42800 20 remove_watcher() i=4 2024-09-22T08:44:25.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.405+0000 7fcd00b42800 20 remove_watcher() i=5 2024-09-22T08:44:25.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.406+0000 7fcd00b42800 20 remove_watcher() i=6 2024-09-22T08:44:25.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.407+0000 7fcd00b42800 20 remove_watcher() i=7 2024-09-22T08:44:25.420 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: unlinked entries are not listable 2024-09-22T08:44:25.420 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:25.423 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:25.423 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:25.537 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-22T08:44:25.537 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:25.539 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:25.539 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:25.611 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:25.611 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:25.672 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-22T08:44:25.672 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:25.674 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:44:25.709 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:25.709 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:25.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.748+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.749+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.749+0000 7ffa3012c800 20 realm 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.749+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.750+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.750+0000 7ffa3012c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.750+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.750+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.750+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.751+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:25.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.751+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.752+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:25.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.752+0000 7ffa3012c800 20 searching for the correct realm 2024-09-22T08:44:25.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.754+0000 7ffa2c53f640 0 -- 172.21.15.39:0/40648155 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ffa2001a040 msgr2=0x7ffa20057ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:25.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.759+0000 7ffa2b53d640 0 -- 172.21.15.39:0/40648155 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ffa24060230 msgr2=0x7ffa2400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:25.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.966+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:25.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:25.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 zone default found 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 4 Realm: () 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 zonegroup default 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.967+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.968+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.968+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.968+0000 7ffa3012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.968+0000 7ffa3012c800 20 started sync module instance, tier type = 2024-09-22T08:44:25.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.968+0000 7ffa3012c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:25.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=0 2024-09-22T08:44:25.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=1 2024-09-22T08:44:25.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=2 2024-09-22T08:44:25.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=3 2024-09-22T08:44:25.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=4 2024-09-22T08:44:25.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=5 2024-09-22T08:44:25.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.982+0000 7ffa3012c800 20 add_watcher() i=6 2024-09-22T08:44:25.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.984+0000 7ffa3012c800 20 add_watcher() i=7 2024-09-22T08:44:25.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.984+0000 7ffa3012c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:25.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.986+0000 7ff8e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.986+0000 7ffa3012c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.986+0000 7ffa3012c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.986+0000 7ffa3012c800 5 note: GC not initialized 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.986+0000 7ff8e0fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 Filter name: none 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ff85a7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:25.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:25.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.987+0000 7ffa3012c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.988+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.989+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.989+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:c state=0x564358ff59c8 s->prefetch_data=0 2024-09-22T08:44:25.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.989+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to ogvpp1jormrelvlb1mkesk4ugt17i3r9 2024-09-22T08:44:25.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.989+0000 7ffa3012c800 20 get_obj_state_impl: setting s->olh_tag to d1bgup6n6r9jxh68oxignq4uwwz3yqdg 2024-09-22T08:44:25.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.989+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d1bgup6n6r9jxh68oxignq4uwwz3yqdg 2024-09-22T08:44:25.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.991+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:25.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.994+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 olh_log_entry: epoch=3 op=3 key=c[TLrafVGgkAQgk6DUvlrIw-QE4FrYQea] 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:TLrafVGgkAQgk6DUvlrIw-QE4FrYQea_c state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 10 manifest: total_size = 22 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16212138206153682641 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:TLrafVGgkAQgk6DUvlrIw-QE4FrYQea_c state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:25.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 prepare_atomic_modification: state is not atomic. state=0x564359031488 2024-09-22T08:44:25.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:25.995+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.001+0000 7ff90affd640 20 handle_completion(): completion ok for obj=c[TLrafVGgkAQgk6DUvlrIw-QE4FrYQea] 2024-09-22T08:44:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.002+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.002+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.004+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.004+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.005+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:d state=0x564358ff59c8 s->prefetch_data=0 2024-09-22T08:44:26.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.005+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to pkndgktq4djyerpkbcpc36im2hyhjc6t 2024-09-22T08:44:26.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.005+0000 7ffa3012c800 20 get_obj_state_impl: setting s->olh_tag to 3bvkc2krd0b8en9c7fk9dut677iehr32 2024-09-22T08:44:26.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.005+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3bvkc2krd0b8en9c7fk9dut677iehr32 2024-09-22T08:44:26.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.009+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.014+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.014+0000 7ffa3012c800 20 olh_log_entry: epoch=3 op=3 key=d[4zMM2Cfew6CfoCV7Z69HGAcrXlu-zFg] 2024-09-22T08:44:26.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.014+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:4zMM2Cfew6CfoCV7Z69HGAcrXlu-zFg_d state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.015+0000 7ffa3012c800 10 manifest: total_size = 22 2024-09-22T08:44:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.015+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3479530503360415108 2024-09-22T08:44:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.015+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:4zMM2Cfew6CfoCV7Z69HGAcrXlu-zFg_d state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.015+0000 7ffa3012c800 20 prepare_atomic_modification: state is not atomic. state=0x564359031488 2024-09-22T08:44:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.015+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.019+0000 7ff90a7fc640 20 handle_completion(): completion ok for obj=d[4zMM2Cfew6CfoCV7Z69HGAcrXlu-zFg] 2024-09-22T08:44:26.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.023+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.023+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.025+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.025+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.025+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:e state=0x564358ff59c8 s->prefetch_data=0 2024-09-22T08:44:26.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.026+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to 4dtkq5goftq9wm3poo30u3mdx09fxmsd 2024-09-22T08:44:26.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.026+0000 7ffa3012c800 20 get_obj_state_impl: setting s->olh_tag to 0r3vadfa9o0ujcu9p7a7um8x84lqk8x7 2024-09-22T08:44:26.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.026+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0r3vadfa9o0ujcu9p7a7um8x84lqk8x7 2024-09-22T08:44:26.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.027+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.028+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:44:26.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 olh_log_entry: epoch=2 op=3 key=e[rwQRAkuQHBPOhQltd2w8AbHCAJrEnLF] 2024-09-22T08:44:26.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:rwQRAkuQHBPOhQltd2w8AbHCAJrEnLF_e state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 10 manifest: total_size = 22 2024-09-22T08:44:26.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10090005261505636815 2024-09-22T08:44:26.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:rwQRAkuQHBPOhQltd2w8AbHCAJrEnLF_e state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 prepare_atomic_modification: state is not atomic. state=0x564359031488 2024-09-22T08:44:26.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.029+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.034+0000 7ff90affd640 20 handle_completion(): completion ok for obj=e[rwQRAkuQHBPOhQltd2w8AbHCAJrEnLF] 2024-09-22T08:44:26.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.036+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:e state=0x564358ff59c8 s->prefetch_data=0 2024-09-22T08:44:26.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.036+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0r3vadfa9o0ujcu9p7a7um8x84lqk8x7 2024-09-22T08:44:26.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.043+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.044+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.044+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.044+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:f state=0x564359033f18 s->prefetch_data=0 2024-09-22T08:44:26.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.045+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to neuf20guoabm0f5x4smqtrx0xaqapwzd 2024-09-22T08:44:26.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.045+0000 7ffa3012c800 20 get_obj_state_impl: setting s->olh_tag to c1jox1v8asgyomqjo4vc4zghg0i5weyz 2024-09-22T08:44:26.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.045+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c1jox1v8asgyomqjo4vc4zghg0i5weyz 2024-09-22T08:44:26.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.048+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.049+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.049+0000 7ffa3012c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.049+0000 7ffa3012c800 20 olh_log_entry: epoch=2 op=3 key=f[qsN5Lw2GhOF7INH6vEqsr-ZAYW-D6WD] 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.049+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:qsN5Lw2GhOF7INH6vEqsr-ZAYW-D6WD_f state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.050+0000 7ffa3012c800 10 manifest: total_size = 22 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.050+0000 7ffa3012c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.700585395066446156 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.050+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:_:qsN5Lw2GhOF7INH6vEqsr-ZAYW-D6WD_f state=0x564359031488 s->prefetch_data=0 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.050+0000 7ffa3012c800 20 prepare_atomic_modification: state is not atomic. state=0x564359031488 2024-09-22T08:44:26.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.050+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.054+0000 7ff90a7fc640 20 handle_completion(): completion ok for obj=f[qsN5Lw2GhOF7INH6vEqsr-ZAYW-D6WD] 2024-09-22T08:44:26.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.058+0000 7ffa3012c800 20 get_obj_state: octx=0x564358d2a0f0 obj=check-bucket:f state=0x564359033f18 s->prefetch_data=0 2024-09-22T08:44:26.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.058+0000 7ffa3012c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c1jox1v8asgyomqjo4vc4zghg0i5weyz 2024-09-22T08:44:26.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.063+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.064+0000 7ffa3012c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.064+0000 7ffa3012c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-22T08:44:26.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.064+0000 7ffa3012c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:44:26.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.065+0000 7ff8e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:26.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.067+0000 7ffa3012c800 20 remove_watcher() i=0 2024-09-22T08:44:26.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.067+0000 7ffa3012c800 2 removed watcher, disabling cache 2024-09-22T08:44:26.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.068+0000 7ffa3012c800 20 remove_watcher() i=1 2024-09-22T08:44:26.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.069+0000 7ffa3012c800 20 remove_watcher() i=2 2024-09-22T08:44:26.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.070+0000 7ffa3012c800 20 remove_watcher() i=3 2024-09-22T08:44:26.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.072+0000 7ffa3012c800 20 remove_watcher() i=4 2024-09-22T08:44:26.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.073+0000 7ffa3012c800 20 remove_watcher() i=5 2024-09-22T08:44:26.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.074+0000 7ffa3012c800 20 remove_watcher() i=6 2024-09-22T08:44:26.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.075+0000 7ffa3012c800 20 remove_watcher() i=7 2024-09-22T08:44:26.089 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.089 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.111 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.111 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.134 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.134 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.156 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.156 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.176 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-22T08:44:26.176 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:26.176 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.177 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.244 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.244 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.267 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.267 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.292 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.292 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.316 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.316 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.340 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-22T08:44:26.341 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:26.342 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-22T08:44:26.375 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:26.376 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:26.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.414+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 20 realm 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.416+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.417+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.417+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.418+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:26.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.418+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.418+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:26.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.418+0000 7f0548f36800 20 searching for the correct realm 2024-09-22T08:44:26.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.421+0000 7f05454b8640 0 -- 172.21.15.39:0/2284608254 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f0538052170 msgr2=0x7f053807fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:26.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.425+0000 7f05444b6640 0 -- 172.21.15.39:0/2284608254 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f053c075160 msgr2=0x7f053c0902b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:26.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:26.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:26.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:26.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:26.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:26.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:26.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.632+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 zone default found 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 4 Realm: () 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:26.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 zonegroup default 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.633+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.634+0000 7f0548f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.634+0000 7f0548f36800 20 started sync module instance, tier type = 2024-09-22T08:44:26.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.634+0000 7f0548f36800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=0 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=1 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=2 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=3 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=4 2024-09-22T08:44:26.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.649+0000 7f0548f36800 20 add_watcher() i=5 2024-09-22T08:44:26.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.654+0000 7f0548f36800 20 add_watcher() i=6 2024-09-22T08:44:26.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.654+0000 7f0548f36800 20 add_watcher() i=7 2024-09-22T08:44:26.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.654+0000 7f0548f36800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:26.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f03fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:26.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f0548f36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:26.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f0548f36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:26.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f0548f36800 5 note: GC not initialized 2024-09-22T08:44:26.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f03fa7e4640 20 reqs_thread_entry: start 2024-09-22T08:44:26.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.656+0000 7f0548f36800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:26.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 20 Filter name: none 2024-09-22T08:44:26.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f03f3fff640 20 reqs_thread_entry: start 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:26.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.657+0000 7f0548f36800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:26.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:26.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:26.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:44:26.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.658+0000 7f0548f36800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:44:26.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.659+0000 7f03fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:26.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.662+0000 7f0548f36800 20 remove_watcher() i=0 2024-09-22T08:44:26.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.662+0000 7f0548f36800 2 removed watcher, disabling cache 2024-09-22T08:44:26.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.663+0000 7f0548f36800 20 remove_watcher() i=1 2024-09-22T08:44:26.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.664+0000 7f0548f36800 20 remove_watcher() i=2 2024-09-22T08:44:26.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.666+0000 7f0548f36800 20 remove_watcher() i=3 2024-09-22T08:44:26.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.667+0000 7f0548f36800 20 remove_watcher() i=4 2024-09-22T08:44:26.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.668+0000 7f0548f36800 20 remove_watcher() i=5 2024-09-22T08:44:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.669+0000 7f0548f36800 20 remove_watcher() i=6 2024-09-22T08:44:26.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.670+0000 7f0548f36800 20 remove_watcher() i=7 2024-09-22T08:44:26.686 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.686 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.811 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:26.811 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:26.860 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:44:26.891 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:26.891 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:26.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.931+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 realm 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:26.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:26.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.933+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.934+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:26.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.934+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:26.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.935+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:26.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.935+0000 7f077f934800 20 searching for the correct realm 2024-09-22T08:44:26.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.936+0000 7f077b6b7640 0 -- 172.21.15.39:0/2272584520 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f077402e070 msgr2=0x7f077403c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:26.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:26.939+0000 7f077b6b7640 0 -- 172.21.15.39:0/2272584520 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7f0768003c90 msgr2=0x7f077402f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.148+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:27.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 zone default found 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 4 Realm: () 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 zonegroup default 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.149+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 started sync module instance, tier type = 2024-09-22T08:44:27.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.150+0000 7f077f934800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=0 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=1 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=2 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=3 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=4 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=5 2024-09-22T08:44:27.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.165+0000 7f077f934800 20 add_watcher() i=6 2024-09-22T08:44:27.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.170+0000 7f077f934800 20 add_watcher() i=7 2024-09-22T08:44:27.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.170+0000 7f077f934800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:27.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.172+0000 7f0631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.172+0000 7f077f934800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.172+0000 7f077f934800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.172+0000 7f077f934800 5 note: GC not initialized 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.172+0000 7f0630fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f077f934800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f077f934800 20 Filter name: none 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f05aa7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:27.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.173+0000 7f077f934800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:27.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 INFO: main: starting shard=0 2024-09-22T08:44:27.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:27.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:44:27.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.174+0000 7f077f934800 20 INFO: main: done 2024-09-22T08:44:27.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.175+0000 7f0631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:27.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.177+0000 7f077f934800 20 remove_watcher() i=0 2024-09-22T08:44:27.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.177+0000 7f077f934800 2 removed watcher, disabling cache 2024-09-22T08:44:27.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.179+0000 7f077f934800 20 remove_watcher() i=1 2024-09-22T08:44:27.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.180+0000 7f077f934800 20 remove_watcher() i=2 2024-09-22T08:44:27.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.181+0000 7f077f934800 20 remove_watcher() i=3 2024-09-22T08:44:27.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.183+0000 7f077f934800 20 remove_watcher() i=4 2024-09-22T08:44:27.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.184+0000 7f077f934800 20 remove_watcher() i=5 2024-09-22T08:44:27.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.185+0000 7f077f934800 20 remove_watcher() i=6 2024-09-22T08:44:27.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.186+0000 7f077f934800 20 remove_watcher() i=7 2024-09-22T08:44:27.200 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:44:27.231 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:27.231 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:27.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.269+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 20 realm 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.271+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.272+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.272+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.273+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:27.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.273+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.273+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:27.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.273+0000 7f8b45140800 20 searching for the correct realm 2024-09-22T08:44:27.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.275+0000 7f8b416ee640 0 -- 172.21.15.39:0/3700742464 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8b2c0a3070 msgr2=0x7f8b2c09b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:27.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.481+0000 7f8b3bfff640 0 -- 172.21.15.39:0/3700742464 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8b3c043f50 msgr2=0x7f8b3c08f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:27.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.688+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 zone default found 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 4 Realm: () 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 zonegroup default 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.689+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.690+0000 7f8b45140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.690+0000 7f8b45140800 20 started sync module instance, tier type = 2024-09-22T08:44:27.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.690+0000 7f8b45140800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=0 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=1 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=2 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=3 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=4 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=5 2024-09-22T08:44:27.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.709+0000 7f8b45140800 20 add_watcher() i=6 2024-09-22T08:44:27.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.713+0000 7f8b45140800 20 add_watcher() i=7 2024-09-22T08:44:27.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.713+0000 7f8b45140800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:27.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f89f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:27.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f8b45140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:27.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f8b45140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:27.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f8b45140800 5 note: GC not initialized 2024-09-22T08:44:27.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f89f5fe3640 20 reqs_thread_entry: start 2024-09-22T08:44:27.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f8b45140800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:27.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f8b45140800 20 Filter name: none 2024-09-22T08:44:27.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.716+0000 7f89677fe640 20 reqs_thread_entry: start 2024-09-22T08:44:27.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 INFO: main: starting shard=0 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.717+0000 7f8b45140800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.718+0000 7f8b45140800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-22T08:44:27.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.718+0000 7f8b45140800 20 INFO: main: done 2024-09-22T08:44:27.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.719+0000 7f89f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:27.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.721+0000 7f8b45140800 20 remove_watcher() i=0 2024-09-22T08:44:27.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.721+0000 7f8b45140800 2 removed watcher, disabling cache 2024-09-22T08:44:27.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.723+0000 7f8b45140800 20 remove_watcher() i=1 2024-09-22T08:44:27.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.724+0000 7f8b45140800 20 remove_watcher() i=2 2024-09-22T08:44:27.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.725+0000 7f8b45140800 20 remove_watcher() i=3 2024-09-22T08:44:27.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.727+0000 7f8b45140800 20 remove_watcher() i=4 2024-09-22T08:44:27.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.728+0000 7f8b45140800 20 remove_watcher() i=5 2024-09-22T08:44:27.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.729+0000 7f8b45140800 20 remove_watcher() i=6 2024-09-22T08:44:27.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.730+0000 7f8b45140800 20 remove_watcher() i=7 2024-09-22T08:44:27.742 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-22T08:44:27.742 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:27.744 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:44:27.776 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:27.776 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:27.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.815+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 realm 2024-09-22T08:44:27.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.817+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.818+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:27.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.818+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:27.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.819+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:27.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.819+0000 7f464260f800 20 searching for the correct realm 2024-09-22T08:44:27.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.820+0000 7f46400f9640 0 -- 172.21.15.39:0/2250748067 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f4638004040 msgr2=0x7f46380668d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:27.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:27.823+0000 7f46400f9640 0 -- 172.21.15.39:0/2250748067 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7f4638032060 msgr2=0x7f46380a00d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.032+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 zone default found 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 4 Realm: () 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 zonegroup default 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.033+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.034+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.034+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.034+0000 7f464260f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.034+0000 7f464260f800 20 started sync module instance, tier type = 2024-09-22T08:44:28.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.034+0000 7f464260f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=0 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=1 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=2 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=3 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=4 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=5 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.052+0000 7f464260f800 20 add_watcher() i=6 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.053+0000 7f464260f800 20 add_watcher() i=7 2024-09-22T08:44:28.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.053+0000 7f464260f800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.057+0000 7f44f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 5 note: GC not initialized 2024-09-22T08:44:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f44f5fdb640 20 reqs_thread_entry: start 2024-09-22T08:44:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 20 Filter name: none 2024-09-22T08:44:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f44677fe640 20 reqs_thread_entry: start 2024-09-22T08:44:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.058+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.059+0000 7f464260f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.060+0000 7f464260f800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-22T08:44:28.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.060+0000 7f464260f800 1 NOTICE: finished all shards (2 entries found) 2024-09-22T08:44:28.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.061+0000 7f44f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:28.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.063+0000 7f464260f800 20 remove_watcher() i=0 2024-09-22T08:44:28.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.063+0000 7f464260f800 2 removed watcher, disabling cache 2024-09-22T08:44:28.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.064+0000 7f464260f800 20 remove_watcher() i=1 2024-09-22T08:44:28.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.066+0000 7f464260f800 20 remove_watcher() i=2 2024-09-22T08:44:28.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.067+0000 7f464260f800 20 remove_watcher() i=3 2024-09-22T08:44:28.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.069+0000 7f464260f800 20 remove_watcher() i=4 2024-09-22T08:44:28.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.070+0000 7f464260f800 20 remove_watcher() i=5 2024-09-22T08:44:28.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.075+0000 7f464260f800 20 remove_watcher() i=6 2024-09-22T08:44:28.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.076+0000 7f464260f800 20 remove_watcher() i=7 2024-09-22T08:44:28.087 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-22T08:44:28.088 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:28.089 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:44:28.122 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:28.123 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:28.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.161+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 realm 2024-09-22T08:44:28.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:28.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.163+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.164+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:28.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.164+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.165+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:28.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.165+0000 7f316a613800 20 searching for the correct realm 2024-09-22T08:44:28.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.167+0000 7f3166593640 0 -- 172.21.15.39:0/114653016 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f315c0cd270 msgr2=0x7f315c009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:28.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.372+0000 7f3165591640 0 -- 172.21.15.39:0/114653016 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f31600779b0 msgr2=0x7f3160008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:28.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.578+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 zone default found 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 4 Realm: () 2024-09-22T08:44:28.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 zonegroup default 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.579+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.580+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.580+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.580+0000 7f316a613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.580+0000 7f316a613800 20 started sync module instance, tier type = 2024-09-22T08:44:28.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.580+0000 7f316a613800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:28.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=0 2024-09-22T08:44:28.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=1 2024-09-22T08:44:28.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=2 2024-09-22T08:44:28.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=3 2024-09-22T08:44:28.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=4 2024-09-22T08:44:28.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=5 2024-09-22T08:44:28.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.596+0000 7f316a613800 20 add_watcher() i=6 2024-09-22T08:44:28.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.597+0000 7f316a613800 20 add_watcher() i=7 2024-09-22T08:44:28.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.597+0000 7f316a613800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:28.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.598+0000 7f30177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 5 note: GC not initialized 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f30167fc640 20 reqs_thread_entry: start 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 20 Filter name: none 2024-09-22T08:44:28.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f2f87fff640 20 reqs_thread_entry: start 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.599+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:28.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.600+0000 7f316a613800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.601+0000 7f316a613800 20 get_obj_state: octx=0x55ded68660f0 obj=check-bucket:c state=0x55ded6b31cb8 s->prefetch_data=0 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.601+0000 7f316a613800 20 get_obj_state: setting s->obj_tag to ogvpp1jormrelvlb1mkesk4ugt17i3r9 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.601+0000 7f316a613800 20 get_obj_state_impl: setting s->olh_tag to d1bgup6n6r9jxh68oxignq4uwwz3yqdg 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.601+0000 7f316a613800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.602+0000 7f316a613800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.602+0000 7f316a613800 20 olh_log_entry: epoch=4 op=3 key=c[9h95tBz6UjjGNEc3LPMhJyhvT.ffk8s] 2024-09-22T08:44:28.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.602+0000 7f316a613800 20 get_obj_state: octx=0x55ded6b6b7b0 obj=check-bucket:_:9h95tBz6UjjGNEc3LPMhJyhvT.ffk8s_c state=0x55ded6b30ad8 s->prefetch_data=0 2024-09-22T08:44:28.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.603+0000 7f316a613800 20 get_obj_state: octx=0x55ded6b6b7b0 obj=check-bucket:c state=0x55ded6b335d8 s->prefetch_data=0 2024-09-22T08:44:28.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.604+0000 7f316a613800 20 get_obj_state: setting s->obj_tag to ogvpp1jormrelvlb1mkesk4ugt17i3r9 2024-09-22T08:44:28.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.604+0000 7f316a613800 20 get_obj_state_impl: setting s->olh_tag to d1bgup6n6r9jxh68oxignq4uwwz3yqdg 2024-09-22T08:44:28.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.604+0000 7f316a613800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d1bgup6n6r9jxh68oxignq4uwwz3yqdg 2024-09-22T08:44:28.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.615+0000 7f316a613800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.622+0000 7f316a613800 20 get_obj_state: octx=0x55ded68660f0 obj=check-bucket:d state=0x55ded6b317a8 s->prefetch_data=0 2024-09-22T08:44:28.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.622+0000 7f316a613800 20 get_obj_state: setting s->obj_tag to pkndgktq4djyerpkbcpc36im2hyhjc6t 2024-09-22T08:44:28.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.622+0000 7f316a613800 20 get_obj_state_impl: setting s->olh_tag to 3bvkc2krd0b8en9c7fk9dut677iehr32 2024-09-22T08:44:28.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.622+0000 7f316a613800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.623+0000 7f316a613800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-22T08:44:28.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.623+0000 7f316a613800 20 olh_log_entry: epoch=4 op=3 key=d[kqudqakHyo2J08AtuW2-gw2ozk02aUP] 2024-09-22T08:44:28.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.623+0000 7f316a613800 20 get_obj_state: octx=0x55ded6b6b7b0 obj=check-bucket:_:kqudqakHyo2J08AtuW2-gw2ozk02aUP_d state=0x55ded6b6fee8 s->prefetch_data=0 2024-09-22T08:44:28.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.625+0000 7f316a613800 20 get_obj_state: octx=0x55ded6b6b7b0 obj=check-bucket:d state=0x55ded6b2ca98 s->prefetch_data=0 2024-09-22T08:44:28.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.625+0000 7f316a613800 20 get_obj_state: setting s->obj_tag to pkndgktq4djyerpkbcpc36im2hyhjc6t 2024-09-22T08:44:28.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.625+0000 7f316a613800 20 get_obj_state_impl: setting s->olh_tag to 3bvkc2krd0b8en9c7fk9dut677iehr32 2024-09-22T08:44:28.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.625+0000 7f316a613800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3bvkc2krd0b8en9c7fk9dut677iehr32 2024-09-22T08:44:28.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.631+0000 7f316a613800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:28.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.633+0000 7f316a613800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-22T08:44:28.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.633+0000 7f316a613800 1 NOTICE: finished all shards (2 entries removed) 2024-09-22T08:44:28.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.634+0000 7f30177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:28.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.636+0000 7f316a613800 20 remove_watcher() i=0 2024-09-22T08:44:28.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.636+0000 7f316a613800 2 removed watcher, disabling cache 2024-09-22T08:44:28.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.638+0000 7f316a613800 20 remove_watcher() i=1 2024-09-22T08:44:28.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.639+0000 7f316a613800 20 remove_watcher() i=2 2024-09-22T08:44:28.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.640+0000 7f316a613800 20 remove_watcher() i=3 2024-09-22T08:44:28.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.641+0000 7f316a613800 20 remove_watcher() i=4 2024-09-22T08:44:28.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.642+0000 7f316a613800 20 remove_watcher() i=5 2024-09-22T08:44:28.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.643+0000 7f316a613800 20 remove_watcher() i=6 2024-09-22T08:44:28.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.644+0000 7f316a613800 20 remove_watcher() i=7 2024-09-22T08:44:28.659 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:44:28.691 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:28.691 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:28.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.729+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 realm 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:28.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.731+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.733+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:28.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.733+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:28.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.733+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:28.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.733+0000 7f7903546800 20 searching for the correct realm 2024-09-22T08:44:28.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.735+0000 7f7901838640 0 -- 172.21.15.39:0/256012020 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f78f800b040 msgr2=0x7f78f802b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:28.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:28.941+0000 7f7900836640 0 -- 172.21.15.39:0/256012020 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f78fc0c2be0 msgr2=0x7f78fc0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:29.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:29.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.148+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 zone default found 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 4 Realm: () 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 zonegroup default 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.149+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.150+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.150+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.150+0000 7f7903546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.150+0000 7f7903546800 20 started sync module instance, tier type = 2024-09-22T08:44:29.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.150+0000 7f7903546800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=0 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=1 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=2 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=3 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=4 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=5 2024-09-22T08:44:29.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.167+0000 7f7903546800 20 add_watcher() i=6 2024-09-22T08:44:29.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.169+0000 7f7903546800 20 add_watcher() i=7 2024-09-22T08:44:29.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.169+0000 7f7903546800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:29.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.171+0000 7f77b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.171+0000 7f7903546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:29.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.171+0000 7f7903546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:29.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.171+0000 7f7903546800 5 note: GC not initialized 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.171+0000 7f77b67e4640 20 reqs_thread_entry: start 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7903546800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7903546800 20 Filter name: none 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7727fff640 20 reqs_thread_entry: start 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.172+0000 7f7903546800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 INFO: main: starting shard=0 2024-09-22T08:44:29.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:29.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:44:29.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.173+0000 7f7903546800 20 INFO: main: done 2024-09-22T08:44:29.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.174+0000 7f77b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.179+0000 7f7903546800 20 remove_watcher() i=0 2024-09-22T08:44:29.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.179+0000 7f7903546800 2 removed watcher, disabling cache 2024-09-22T08:44:29.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.181+0000 7f7903546800 20 remove_watcher() i=1 2024-09-22T08:44:29.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.182+0000 7f7903546800 20 remove_watcher() i=2 2024-09-22T08:44:29.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.183+0000 7f7903546800 20 remove_watcher() i=3 2024-09-22T08:44:29.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.184+0000 7f7903546800 20 remove_watcher() i=4 2024-09-22T08:44:29.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.186+0000 7f7903546800 20 remove_watcher() i=5 2024-09-22T08:44:29.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.187+0000 7f7903546800 20 remove_watcher() i=6 2024-09-22T08:44:29.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.188+0000 7f7903546800 20 remove_watcher() i=7 2024-09-22T08:44:29.202 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:44:29.234 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:29.234 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:29.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.273+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 realm 2024-09-22T08:44:29.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.275+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.276+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.276+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.277+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:29.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.277+0000 7fd278f2a800 20 searching for the correct realm 2024-09-22T08:44:29.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.279+0000 7fd2754ae640 0 -- 172.21.15.39:0/604261209 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd25c047400 msgr2=0x7fd25c047820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.485+0000 7fd2744ac640 0 -- 172.21.15.39:0/604261209 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd26c00e070 msgr2=0x7fd26c010070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.691+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.692+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.692+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.692+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.692+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 zone default found 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 4 Realm: () 2024-09-22T08:44:29.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 zonegroup default 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.693+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.694+0000 7fd278f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.694+0000 7fd278f2a800 20 started sync module instance, tier type = 2024-09-22T08:44:29.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.694+0000 7fd278f2a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=0 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=1 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=2 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=3 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=4 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=5 2024-09-22T08:44:29.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.709+0000 7fd278f2a800 20 add_watcher() i=6 2024-09-22T08:44:29.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.710+0000 7fd278f2a800 20 add_watcher() i=7 2024-09-22T08:44:29.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.710+0000 7fd278f2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:29.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd12afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd278f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd278f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd278f2a800 5 note: GC not initialized 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd129fe3640 20 reqs_thread_entry: start 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.712+0000 7fd278f2a800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 Filter name: none 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd09b7fe640 20 reqs_thread_entry: start 2024-09-22T08:44:29.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 INFO: main: starting shard=0 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.713+0000 7fd278f2a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.714+0000 7fd278f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T08:44:29.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.714+0000 7fd278f2a800 20 INFO: main: done 2024-09-22T08:44:29.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.715+0000 7fd12afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:29.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.717+0000 7fd278f2a800 20 remove_watcher() i=0 2024-09-22T08:44:29.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.717+0000 7fd278f2a800 2 removed watcher, disabling cache 2024-09-22T08:44:29.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.719+0000 7fd278f2a800 20 remove_watcher() i=1 2024-09-22T08:44:29.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.720+0000 7fd278f2a800 20 remove_watcher() i=2 2024-09-22T08:44:29.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.721+0000 7fd278f2a800 20 remove_watcher() i=3 2024-09-22T08:44:29.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.722+0000 7fd278f2a800 20 remove_watcher() i=4 2024-09-22T08:44:29.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.724+0000 7fd278f2a800 20 remove_watcher() i=5 2024-09-22T08:44:29.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.725+0000 7fd278f2a800 20 remove_watcher() i=6 2024-09-22T08:44:29.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.726+0000 7fd278f2a800 20 remove_watcher() i=7 2024-09-22T08:44:29.738 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-22T08:44:29.739 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:29.740 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-22T08:44:29.772 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:29.772 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:29.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.811+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 realm 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.813+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.814+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:29.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.814+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:29.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.815+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:29.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.815+0000 7fe7cdd2e800 20 searching for the correct realm 2024-09-22T08:44:29.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:29.816+0000 7fe7c92dc640 0 -- 172.21.15.39:0/2778276462 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fe7bc061040 msgr2=0x7fe7bc062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.021+0000 7fe7c9add640 0 -- 172.21.15.39:0/2778276462 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fe7b4003cb0 msgr2=0x7fe7c4073dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.027+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 zone default found 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 4 Realm: () 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 zonegroup default 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.028+0000 7fe7cdd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.029+0000 7fe7cdd2e800 20 started sync module instance, tier type = 2024-09-22T08:44:30.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.029+0000 7fe7cdd2e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=0 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=1 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=2 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=3 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=4 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=5 2024-09-22T08:44:30.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.047+0000 7fe7cdd2e800 20 add_watcher() i=6 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.048+0000 7fe7cdd2e800 20 add_watcher() i=7 2024-09-22T08:44:30.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.048+0000 7fe7cdd2e800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:30.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.050+0000 7fe67b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 5 note: GC not initialized 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe67a7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:30.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 20 Filter name: none 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe5effff640 20 reqs_thread_entry: start 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:30.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.051+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 20 rados->read ofs=0 len=0 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.052+0000 7fe7cdd2e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.053+0000 7fe7cdd2e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.053+0000 7fe7cdd2e800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T08:44:30.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.053+0000 7fe67b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.056+0000 7fe7cdd2e800 20 remove_watcher() i=0 2024-09-22T08:44:30.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.056+0000 7fe7cdd2e800 2 removed watcher, disabling cache 2024-09-22T08:44:30.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.057+0000 7fe7cdd2e800 20 remove_watcher() i=1 2024-09-22T08:44:30.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.058+0000 7fe7cdd2e800 20 remove_watcher() i=2 2024-09-22T08:44:30.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.059+0000 7fe7cdd2e800 20 remove_watcher() i=3 2024-09-22T08:44:30.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.060+0000 7fe7cdd2e800 20 remove_watcher() i=4 2024-09-22T08:44:30.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.061+0000 7fe7cdd2e800 20 remove_watcher() i=5 2024-09-22T08:44:30.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.062+0000 7fe7cdd2e800 20 remove_watcher() i=6 2024-09-22T08:44:30.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:30.064+0000 7fe7cdd2e800 20 remove_watcher() i=7 2024-09-22T08:44:30.075 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-22T08:44:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:30.078 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.127 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.127 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.195 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-22T08:44:30.196 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:44:30.196 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.196 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.262 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.262 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.468 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.468 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.527 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.527 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.552 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.552 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.603 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.604 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.628 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.628 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.680 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.680 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.705 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.705 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.756 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.756 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.781 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.781 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.830 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.830 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.855 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.855 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.908 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:30.908 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:30.933 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T08:44:31.362 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T08:44:32.780 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:32.780 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:32.866 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:32.868 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-22T08:44:32.904 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:32.904 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:32.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.946+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:32.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:32.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 20 realm 2024-09-22T08:44:32.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:32.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:32.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:32.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.948+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:32.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.949+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:32.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.949+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:32.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.950+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:32.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.950+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:32.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.950+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:32.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.950+0000 7f8254728800 20 searching for the correct realm 2024-09-22T08:44:32.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:32.953+0000 7f8250c70640 0 -- 172.21.15.39:0/3383679433 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f82440c7c20 msgr2=0x7f82440a42f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:33.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.160+0000 7f824fc6e640 0 -- 172.21.15.39:0/3383679433 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8248029070 msgr2=0x7f824804c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:33.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:33.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.367+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 zone default found 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 4 Realm: () 2024-09-22T08:44:33.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 zonegroup default 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.368+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.369+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.369+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.369+0000 7f8254728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.369+0000 7f8254728800 20 started sync module instance, tier type = 2024-09-22T08:44:33.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.369+0000 7f8254728800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=0 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=1 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=2 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=3 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=4 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=5 2024-09-22T08:44:33.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.381+0000 7f8254728800 20 add_watcher() i=6 2024-09-22T08:44:33.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.382+0000 7f8254728800 20 add_watcher() i=7 2024-09-22T08:44:33.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.382+0000 7f8254728800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:33.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.384+0000 7f8106fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.384+0000 7f8254728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.384+0000 7f8254728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.384+0000 7f8254728800 5 note: GC not initialized 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8105fdb640 20 reqs_thread_entry: start 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8254728800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:33.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8254728800 20 Filter name: none 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f80777fe640 20 reqs_thread_entry: start 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.385+0000 7f8254728800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 INFO: main: starting shard=0 2024-09-22T08:44:33.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:33.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.386+0000 7f8254728800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:44:33.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.387+0000 7f8254728800 20 INFO: main: done 2024-09-22T08:44:33.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.388+0000 7f8106fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:33.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.390+0000 7f8254728800 20 remove_watcher() i=0 2024-09-22T08:44:33.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.390+0000 7f8254728800 2 removed watcher, disabling cache 2024-09-22T08:44:33.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.391+0000 7f8254728800 20 remove_watcher() i=1 2024-09-22T08:44:33.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.393+0000 7f8254728800 20 remove_watcher() i=2 2024-09-22T08:44:33.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.394+0000 7f8254728800 20 remove_watcher() i=3 2024-09-22T08:44:33.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.395+0000 7f8254728800 20 remove_watcher() i=4 2024-09-22T08:44:33.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.397+0000 7f8254728800 20 remove_watcher() i=5 2024-09-22T08:44:33.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.398+0000 7f8254728800 20 remove_watcher() i=6 2024-09-22T08:44:33.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.399+0000 7f8254728800 20 remove_watcher() i=7 2024-09-22T08:44:33.414 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:33.415 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:33.441 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:33.441 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:33.521 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:33.523 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-22T08:44:33.555 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:33.555 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:33.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.593+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 realm 2024-09-22T08:44:33.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:33.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.595+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.596+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:33.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.596+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.597+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:33.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.597+0000 7f74e9f2a800 20 searching for the correct realm 2024-09-22T08:44:33.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.599+0000 7f74e641f640 0 -- 172.21.15.39:0/2285903755 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f74dc015070 msgr2=0x7f74dc061ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:33.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.603+0000 7f74e541d640 0 -- 172.21.15.39:0/2285903755 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f74e00c4700 msgr2=0x7f74e00e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:44:33.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:33.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.809+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 zone default found 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 4 Realm: () 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:33.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 zonegroup default 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.810+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.811+0000 7f74e9f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:33.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.811+0000 7f74e9f2a800 20 started sync module instance, tier type = 2024-09-22T08:44:33.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.811+0000 7f74e9f2a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=0 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=1 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=2 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=3 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=4 2024-09-22T08:44:33.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=5 2024-09-22T08:44:33.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.823+0000 7f74e9f2a800 20 add_watcher() i=6 2024-09-22T08:44:33.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.825+0000 7f74e9f2a800 20 add_watcher() i=7 2024-09-22T08:44:33.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.825+0000 7f74e9f2a800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:33.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f73977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:33.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:33.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:33.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 5 note: GC not initialized 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f73967fc640 20 reqs_thread_entry: start 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 20 Filter name: none 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f7307fff640 20 reqs_thread_entry: start 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.827+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:33.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 rados->read ofs=0 len=0 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 INFO: main: starting shard=0 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.828+0000 7f74e9f2a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.829+0000 7f74e9f2a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-22T08:44:33.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.829+0000 7f74e9f2a800 20 INFO: main: done 2024-09-22T08:44:33.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.830+0000 7f73977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:33.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.832+0000 7f74e9f2a800 20 remove_watcher() i=0 2024-09-22T08:44:33.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.832+0000 7f74e9f2a800 2 removed watcher, disabling cache 2024-09-22T08:44:33.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.833+0000 7f74e9f2a800 20 remove_watcher() i=1 2024-09-22T08:44:33.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.835+0000 7f74e9f2a800 20 remove_watcher() i=2 2024-09-22T08:44:33.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.836+0000 7f74e9f2a800 20 remove_watcher() i=3 2024-09-22T08:44:33.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.837+0000 7f74e9f2a800 20 remove_watcher() i=4 2024-09-22T08:44:33.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.838+0000 7f74e9f2a800 20 remove_watcher() i=5 2024-09-22T08:44:33.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.839+0000 7f74e9f2a800 20 remove_watcher() i=6 2024-09-22T08:44:33.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:33.840+0000 7f74e9f2a800 20 remove_watcher() i=7 2024-09-22T08:44:33.855 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:33.855 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:33.878 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:33.879 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:33.960 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:33.962 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-22T08:44:33.995 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:33.995 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.034+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 realm 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.036+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.037+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:34.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.037+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.038+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:34.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.038+0000 7f5cb1e87800 20 searching for the correct realm 2024-09-22T08:44:34.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.040+0000 7f5cb0172640 0 -- 172.21.15.39:0/3137283825 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5c980d4040 msgr2=0x7f5c980afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:34.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.247+0000 7f5ca7fff640 0 -- 172.21.15.39:0/3137283825 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5ca802d920 msgr2=0x7f5ca802c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:34.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:34.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:34.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:34.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:34.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:34.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:34.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.454+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 zone default found 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 4 Realm: () 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:34.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 zonegroup default 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.455+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.456+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.456+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.456+0000 7f5cb1e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.456+0000 7f5cb1e87800 20 started sync module instance, tier type = 2024-09-22T08:44:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.456+0000 7f5cb1e87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:34.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=0 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=1 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=2 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=3 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=4 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=5 2024-09-22T08:44:34.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.470+0000 7f5cb1e87800 20 add_watcher() i=6 2024-09-22T08:44:34.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.471+0000 7f5cb1e87800 20 add_watcher() i=7 2024-09-22T08:44:34.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.471+0000 7f5cb1e87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:34.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.473+0000 7f5b65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:34.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:34.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:34.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 5 note: GC not initialized 2024-09-22T08:44:34.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5b64fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:34.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 Filter name: none 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5ade7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.474+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:34.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 INFO: main: starting shard=0 2024-09-22T08:44:34.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:34.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:44:34.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.475+0000 7f5cb1e87800 20 INFO: main: done 2024-09-22T08:44:34.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.476+0000 7f5b65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:34.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.479+0000 7f5cb1e87800 20 remove_watcher() i=0 2024-09-22T08:44:34.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.479+0000 7f5cb1e87800 2 removed watcher, disabling cache 2024-09-22T08:44:34.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.481+0000 7f5cb1e87800 20 remove_watcher() i=1 2024-09-22T08:44:34.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.482+0000 7f5cb1e87800 20 remove_watcher() i=2 2024-09-22T08:44:34.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.483+0000 7f5cb1e87800 20 remove_watcher() i=3 2024-09-22T08:44:34.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.484+0000 7f5cb1e87800 20 remove_watcher() i=4 2024-09-22T08:44:34.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.485+0000 7f5cb1e87800 20 remove_watcher() i=5 2024-09-22T08:44:34.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.486+0000 7f5cb1e87800 20 remove_watcher() i=6 2024-09-22T08:44:34.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.487+0000 7f5cb1e87800 20 remove_watcher() i=7 2024-09-22T08:44:34.502 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:34.502 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:34.525 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:34.525 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:34.608 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T08:44:34.610 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-22T08:44:34.641 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:34.641 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:34.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.679+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 20 realm 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.681+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.682+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:34.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.682+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.683+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:34.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.683+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:34.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.683+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:34.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.683+0000 7f42c2d0c800 20 searching for the correct realm 2024-09-22T08:44:34.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.686+0000 7f42c0ff7640 0 -- 172.21.15.39:0/1545637035 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f42b4017070 msgr2=0x7f42b40471a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:34.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:34.892+0000 7f42bfff5640 0 -- 172.21.15.39:0/1545637035 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f42b80b97a0 msgr2=0x7f42b80b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.099+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.100+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:35.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.100+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.100+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:35.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.100+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 zone default found 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 4 Realm: () 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 zonegroup default 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.101+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.102+0000 7f42c2d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:35.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.102+0000 7f42c2d0c800 20 started sync module instance, tier type = 2024-09-22T08:44:35.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.102+0000 7f42c2d0c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:35.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=0 2024-09-22T08:44:35.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=1 2024-09-22T08:44:35.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=2 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=3 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=4 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=5 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.114+0000 7f42c2d0c800 20 add_watcher() i=6 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.115+0000 7f42c2d0c800 20 add_watcher() i=7 2024-09-22T08:44:35.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.115+0000 7f42c2d0c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:35.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.117+0000 7f4176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:35.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:35.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:35.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 5 note: GC not initialized 2024-09-22T08:44:35.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f4175fdb640 20 reqs_thread_entry: start 2024-09-22T08:44:35.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 20 Filter name: none 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f40e77fe640 20 reqs_thread_entry: start 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.118+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:35.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 INFO: main: starting shard=0 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.119+0000 7f42c2d0c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.120+0000 7f42c2d0c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T08:44:35.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.120+0000 7f42c2d0c800 20 INFO: main: done 2024-09-22T08:44:35.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.121+0000 7f4176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:35.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.124+0000 7f42c2d0c800 20 remove_watcher() i=0 2024-09-22T08:44:35.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.124+0000 7f42c2d0c800 2 removed watcher, disabling cache 2024-09-22T08:44:35.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.125+0000 7f42c2d0c800 20 remove_watcher() i=1 2024-09-22T08:44:35.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.127+0000 7f42c2d0c800 20 remove_watcher() i=2 2024-09-22T08:44:35.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.128+0000 7f42c2d0c800 20 remove_watcher() i=3 2024-09-22T08:44:35.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.129+0000 7f42c2d0c800 20 remove_watcher() i=4 2024-09-22T08:44:35.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.130+0000 7f42c2d0c800 20 remove_watcher() i=5 2024-09-22T08:44:35.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.132+0000 7f42c2d0c800 20 remove_watcher() i=6 2024-09-22T08:44:35.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:35.134+0000 7f42c2d0c800 20 remove_watcher() i=7 2024-09-22T08:44:35.149 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:35.149 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:35.175 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T08:44:35.610 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T08:44:36.024 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-22T08:44:36.054 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:36.054 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:36.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.294+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 realm 2024-09-22T08:44:36.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.296+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.297+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:36.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.297+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.298+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:36.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.298+0000 7ff67f13d800 20 searching for the correct realm 2024-09-22T08:44:36.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.300+0000 7ff67b62b640 0 -- 172.21.15.39:0/694558412 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff670091020 msgr2=0x7ff6700b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:36.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.506+0000 7ff67a629640 0 -- 172.21.15.39:0/694558412 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff67403f930 msgr2=0x7ff674020460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:36.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:36.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.713+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 zone default found 2024-09-22T08:44:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 4 Realm: () 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 zonegroup default 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.714+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.715+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.715+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.715+0000 7ff67f13d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.715+0000 7ff67f13d800 20 started sync module instance, tier type = 2024-09-22T08:44:36.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.715+0000 7ff67f13d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=0 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=1 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=2 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=3 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=4 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=5 2024-09-22T08:44:36.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.729+0000 7ff67f13d800 20 add_watcher() i=6 2024-09-22T08:44:36.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.730+0000 7ff67f13d800 20 add_watcher() i=7 2024-09-22T08:44:36.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.730+0000 7ff67f13d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:36.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.733+0000 7ff5317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:36.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.733+0000 7ff67f13d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:36.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.733+0000 7ff67f13d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:36.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.733+0000 7ff67f13d800 5 note: GC not initialized 2024-09-22T08:44:36.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.733+0000 7ff4abfff640 20 reqs_thread_entry: start 2024-09-22T08:44:36.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 20 Filter name: none 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff4a9ffb640 20 reqs_thread_entry: start 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.734+0000 7ff67f13d800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:36.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.735+0000 7ff67f13d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:36.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.739+0000 7ff5317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:36.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.742+0000 7ff67f13d800 20 remove_watcher() i=0 2024-09-22T08:44:36.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.742+0000 7ff67f13d800 2 removed watcher, disabling cache 2024-09-22T08:44:36.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.743+0000 7ff67f13d800 20 remove_watcher() i=1 2024-09-22T08:44:36.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.744+0000 7ff67f13d800 20 remove_watcher() i=2 2024-09-22T08:44:36.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.745+0000 7ff67f13d800 20 remove_watcher() i=3 2024-09-22T08:44:36.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.747+0000 7ff67f13d800 20 remove_watcher() i=4 2024-09-22T08:44:36.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.748+0000 7ff67f13d800 20 remove_watcher() i=5 2024-09-22T08:44:36.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.749+0000 7ff67f13d800 20 remove_watcher() i=6 2024-09-22T08:44:36.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.750+0000 7ff67f13d800 20 remove_watcher() i=7 2024-09-22T08:44:36.764 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T08:44:36.800 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:36.800 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:36.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.839+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 20 realm 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.841+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.842+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.842+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.843+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:36.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.843+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:36.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.843+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:36.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.843+0000 7fa10ff3c800 20 searching for the correct realm 2024-09-22T08:44:36.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.846+0000 7fa10c482640 0 -- 172.21.15.39:0/2320841958 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa10005d6e0 msgr2=0x7fa100067980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:36.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:36.850+0000 7fa10b480640 0 -- 172.21.15.39:0/2320841958 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa104073c00 msgr2=0x7fa104080820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:37.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:37.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:37.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.056+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 zone default found 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 4 Realm: () 2024-09-22T08:44:37.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 zonegroup default 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.057+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.058+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.058+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.058+0000 7fa10ff3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.058+0000 7fa10ff3c800 20 started sync module instance, tier type = 2024-09-22T08:44:37.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.058+0000 7fa10ff3c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=0 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=1 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=2 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=3 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=4 2024-09-22T08:44:37.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.073+0000 7fa10ff3c800 20 add_watcher() i=5 2024-09-22T08:44:37.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.078+0000 7fa10ff3c800 20 add_watcher() i=6 2024-09-22T08:44:37.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.078+0000 7fa10ff3c800 20 add_watcher() i=7 2024-09-22T08:44:37.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.078+0000 7fa10ff3c800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:37.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.080+0000 7f9fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.080+0000 7fa10ff3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.080+0000 7fa10ff3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.080+0000 7fa10ff3c800 5 note: GC not initialized 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.080+0000 7f9fc0fe1640 20 reqs_thread_entry: start 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 20 Filter name: none 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7f9f3a7fc640 20 reqs_thread_entry: start 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-22T08:44:37.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 : miss 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.081+0000 7fa10ff3c800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 info.flags=0x17 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 to cache LRU end 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.1 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.082+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.083+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.083+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:c state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.083+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to bjubdtczusf6ti9z1e6zd2yv0eiizd3i 2024-09-22T08:44:37.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.083+0000 7fa10ff3c800 20 get_obj_state_impl: setting s->olh_tag to 2fcyiyx43q667967mj7u9hh34up4m5kv 2024-09-22T08:44:37.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.083+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2fcyiyx43q667967mj7u9hh34up4m5kv 2024-09-22T08:44:37.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.088+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.089+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 olh_log_entry: epoch=3 op=3 key=c[62UrtpfGsCmgJeTk1FyqZmAoKrk5N8c] 2024-09-22T08:44:37.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:62UrtpfGsCmgJeTk1FyqZmAoKrk5N8c_c state=0x55af5b28bbc8 s->prefetch_data=0 2024-09-22T08:44:37.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 10 manifest: total_size = 22 2024-09-22T08:44:37.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13913292392297650801 2024-09-22T08:44:37.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:62UrtpfGsCmgJeTk1FyqZmAoKrk5N8c_c state=0x55af5b28bbc8 s->prefetch_data=0 2024-09-22T08:44:37.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 prepare_atomic_modification: state is not atomic. state=0x55af5b28bbc8 2024-09-22T08:44:37.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.090+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.094+0000 7f9feaffd640 20 handle_completion(): completion ok for obj=c[62UrtpfGsCmgJeTk1FyqZmAoKrk5N8c] 2024-09-22T08:44:37.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.102+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.102+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.104+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.105+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.105+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:d state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.105+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 4xwapw86pwsf6yj0ialfrlfzwzb15t62 2024-09-22T08:44:37.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.105+0000 7fa10ff3c800 20 get_obj_state_impl: setting s->olh_tag to ilasplqiwexgnr6catjarzcim54fr4wo 2024-09-22T08:44:37.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.105+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ilasplqiwexgnr6catjarzcim54fr4wo 2024-09-22T08:44:37.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.108+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 olh_log_entry: epoch=3 op=3 key=d[.XlHm4tXm7O9Bll2.Yp3DITc-9-fFCT] 2024-09-22T08:44:37.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:.XlHm4tXm7O9Bll2.Yp3DITc-9-fFCT_d state=0x55af5b28e0f8 s->prefetch_data=0 2024-09-22T08:44:37.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 10 manifest: total_size = 22 2024-09-22T08:44:37.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18089763460612925702 2024-09-22T08:44:37.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:.XlHm4tXm7O9Bll2.Yp3DITc-9-fFCT_d state=0x55af5b28e0f8 s->prefetch_data=0 2024-09-22T08:44:37.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 prepare_atomic_modification: state is not atomic. state=0x55af5b28e0f8 2024-09-22T08:44:37.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.110+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.115+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.115+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.115+0000 7f9feaffd640 20 handle_completion(): completion ok for obj=d[.XlHm4tXm7O9Bll2.Yp3DITc-9-fFCT] 2024-09-22T08:44:37.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.116+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.116+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.117+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:e state=0x55af5b24b3f8 s->prefetch_data=0 2024-09-22T08:44:37.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.117+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to ubrl3dk08yl82t6hrchhcqzpon493grh 2024-09-22T08:44:37.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.117+0000 7fa10ff3c800 20 get_obj_state_impl: setting s->olh_tag to 7wvk28ff4zdsg200f9ulgvgrdq885nap 2024-09-22T08:44:37.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.117+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7wvk28ff4zdsg200f9ulgvgrdq885nap 2024-09-22T08:44:37.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.118+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-22T08:44:37.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 olh_log_entry: epoch=2 op=3 key=e[8NUp0FlXG8R1Fi3h2ydJ3YGKdptbtM0] 2024-09-22T08:44:37.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:8NUp0FlXG8R1Fi3h2ydJ3YGKdptbtM0_e state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 10 manifest: total_size = 11 2024-09-22T08:44:37.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.1347199454407193979 2024-09-22T08:44:37.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:_:8NUp0FlXG8R1Fi3h2ydJ3YGKdptbtM0_e state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 prepare_atomic_modification: state is not atomic. state=0x55af5b250108 2024-09-22T08:44:37.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.120+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.125+0000 7f9feaffd640 20 handle_completion(): completion ok for obj=e[8NUp0FlXG8R1Fi3h2ydJ3YGKdptbtM0] 2024-09-22T08:44:37.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.128+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5af850f0 obj=check-bucket:e state=0x55af5b24b3f8 s->prefetch_data=0 2024-09-22T08:44:37.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.128+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7wvk28ff4zdsg200f9ulgvgrdq885nap 2024-09-22T08:44:37.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.136+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.137+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.138+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.138+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5b28bff0 obj=check-bucket:f state=0x55af5b24b3f8 s->prefetch_data=0 2024-09-22T08:44:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.138+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 3dkek02u2rk765ba4wgz3xcz915rz50n 2024-09-22T08:44:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.138+0000 7fa10ff3c800 20 get_obj_state_impl: setting s->olh_tag to rcsb6ea3iplxddns45hpuuyo3z6uhjh6 2024-09-22T08:44:37.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.138+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rcsb6ea3iplxddns45hpuuyo3z6uhjh6 2024-09-22T08:44:37.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.142+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.143+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.143+0000 7fa10ff3c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-22T08:44:37.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.143+0000 7fa10ff3c800 20 olh_log_entry: epoch=2 op=3 key=f[TmJnGbd6IEClqRlhOVbHG6156ENQp1n] 2024-09-22T08:44:37.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.143+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5b28bff0 obj=check-bucket:_:TmJnGbd6IEClqRlhOVbHG6156ENQp1n_f state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.144+0000 7fa10ff3c800 10 manifest: total_size = 12 2024-09-22T08:44:37.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.144+0000 7fa10ff3c800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.1062820645417088765 2024-09-22T08:44:37.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.144+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5b28bff0 obj=check-bucket:_:TmJnGbd6IEClqRlhOVbHG6156ENQp1n_f state=0x55af5b250108 s->prefetch_data=0 2024-09-22T08:44:37.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.144+0000 7fa10ff3c800 20 prepare_atomic_modification: state is not atomic. state=0x55af5b250108 2024-09-22T08:44:37.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.144+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.148+0000 7f9fea7fc640 20 handle_completion(): completion ok for obj=f[TmJnGbd6IEClqRlhOVbHG6156ENQp1n] 2024-09-22T08:44:37.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.148+0000 7fa10ff3c800 20 get_obj_state: octx=0x55af5b28bff0 obj=check-bucket:f state=0x55af5b24b3f8 s->prefetch_data=0 2024-09-22T08:44:37.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.148+0000 7fa10ff3c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rcsb6ea3iplxddns45hpuuyo3z6uhjh6 2024-09-22T08:44:37.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.156+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.157+0000 7fa10ff3c800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.1.0 2024-09-22T08:44:37.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.157+0000 7fa10ff3c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-22T08:44:37.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.157+0000 7fa10ff3c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-22T08:44:37.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.158+0000 7f9fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:37.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.160+0000 7fa10ff3c800 20 remove_watcher() i=0 2024-09-22T08:44:37.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.160+0000 7fa10ff3c800 2 removed watcher, disabling cache 2024-09-22T08:44:37.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.161+0000 7fa10ff3c800 20 remove_watcher() i=1 2024-09-22T08:44:37.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.162+0000 7fa10ff3c800 20 remove_watcher() i=2 2024-09-22T08:44:37.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.163+0000 7fa10ff3c800 20 remove_watcher() i=3 2024-09-22T08:44:37.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.164+0000 7fa10ff3c800 20 remove_watcher() i=4 2024-09-22T08:44:37.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.165+0000 7fa10ff3c800 20 remove_watcher() i=5 2024-09-22T08:44:37.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.166+0000 7fa10ff3c800 20 remove_watcher() i=6 2024-09-22T08:44:37.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.167+0000 7fa10ff3c800 20 remove_watcher() i=7 2024-09-22T08:44:37.182 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:37.182 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:37.213 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:37.213 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:37.399 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-22T08:44:37.431 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:44:37.431 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:44:37.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.469+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 realm 2024-09-22T08:44:37.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.471+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.472+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:37.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.472+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.473+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:44:37.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.473+0000 7fef4ea87800 20 searching for the correct realm 2024-09-22T08:44:37.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.474+0000 7fef43fff640 0 -- 172.21.15.39:0/2583216672 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fef3c064430 msgr2=0x7fef3c0648b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:37.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.478+0000 7fef43fff640 0 -- 172.21.15.39:0/2583216672 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fee14085200 msgr2=0x7fee14087630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:44:37.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 zone default found 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 4 Realm: () 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 zonegroup default 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.483+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:44:37.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 started sync module instance, tier type = 2024-09-22T08:44:37.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.484+0000 7fef4ea87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=0 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=1 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=2 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=3 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=4 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=5 2024-09-22T08:44:37.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.496+0000 7fef4ea87800 20 add_watcher() i=6 2024-09-22T08:44:37.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.497+0000 7fef4ea87800 20 add_watcher() i=7 2024-09-22T08:44:37.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.497+0000 7fef4ea87800 2 all 8 watchers are set, enabling cache 2024-09-22T08:44:37.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fee02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:37.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:44:37.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 5 note: GC not initialized 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fee01fdb640 20 reqs_thread_entry: start 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 20 init_complete bucket index max shards: 1 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 20 Filter name: none 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fed737fe640 20 reqs_thread_entry: start 2024-09-22T08:44:37.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.499+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=190 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.500+0000 7fef4ea87800 20 rados->read ofs=0 len=0 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.501+0000 7fef4ea87800 20 rados_obj.operate() r=0 bl.length=412 2024-09-22T08:44:37.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.501+0000 7fef4ea87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T08:44:37.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.502+0000 7fee02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:44:37.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.504+0000 7fef4ea87800 20 remove_watcher() i=0 2024-09-22T08:44:37.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.504+0000 7fef4ea87800 2 removed watcher, disabling cache 2024-09-22T08:44:37.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.505+0000 7fef4ea87800 20 remove_watcher() i=1 2024-09-22T08:44:37.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.506+0000 7fef4ea87800 20 remove_watcher() i=2 2024-09-22T08:44:37.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.508+0000 7fef4ea87800 20 remove_watcher() i=3 2024-09-22T08:44:37.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.509+0000 7fef4ea87800 20 remove_watcher() i=4 2024-09-22T08:44:37.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.510+0000 7fef4ea87800 20 remove_watcher() i=5 2024-09-22T08:44:37.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.511+0000 7fef4ea87800 20 remove_watcher() i=6 2024-09-22T08:44:37.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:44:37.512+0000 7fef4ea87800 20 remove_watcher() i=7 2024-09-22T08:44:37.524 INFO:tasks.workunit.client.0.smithi039.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T08:44:37.524 INFO:tasks.workunit.client.0.smithi039.stderr:Deleting bucket check-bucket 2024-09-22T08:44:37.526 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:37.526 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:37.551 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T08:44:37.551 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T08:44:37.683 INFO:tasks.workunit.client.0.smithi039.stderr:Completed bucket check tests 2024-09-22T08:44:37.683 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T08:44:37.683 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T08:44:37.683 INFO:tasks.workunit.client.0.smithi039.stdout:connected to https://localhost:443 2024-09-22T08:44:37.750 INFO:tasks.workunit.client.0.smithi039.stderr:+ deactivate 2024-09-22T08:44:37.750 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T08:44:37.750 INFO:tasks.workunit.client.0.smithi039.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T08:44:37.750 INFO:tasks.workunit.client.0.smithi039.stderr:+ export PATH 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ hash -r 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset VIRTUAL_ENV 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset -f deactivate 2024-09-22T08:44:37.751 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo OK. 2024-09-22T08:44:37.752 INFO:tasks.workunit.client.0.smithi039.stdout:OK. 2024-09-22T08:44:37.752 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:44:37.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:44:37.831 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-22T08:44:37.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:44:38.453 DEBUG:teuthology.parallel:result is None 2024-09-22T08:44:38.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:44:38.493 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:44:38.493 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:44:38.585 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:44:38.585 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:44:38.601 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:44:38.602 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:44:38.602 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:44:38.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:44:38.631 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:44:38.632 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:44:38.702 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:44:38.702 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:44:38.771 INFO:tasks.workunit:timeout=3h 2024-09-22T08:44:38.772 INFO:tasks.workunit:cleanup=True 2024-09-22T08:44:38.772 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:44:38.842 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:45:40.002 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 93% (11825/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-22T08:45:40.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.336 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-22T08:45:40.336 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.336 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:45:40.336 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:45:40.336 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:45:40.340 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:45:40.409 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:45:40.411 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:45:40.412 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:45:40.463 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:45:40.512 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:45:40.553 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:45:40.555 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:45:40.555 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:45:40.595 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:45:40.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:45:40.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:45:40.668 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-22T08:45:40.669 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-22T08:45:40.669 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-22T08:45:40.752 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:45:40.753 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:45:40.753 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:45:40.753 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from ClsLock 2024-09-22T08:45:40.753 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-22T08:45:42.377 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:42.377 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: exclusive 2024-09-22T08:45:42.377 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:42.377 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:42.378 INFO:tasks.workunit.client.0.smithi039.stdout: client.5124 expiration=2024-09-22T08:47:42.372016+0000 addr=v1:172.21.15.39:0/2991204173 cookie= 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: shared 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout: client.5124 expiration=2024-09-22T08:47:42.381474+0000 addr=v1:172.21.15.39:0/2991204173 cookie= 2024-09-22T08:45:42.383 INFO:tasks.workunit.client.0.smithi039.stdout: client.5133 expiration=0.000000 addr=v1:172.21.15.39:0/3856536587 cookie= 2024-09-22T08:45:42.385 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:42.385 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: shared 2024-09-22T08:45:42.385 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:42.385 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:42.385 INFO:tasks.workunit.client.0.smithi039.stdout: client.5133 expiration=0.000000 addr=v1:172.21.15.39:0/3856536587 cookie= 2024-09-22T08:45:43.221 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestMultiLocking (2469 ms) 2024-09-22T08:45:43.221 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestMeta 2024-09-22T08:45:45.324 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:45.324 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: shared 2024-09-22T08:45:45.324 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:45.325 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:45.325 INFO:tasks.workunit.client.0.smithi039.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.39:0/3999443605 cookie= 2024-09-22T08:45:45.327 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:45.328 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: exclusive 2024-09-22T08:45:45.328 INFO:tasks.workunit.client.0.smithi039.stdout: tag: new_tag 2024-09-22T08:45:45.328 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:45.328 INFO:tasks.workunit.client.0.smithi039.stdout: client.5136 expiration=0.000000 addr=v1:172.21.15.39:0/3855056061 cookie= 2024-09-22T08:45:46.290 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestMeta (3068 ms) 2024-09-22T08:45:46.290 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestCookie 2024-09-22T08:45:48.333 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:48.334 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: exclusive 2024-09-22T08:45:48.334 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:48.334 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout:lock: mylock 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout: lock_type: shared 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout: tag: 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout: lockers: 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.39:0/26923856 cookie= 2024-09-22T08:45:48.336 INFO:tasks.workunit.client.0.smithi039.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.39:0/26923856 cookie=new cookie 2024-09-22T08:45:49.353 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestCookie (3064 ms) 2024-09-22T08:45:49.353 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-22T08:45:52.390 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestMultipleLocks (3037 ms) 2024-09-22T08:45:52.390 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-22T08:46:00.044 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestLockDuration (7653 ms) 2024-09-22T08:46:00.044 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-22T08:46:03.074 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestAssertLocked (3029 ms) 2024-09-22T08:46:03.074 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-22T08:46:06.121 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestSetCookie (3049 ms) 2024-09-22T08:46:06.121 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestRenew 2024-09-22T08:46:26.244 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestRenew (20123 ms) 2024-09-22T08:46:26.245 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-22T08:46:33.299 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7054 ms) 2024-09-22T08:46:33.299 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-22T08:46:41.362 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8063 ms) 2024-09-22T08:46:41.362 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-22T08:46:48.527 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7166 ms) 2024-09-22T08:46:48.527 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from ClsLock (67775 ms total) 2024-09-22T08:46:48.527 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:46:48.527 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:46:48.527 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 11 tests from 1 test suite ran. (67775 ms total) 2024-09-22T08:46:48.528 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 11 tests. 2024-09-22T08:46:48.530 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:46:48.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:46:48.577 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-22T08:46:48.578 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-22T08:46:48.578 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-22T08:46:48.627 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:46:48.627 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:46:48.627 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:46:48.628 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from cls_log 2024-09-22T08:46:48.628 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-22T08:46:51.571 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_log.test_log_add_same_time (2943 ms) 2024-09-22T08:46:51.571 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-22T08:46:54.586 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_log.test_log_add_different_time (3015 ms) 2024-09-22T08:46:54.586 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_log.trim_by_time 2024-09-22T08:46:57.594 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_log.trim_by_time (3008 ms) 2024-09-22T08:46:57.594 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-22T08:47:00.649 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_log.trim_by_marker (3055 ms) 2024-09-22T08:47:00.649 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from cls_log (12022 ms total) 2024-09-22T08:47:00.649 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:47:00.649 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:47:00.650 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 4 tests from 1 test suite ran. (12023 ms total) 2024-09-22T08:47:00.650 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 4 tests. 2024-09-22T08:47:00.652 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:47:00.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:47:00.697 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-22T08:47:00.699 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-22T08:47:00.700 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-22T08:47:00.747 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:47:00.747 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:47:00.748 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:47:00.748 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 10 tests from cls_refcount 2024-09-22T08:47:00.748 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-22T08:47:03.703 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_implicit (2956 ms) 2024-09-22T08:47:03.703 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-22T08:47:06.744 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3041 ms) 2024-09-22T08:47:06.744 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-22T08:47:15.842 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_put_snap (9098 ms) 2024-09-22T08:47:15.842 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-22T08:47:18.858 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_explicit (3015 ms) 2024-09-22T08:47:18.858 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.set 2024-09-22T08:47:21.937 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.set (3080 ms) 2024-09-22T08:47:21.937 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-22T08:47:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_implicit_ec (7034 ms) 2024-09-22T08:47:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-22T08:47:36.080 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7108 ms) 2024-09-22T08:47:36.080 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-22T08:47:49.217 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_put_snap_ec (13138 ms) 2024-09-22T08:47:49.217 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-22T08:47:56.298 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.test_explicit_ec (7080 ms) 2024-09-22T08:47:56.298 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_refcount.set_ec 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_refcount.set_ec (7069 ms) 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 10 tests from cls_refcount (62619 ms total) 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 10 tests from 1 test suite ran. (62619 ms total) 2024-09-22T08:48:03.367 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 10 tests. 2024-09-22T08:48:03.369 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:48:03.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:48:03.415 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-22T08:48:03.416 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-22T08:48:03.417 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-22T08:48:03.466 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:48:03.466 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:48:03.466 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:48:03.466 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from cls_rgw 2024-09-22T08:48:05.400 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_basic 2024-09-22T08:48:05.453 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_basic (53 ms) 2024-09-22T08:48:05.453 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-22T08:48:05.485 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-09-22T08:48:05.485 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-22T08:48:05.529 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-22T08:48:05.529 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-22T08:48:07.023 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_suggest (1494 ms) 2024-09-22T08:48:07.023 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-22T08:48:07.029 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-22T08:48:07.029 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_list 2024-09-22T08:48:07.065 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_list (36 ms) 2024-09-22T08:48:07.065 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-22T08:48:28.183 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_list_delimited (21117 ms) 2024-09-22T08:48:28.183 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.bi_list 2024-09-22T08:48:28.264 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.bi_list (82 ms) 2024-09-22T08:48:28.264 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.gc_set 2024-09-22T08:48:28.274 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-22T08:48:28.274 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.gc_list 2024-09-22T08:48:28.487 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.gc_list (213 ms) 2024-09-22T08:48:28.488 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-22T08:48:36.172 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.gc_defer (7684 ms) 2024-09-22T08:48:36.172 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-22T08:48:36.251 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.usage_basic (79 ms) 2024-09-22T08:48:36.251 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-22T08:48:36.252 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-22T08:48:36.252 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-22T08:48:36.420 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.usage_clear (167 ms) 2024-09-22T08:48:36.420 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-22T08:48:36.468 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.bi_log_trim (48 ms) 2024-09-22T08:48:36.468 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-22T08:48:36.489 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.index_racing_removes (22 ms) 2024-09-22T08:48:36.489 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-22T08:48:36.504 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-22T08:48:36.504 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-22T08:48:36.518 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.reshardlog_num (14 ms) 2024-09-22T08:48:36.518 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-22T08:48:36.543 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw.bi_put_entries (25 ms) 2024-09-22T08:48:37.194 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from cls_rgw (31144 ms total) 2024-09-22T08:48:37.194 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:48:37.194 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:48:37.194 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 19 tests from 1 test suite ran. (33729 ms total) 2024-09-22T08:48:37.194 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 19 tests. 2024-09-22T08:48:37.197 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:48:37.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:48:37.253 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-22T08:48:37.254 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-22T08:48:37.255 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-22T08:48:37.304 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:48:37.304 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:48:37.304 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:48:37.304 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-22T08:48:37.304 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.init 2024-09-22T08:48:39.204 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.init (1900 ms) 2024-09-22T08:48:39.204 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-22T08:48:39.227 INFO:tasks.workunit.client.0.smithi039.stderr:[ ] list info tag = chain-0 2024-09-22T08:48:39.227 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (24 ms) 2024-09-22T08:48:39.227 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-22T08:48:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:[ ] next_marker is: = 0/4263 2024-09-22T08:48:39.238 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-09-22T08:48:39.238 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-22T08:48:39.246 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-22T08:48:39.247 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-22T08:48:39.988 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (741 ms) 2024-09-22T08:48:39.988 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-22T08:48:40.083 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (95 ms) 2024-09-22T08:48:40.083 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-22T08:48:40.092 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-22T08:48:40.092 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-22T08:48:40.100 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-22T08:48:40.100 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_gc.finalize (119 ms) 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from cls_rgw_gc (2915 ms total) 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 9 tests from 1 test suite ran. (2915 ms total) 2024-09-22T08:48:40.219 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 9 tests. 2024-09-22T08:48:40.221 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:48:40.222 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:48:40.269 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-22T08:48:40.270 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-22T08:48:40.270 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-22T08:48:40.327 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:48:40.327 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:48:40.327 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 1 test from 1 test suite. 2024-09-22T08:48:40.328 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:48:42.251 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 1 test from cls_rgw_stats 2024-09-22T08:48:42.252 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-22T08:48:42.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.263+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=1YVOQZ4W2560 type=del size=1178680 2024-09-22T08:48:42.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.266+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~TSSNQL0ESXAQ.0 size=880839 2024-09-22T08:48:42.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.266+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=TSSNQL0ESXAQ tag=WRJLF4LZKWD8 type=write size=1929415 2024-09-22T08:48:42.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.269+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.0 size=1048576 2024-09-22T08:48:42.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.270+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.1 size=1048576 2024-09-22T08:48:42.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.271+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.2 size=548169 2024-09-22T08:48:42.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.271+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=12K4B0FXQ1Q2 tag=5HY1KFZE555U type=write size=3693897 2024-09-22T08:48:42.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.274+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~YSZ801G8S45K.0 size=1048576 2024-09-22T08:48:42.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.275+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~YSZ801G8S45K.1 size=792748 2024-09-22T08:48:42.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.275+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=YSZ801G8S45K tag=07TYMLFG1GL5 type=write size=2889900 2024-09-22T08:48:42.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.277+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=OD57AITVKZO0 type=del size=30861 2024-09-22T08:48:42.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.280+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~UW7OOMT65NMA.0 size=781651 2024-09-22T08:48:42.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.280+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=UW7OOMT65NMA tag=2AJX61TL2SCI type=write size=1830227 2024-09-22T08:48:42.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.282+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=6HNJT23K2NH2 type=write size=1037274 2024-09-22T08:48:42.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.285+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.0 size=1048576 2024-09-22T08:48:42.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.286+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.1 size=1048576 2024-09-22T08:48:42.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.287+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.2 size=945928 2024-09-22T08:48:42.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.287+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=DY76CKQ3EH7T tag=L0ACOYG30FFO type=write size=4091656 2024-09-22T08:48:42.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.289+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=AY6HXX1F1FKX type=del size=441828 2024-09-22T08:48:42.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.290+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=IWFJVI3W39CK type=del size=3674066 2024-09-22T08:48:42.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.292+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=LL4DECSH04EK type=del size=1566239 2024-09-22T08:48:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.295+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~T2JSTL1E1VFH.0 size=176730 2024-09-22T08:48:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.295+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=T2JSTL1E1VFH tag=HZTCEIFUZP22 type=write size=1225306 2024-09-22T08:48:42.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.298+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.0 size=1048576 2024-09-22T08:48:42.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.299+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.1 size=1048576 2024-09-22T08:48:42.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.300+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.2 size=106193 2024-09-22T08:48:42.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.300+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=YX146J3LEW53 tag=9L2BAKFZTL5I type=write size=3251921 2024-09-22T08:48:42.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.302+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=YJAKVSIIFWRQ type=del size=403090 2024-09-22T08:48:42.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.303+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=N25LRCBR1FJX type=del size=1748424 2024-09-22T08:48:42.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.305+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=56X43JIKR8PZ type=del size=3378130 2024-09-22T08:48:42.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.306+0000 7f7b8ef90780 1 < canceled operation key=F3IHQ6Z9V1DX tag=1YVOQZ4W2560 type=del size=1178680 2024-09-22T08:48:42.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.308+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=VEY9FYK0YR98 type=write size=313748 2024-09-22T08:48:42.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.309+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~TSSNQL0ESXAQ.0 size=880839 2024-09-22T08:48:42.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.312+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=TSSNQL0ESXAQ tag=WRJLF4LZKWD8 type=write size=1929415 2024-09-22T08:48:42.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.315+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~M2H62IKU5X3R.0 size=505290 2024-09-22T08:48:42.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.315+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=M2H62IKU5X3R tag=4F3AT2U8JDEB type=write size=1553866 2024-09-22T08:48:42.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.316+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.0 size=1048576 2024-09-22T08:48:42.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.317+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.1 size=1048576 2024-09-22T08:48:42.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.319+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~12K4B0FXQ1Q2.2 size=548169 2024-09-22T08:48:42.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.321+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=12K4B0FXQ1Q2 tag=5HY1KFZE555U type=write size=3693897 2024-09-22T08:48:42.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.323+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=R8RGCM53LHM8 type=del size=2088817 2024-09-22T08:48:42.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.324+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~YSZ801G8S45K.0 size=1048576 2024-09-22T08:48:42.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.325+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~YSZ801G8S45K.1 size=792748 2024-09-22T08:48:42.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.328+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=YSZ801G8S45K tag=07TYMLFG1GL5 type=write size=2889900 2024-09-22T08:48:42.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.329+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=LBW5GDAVKCJX type=del size=1663351 2024-09-22T08:48:42.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.332+0000 7f7b8ef90780 1 < suggested update operation key=O81X7IWXN4VP tag=OD57AITVKZO0 type=del size=30861 2024-09-22T08:48:42.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.334+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=DCKSIR05PJW6 type=del size=1702415 2024-09-22T08:48:42.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.335+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~UW7OOMT65NMA.0 size=781651 2024-09-22T08:48:42.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.338+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=UW7OOMT65NMA tag=2AJX61TL2SCI type=write size=1830227 2024-09-22T08:48:42.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.339+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=DARQK598LO2H type=del size=1640535 2024-09-22T08:48:42.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.341+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=6HNJT23K2NH2 type=write size=1037274 2024-09-22T08:48:42.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.342+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=YAUH2OLBBWP2 type=del size=213260 2024-09-22T08:48:42.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.344+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.0 size=1048576 2024-09-22T08:48:42.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.345+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.1 size=1048576 2024-09-22T08:48:42.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.346+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~DY76CKQ3EH7T.2 size=945928 2024-09-22T08:48:42.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.349+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=DY76CKQ3EH7T tag=L0ACOYG30FFO type=write size=4091656 2024-09-22T08:48:42.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.350+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=C3NIJ440E2A0 type=write size=451655 2024-09-22T08:48:42.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.354+0000 7f7b8ef90780 1 < suggested remove operation key=X9TWX0Z54MOO tag=AY6HXX1F1FKX type=del 2024-09-22T08:48:42.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.356+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EA7YJJMV3FXY.0 size=1048576 2024-09-22T08:48:42.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.357+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EA7YJJMV3FXY.1 size=97982 2024-09-22T08:48:42.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.357+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=EA7YJJMV3FXY tag=AEX742DIRW01 type=write size=2195134 2024-09-22T08:48:42.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.359+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=IWFJVI3W39CK type=del 2024-09-22T08:48:42.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.360+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=SBE89HRRQHF8 type=del size=3202239 2024-09-22T08:48:42.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.362+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=LL4DECSH04EK type=del 2024-09-22T08:48:42.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.363+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=LU5NUQ4DHFD7 type=del size=1259113 2024-09-22T08:48:42.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.365+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~T2JSTL1E1VFH.0 size=176730 2024-09-22T08:48:42.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.367+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=T2JSTL1E1VFH tag=HZTCEIFUZP22 type=write size=1225306 2024-09-22T08:48:42.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.368+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=ZB2UEIBSQM02 type=del size=4080159 2024-09-22T08:48:42.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.370+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.0 size=1048576 2024-09-22T08:48:42.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.371+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.1 size=1048576 2024-09-22T08:48:42.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.373+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~YX146J3LEW53.2 size=106193 2024-09-22T08:48:42.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.375+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=YX146J3LEW53 tag=9L2BAKFZTL5I type=write size=3251921 2024-09-22T08:48:42.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.377+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~NLXLL0RUPS8Q.0 size=1048576 2024-09-22T08:48:42.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.378+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~NLXLL0RUPS8Q.1 size=153701 2024-09-22T08:48:42.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.378+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=NLXLL0RUPS8Q tag=TI8XCJI8CEB6 type=write size=2250853 2024-09-22T08:48:42.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.380+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=YJAKVSIIFWRQ type=del 2024-09-22T08:48:42.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.381+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=3SUIMS4UHN7N type=del size=2888761 2024-09-22T08:48:42.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.383+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=N25LRCBR1FJX type=del 2024-09-22T08:48:42.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.384+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=OVS1IWH4TBTO type=del size=3530699 2024-09-22T08:48:42.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.387+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=56X43JIKR8PZ type=del 2024-09-22T08:48:42.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.388+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=5UPHEVKQTY8X type=del size=728781 2024-09-22T08:48:42.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.390+0000 7f7b8ef90780 -1 < failed to complete operation key=QH6TK0MJKYUO tag=VEY9FYK0YR98 type=write size=313748: (22) Invalid argument 2024-09-22T08:48:42.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.391+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=8TCMH4U8QHB5 type=del size=1304465 2024-09-22T08:48:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.392+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~M2H62IKU5X3R.0 size=505290 2024-09-22T08:48:42.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.395+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=M2H62IKU5X3R tag=4F3AT2U8JDEB type=write size=1553866 2024-09-22T08:48:42.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.397+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~JVAGMM8S8HQI.0 size=1048576 2024-09-22T08:48:42.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.398+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~JVAGMM8S8HQI.1 size=348424 2024-09-22T08:48:42.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.398+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=JVAGMM8S8HQI tag=H5CP84KP56BG type=write size=2445576 2024-09-22T08:48:42.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.400+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=R8RGCM53LHM8 type=del 2024-09-22T08:48:42.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.403+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~5SXUJQPRRFX7.0 size=1048576 2024-09-22T08:48:42.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.404+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~5SXUJQPRRFX7.1 size=836526 2024-09-22T08:48:42.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.404+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=5SXUJQPRRFX7 tag=BPJBBG0552D4 type=write size=2933678 2024-09-22T08:48:42.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.406+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=LBW5GDAVKCJX type=del 2024-09-22T08:48:42.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.408+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~W2A7FITFI5ER.0 size=1048576 2024-09-22T08:48:42.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.410+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~W2A7FITFI5ER.1 size=310662 2024-09-22T08:48:42.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.410+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=W2A7FITFI5ER tag=TYORER3EE8OX type=write size=2407814 2024-09-22T08:48:42.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.411+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=DCKSIR05PJW6 type=del 2024-09-22T08:48:42.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.414+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EOUFADOFWE04.0 size=1048576 2024-09-22T08:48:42.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.415+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EOUFADOFWE04.1 size=681735 2024-09-22T08:48:42.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.415+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=EOUFADOFWE04 tag=GMLZI0XEGLE5 type=write size=2778887 2024-09-22T08:48:42.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.417+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=DARQK598LO2H type=del 2024-09-22T08:48:42.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.418+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=JN1G4615V08Y type=del size=2030724 2024-09-22T08:48:42.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.419+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=YAUH2OLBBWP2 type=del 2024-09-22T08:48:42.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.421+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=AITBJEARQNA8 type=del size=3168299 2024-09-22T08:48:42.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.422+0000 7f7b8ef90780 1 < completed write operation key=Z9CHXCJ02L85 tag=C3NIJ440E2A0 type=write size=451655 2024-09-22T08:48:42.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.424+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=59XGOTK0ITL0 type=del size=2591931 2024-09-22T08:48:42.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.425+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EA7YJJMV3FXY.0 size=1048576 2024-09-22T08:48:42.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.426+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EA7YJJMV3FXY.1 size=97982 2024-09-22T08:48:42.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.428+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=EA7YJJMV3FXY tag=AEX742DIRW01 type=write size=2195134 2024-09-22T08:48:42.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.430+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=474Z9BWNW4PU type=write size=520004 2024-09-22T08:48:42.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.431+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=SBE89HRRQHF8 type=del 2024-09-22T08:48:42.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.433+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=XDQ6YFMZL9PC type=del size=1649533 2024-09-22T08:48:42.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.434+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=LU5NUQ4DHFD7 type=del 2024-09-22T08:48:42.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.436+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=HRWN22RPZDLN type=del size=1977039 2024-09-22T08:48:42.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.437+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=ZB2UEIBSQM02 type=del 2024-09-22T08:48:42.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.440+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~8PWP1QXMU82X.0 size=910754 2024-09-22T08:48:42.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.440+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=8PWP1QXMU82X tag=A858AQECVY0B type=write size=1959330 2024-09-22T08:48:42.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.441+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~NLXLL0RUPS8Q.0 size=1048576 2024-09-22T08:48:42.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.442+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~NLXLL0RUPS8Q.1 size=153701 2024-09-22T08:48:42.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.445+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=NLXLL0RUPS8Q tag=TI8XCJI8CEB6 type=write size=2250853 2024-09-22T08:48:42.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.446+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=VDJR5GEO78A5 type=del size=3827779 2024-09-22T08:48:42.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.447+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=3SUIMS4UHN7N type=del 2024-09-22T08:48:42.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.450+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~LSP42HCU3SG7.0 size=1048576 2024-09-22T08:48:42.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.451+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~LSP42HCU3SG7.1 size=750301 2024-09-22T08:48:42.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.451+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=LSP42HCU3SG7 tag=BIAVJCGUJYYI type=write size=2847453 2024-09-22T08:48:42.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.452+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=OVS1IWH4TBTO type=del 2024-09-22T08:48:42.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.455+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~ON68I27JDNZD.0 size=966737 2024-09-22T08:48:42.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.455+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=ON68I27JDNZD tag=CADZ1L9WSKK6 type=write size=2015313 2024-09-22T08:48:42.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.456+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=5UPHEVKQTY8X type=del 2024-09-22T08:48:42.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.457+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=C7XMIFNJBAEO type=del size=2913034 2024-09-22T08:48:42.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.459+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=8TCMH4U8QHB5 type=del size=1304465 2024-09-22T08:48:42.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.460+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=FWA3EE2T0IJL type=del size=4078714 2024-09-22T08:48:42.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.461+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~JVAGMM8S8HQI.0 size=1048576 2024-09-22T08:48:42.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.462+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~JVAGMM8S8HQI.1 size=348424 2024-09-22T08:48:42.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.464+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=JVAGMM8S8HQI tag=H5CP84KP56BG type=write size=2445576 2024-09-22T08:48:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.467+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~UNHI8MP17CT2.0 size=273733 2024-09-22T08:48:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.467+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=UNHI8MP17CT2 tag=KOJC7X7YK4SA type=write size=1322309 2024-09-22T08:48:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.468+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~5SXUJQPRRFX7.0 size=1048576 2024-09-22T08:48:42.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.469+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~5SXUJQPRRFX7.1 size=836526 2024-09-22T08:48:42.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.471+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=5SXUJQPRRFX7 tag=BPJBBG0552D4 type=write size=2933678 2024-09-22T08:48:42.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.473+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~I0ILYZ0IAWHP.0 size=1048576 2024-09-22T08:48:42.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.474+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~I0ILYZ0IAWHP.1 size=509669 2024-09-22T08:48:42.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.474+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=I0ILYZ0IAWHP tag=1RYEXIWYUVT4 type=write size=2606821 2024-09-22T08:48:42.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.476+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~W2A7FITFI5ER.0 size=1048576 2024-09-22T08:48:42.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.476+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~W2A7FITFI5ER.1 size=310662 2024-09-22T08:48:42.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.479+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=W2A7FITFI5ER tag=TYORER3EE8OX type=write size=2407814 2024-09-22T08:48:42.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.480+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=PRXH9O9L6UNL type=write size=496401 2024-09-22T08:48:42.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.481+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EOUFADOFWE04.0 size=1048576 2024-09-22T08:48:42.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.482+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EOUFADOFWE04.1 size=681735 2024-09-22T08:48:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.484+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=EOUFADOFWE04 tag=GMLZI0XEGLE5 type=write size=2778887 2024-09-22T08:48:42.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.486+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=320SVH6SYU6D type=del size=4097205 2024-09-22T08:48:42.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.487+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=JN1G4615V08Y type=del 2024-09-22T08:48:42.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.489+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~I64UOWIL7FTH.0 size=1048576 2024-09-22T08:48:42.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.491+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~I64UOWIL7FTH.1 size=945677 2024-09-22T08:48:42.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.491+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=I64UOWIL7FTH tag=59Z77TPIRSUI type=write size=3042829 2024-09-22T08:48:42.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.493+0000 7f7b8ef90780 1 < suggested update operation key=YXIZJPACZZFY tag=AITBJEARQNA8 type=del size=3168299 2024-09-22T08:48:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.494+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=V3O46T3YHRJ3 type=write size=1013954 2024-09-22T08:48:42.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.496+0000 7f7b8ef90780 1 < canceled operation key=ORON3U0WY2K5 tag=59XGOTK0ITL0 type=del size=2591931 2024-09-22T08:48:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.498+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~VA96Q1XEJX3C.0 size=898344 2024-09-22T08:48:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.498+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=VA96Q1XEJX3C tag=75L5TCJ4J19Z type=write size=1946920 2024-09-22T08:48:42.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.501+0000 7f7b8ef90780 1 < suggested remove operation key=WDGY8YL16UWI tag=474Z9BWNW4PU type=write 2024-09-22T08:48:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.503+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~ZPVA03FBLN2M.0 size=1048576 2024-09-22T08:48:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.504+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~ZPVA03FBLN2M.1 size=873588 2024-09-22T08:48:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.504+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=ZPVA03FBLN2M tag=L2T2Z6B3Q7P0 type=write size=2970740 2024-09-22T08:48:42.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.505+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=XDQ6YFMZL9PC type=del 2024-09-22T08:48:42.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.506+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=I1D31WHF8R86 type=del size=2244517 2024-09-22T08:48:42.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.508+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=HRWN22RPZDLN type=del 2024-09-22T08:48:42.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.509+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=GOFHL87A2YZT type=write size=244962 2024-09-22T08:48:42.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.510+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~8PWP1QXMU82X.0 size=910754 2024-09-22T08:48:42.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.513+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=8PWP1QXMU82X tag=A858AQECVY0B type=write size=1959330 2024-09-22T08:48:42.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.514+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=ZSJCNXSG0CGL type=del size=3767860 2024-09-22T08:48:42.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.515+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=VDJR5GEO78A5 type=del 2024-09-22T08:48:42.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.516+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=TO83Z2AKLJ3B type=del size=240270 2024-09-22T08:48:42.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.518+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~LSP42HCU3SG7.0 size=1048576 2024-09-22T08:48:42.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.518+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~LSP42HCU3SG7.1 size=750301 2024-09-22T08:48:42.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.521+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=LSP42HCU3SG7 tag=BIAVJCGUJYYI type=write size=2847453 2024-09-22T08:48:42.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.522+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=TK2Z9EKI5O34 type=del size=861771 2024-09-22T08:48:42.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.523+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~ON68I27JDNZD.0 size=966737 2024-09-22T08:48:42.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.526+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=ON68I27JDNZD tag=CADZ1L9WSKK6 type=write size=2015313 2024-09-22T08:48:42.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.527+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=245WWLK54EOZ type=write size=145450 2024-09-22T08:48:42.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.528+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=C7XMIFNJBAEO type=del 2024-09-22T08:48:42.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.530+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=R8CYYQQDX69V type=write size=827329 2024-09-22T08:48:42.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.531+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=FWA3EE2T0IJL type=del 2024-09-22T08:48:42.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.533+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.0 size=1048576 2024-09-22T08:48:42.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.534+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.1 size=1048576 2024-09-22T08:48:42.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.535+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.2 size=676477 2024-09-22T08:48:42.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.535+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=SYTISCC791F6 tag=Z1RXP435BNIC type=write size=3822205 2024-09-22T08:48:42.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.536+0000 7f7b8ef90780 1 < canceled part key=_multipart_9DO6M6UQ5A05.2~UNHI8MP17CT2.0 size=273733 2024-09-22T08:48:42.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.539+0000 7f7b8ef90780 1 < canceled multipart upload key=9DO6M6UQ5A05 upload=UNHI8MP17CT2 tag=KOJC7X7YK4SA type=write size=1322309 2024-09-22T08:48:42.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.540+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=X0OUK78P7F6X type=del size=897453 2024-09-22T08:48:42.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.541+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~I0ILYZ0IAWHP.0 size=1048576 2024-09-22T08:48:42.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.543+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~I0ILYZ0IAWHP.1 size=509669 2024-09-22T08:48:42.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.545+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=I0ILYZ0IAWHP tag=1RYEXIWYUVT4 type=write size=2606821 2024-09-22T08:48:42.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.546+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=3LBL31WI4QFM type=del size=1842599 2024-09-22T08:48:42.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.547+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=PRXH9O9L6UNL type=write size=496401 2024-09-22T08:48:42.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.550+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~4QEHHOTXCGY0.0 size=91874 2024-09-22T08:48:42.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.550+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=4QEHHOTXCGY0 tag=7TP02SOE03XH type=write size=1140450 2024-09-22T08:48:42.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.551+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=320SVH6SYU6D type=del 2024-09-22T08:48:42.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.553+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~53ABSG8N3CJS.0 size=1048576 2024-09-22T08:48:42.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.554+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~53ABSG8N3CJS.1 size=1046215 2024-09-22T08:48:42.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.554+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=53ABSG8N3CJS tag=GAPLB73NN9S2 type=write size=3143367 2024-09-22T08:48:42.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.556+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~I64UOWIL7FTH.0 size=1048576 2024-09-22T08:48:42.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.556+0000 7f7b8ef90780 1 < canceled part key=_multipart_ORON3U0WY2K5.2~I64UOWIL7FTH.1 size=945677 2024-09-22T08:48:42.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.558+0000 7f7b8ef90780 1 < canceled multipart upload key=ORON3U0WY2K5 upload=I64UOWIL7FTH tag=59Z77TPIRSUI type=write size=3042829 2024-09-22T08:48:42.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.559+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=9LPKG4YWL4J4 type=del size=524945 2024-09-22T08:48:42.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.561+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=V3O46T3YHRJ3 type=write size=1013954 2024-09-22T08:48:42.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.562+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=JSDUBFPSY03C type=del size=3145404 2024-09-22T08:48:42.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.563+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~VA96Q1XEJX3C.0 size=898344 2024-09-22T08:48:42.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.566+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=VA96Q1XEJX3C tag=75L5TCJ4J19Z type=write size=1946920 2024-09-22T08:48:42.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.568+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~B9PVH6KH8N6V.0 size=1048576 2024-09-22T08:48:42.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.569+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~B9PVH6KH8N6V.1 size=743550 2024-09-22T08:48:42.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.569+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=B9PVH6KH8N6V tag=N8076MTDZF7Q type=write size=2840702 2024-09-22T08:48:42.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.570+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~ZPVA03FBLN2M.0 size=1048576 2024-09-22T08:48:42.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.571+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~ZPVA03FBLN2M.1 size=873588 2024-09-22T08:48:42.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.574+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=ZPVA03FBLN2M tag=L2T2Z6B3Q7P0 type=write size=2970740 2024-09-22T08:48:42.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.575+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=E0I4ROUB9RYD type=del size=579052 2024-09-22T08:48:42.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.577+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=I1D31WHF8R86 type=del 2024-09-22T08:48:42.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.579+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~33PVYI00SN6Z.0 size=648423 2024-09-22T08:48:42.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.579+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=33PVYI00SN6Z tag=675ZYJ3W9MRZ type=write size=1696999 2024-09-22T08:48:42.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.580+0000 7f7b8ef90780 1 < completed write operation key=F3IHQ6Z9V1DX tag=GOFHL87A2YZT type=write size=244962 2024-09-22T08:48:42.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.582+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=1U5AW3XDFVXH type=write size=943184 2024-09-22T08:48:42.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.583+0000 7f7b8ef90780 1 < canceled operation key=6DC0SVAYR2DB tag=ZSJCNXSG0CGL type=del size=3767860 2024-09-22T08:48:42.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.584+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=EX3HG1YRX2MN type=del size=3018729 2024-09-22T08:48:42.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.586+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=TO83Z2AKLJ3B type=del 2024-09-22T08:48:42.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.587+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=70417Z07JZ3G type=write size=863640 2024-09-22T08:48:42.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.589+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=TK2Z9EKI5O34 type=del 2024-09-22T08:48:42.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.590+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=MMTT7Q11LVFX type=del size=2630288 2024-09-22T08:48:42.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.593+0000 7f7b8ef90780 1 < suggested remove operation key=G51KS3NM4VFY tag=245WWLK54EOZ type=write 2024-09-22T08:48:42.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.595+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~W2KGOJZLFAFS.0 size=959884 2024-09-22T08:48:42.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.595+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=W2KGOJZLFAFS tag=NVOY8GS5XAEY type=write size=2008460 2024-09-22T08:48:42.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.597+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=R8CYYQQDX69V type=write size=827329 2024-09-22T08:48:42.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.598+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=HXPF1LZPV7NR type=del size=2431135 2024-09-22T08:48:42.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.599+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.0 size=1048576 2024-09-22T08:48:42.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.599+0000 7f7b8ef90780 1 < canceled part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.1 size=1048576 2024-09-22T08:48:42.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.601+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~SYTISCC791F6.2 size=676477 2024-09-22T08:48:42.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.603+0000 7f7b8ef90780 1 < canceled multipart upload key=X9TWX0Z54MOO upload=SYTISCC791F6 tag=Z1RXP435BNIC type=write size=3822205 2024-09-22T08:48:42.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.605+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1GBJ5C2HAXLS.0 size=15108 2024-09-22T08:48:42.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.605+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=1GBJ5C2HAXLS tag=CQRKGN5MY8FJ type=write size=1063684 2024-09-22T08:48:42.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.607+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=X0OUK78P7F6X type=del 2024-09-22T08:48:42.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.609+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=8XDVGJ1CJU1O type=del size=3058972 2024-09-22T08:48:42.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.610+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=3LBL31WI4QFM type=del 2024-09-22T08:48:42.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.611+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=D2XF8H92KQCZ type=del size=534655 2024-09-22T08:48:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.613+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~4QEHHOTXCGY0.0 size=91874 2024-09-22T08:48:42.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.615+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=4QEHHOTXCGY0 tag=7TP02SOE03XH type=write size=1140450 2024-09-22T08:48:42.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.617+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=GT5ECBVK0ZNE type=del size=174254 2024-09-22T08:48:42.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.618+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~53ABSG8N3CJS.0 size=1048576 2024-09-22T08:48:42.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.619+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~53ABSG8N3CJS.1 size=1046215 2024-09-22T08:48:42.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.621+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=53ABSG8N3CJS tag=GAPLB73NN9S2 type=write size=3143367 2024-09-22T08:48:42.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.624+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OUM39CI043PO.0 size=546429 2024-09-22T08:48:42.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.624+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=OUM39CI043PO tag=E92UMYM4LDCX type=write size=1595005 2024-09-22T08:48:42.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.625+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=9LPKG4YWL4J4 type=del 2024-09-22T08:48:42.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.628+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~SQ0JRULIIVK2.0 size=971329 2024-09-22T08:48:42.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.628+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=SQ0JRULIIVK2 tag=4XYPYQEOUNFX type=write size=2019905 2024-09-22T08:48:42.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.630+0000 7f7b8ef90780 1 < suggested update operation key=X9TWX0Z54MOO tag=JSDUBFPSY03C type=del size=3145404 2024-09-22T08:48:42.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.633+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~LK60H87KFXHR.0 size=573540 2024-09-22T08:48:42.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.633+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=LK60H87KFXHR tag=QY5AQ0UDFGOD type=write size=1622116 2024-09-22T08:48:42.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.634+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~B9PVH6KH8N6V.0 size=1048576 2024-09-22T08:48:42.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.636+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~B9PVH6KH8N6V.1 size=743550 2024-09-22T08:48:42.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.638+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=B9PVH6KH8N6V tag=N8076MTDZF7Q type=write size=2840702 2024-09-22T08:48:42.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.639+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=97JXH56AUD45 type=write size=995178 2024-09-22T08:48:42.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.640+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=E0I4ROUB9RYD type=del 2024-09-22T08:48:42.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.0 size=1048576 2024-09-22T08:48:42.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.644+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.1 size=1048576 2024-09-22T08:48:42.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.645+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.2 size=8935 2024-09-22T08:48:42.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.645+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=1FTFLT31S03V tag=YQKKV7MOV1YT type=write size=3154663 2024-09-22T08:48:42.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.646+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~33PVYI00SN6Z.0 size=648423 2024-09-22T08:48:42.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.649+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=33PVYI00SN6Z tag=675ZYJ3W9MRZ type=write size=1696999 2024-09-22T08:48:42.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.650+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=9JAXK8HDMUBL type=del size=3700977 2024-09-22T08:48:42.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.653+0000 7f7b8ef90780 1 < suggested remove operation key=UQPY2ITDMKGO tag=1U5AW3XDFVXH type=write 2024-09-22T08:48:42.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.654+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=2W864E5DX2F7 type=del size=3862359 2024-09-22T08:48:42.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.655+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=EX3HG1YRX2MN type=del 2024-09-22T08:48:42.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.658+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~FZ5KJCRTV8DK.0 size=275941 2024-09-22T08:48:42.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.658+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=FZ5KJCRTV8DK tag=DJWV4982229F type=write size=1324517 2024-09-22T08:48:42.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.660+0000 7f7b8ef90780 1 < suggested update operation key=70WNR3KVU0BG tag=70417Z07JZ3G type=write size=863640 2024-09-22T08:48:42.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.662+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=Z2SXE3BEU9M1 type=write size=67642 2024-09-22T08:48:42.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.663+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=MMTT7Q11LVFX type=del 2024-09-22T08:48:42.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.666+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~12SDV23V8NE5.0 size=1048576 2024-09-22T08:48:42.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.668+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~12SDV23V8NE5.1 size=479773 2024-09-22T08:48:42.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.668+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=12SDV23V8NE5 tag=7GN70D2JUQZ7 type=write size=2576925 2024-09-22T08:48:42.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.669+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~W2KGOJZLFAFS.0 size=959884 2024-09-22T08:48:42.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.671+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=W2KGOJZLFAFS tag=NVOY8GS5XAEY type=write size=2008460 2024-09-22T08:48:42.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.674+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.0 size=1048576 2024-09-22T08:48:42.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.675+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.1 size=1048576 2024-09-22T08:48:42.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.676+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.2 size=657482 2024-09-22T08:48:42.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.676+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=UA1T1RUY7OYN tag=6QQ27B55G6SB type=write size=3803210 2024-09-22T08:48:42.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.677+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=HXPF1LZPV7NR type=del size=2431135 2024-09-22T08:48:42.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.679+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.0 size=1048576 2024-09-22T08:48:42.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.681+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.1 size=1048576 2024-09-22T08:48:42.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.682+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.2 size=844422 2024-09-22T08:48:42.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.682+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=OMTXE9T0TNBC tag=G9I8ZRMNQNLN type=write size=3990150 2024-09-22T08:48:42.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.683+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~1GBJ5C2HAXLS.0 size=15108 2024-09-22T08:48:42.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.685+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=1GBJ5C2HAXLS tag=CQRKGN5MY8FJ type=write size=1063684 2024-09-22T08:48:42.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.688+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~ZW4EY0ABXND9.0 size=1048576 2024-09-22T08:48:42.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.689+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~ZW4EY0ABXND9.1 size=214065 2024-09-22T08:48:42.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.689+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=ZW4EY0ABXND9 tag=NTBPRS3HZSVZ type=write size=2311217 2024-09-22T08:48:42.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.691+0000 7f7b8ef90780 1 < suggested update operation key=70WNR3KVU0BG tag=8XDVGJ1CJU1O type=del size=3058972 2024-09-22T08:48:42.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.693+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=BD6A6UAAMO4W type=del size=43320 2024-09-22T08:48:42.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.695+0000 7f7b8ef90780 1 < suggested remove operation key=L1URDVW43BUG tag=D2XF8H92KQCZ type=del 2024-09-22T08:48:42.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.696+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=MDS0LW4MV4CV type=del size=1445673 2024-09-22T08:48:42.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.698+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=GT5ECBVK0ZNE type=del 2024-09-22T08:48:42.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.699+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=VOEJSGMIEYX5 type=del size=3483343 2024-09-22T08:48:42.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.700+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~OUM39CI043PO.0 size=546429 2024-09-22T08:48:42.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.702+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=OUM39CI043PO tag=E92UMYM4LDCX type=write size=1595005 2024-09-22T08:48:42.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.703+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=PQT3PW9QXYD1 type=del size=1575228 2024-09-22T08:48:42.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.705+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~SQ0JRULIIVK2.0 size=971329 2024-09-22T08:48:42.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.707+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=SQ0JRULIIVK2 tag=4XYPYQEOUNFX type=write size=2019905 2024-09-22T08:48:42.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.708+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=WG0YDXZ8SPJS type=del size=2178299 2024-09-22T08:48:42.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.709+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~LK60H87KFXHR.0 size=573540 2024-09-22T08:48:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.711+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=LK60H87KFXHR tag=QY5AQ0UDFGOD type=write size=1622116 2024-09-22T08:48:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.714+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~YB2Y8J8CV3LA.0 size=474361 2024-09-22T08:48:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.714+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=YB2Y8J8CV3LA tag=TQXKTYIGJ00V type=write size=1522937 2024-09-22T08:48:42.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.715+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=97JXH56AUD45 type=write size=995178 2024-09-22T08:48:42.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.717+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~CLM140XSWY6G.0 size=1048576 2024-09-22T08:48:42.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.718+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~CLM140XSWY6G.1 size=990982 2024-09-22T08:48:42.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.718+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=CLM140XSWY6G tag=JR83EV38IOCC type=write size=3088134 2024-09-22T08:48:42.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.720+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.0 size=1048576 2024-09-22T08:48:42.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.721+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.1 size=1048576 2024-09-22T08:48:42.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.722+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~1FTFLT31S03V.2 size=8935 2024-09-22T08:48:42.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.724+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=1FTFLT31S03V tag=YQKKV7MOV1YT type=write size=3154663 2024-09-22T08:48:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.725+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=8KIYNBXHPR3I type=write size=4399 2024-09-22T08:48:42.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.726+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=9JAXK8HDMUBL type=del 2024-09-22T08:48:42.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.729+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~IELW16M0HS2B.0 size=1048576 2024-09-22T08:48:42.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.730+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~IELW16M0HS2B.1 size=81592 2024-09-22T08:48:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.730+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=IELW16M0HS2B tag=VZKX3B3TOJLB type=write size=2178744 2024-09-22T08:48:42.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.731+0000 7f7b8ef90780 -1 < failed to complete operation key=L1URDVW43BUG tag=2W864E5DX2F7 type=del size=3862359: (22) Invalid argument 2024-09-22T08:48:42.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.732+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=LDJH2JTB7SBD type=write size=772275 2024-09-22T08:48:42.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.733+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~FZ5KJCRTV8DK.0 size=275941 2024-09-22T08:48:42.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.735+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=FZ5KJCRTV8DK tag=DJWV4982229F type=write size=1324517 2024-09-22T08:48:42.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.737+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=DOIMWY2LDA5K type=write size=998654 2024-09-22T08:48:42.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.738+0000 7f7b8ef90780 -1 < failed to complete operation key=70WNR3KVU0BG tag=Z2SXE3BEU9M1 type=write size=67642: (22) Invalid argument 2024-09-22T08:48:42.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.740+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~JNG8GRU6Z82C.0 size=97785 2024-09-22T08:48:42.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.740+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=JNG8GRU6Z82C tag=DJ5F6NHTA113 type=write size=1146361 2024-09-22T08:48:42.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.741+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~12SDV23V8NE5.0 size=1048576 2024-09-22T08:48:42.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.741+0000 7f7b8ef90780 1 < canceled part key=_multipart_T43DW9JPG1BU.2~12SDV23V8NE5.1 size=479773 2024-09-22T08:48:42.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.743+0000 7f7b8ef90780 1 < canceled multipart upload key=T43DW9JPG1BU upload=12SDV23V8NE5 tag=7GN70D2JUQZ7 type=write size=2576925 2024-09-22T08:48:42.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.746+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~0IBRVIIDQGXW.0 size=961495 2024-09-22T08:48:42.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.746+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=0IBRVIIDQGXW tag=7V2LSVDD5J4M type=write size=2010071 2024-09-22T08:48:42.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.747+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.0 size=1048576 2024-09-22T08:48:42.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.748+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.1 size=1048576 2024-09-22T08:48:42.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.749+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~UA1T1RUY7OYN.2 size=657482 2024-09-22T08:48:42.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.751+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=UA1T1RUY7OYN tag=6QQ27B55G6SB type=write size=3803210 2024-09-22T08:48:42.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.752+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=A46ABHD8AN5L type=del size=980170 2024-09-22T08:48:42.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.753+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.0 size=1048576 2024-09-22T08:48:42.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.754+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.1 size=1048576 2024-09-22T08:48:42.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.755+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~OMTXE9T0TNBC.2 size=844422 2024-09-22T08:48:42.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.758+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=OMTXE9T0TNBC tag=G9I8ZRMNQNLN type=write size=3990150 2024-09-22T08:48:42.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.760+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~H2EC3URP2ENF.0 size=690745 2024-09-22T08:48:42.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.760+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=H2EC3URP2ENF tag=IJ452B3OIU58 type=write size=1739321 2024-09-22T08:48:42.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.760+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~ZW4EY0ABXND9.0 size=1048576 2024-09-22T08:48:42.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.761+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~ZW4EY0ABXND9.1 size=214065 2024-09-22T08:48:42.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.763+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=ZW4EY0ABXND9 tag=NTBPRS3HZSVZ type=write size=2311217 2024-09-22T08:48:42.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.765+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=FR7K38TAWLT9 type=del size=120968 2024-09-22T08:48:42.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.766+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=BD6A6UAAMO4W type=del 2024-09-22T08:48:42.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.768+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~N2U7RSFTYTJI.0 size=752847 2024-09-22T08:48:42.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.768+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=N2U7RSFTYTJI tag=N36DLRICBQ72 type=write size=1801423 2024-09-22T08:48:42.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.770+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=MDS0LW4MV4CV type=del 2024-09-22T08:48:42.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.772+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.0 size=1048576 2024-09-22T08:48:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.773+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.1 size=1048576 2024-09-22T08:48:42.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.774+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.2 size=64182 2024-09-22T08:48:42.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.774+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=30OZ0ZF8Q95B tag=JNLTMUMAAJSB type=write size=3209910 2024-09-22T08:48:42.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.775+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=VOEJSGMIEYX5 type=del 2024-09-22T08:48:42.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.777+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=D8VYOU6AD08H type=write size=740025 2024-09-22T08:48:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.778+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=PQT3PW9QXYD1 type=del 2024-09-22T08:48:42.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.779+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=CY7IJYEZ2VJ6 type=del size=1029931 2024-09-22T08:48:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.781+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=WG0YDXZ8SPJS type=del 2024-09-22T08:48:42.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.783+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=9K95K4P2HKUV type=del size=785249 2024-09-22T08:48:42.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.784+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~YB2Y8J8CV3LA.0 size=474361 2024-09-22T08:48:42.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.786+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=YB2Y8J8CV3LA tag=TQXKTYIGJ00V type=write size=1522937 2024-09-22T08:48:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.788+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=2KMRU2EP5YN9 type=del size=2479243 2024-09-22T08:48:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.789+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~CLM140XSWY6G.0 size=1048576 2024-09-22T08:48:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.790+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~CLM140XSWY6G.1 size=990982 2024-09-22T08:48:42.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.792+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=CLM140XSWY6G tag=JR83EV38IOCC type=write size=3088134 2024-09-22T08:48:42.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.794+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=PL52GIRMI0CM type=del size=925405 2024-09-22T08:48:42.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.795+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=8KIYNBXHPR3I type=write size=4399 2024-09-22T08:48:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.796+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=0LSVNL77VDCD type=del size=1731071 2024-09-22T08:48:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.796+0000 7f7b8ef90780 1 < canceled part key=_multipart_QH6TK0MJKYUO.2~IELW16M0HS2B.0 size=1048576 2024-09-22T08:48:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.797+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~IELW16M0HS2B.1 size=81592 2024-09-22T08:48:42.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.800+0000 7f7b8ef90780 1 < canceled multipart upload key=QH6TK0MJKYUO upload=IELW16M0HS2B tag=VZKX3B3TOJLB type=write size=2178744 2024-09-22T08:48:42.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.801+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=8I3IC3J14CR2 type=write size=470682 2024-09-22T08:48:42.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.802+0000 7f7b8ef90780 1 < completed write operation key=9DO6M6UQ5A05 tag=LDJH2JTB7SBD type=write size=772275 2024-09-22T08:48:42.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.805+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~6G32ELTC4ZS6.0 size=638404 2024-09-22T08:48:42.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.805+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=6G32ELTC4ZS6 tag=COVE1NI3BN9V type=write size=1686980 2024-09-22T08:48:42.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.806+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=DOIMWY2LDA5K type=write size=998654 2024-09-22T08:48:42.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.808+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=Y4PY8KD814ML type=del size=4020758 2024-09-22T08:48:42.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.809+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~JNG8GRU6Z82C.0 size=97785 2024-09-22T08:48:42.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.812+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=JNG8GRU6Z82C tag=DJ5F6NHTA113 type=write size=1146361 2024-09-22T08:48:42.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.813+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=MSOLI7C190KH type=del size=1859942 2024-09-22T08:48:42.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.814+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~0IBRVIIDQGXW.0 size=961495 2024-09-22T08:48:42.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.817+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=0IBRVIIDQGXW tag=7V2LSVDD5J4M type=write size=2010071 2024-09-22T08:48:42.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.818+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=XEWQLQZZOROA type=del size=209584 2024-09-22T08:48:42.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.821+0000 7f7b8ef90780 1 < suggested update operation key=UQPY2ITDMKGO tag=A46ABHD8AN5L type=del size=980170 2024-09-22T08:48:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.822+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=1K6ZV9S4A759 type=del size=1793233 2024-09-22T08:48:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.823+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~H2EC3URP2ENF.0 size=690745 2024-09-22T08:48:42.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.826+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=H2EC3URP2ENF tag=IJ452B3OIU58 type=write size=1739321 2024-09-22T08:48:42.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.827+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=D11AX608S8X4 type=del size=2140164 2024-09-22T08:48:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.830+0000 7f7b8ef90780 1 < suggested update operation key=ZM6ITJ2QUIPJ tag=FR7K38TAWLT9 type=del size=120968 2024-09-22T08:48:42.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.831+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=OWSKQFY0L5BM type=del size=348235 2024-09-22T08:48:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.833+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~N2U7RSFTYTJI.0 size=752847 2024-09-22T08:48:42.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.835+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=N2U7RSFTYTJI tag=N36DLRICBQ72 type=write size=1801423 2024-09-22T08:48:42.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.837+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~GPZK2KQWHXP7.0 size=747640 2024-09-22T08:48:42.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.837+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=GPZK2KQWHXP7 tag=SQXJ2VWFPW03 type=write size=1796216 2024-09-22T08:48:42.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.839+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.0 size=1048576 2024-09-22T08:48:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.840+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.1 size=1048576 2024-09-22T08:48:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.841+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~30OZ0ZF8Q95B.2 size=64182 2024-09-22T08:48:42.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.843+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=30OZ0ZF8Q95B tag=JNLTMUMAAJSB type=write size=3209910 2024-09-22T08:48:42.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.844+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=ZB9WI5APKRPR type=del size=231289 2024-09-22T08:48:42.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.846+0000 7f7b8ef90780 1 < completed write operation key=4ZJ4E4SUA01H tag=D8VYOU6AD08H type=write size=740025 2024-09-22T08:48:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.847+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=BCIJU35C17KN type=write size=552939 2024-09-22T08:48:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.848+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=CY7IJYEZ2VJ6 type=del 2024-09-22T08:48:42.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.850+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=G31SB0W1NCXS type=del size=3723806 2024-09-22T08:48:42.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.851+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=9K95K4P2HKUV type=del 2024-09-22T08:48:42.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.853+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=QK6Q1PCR0KUM type=del size=3108858 2024-09-22T08:48:42.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.856+0000 7f7b8ef90780 1 < suggested update operation key=ZM6ITJ2QUIPJ tag=2KMRU2EP5YN9 type=del size=2479243 2024-09-22T08:48:42.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.857+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=OFZM0UJEZGX5 type=del size=1157693 2024-09-22T08:48:42.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.859+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=PL52GIRMI0CM type=del 2024-09-22T08:48:42.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.860+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=T9HMJM3OOKPE type=write size=451234 2024-09-22T08:48:42.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.862+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=0LSVNL77VDCD type=del 2024-09-22T08:48:42.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.863+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=YDHTUJ30ZCA0 type=del size=2395589 2024-09-22T08:48:42.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.865+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=8I3IC3J14CR2 type=write size=470682 2024-09-22T08:48:42.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.866+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=OA2N5OZVIMFK type=del size=2910435 2024-09-22T08:48:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.868+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~6G32ELTC4ZS6.0 size=638404 2024-09-22T08:48:42.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.870+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=6G32ELTC4ZS6 tag=COVE1NI3BN9V type=write size=1686980 2024-09-22T08:48:42.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.872+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=29EQJ0CTPDGK type=write size=952006 2024-09-22T08:48:42.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.873+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=Y4PY8KD814ML type=del 2024-09-22T08:48:42.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.876+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.0 size=1048576 2024-09-22T08:48:42.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.878+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.1 size=1048576 2024-09-22T08:48:42.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.879+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.2 size=783887 2024-09-22T08:48:42.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.879+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=R30NF0Z5BTVX tag=QZ39KJ9KUY13 type=write size=3929615 2024-09-22T08:48:42.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.880+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=MSOLI7C190KH type=del 2024-09-22T08:48:42.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.882+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=6J7FJFPKF9EU type=del size=1812412 2024-09-22T08:48:42.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.883+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=XEWQLQZZOROA type=del 2024-09-22T08:48:42.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.885+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=E678OR64Y6GG type=write size=284725 2024-09-22T08:48:42.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.886+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=1K6ZV9S4A759 type=del 2024-09-22T08:48:42.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.889+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~3U689R1KDH5V.0 size=67308 2024-09-22T08:48:42.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.889+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=3U689R1KDH5V tag=R7T7BY0P2ZSJ type=write size=1115884 2024-09-22T08:48:42.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.891+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=D11AX608S8X4 type=del 2024-09-22T08:48:42.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.892+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=4ZCL2E30CJVX type=del size=424689 2024-09-22T08:48:42.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.894+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=OWSKQFY0L5BM type=del 2024-09-22T08:48:42.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.895+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=0ZJG2RZF419G type=write size=433671 2024-09-22T08:48:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.897+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~GPZK2KQWHXP7.0 size=747640 2024-09-22T08:48:42.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.899+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=GPZK2KQWHXP7 tag=SQXJ2VWFPW03 type=write size=1796216 2024-09-22T08:48:42.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.902+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.0 size=1048576 2024-09-22T08:48:42.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.903+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.1 size=1048576 2024-09-22T08:48:42.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.904+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.2 size=545719 2024-09-22T08:48:42.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.904+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=7F4UXUYZ0HWD tag=IVX7C0G0RJVE type=write size=3691447 2024-09-22T08:48:42.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.907+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=ZB9WI5APKRPR type=del size=231289 2024-09-22T08:48:42.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.909+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=TVL93MWS1FN6 type=del size=2726343 2024-09-22T08:48:42.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.910+0000 7f7b8ef90780 -1 < failed to complete operation key=WDGY8YL16UWI tag=BCIJU35C17KN type=write size=552939: (22) Invalid argument 2024-09-22T08:48:42.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.911+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=PVSSOB45CHHT type=write size=143901 2024-09-22T08:48:42.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.913+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=G31SB0W1NCXS type=del 2024-09-22T08:48:42.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.914+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=LZD0SVYHQ866 type=del size=2560915 2024-09-22T08:48:42.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.915+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=QK6Q1PCR0KUM type=del 2024-09-22T08:48:42.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.917+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=HCKGS77KJR7J type=del size=3800512 2024-09-22T08:48:42.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.920+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=OFZM0UJEZGX5 type=del 2024-09-22T08:48:42.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.921+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=DP6PY8B1FBR1 type=del size=2549619 2024-09-22T08:48:42.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.922+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=T9HMJM3OOKPE type=write size=451234 2024-09-22T08:48:42.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.925+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.0 size=1048576 2024-09-22T08:48:42.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.926+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.1 size=1048576 2024-09-22T08:48:42.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.927+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.2 size=410500 2024-09-22T08:48:42.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.927+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=GTJZTCJ5C5VG tag=5MTWLOH1UXLR type=write size=3556228 2024-09-22T08:48:42.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.928+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=YDHTUJ30ZCA0 type=del 2024-09-22T08:48:42.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.930+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~WXCAHD5B2EUB.0 size=289061 2024-09-22T08:48:42.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.930+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=WXCAHD5B2EUB tag=1EKF8W4I09V3 type=write size=1337637 2024-09-22T08:48:42.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.932+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=OA2N5OZVIMFK type=del 2024-09-22T08:48:42.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.934+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~APRV5LFYKJTD.0 size=1048576 2024-09-22T08:48:42.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.935+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~APRV5LFYKJTD.1 size=833081 2024-09-22T08:48:42.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.935+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=APRV5LFYKJTD tag=6YW0IUR781DT type=write size=2930233 2024-09-22T08:48:42.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.936+0000 7f7b8ef90780 1 < completed write operation key=4ZJ4E4SUA01H tag=29EQJ0CTPDGK type=write size=952006 2024-09-22T08:48:42.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.939+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~31RLY164RM40.0 size=1048576 2024-09-22T08:48:42.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.940+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~31RLY164RM40.1 size=880919 2024-09-22T08:48:42.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.940+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=31RLY164RM40 tag=U6PYBBDQRL49 type=write size=2978071 2024-09-22T08:48:42.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.941+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.0 size=1048576 2024-09-22T08:48:42.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.942+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.1 size=1048576 2024-09-22T08:48:42.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.943+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~R30NF0Z5BTVX.2 size=783887 2024-09-22T08:48:42.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.945+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=R30NF0Z5BTVX tag=QZ39KJ9KUY13 type=write size=3929615 2024-09-22T08:48:42.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.946+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=8SROQTARCAI1 type=write size=562841 2024-09-22T08:48:42.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.948+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=6J7FJFPKF9EU type=del 2024-09-22T08:48:42.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.949+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=7VOR5IB8L233 type=write size=83531 2024-09-22T08:48:42.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.950+0000 7f7b8ef90780 1 < canceled operation key=4ZJ4E4SUA01H tag=E678OR64Y6GG type=write size=284725 2024-09-22T08:48:42.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.952+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=J5J8BN7SXPQA type=del size=751130 2024-09-22T08:48:42.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.953+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~3U689R1KDH5V.0 size=67308 2024-09-22T08:48:42.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.955+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=3U689R1KDH5V tag=R7T7BY0P2ZSJ type=write size=1115884 2024-09-22T08:48:42.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.956+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=0BUKU7VOEMI8 type=write size=435169 2024-09-22T08:48:42.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.958+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=4ZCL2E30CJVX type=del 2024-09-22T08:48:42.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.960+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~H06BQCLTPAUS.0 size=330492 2024-09-22T08:48:42.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.960+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=H06BQCLTPAUS tag=6NL0RL3VM47V type=write size=1379068 2024-09-22T08:48:42.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.962+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=0ZJG2RZF419G type=write 2024-09-22T08:48:42.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.964+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=1ZP8INRXVL8O type=del size=4046755 2024-09-22T08:48:42.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.964+0000 7f7b8ef90780 1 < canceled part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.0 size=1048576 2024-09-22T08:48:42.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.965+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.1 size=1048576 2024-09-22T08:48:42.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.966+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~7F4UXUYZ0HWD.2 size=545719 2024-09-22T08:48:42.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.968+0000 7f7b8ef90780 1 < canceled multipart upload key=QQKJ4URBRF16 upload=7F4UXUYZ0HWD tag=IVX7C0G0RJVE type=write size=3691447 2024-09-22T08:48:42.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.970+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.0 size=1048576 2024-09-22T08:48:42.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.971+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.1 size=1048576 2024-09-22T08:48:42.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.972+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.2 size=40286 2024-09-22T08:48:42.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.972+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=4WUO1IINJU7E tag=TQC1Y9FB18VB type=write size=3186014 2024-09-22T08:48:42.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.974+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=TVL93MWS1FN6 type=del 2024-09-22T08:48:42.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.976+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~CWL4ZSCIL9MD.0 size=1048576 2024-09-22T08:48:42.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.977+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~CWL4ZSCIL9MD.1 size=346644 2024-09-22T08:48:42.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.977+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=CWL4ZSCIL9MD tag=HCFSEGLDY2NW type=write size=2443796 2024-09-22T08:48:42.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.978+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=PVSSOB45CHHT type=write size=143901 2024-09-22T08:48:42.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.979+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=15Y1LSZ8XWEX type=write size=209924 2024-09-22T08:48:42.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.981+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=LZD0SVYHQ866 type=del 2024-09-22T08:48:42.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.983+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.0 size=1048576 2024-09-22T08:48:42.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.984+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.1 size=1048576 2024-09-22T08:48:42.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.985+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.2 size=866074 2024-09-22T08:48:42.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.985+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=4GAJL61GMAW2 tag=E6OARL3FDOQR type=write size=4011802 2024-09-22T08:48:42.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.987+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=HCKGS77KJR7J type=del 2024-09-22T08:48:42.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.989+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=8X26ZYXS7BZB type=del size=1305209 2024-09-22T08:48:42.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.990+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=DP6PY8B1FBR1 type=del 2024-09-22T08:48:42.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.992+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~11OIFR0JIEDB.0 size=1048576 2024-09-22T08:48:42.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.993+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~11OIFR0JIEDB.1 size=872729 2024-09-22T08:48:42.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.993+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=11OIFR0JIEDB tag=SWQTCQBAM5U3 type=write size=2969881 2024-09-22T08:48:42.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.995+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.0 size=1048576 2024-09-22T08:48:42.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.996+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.1 size=1048576 2024-09-22T08:48:42.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.997+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GTJZTCJ5C5VG.2 size=410500 2024-09-22T08:48:43.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:42.999+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=GTJZTCJ5C5VG tag=5MTWLOH1UXLR type=write size=3556228 2024-09-22T08:48:43.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.001+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.0 size=1048576 2024-09-22T08:48:43.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.002+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.1 size=1048576 2024-09-22T08:48:43.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.003+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.2 size=121352 2024-09-22T08:48:43.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.003+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=A2RLF3XHS24A tag=VT3O16R4H1LO type=write size=3267080 2024-09-22T08:48:43.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.005+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~WXCAHD5B2EUB.0 size=289061 2024-09-22T08:48:43.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.007+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=WXCAHD5B2EUB tag=1EKF8W4I09V3 type=write size=1337637 2024-09-22T08:48:43.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.009+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~P21AIBE9KS02.0 size=948344 2024-09-22T08:48:43.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.009+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=P21AIBE9KS02 tag=WE3GH0SDQSQ6 type=write size=1996920 2024-09-22T08:48:43.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.011+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~APRV5LFYKJTD.0 size=1048576 2024-09-22T08:48:43.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.012+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~APRV5LFYKJTD.1 size=833081 2024-09-22T08:48:43.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.014+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=APRV5LFYKJTD tag=6YW0IUR781DT type=write size=2930233 2024-09-22T08:48:43.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.016+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=S6QYT3JX39J4 type=del size=2753476 2024-09-22T08:48:43.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.017+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~31RLY164RM40.0 size=1048576 2024-09-22T08:48:43.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.018+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~31RLY164RM40.1 size=880919 2024-09-22T08:48:43.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.020+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=31RLY164RM40 tag=U6PYBBDQRL49 type=write size=2978071 2024-09-22T08:48:43.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.023+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~F0HSJG5KYZXG.0 size=1048576 2024-09-22T08:48:43.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.024+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~F0HSJG5KYZXG.1 size=771062 2024-09-22T08:48:43.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.024+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=F0HSJG5KYZXG tag=RP3YO47CSMTD type=write size=2868214 2024-09-22T08:48:43.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.025+0000 7f7b8ef90780 1 < completed write operation key=Y7W0V6YTDFIB tag=8SROQTARCAI1 type=write size=562841 2024-09-22T08:48:43.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.026+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=KP4HRLLQ5EWW type=del size=972984 2024-09-22T08:48:43.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.029+0000 7f7b8ef90780 1 < suggested remove operation key=Z9CHXCJ02L85 tag=7VOR5IB8L233 type=write 2024-09-22T08:48:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.031+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.0 size=1048576 2024-09-22T08:48:43.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.032+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.1 size=1048576 2024-09-22T08:48:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.033+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.2 size=22023 2024-09-22T08:48:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.033+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=W1URR0EIA63B tag=LD10UC56VQIL type=write size=3167751 2024-09-22T08:48:43.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.035+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=J5J8BN7SXPQA type=del 2024-09-22T08:48:43.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.036+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=Z5XP4PM42OF8 type=del size=1040856 2024-09-22T08:48:43.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.038+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=0BUKU7VOEMI8 type=write size=435169 2024-09-22T08:48:43.040 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.039+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=ZUGR83G5TVZH type=del size=2811609 2024-09-22T08:48:43.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.041+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~H06BQCLTPAUS.0 size=330492 2024-09-22T08:48:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.043+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=H06BQCLTPAUS tag=6NL0RL3VM47V type=write size=1379068 2024-09-22T08:48:43.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.044+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=KKG43BK7R1MF type=del size=4109625 2024-09-22T08:48:43.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.046+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=1ZP8INRXVL8O type=del 2024-09-22T08:48:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.047+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=XSCXON2YNUEV type=del size=3969550 2024-09-22T08:48:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.048+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.0 size=1048576 2024-09-22T08:48:43.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.049+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.1 size=1048576 2024-09-22T08:48:43.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.049+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~4WUO1IINJU7E.2 size=40286 2024-09-22T08:48:43.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.052+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=4WUO1IINJU7E tag=TQC1Y9FB18VB type=write size=3186014 2024-09-22T08:48:43.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.053+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=3OIIM0SYTQ3V type=write size=244106 2024-09-22T08:48:43.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.055+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~CWL4ZSCIL9MD.0 size=1048576 2024-09-22T08:48:43.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.055+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~CWL4ZSCIL9MD.1 size=346644 2024-09-22T08:48:43.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.057+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=CWL4ZSCIL9MD tag=HCFSEGLDY2NW type=write size=2443796 2024-09-22T08:48:43.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.058+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=PLUUW59EN32X type=del size=4177659 2024-09-22T08:48:43.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.059+0000 7f7b8ef90780 -1 < failed to complete operation key=RX3H0G6WHB9L tag=15Y1LSZ8XWEX type=write size=209924: (22) Invalid argument 2024-09-22T08:48:43.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.061+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~823LE6SDQC5I.0 size=1048576 2024-09-22T08:48:43.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.062+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~823LE6SDQC5I.1 size=209720 2024-09-22T08:48:43.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.062+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=823LE6SDQC5I tag=T11D5XTVNZ6D type=write size=2306872 2024-09-22T08:48:43.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.064+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.0 size=1048576 2024-09-22T08:48:43.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.064+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.1 size=1048576 2024-09-22T08:48:43.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.065+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~4GAJL61GMAW2.2 size=866074 2024-09-22T08:48:43.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.067+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=4GAJL61GMAW2 tag=E6OARL3FDOQR type=write size=4011802 2024-09-22T08:48:43.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.068+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=EJOTEID6ZM37 type=del size=2887947 2024-09-22T08:48:43.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.069+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=8X26ZYXS7BZB type=del 2024-09-22T08:48:43.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.072+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~H8VZEJOQRNQM.0 size=226867 2024-09-22T08:48:43.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.072+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=H8VZEJOQRNQM tag=1WQA4W897NBH type=write size=1275443 2024-09-22T08:48:43.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.073+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~11OIFR0JIEDB.0 size=1048576 2024-09-22T08:48:43.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.074+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~11OIFR0JIEDB.1 size=872729 2024-09-22T08:48:43.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.076+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=11OIFR0JIEDB tag=SWQTCQBAM5U3 type=write size=2969881 2024-09-22T08:48:43.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.078+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~H6K3NH5IX5MT.0 size=382081 2024-09-22T08:48:43.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.078+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=H6K3NH5IX5MT tag=MHMVUAYYLMOB type=write size=1430657 2024-09-22T08:48:43.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.080+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.0 size=1048576 2024-09-22T08:48:43.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.081+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.1 size=1048576 2024-09-22T08:48:43.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.082+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~A2RLF3XHS24A.2 size=121352 2024-09-22T08:48:43.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.084+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=A2RLF3XHS24A tag=VT3O16R4H1LO type=write size=3267080 2024-09-22T08:48:43.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.086+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~GI18COAZDHYF.0 size=670802 2024-09-22T08:48:43.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.086+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=GI18COAZDHYF tag=PYKLLEBRWGTM type=write size=1719378 2024-09-22T08:48:43.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.088+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~P21AIBE9KS02.0 size=948344 2024-09-22T08:48:43.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.090+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=P21AIBE9KS02 tag=WE3GH0SDQSQ6 type=write size=1996920 2024-09-22T08:48:43.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.091+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=0U2NUDEIIYNG type=write size=269860 2024-09-22T08:48:43.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.093+0000 7f7b8ef90780 1 < suggested remove operation key=YF94C9GVRXQP tag=S6QYT3JX39J4 type=del 2024-09-22T08:48:43.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.095+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=CUWN8WK8TO2I type=del size=2927618 2024-09-22T08:48:43.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.096+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~F0HSJG5KYZXG.0 size=1048576 2024-09-22T08:48:43.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.097+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~F0HSJG5KYZXG.1 size=771062 2024-09-22T08:48:43.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.099+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=F0HSJG5KYZXG tag=RP3YO47CSMTD type=write size=2868214 2024-09-22T08:48:43.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.100+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=7N2IPO1NECB9 type=del size=2619047 2024-09-22T08:48:43.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.103+0000 7f7b8ef90780 1 < suggested remove operation key=IEZKK9YIIF33 tag=KP4HRLLQ5EWW type=del 2024-09-22T08:48:43.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.105+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1JWVR647HITO.0 size=497034 2024-09-22T08:48:43.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.105+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=1JWVR647HITO tag=EK9YEEIVFHRV type=write size=1545610 2024-09-22T08:48:43.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.106+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.0 size=1048576 2024-09-22T08:48:43.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.107+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.1 size=1048576 2024-09-22T08:48:43.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.108+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~W1URR0EIA63B.2 size=22023 2024-09-22T08:48:43.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.111+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=W1URR0EIA63B tag=LD10UC56VQIL type=write size=3167751 2024-09-22T08:48:43.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.112+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=UOR3SJ6P34IS type=del size=537250 2024-09-22T08:48:43.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.113+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=Z5XP4PM42OF8 type=del 2024-09-22T08:48:43.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.114+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=DZ7YLWIUAGLK type=del size=1028411 2024-09-22T08:48:43.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.116+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=ZUGR83G5TVZH type=del 2024-09-22T08:48:43.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.118+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~EJ2PIIRS9DME.0 size=112353 2024-09-22T08:48:43.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.118+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=EJ2PIIRS9DME tag=SPL8EDT6CILG type=write size=1160929 2024-09-22T08:48:43.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.119+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=KKG43BK7R1MF type=del 2024-09-22T08:48:43.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.120+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=AQEE927WLWNY type=write size=865789 2024-09-22T08:48:43.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.122+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=XSCXON2YNUEV type=del 2024-09-22T08:48:43.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.124+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.0 size=1048576 2024-09-22T08:48:43.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.125+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.1 size=1048576 2024-09-22T08:48:43.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.126+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.2 size=636151 2024-09-22T08:48:43.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.126+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=A2B1DRF99N8R tag=91IXX5284AE5 type=write size=3781879 2024-09-22T08:48:43.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.128+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=3OIIM0SYTQ3V type=write size=244106 2024-09-22T08:48:43.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.129+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=BUY4QOJKP30B type=write size=96267 2024-09-22T08:48:43.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.130+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=PLUUW59EN32X type=del 2024-09-22T08:48:43.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.132+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=U1L89WMOU4HY type=del size=2417394 2024-09-22T08:48:43.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.133+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~823LE6SDQC5I.0 size=1048576 2024-09-22T08:48:43.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.134+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~823LE6SDQC5I.1 size=209720 2024-09-22T08:48:43.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.136+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=823LE6SDQC5I tag=T11D5XTVNZ6D type=write size=2306872 2024-09-22T08:48:43.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.138+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.0 size=1048576 2024-09-22T08:48:43.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.139+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.1 size=1048576 2024-09-22T08:48:43.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.140+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.2 size=591495 2024-09-22T08:48:43.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.140+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=QSDAT26YAPX4 tag=MXOH3TT9GLUP type=write size=3737223 2024-09-22T08:48:43.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.141+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=YF94C9GVRXQP tag=EJOTEID6ZM37 type=del size=2887947: (2) No such file or directory 2024-09-22T08:48:43.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.143+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~PTFNBRORVYSW.0 size=1048576 2024-09-22T08:48:43.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.144+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~PTFNBRORVYSW.1 size=78144 2024-09-22T08:48:43.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.144+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=PTFNBRORVYSW tag=O4XWE14PGZ5L type=write size=2175296 2024-09-22T08:48:43.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.145+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~H8VZEJOQRNQM.0 size=226867 2024-09-22T08:48:43.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.147+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=H8VZEJOQRNQM tag=1WQA4W897NBH type=write size=1275443 2024-09-22T08:48:43.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.148+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=GDYWU7G0W1TA type=del size=3150579 2024-09-22T08:48:43.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.149+0000 7f7b8ef90780 1 < canceled part key=_multipart_L3XF68XD23FP.2~H6K3NH5IX5MT.0 size=382081 2024-09-22T08:48:43.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.151+0000 7f7b8ef90780 1 < canceled multipart upload key=L3XF68XD23FP upload=H6K3NH5IX5MT tag=MHMVUAYYLMOB type=write size=1430657 2024-09-22T08:48:43.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.152+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=HD60BZMJKHYV type=write size=518149 2024-09-22T08:48:43.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.154+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~GI18COAZDHYF.0 size=670802 2024-09-22T08:48:43.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.156+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=GI18COAZDHYF tag=PYKLLEBRWGTM type=write size=1719378 2024-09-22T08:48:43.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.158+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Z1DMFXO2482W.0 size=1048576 2024-09-22T08:48:43.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.160+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Z1DMFXO2482W.1 size=427410 2024-09-22T08:48:43.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.160+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=Z1DMFXO2482W tag=DYX1J1UVHBJE type=write size=2524562 2024-09-22T08:48:43.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.161+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=0U2NUDEIIYNG type=write size=269860 2024-09-22T08:48:43.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.163+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~AEZCHL2XK7S7.0 size=877124 2024-09-22T08:48:43.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.163+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=AEZCHL2XK7S7 tag=6NJ3UZZHSS7X type=write size=1925700 2024-09-22T08:48:43.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.164+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=CUWN8WK8TO2I type=del 2024-09-22T08:48:43.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.167+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~L780WH175UJE.0 size=1048576 2024-09-22T08:48:43.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.168+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~L780WH175UJE.1 size=750979 2024-09-22T08:48:43.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.168+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=L780WH175UJE tag=83F6G47G3T56 type=write size=2848131 2024-09-22T08:48:43.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.169+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=7N2IPO1NECB9 type=del 2024-09-22T08:48:43.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.170+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=OG56L5CVADJA type=del size=1728877 2024-09-22T08:48:43.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.172+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~1JWVR647HITO.0 size=497034 2024-09-22T08:48:43.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.174+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=1JWVR647HITO tag=EK9YEEIVFHRV type=write size=1545610 2024-09-22T08:48:43.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.175+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=UYX2P65VE7RM type=del size=700630 2024-09-22T08:48:43.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.176+0000 7f7b8ef90780 1 < canceled operation key=YDJLMBL7EQWN tag=UOR3SJ6P34IS type=del size=537250 2024-09-22T08:48:43.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.178+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=KBP7N8PBGEOK type=del size=1472661 2024-09-22T08:48:43.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.179+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=DZ7YLWIUAGLK type=del 2024-09-22T08:48:43.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.181+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~UQFCEO52OHU8.0 size=1048576 2024-09-22T08:48:43.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.182+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~UQFCEO52OHU8.1 size=19126 2024-09-22T08:48:43.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.182+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=UQFCEO52OHU8 tag=VEDT0SB28H36 type=write size=2116278 2024-09-22T08:48:43.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.183+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~EJ2PIIRS9DME.0 size=112353 2024-09-22T08:48:43.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.185+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=EJ2PIIRS9DME tag=SPL8EDT6CILG type=write size=1160929 2024-09-22T08:48:43.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.186+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=4TL6R9LA63I1 type=del size=1781090 2024-09-22T08:48:43.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.188+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=AQEE927WLWNY type=write size=865789 2024-09-22T08:48:43.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.190+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.0 size=1048576 2024-09-22T08:48:43.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.191+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.1 size=1048576 2024-09-22T08:48:43.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.192+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.2 size=473927 2024-09-22T08:48:43.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.192+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=GJ423YCZGALT tag=UJKUVCJUQQRG type=write size=3619655 2024-09-22T08:48:43.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.193+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.0 size=1048576 2024-09-22T08:48:43.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.194+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.1 size=1048576 2024-09-22T08:48:43.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.195+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~A2B1DRF99N8R.2 size=636151 2024-09-22T08:48:43.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.198+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=A2B1DRF99N8R tag=91IXX5284AE5 type=write size=3781879 2024-09-22T08:48:43.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.199+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=8IX0HORNXITP type=del size=1958201 2024-09-22T08:48:43.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.200+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=BUY4QOJKP30B type=write size=96267 2024-09-22T08:48:43.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.201+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=NL6PJJLLOBD7 type=del size=2280124 2024-09-22T08:48:43.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.202+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=U1L89WMOU4HY type=del 2024-09-22T08:48:43.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.205+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.0 size=1048576 2024-09-22T08:48:43.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.206+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.1 size=1048576 2024-09-22T08:48:43.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.207+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.2 size=609265 2024-09-22T08:48:43.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.207+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=AXBF56T7T8XE tag=FDRDBSLZV8HD type=write size=3754993 2024-09-22T08:48:43.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.209+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.0 size=1048576 2024-09-22T08:48:43.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.209+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.1 size=1048576 2024-09-22T08:48:43.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.210+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~QSDAT26YAPX4.2 size=591495 2024-09-22T08:48:43.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.213+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=QSDAT26YAPX4 tag=MXOH3TT9GLUP type=write size=3737223 2024-09-22T08:48:43.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.214+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=IM1MN9UGYBHW type=write size=42352 2024-09-22T08:48:43.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.216+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~PTFNBRORVYSW.0 size=1048576 2024-09-22T08:48:43.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.217+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~PTFNBRORVYSW.1 size=78144 2024-09-22T08:48:43.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.219+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=PTFNBRORVYSW tag=O4XWE14PGZ5L type=write size=2175296 2024-09-22T08:48:43.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.220+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=95W9UTROIF5N type=del size=733548 2024-09-22T08:48:43.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.222+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=GDYWU7G0W1TA type=del 2024-09-22T08:48:43.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.224+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.0 size=1048576 2024-09-22T08:48:43.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.225+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.1 size=1048576 2024-09-22T08:48:43.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.226+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.2 size=433251 2024-09-22T08:48:43.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.226+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=6ORO5Z3T7B1Z tag=9PIOLQ22R4SM type=write size=3578979 2024-09-22T08:48:43.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.227+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=HD60BZMJKHYV type=write size=518149 2024-09-22T08:48:43.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.228+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=T7C65ONV5LVI type=del size=1896102 2024-09-22T08:48:43.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.229+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~Z1DMFXO2482W.0 size=1048576 2024-09-22T08:48:43.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.230+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Z1DMFXO2482W.1 size=427410 2024-09-22T08:48:43.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.232+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=Z1DMFXO2482W tag=DYX1J1UVHBJE type=write size=2524562 2024-09-22T08:48:43.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.234+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=88OSE7CKLYFS type=write size=506800 2024-09-22T08:48:43.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.235+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~AEZCHL2XK7S7.0 size=877124 2024-09-22T08:48:43.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.238+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=AEZCHL2XK7S7 tag=6NJ3UZZHSS7X type=write size=1925700 2024-09-22T08:48:43.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.240+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=CJCL2P530E1H type=write size=585116 2024-09-22T08:48:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.245+0000 7f7b8ef90780 1 < canceled part key=_multipart_4ZJ4E4SUA01H.2~L780WH175UJE.0 size=1048576 2024-09-22T08:48:43.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.246+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~L780WH175UJE.1 size=750979 2024-09-22T08:48:43.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.249+0000 7f7b8ef90780 1 < canceled multipart upload key=4ZJ4E4SUA01H upload=L780WH175UJE tag=83F6G47G3T56 type=write size=2848131 2024-09-22T08:48:43.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.251+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=5GH747K6JOK1 type=del size=99066 2024-09-22T08:48:43.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.253+0000 7f7b8ef90780 1 < suggested update operation key=RX3H0G6WHB9L tag=OG56L5CVADJA type=del size=1728877 2024-09-22T08:48:43.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.255+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~MZD72JRWRW3T.0 size=1048576 2024-09-22T08:48:43.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.256+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~MZD72JRWRW3T.1 size=665457 2024-09-22T08:48:43.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.256+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=MZD72JRWRW3T tag=6GV9ID2F0QML type=write size=2762609 2024-09-22T08:48:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.257+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=UYX2P65VE7RM type=del 2024-09-22T08:48:43.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.259+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.0 size=1048576 2024-09-22T08:48:43.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.260+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.1 size=1048576 2024-09-22T08:48:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.261+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.2 size=493714 2024-09-22T08:48:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.261+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=Z4DAD46XHARD tag=8RRR6HD5987A type=write size=3639442 2024-09-22T08:48:43.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.264+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=KBP7N8PBGEOK type=del size=1472661 2024-09-22T08:48:43.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.266+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~YMLGKY0CXUVA.0 size=1048576 2024-09-22T08:48:43.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.267+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~YMLGKY0CXUVA.1 size=508554 2024-09-22T08:48:43.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.267+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=YMLGKY0CXUVA tag=PG8KN5DTEWIX type=write size=2605706 2024-09-22T08:48:43.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.268+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~UQFCEO52OHU8.0 size=1048576 2024-09-22T08:48:43.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.269+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~UQFCEO52OHU8.1 size=19126 2024-09-22T08:48:43.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.271+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=UQFCEO52OHU8 tag=VEDT0SB28H36 type=write size=2116278 2024-09-22T08:48:43.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.274+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.0 size=1048576 2024-09-22T08:48:43.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.275+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.1 size=1048576 2024-09-22T08:48:43.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.276+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.2 size=686454 2024-09-22T08:48:43.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.276+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=BR7XVK8NA2VV tag=DC3WOHU6JT9W type=write size=3832182 2024-09-22T08:48:43.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.278+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=4TL6R9LA63I1 type=del 2024-09-22T08:48:43.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.281+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.0 size=1048576 2024-09-22T08:48:43.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.282+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.1 size=1048576 2024-09-22T08:48:43.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.283+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.2 size=1001006 2024-09-22T08:48:43.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.283+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=CKM1ZJADATUK tag=QWP40XSEVCYS type=write size=4146734 2024-09-22T08:48:43.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.284+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.0 size=1048576 2024-09-22T08:48:43.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.285+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.1 size=1048576 2024-09-22T08:48:43.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.286+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~GJ423YCZGALT.2 size=473927 2024-09-22T08:48:43.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.288+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=GJ423YCZGALT tag=UJKUVCJUQQRG type=write size=3619655 2024-09-22T08:48:43.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.290+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=NBB3WAK5J6TS type=del size=3359732 2024-09-22T08:48:43.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.291+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=8IX0HORNXITP type=del 2024-09-22T08:48:43.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.293+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~3WAYJ8PZUE22.0 size=1048576 2024-09-22T08:48:43.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.295+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~3WAYJ8PZUE22.1 size=317891 2024-09-22T08:48:43.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.295+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=3WAYJ8PZUE22 tag=FQRTP2JXKKCI type=write size=2415043 2024-09-22T08:48:43.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.296+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=NL6PJJLLOBD7 type=del 2024-09-22T08:48:43.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.297+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=ZGMMSKYSX0P4 type=del size=884855 2024-09-22T08:48:43.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.298+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.0 size=1048576 2024-09-22T08:48:43.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.300+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.1 size=1048576 2024-09-22T08:48:43.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.301+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~AXBF56T7T8XE.2 size=609265 2024-09-22T08:48:43.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.303+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=AXBF56T7T8XE tag=FDRDBSLZV8HD type=write size=3754993 2024-09-22T08:48:43.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.305+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=1HIZGKZ6TDB6 type=del size=2744105 2024-09-22T08:48:43.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.306+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=IM1MN9UGYBHW type=write size=42352 2024-09-22T08:48:43.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.308+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~R34UQJZX81NL.0 size=630836 2024-09-22T08:48:43.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.308+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=R34UQJZX81NL tag=IZ9YUTN5MH5M type=write size=1679412 2024-09-22T08:48:43.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.310+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=95W9UTROIF5N type=del 2024-09-22T08:48:43.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.311+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=XNONLCOPZXOD type=del size=68852 2024-09-22T08:48:43.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.312+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.0 size=1048576 2024-09-22T08:48:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.313+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.1 size=1048576 2024-09-22T08:48:43.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.314+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~6ORO5Z3T7B1Z.2 size=433251 2024-09-22T08:48:43.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.317+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=6ORO5Z3T7B1Z tag=9PIOLQ22R4SM type=write size=3578979 2024-09-22T08:48:43.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.318+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=W3WJTABTQW02 type=del size=799034 2024-09-22T08:48:43.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.319+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=T7C65ONV5LVI type=del 2024-09-22T08:48:43.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.320+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=M0ZO6KUTIQV0 type=write size=1006334 2024-09-22T08:48:43.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.322+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=88OSE7CKLYFS type=write size=506800 2024-09-22T08:48:43.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.323+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=0W302R53L2XK type=del size=2685466 2024-09-22T08:48:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.324+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=CJCL2P530E1H type=write size=585116 2024-09-22T08:48:43.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.326+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~N2XINBKY1L04.0 size=1048576 2024-09-22T08:48:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.327+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~N2XINBKY1L04.1 size=1043629 2024-09-22T08:48:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.327+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=N2XINBKY1L04 tag=CZVA8ZBRPZ98 type=write size=3140781 2024-09-22T08:48:43.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.329+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=5GH747K6JOK1 type=del 2024-09-22T08:48:43.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.331+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~O7PZXKW8D60U.0 size=1048576 2024-09-22T08:48:43.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.332+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~O7PZXKW8D60U.1 size=194655 2024-09-22T08:48:43.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.332+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=O7PZXKW8D60U tag=040DTPYXFGRD type=write size=2291807 2024-09-22T08:48:43.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.333+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~MZD72JRWRW3T.0 size=1048576 2024-09-22T08:48:43.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.333+0000 7f7b8ef90780 1 < canceled part key=_multipart_YF94C9GVRXQP.2~MZD72JRWRW3T.1 size=665457 2024-09-22T08:48:43.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.336+0000 7f7b8ef90780 1 < canceled multipart upload key=YF94C9GVRXQP upload=MZD72JRWRW3T tag=6GV9ID2F0QML type=write size=2762609 2024-09-22T08:48:43.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.337+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=JKFFI6G8LQ93 type=del size=1132227 2024-09-22T08:48:43.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.338+0000 7f7b8ef90780 1 < canceled part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.0 size=1048576 2024-09-22T08:48:43.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.339+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.1 size=1048576 2024-09-22T08:48:43.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.340+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~Z4DAD46XHARD.2 size=493714 2024-09-22T08:48:43.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.342+0000 7f7b8ef90780 1 < canceled multipart upload key=T43DW9JPG1BU upload=Z4DAD46XHARD tag=8RRR6HD5987A type=write size=3639442 2024-09-22T08:48:43.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.344+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~RRXQPGJ1XI8D.0 size=730205 2024-09-22T08:48:43.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.344+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=RRXQPGJ1XI8D tag=1R2P2GJI0DRD type=write size=1778781 2024-09-22T08:48:43.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.346+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~YMLGKY0CXUVA.0 size=1048576 2024-09-22T08:48:43.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.347+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~YMLGKY0CXUVA.1 size=508554 2024-09-22T08:48:43.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.349+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=YMLGKY0CXUVA tag=PG8KN5DTEWIX type=write size=2605706 2024-09-22T08:48:43.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.350+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=X58CBLMV4O39 type=del size=2151090 2024-09-22T08:48:43.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.352+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.0 size=1048576 2024-09-22T08:48:43.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.353+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.1 size=1048576 2024-09-22T08:48:43.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.354+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~BR7XVK8NA2VV.2 size=686454 2024-09-22T08:48:43.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.356+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=BR7XVK8NA2VV tag=DC3WOHU6JT9W type=write size=3832182 2024-09-22T08:48:43.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.359+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~FTC4B6QYUWYC.0 size=1048576 2024-09-22T08:48:43.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.360+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~FTC4B6QYUWYC.1 size=187289 2024-09-22T08:48:43.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.360+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=FTC4B6QYUWYC tag=LZAKOG10YDXD type=write size=2284441 2024-09-22T08:48:43.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.361+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.0 size=1048576 2024-09-22T08:48:43.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.362+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.1 size=1048576 2024-09-22T08:48:43.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.363+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~CKM1ZJADATUK.2 size=1001006 2024-09-22T08:48:43.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.365+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=CKM1ZJADATUK tag=QWP40XSEVCYS type=write size=4146734 2024-09-22T08:48:43.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.368+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~3L0NLOI2W5WV.0 size=1048576 2024-09-22T08:48:43.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.369+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~3L0NLOI2W5WV.1 size=717299 2024-09-22T08:48:43.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.369+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=3L0NLOI2W5WV tag=Y9RMWE66UQAJ type=write size=2814451 2024-09-22T08:48:43.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.370+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=NBB3WAK5J6TS type=del 2024-09-22T08:48:43.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.373+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.0 size=1048576 2024-09-22T08:48:43.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.374+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.1 size=1048576 2024-09-22T08:48:43.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.375+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.2 size=455006 2024-09-22T08:48:43.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.375+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=FCXVGMGGD03Q tag=Z4TFJ03C5DRW type=write size=3600734 2024-09-22T08:48:43.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.376+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~3WAYJ8PZUE22.0 size=1048576 2024-09-22T08:48:43.378 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.377+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~3WAYJ8PZUE22.1 size=317891 2024-09-22T08:48:43.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.379+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=3WAYJ8PZUE22 tag=FQRTP2JXKKCI type=write size=2415043 2024-09-22T08:48:43.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.381+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=NMWJP2FTBB2S type=del size=809490 2024-09-22T08:48:43.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.382+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=ZGMMSKYSX0P4 type=del 2024-09-22T08:48:43.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.383+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=A3PH037DYGLL type=write size=564631 2024-09-22T08:48:43.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.386+0000 7f7b8ef90780 1 < suggested update operation key=YDJLMBL7EQWN tag=1HIZGKZ6TDB6 type=del size=2744105 2024-09-22T08:48:43.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.387+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=VCQVWACL2ON6 type=write size=698848 2024-09-22T08:48:43.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.389+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~R34UQJZX81NL.0 size=630836 2024-09-22T08:48:43.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.391+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=R34UQJZX81NL tag=IZ9YUTN5MH5M type=write size=1679412 2024-09-22T08:48:43.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.393+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.0 size=1048576 2024-09-22T08:48:43.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.394+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.1 size=1048576 2024-09-22T08:48:43.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.395+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.2 size=41661 2024-09-22T08:48:43.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.395+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=2CJYABPZ6UZT tag=9AWGZG4W00Y7 type=write size=3187389 2024-09-22T08:48:43.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.399+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=XNONLCOPZXOD type=del 2024-09-22T08:48:43.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.400+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=63AFE58UTH7S type=del size=1417089 2024-09-22T08:48:43.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.401+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=W3WJTABTQW02 type=del 2024-09-22T08:48:43.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.402+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=B9GTKL68JVTF type=del size=4107190 2024-09-22T08:48:43.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.404+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=M0ZO6KUTIQV0 type=write size=1006334 2024-09-22T08:48:43.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.405+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=04AQWW3RWRKA type=del size=1201761 2024-09-22T08:48:43.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.408+0000 7f7b8ef90780 1 < suggested update operation key=4J4EGI19N123 tag=0W302R53L2XK type=del size=2685466 2024-09-22T08:48:43.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.409+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=C1R7MP3PUMMU type=del size=1094415 2024-09-22T08:48:43.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.410+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~N2XINBKY1L04.0 size=1048576 2024-09-22T08:48:43.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.411+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~N2XINBKY1L04.1 size=1043629 2024-09-22T08:48:43.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.413+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=N2XINBKY1L04 tag=CZVA8ZBRPZ98 type=write size=3140781 2024-09-22T08:48:43.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.416+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~HQQ5ROLJN7K3.0 size=476084 2024-09-22T08:48:43.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.416+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=HQQ5ROLJN7K3 tag=YO7TSU85TYVF type=write size=1524660 2024-09-22T08:48:43.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.417+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~O7PZXKW8D60U.0 size=1048576 2024-09-22T08:48:43.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.418+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~O7PZXKW8D60U.1 size=194655 2024-09-22T08:48:43.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.420+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=O7PZXKW8D60U tag=040DTPYXFGRD type=write size=2291807 2024-09-22T08:48:43.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.421+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=GV43D23MYTGN type=del size=1996692 2024-09-22T08:48:43.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.422+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=JKFFI6G8LQ93 type=del 2024-09-22T08:48:43.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.424+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=BXMGN1CWILZR type=del size=44721 2024-09-22T08:48:43.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.425+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~RRXQPGJ1XI8D.0 size=730205 2024-09-22T08:48:43.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.427+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=RRXQPGJ1XI8D tag=1R2P2GJI0DRD type=write size=1778781 2024-09-22T08:48:43.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.428+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=GL3WUFWQ7LOW type=write size=743263 2024-09-22T08:48:43.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.429+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=X58CBLMV4O39 type=del 2024-09-22T08:48:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.432+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.0 size=1048576 2024-09-22T08:48:43.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.433+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.1 size=1048576 2024-09-22T08:48:43.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.434+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.2 size=333888 2024-09-22T08:48:43.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.434+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=OFV0CVNJBP94 tag=5362280SKUCS type=write size=3479616 2024-09-22T08:48:43.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.435+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~FTC4B6QYUWYC.0 size=1048576 2024-09-22T08:48:43.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.436+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~FTC4B6QYUWYC.1 size=187289 2024-09-22T08:48:43.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.438+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=FTC4B6QYUWYC tag=LZAKOG10YDXD type=write size=2284441 2024-09-22T08:48:43.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.439+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=TQAZM1P83PTQ type=del size=1055219 2024-09-22T08:48:43.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.441+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~3L0NLOI2W5WV.0 size=1048576 2024-09-22T08:48:43.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.442+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~3L0NLOI2W5WV.1 size=717299 2024-09-22T08:48:43.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.444+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=3L0NLOI2W5WV tag=Y9RMWE66UQAJ type=write size=2814451 2024-09-22T08:48:43.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.446+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OKCO5R33BJI2.0 size=1048576 2024-09-22T08:48:43.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.447+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~OKCO5R33BJI2.1 size=745659 2024-09-22T08:48:43.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.447+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=OKCO5R33BJI2 tag=8ZW1E3Q4MISV type=write size=2842811 2024-09-22T08:48:43.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.448+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.0 size=1048576 2024-09-22T08:48:43.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.449+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.1 size=1048576 2024-09-22T08:48:43.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.450+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~FCXVGMGGD03Q.2 size=455006 2024-09-22T08:48:43.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.452+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=FCXVGMGGD03Q tag=Z4TFJ03C5DRW type=write size=3600734 2024-09-22T08:48:43.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.454+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=P5H2YTT4P01M type=del size=638948 2024-09-22T08:48:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.455+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=NMWJP2FTBB2S type=del 2024-09-22T08:48:43.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.457+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~NA7V5AWVJ0KC.0 size=1048576 2024-09-22T08:48:43.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.459+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~NA7V5AWVJ0KC.1 size=482208 2024-09-22T08:48:43.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.459+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=NA7V5AWVJ0KC tag=F8PSVGITLQVS type=write size=2579360 2024-09-22T08:48:43.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.460+0000 7f7b8ef90780 1 < completed write operation key=UQPY2ITDMKGO tag=A3PH037DYGLL type=write size=564631 2024-09-22T08:48:43.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.461+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=B1KD0O2B5MJM type=del size=1769251 2024-09-22T08:48:43.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.463+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=VCQVWACL2ON6 type=write size=698848 2024-09-22T08:48:43.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.464+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=WYF3HJTH6HG2 type=del size=3069684 2024-09-22T08:48:43.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.465+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.0 size=1048576 2024-09-22T08:48:43.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.466+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.1 size=1048576 2024-09-22T08:48:43.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.468+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~2CJYABPZ6UZT.2 size=41661 2024-09-22T08:48:43.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.470+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=2CJYABPZ6UZT tag=9AWGZG4W00Y7 type=write size=3187389 2024-09-22T08:48:43.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.472+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.0 size=1048576 2024-09-22T08:48:43.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.473+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.1 size=1048576 2024-09-22T08:48:43.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.474+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.2 size=902832 2024-09-22T08:48:43.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.474+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=V27U87VAMO1W tag=O7XHT2F1QAA8 type=write size=4048560 2024-09-22T08:48:43.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.475+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=63AFE58UTH7S type=del 2024-09-22T08:48:43.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.477+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~UR6CBBIX7RK0.0 size=1048576 2024-09-22T08:48:43.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.478+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~UR6CBBIX7RK0.1 size=121545 2024-09-22T08:48:43.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.478+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=UR6CBBIX7RK0 tag=4290VSUHO0RO type=write size=2218697 2024-09-22T08:48:43.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.481+0000 7f7b8ef90780 1 < suggested update operation key=ORON3U0WY2K5 tag=B9GTKL68JVTF type=del size=4107190 2024-09-22T08:48:43.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.482+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=DU2PWZ32FHVV type=del size=3914961 2024-09-22T08:48:43.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.483+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=04AQWW3RWRKA type=del size=1201761 2024-09-22T08:48:43.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.484+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=KU62UYEKLHJJ type=del size=1813951 2024-09-22T08:48:43.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.486+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=C1R7MP3PUMMU type=del 2024-09-22T08:48:43.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.487+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=JFXOTHRLXWWA type=write size=969276 2024-09-22T08:48:43.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.488+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~HQQ5ROLJN7K3.0 size=476084 2024-09-22T08:48:43.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.490+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=HQQ5ROLJN7K3 tag=YO7TSU85TYVF type=write size=1524660 2024-09-22T08:48:43.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.491+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=310KO8E6L229 type=del size=3327534 2024-09-22T08:48:43.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.493+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=GV43D23MYTGN type=del 2024-09-22T08:48:43.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.494+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=F4I25QFD75C7 type=del size=306680 2024-09-22T08:48:43.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.495+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=BXMGN1CWILZR type=del 2024-09-22T08:48:43.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.497+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.0 size=1048576 2024-09-22T08:48:43.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.498+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.1 size=1048576 2024-09-22T08:48:43.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.499+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.2 size=947210 2024-09-22T08:48:43.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.499+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=JHEWNR3JQXH0 tag=LORS82CXDJJ7 type=write size=4092938 2024-09-22T08:48:43.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.501+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=GL3WUFWQ7LOW type=write size=743263 2024-09-22T08:48:43.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.503+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~ZVBEQ73VE48K.0 size=1048576 2024-09-22T08:48:43.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.504+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~ZVBEQ73VE48K.1 size=741856 2024-09-22T08:48:43.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.504+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=ZVBEQ73VE48K tag=P33AI9PWGHBC type=write size=2839008 2024-09-22T08:48:43.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.506+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.0 size=1048576 2024-09-22T08:48:43.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.507+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.1 size=1048576 2024-09-22T08:48:43.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.507+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~OFV0CVNJBP94.2 size=333888 2024-09-22T08:48:43.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.509+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=OFV0CVNJBP94 tag=5362280SKUCS type=write size=3479616 2024-09-22T08:48:43.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.511+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.0 size=1048576 2024-09-22T08:48:43.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.512+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.1 size=1048576 2024-09-22T08:48:43.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.513+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.2 size=866998 2024-09-22T08:48:43.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.513+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=DT3AM9J3RQ1Y tag=5RID4UODQBLA type=write size=4012726 2024-09-22T08:48:43.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.515+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=TQAZM1P83PTQ type=del 2024-09-22T08:48:43.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.518+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~MR3LMVVTVM7N.0 size=27323 2024-09-22T08:48:43.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.518+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=MR3LMVVTVM7N tag=C6YC3J7ASELS type=write size=1075899 2024-09-22T08:48:43.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.519+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~OKCO5R33BJI2.0 size=1048576 2024-09-22T08:48:43.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.519+0000 7f7b8ef90780 1 < canceled part key=_multipart_IEZKK9YIIF33.2~OKCO5R33BJI2.1 size=745659 2024-09-22T08:48:43.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.521+0000 7f7b8ef90780 1 < canceled multipart upload key=IEZKK9YIIF33 upload=OKCO5R33BJI2 tag=8ZW1E3Q4MISV type=write size=2842811 2024-09-22T08:48:43.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.522+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=FOLHJ4454NF0 type=del size=1087643 2024-09-22T08:48:43.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.524+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=P5H2YTT4P01M type=del 2024-09-22T08:48:43.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.525+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=2J5LBPDEFQES type=del size=2973125 2024-09-22T08:48:43.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.526+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~NA7V5AWVJ0KC.0 size=1048576 2024-09-22T08:48:43.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.527+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~NA7V5AWVJ0KC.1 size=482208 2024-09-22T08:48:43.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.530+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=NA7V5AWVJ0KC tag=F8PSVGITLQVS type=write size=2579360 2024-09-22T08:48:43.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.531+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=TZ6YDKWXZ2LC type=del size=115682 2024-09-22T08:48:43.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.532+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=B1KD0O2B5MJM type=del 2024-09-22T08:48:43.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.534+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=55OADA8CJ41Z type=del size=1461212 2024-09-22T08:48:43.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.535+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=WYF3HJTH6HG2 type=del 2024-09-22T08:48:43.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.536+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=FV8QRPDZKMCQ type=write size=433010 2024-09-22T08:48:43.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.538+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.0 size=1048576 2024-09-22T08:48:43.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.538+0000 7f7b8ef90780 1 < canceled part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.1 size=1048576 2024-09-22T08:48:43.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.539+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~V27U87VAMO1W.2 size=902832 2024-09-22T08:48:43.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.541+0000 7f7b8ef90780 1 < canceled multipart upload key=X9TWX0Z54MOO upload=V27U87VAMO1W tag=O7XHT2F1QAA8 type=write size=4048560 2024-09-22T08:48:43.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.543+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~KPOD7MQ7G9Z0.0 size=1048576 2024-09-22T08:48:43.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.544+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~KPOD7MQ7G9Z0.1 size=231877 2024-09-22T08:48:43.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.544+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=KPOD7MQ7G9Z0 tag=8NJDO7RGYS0I type=write size=2329029 2024-09-22T08:48:43.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.546+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~UR6CBBIX7RK0.0 size=1048576 2024-09-22T08:48:43.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.547+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~UR6CBBIX7RK0.1 size=121545 2024-09-22T08:48:43.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.549+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=UR6CBBIX7RK0 tag=4290VSUHO0RO type=write size=2218697 2024-09-22T08:48:43.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.551+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.0 size=1048576 2024-09-22T08:48:43.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.552+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.1 size=1048576 2024-09-22T08:48:43.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.553+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.2 size=985504 2024-09-22T08:48:43.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.553+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=I8EKA92YVP30 tag=Q7716CUGHVD5 type=write size=4131232 2024-09-22T08:48:43.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.554+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=DU2PWZ32FHVV type=del 2024-09-22T08:48:43.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.556+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=1DS0MUJ6TMBK type=del size=1612932 2024-09-22T08:48:43.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.557+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=KU62UYEKLHJJ type=del 2024-09-22T08:48:43.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.559+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5UK9IC5CXG08.0 size=1048576 2024-09-22T08:48:43.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.560+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5UK9IC5CXG08.1 size=53392 2024-09-22T08:48:43.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.560+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=5UK9IC5CXG08 tag=XI4I9BAXZP7A type=write size=2150544 2024-09-22T08:48:43.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.561+0000 7f7b8ef90780 1 < completed write operation key=L1URDVW43BUG tag=JFXOTHRLXWWA type=write size=969276 2024-09-22T08:48:43.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.563+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=E5WS0EB6VXSA type=del size=1451988 2024-09-22T08:48:43.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.564+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=310KO8E6L229 type=del 2024-09-22T08:48:43.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.565+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=Z1G6QC1YOSPY type=del size=3670713 2024-09-22T08:48:43.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.568+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=F4I25QFD75C7 type=del size=306680 2024-09-22T08:48:43.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.569+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=JS50AAA29SGY type=del size=1757963 2024-09-22T08:48:43.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.570+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.0 size=1048576 2024-09-22T08:48:43.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.572+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.1 size=1048576 2024-09-22T08:48:43.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.573+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~JHEWNR3JQXH0.2 size=947210 2024-09-22T08:48:43.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.575+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=JHEWNR3JQXH0 tag=LORS82CXDJJ7 type=write size=4092938 2024-09-22T08:48:43.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.577+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.0 size=1048576 2024-09-22T08:48:43.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.578+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.1 size=1048576 2024-09-22T08:48:43.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.579+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.2 size=821284 2024-09-22T08:48:43.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.579+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=NQQO6X7H37EB tag=VPGBG1AWWLWG type=write size=3967012 2024-09-22T08:48:43.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.580+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~ZVBEQ73VE48K.0 size=1048576 2024-09-22T08:48:43.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.581+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~ZVBEQ73VE48K.1 size=741856 2024-09-22T08:48:43.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.584+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=ZVBEQ73VE48K tag=P33AI9PWGHBC type=write size=2839008 2024-09-22T08:48:43.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.585+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=V85YURCNI94H type=del size=3760286 2024-09-22T08:48:43.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.586+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.0 size=1048576 2024-09-22T08:48:43.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.587+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.1 size=1048576 2024-09-22T08:48:43.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.588+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~DT3AM9J3RQ1Y.2 size=866998 2024-09-22T08:48:43.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.590+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=DT3AM9J3RQ1Y tag=5RID4UODQBLA type=write size=4012726 2024-09-22T08:48:43.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.592+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~40GXQLWTDOZP.0 size=1048576 2024-09-22T08:48:43.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.593+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~40GXQLWTDOZP.1 size=265658 2024-09-22T08:48:43.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.593+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=40GXQLWTDOZP tag=E6JO4TRPP0KL type=write size=2362810 2024-09-22T08:48:43.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.595+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~MR3LMVVTVM7N.0 size=27323 2024-09-22T08:48:43.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.597+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=MR3LMVVTVM7N tag=C6YC3J7ASELS type=write size=1075899 2024-09-22T08:48:43.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.599+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.0 size=1048576 2024-09-22T08:48:43.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.600+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.1 size=1048576 2024-09-22T08:48:43.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.601+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.2 size=291493 2024-09-22T08:48:43.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.601+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=XEADFFDSNI9U tag=3ZKNXTRA6M0M type=write size=3437221 2024-09-22T08:48:43.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.602+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=FOLHJ4454NF0 type=del 2024-09-22T08:48:43.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.603+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=IC08ASXCKMVD type=write size=939071 2024-09-22T08:48:43.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.605+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=2J5LBPDEFQES type=del 2024-09-22T08:48:43.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.606+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=UGHEY0UMFM3C type=del size=3626633 2024-09-22T08:48:43.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.607+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=TZ6YDKWXZ2LC type=del 2024-09-22T08:48:43.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.609+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=666Z69TYS9TE type=del size=3201605 2024-09-22T08:48:43.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.610+0000 7f7b8ef90780 1 < canceled operation key=R0N30XP1BXY3 tag=55OADA8CJ41Z type=del size=1461212 2024-09-22T08:48:43.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.612+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=W0KKS0GCH71P type=del size=3138024 2024-09-22T08:48:43.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.613+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=FV8QRPDZKMCQ type=write size=433010 2024-09-22T08:48:43.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.615+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~JCRPHOJX2OIR.0 size=836825 2024-09-22T08:48:43.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.615+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=JCRPHOJX2OIR tag=4EVTSRSJ54QE type=write size=1885401 2024-09-22T08:48:43.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.617+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~KPOD7MQ7G9Z0.0 size=1048576 2024-09-22T08:48:43.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.618+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~KPOD7MQ7G9Z0.1 size=231877 2024-09-22T08:48:43.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.620+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=KPOD7MQ7G9Z0 tag=8NJDO7RGYS0I type=write size=2329029 2024-09-22T08:48:43.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.621+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=B6OSZ1XS885M type=write size=876993 2024-09-22T08:48:43.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.623+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.0 size=1048576 2024-09-22T08:48:43.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.624+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.1 size=1048576 2024-09-22T08:48:43.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.625+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~I8EKA92YVP30.2 size=985504 2024-09-22T08:48:43.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.627+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=I8EKA92YVP30 tag=Q7716CUGHVD5 type=write size=4131232 2024-09-22T08:48:43.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.628+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=Q740CDGJAMSY type=del size=3004185 2024-09-22T08:48:43.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.629+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=1DS0MUJ6TMBK type=del 2024-09-22T08:48:43.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.632+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~B19A2H0VCO4U.0 size=735739 2024-09-22T08:48:43.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.632+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=B19A2H0VCO4U tag=XNDB6NEKK5ZF type=write size=1784315 2024-09-22T08:48:43.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.634+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~5UK9IC5CXG08.0 size=1048576 2024-09-22T08:48:43.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.635+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~5UK9IC5CXG08.1 size=53392 2024-09-22T08:48:43.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.637+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=5UK9IC5CXG08 tag=XI4I9BAXZP7A type=write size=2150544 2024-09-22T08:48:43.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.638+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=HQ5O3MHFOBLX type=del size=33663 2024-09-22T08:48:43.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.639+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=E5WS0EB6VXSA type=del 2024-09-22T08:48:43.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.641+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=NJN8VHBXYW52 type=del size=1725618 2024-09-22T08:48:43.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.643+0000 7f7b8ef90780 1 < suggested remove operation key=G51KS3NM4VFY tag=Z1G6QC1YOSPY type=del 2024-09-22T08:48:43.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.645+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~AXDLJ7YCFIX3.0 size=169170 2024-09-22T08:48:43.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.645+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=AXDLJ7YCFIX3 tag=Z10HN3RZ1DNS type=write size=1217746 2024-09-22T08:48:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.648+0000 7f7b8ef90780 1 < suggested update operation key=Z9CHXCJ02L85 tag=JS50AAA29SGY type=del size=1757963 2024-09-22T08:48:43.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.650+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.0 size=1048576 2024-09-22T08:48:43.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.651+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.1 size=1048576 2024-09-22T08:48:43.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.652+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.2 size=263419 2024-09-22T08:48:43.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.652+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=AVYUD42PXF4R tag=Q5Y60NGV9K6R type=write size=3409147 2024-09-22T08:48:43.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.653+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.0 size=1048576 2024-09-22T08:48:43.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.654+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.1 size=1048576 2024-09-22T08:48:43.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.655+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~NQQO6X7H37EB.2 size=821284 2024-09-22T08:48:43.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.657+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=NQQO6X7H37EB tag=VPGBG1AWWLWG type=write size=3967012 2024-09-22T08:48:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.658+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=VB3TFT5MOS8Z type=del size=1542473 2024-09-22T08:48:43.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.659+0000 7f7b8ef90780 -1 < failed to complete operation key=G51KS3NM4VFY tag=V85YURCNI94H type=del size=3760286: (22) Invalid argument 2024-09-22T08:48:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.661+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~99Y3I6B37Z1J.0 size=1048576 2024-09-22T08:48:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.662+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~99Y3I6B37Z1J.1 size=1038426 2024-09-22T08:48:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.662+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=99Y3I6B37Z1J tag=2J1SWHC4JP0U type=write size=3135578 2024-09-22T08:48:43.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.663+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~40GXQLWTDOZP.0 size=1048576 2024-09-22T08:48:43.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.664+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~40GXQLWTDOZP.1 size=265658 2024-09-22T08:48:43.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.665+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=40GXQLWTDOZP tag=E6JO4TRPP0KL type=write size=2362810 2024-09-22T08:48:43.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.667+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=LJGZJM39NH3S type=write size=685714 2024-09-22T08:48:43.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.668+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.0 size=1048576 2024-09-22T08:48:43.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.669+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.1 size=1048576 2024-09-22T08:48:43.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.670+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~XEADFFDSNI9U.2 size=291493 2024-09-22T08:48:43.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.671+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=XEADFFDSNI9U tag=3ZKNXTRA6M0M type=write size=3437221 2024-09-22T08:48:43.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.674+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.0 size=1048576 2024-09-22T08:48:43.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.675+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.1 size=1048576 2024-09-22T08:48:43.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.676+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.2 size=776051 2024-09-22T08:48:43.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.676+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=96NCZYDYQQ8J tag=NTWSAA6YDA3K type=write size=3921779 2024-09-22T08:48:43.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.676+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=G51KS3NM4VFY tag=IC08ASXCKMVD type=write size=939071: (2) No such file or directory 2024-09-22T08:48:43.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.677+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=6ROECDJZA3JY type=write size=322847 2024-09-22T08:48:43.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.679+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=UGHEY0UMFM3C type=del size=3626633 2024-09-22T08:48:43.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.680+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=KXBQZZHK5ESW type=del size=482632 2024-09-22T08:48:43.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.683+0000 7f7b8ef90780 1 < suggested update operation key=YDJLMBL7EQWN tag=666Z69TYS9TE type=del size=3201605 2024-09-22T08:48:43.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.684+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=JS5Z8C44D3KF type=del size=1939417 2024-09-22T08:48:43.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.686+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=W0KKS0GCH71P type=del 2024-09-22T08:48:43.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.688+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.0 size=1048576 2024-09-22T08:48:43.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.689+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.1 size=1048576 2024-09-22T08:48:43.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.691+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.2 size=818525 2024-09-22T08:48:43.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.691+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=55YIK33F9BLO tag=TD2LOVZCFTVV type=write size=3964253 2024-09-22T08:48:43.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.692+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~JCRPHOJX2OIR.0 size=836825 2024-09-22T08:48:43.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.694+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=JCRPHOJX2OIR tag=4EVTSRSJ54QE type=write size=1885401 2024-09-22T08:48:43.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.695+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=TB4INFYZXA80 type=write size=915426 2024-09-22T08:48:43.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.696+0000 7f7b8ef90780 1 < canceled operation key=YF94C9GVRXQP tag=B6OSZ1XS885M type=write size=876993 2024-09-22T08:48:43.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.697+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=MWK4DX4VFWBS type=write size=972627 2024-09-22T08:48:43.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.699+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=Q740CDGJAMSY type=del size=3004185: (22) Invalid argument 2024-09-22T08:48:43.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.700+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=AN4M7Y14Q84U type=write size=785583 2024-09-22T08:48:43.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.701+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~B19A2H0VCO4U.0 size=735739 2024-09-22T08:48:43.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.703+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=B19A2H0VCO4U tag=XNDB6NEKK5ZF type=write size=1784315 2024-09-22T08:48:43.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.704+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=GKYMJESK4470 type=del size=3320445 2024-09-22T08:48:43.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.705+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=HQ5O3MHFOBLX type=del 2024-09-22T08:48:43.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.706+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=WMCNBXHZ6SMB type=del size=251806 2024-09-22T08:48:43.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.708+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=NJN8VHBXYW52 type=del size=1725618 2024-09-22T08:48:43.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.709+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=O89MCJYWP6X9 type=del size=769427 2024-09-22T08:48:43.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.710+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~AXDLJ7YCFIX3.0 size=169170 2024-09-22T08:48:43.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.712+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=AXDLJ7YCFIX3 tag=Z10HN3RZ1DNS type=write size=1217746 2024-09-22T08:48:43.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.713+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=8P42HBGSL7EE type=del size=893104 2024-09-22T08:48:43.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.715+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.0 size=1048576 2024-09-22T08:48:43.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.715+0000 7f7b8ef90780 1 < canceled part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.1 size=1048576 2024-09-22T08:48:43.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.716+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~AVYUD42PXF4R.2 size=263419 2024-09-22T08:48:43.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.718+0000 7f7b8ef90780 1 < canceled multipart upload key=QQKJ4URBRF16 upload=AVYUD42PXF4R tag=Q5Y60NGV9K6R type=write size=3409147 2024-09-22T08:48:43.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.720+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~0EOJNSKFOHWG.0 size=719805 2024-09-22T08:48:43.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.720+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=0EOJNSKFOHWG tag=M5G5BXQPR804 type=write size=1768381 2024-09-22T08:48:43.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.723+0000 7f7b8ef90780 1 < suggested remove operation key=Z9CHXCJ02L85 tag=VB3TFT5MOS8Z type=del 2024-09-22T08:48:43.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.725+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.0 size=1048576 2024-09-22T08:48:43.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.726+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.1 size=1048576 2024-09-22T08:48:43.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.727+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.2 size=526076 2024-09-22T08:48:43.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.727+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=FW8YJ4K2T31O tag=Q6T3LTHJD0OZ type=write size=3671804 2024-09-22T08:48:43.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.728+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~99Y3I6B37Z1J.0 size=1048576 2024-09-22T08:48:43.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.730+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~99Y3I6B37Z1J.1 size=1038426 2024-09-22T08:48:43.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.732+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=99Y3I6B37Z1J tag=2J1SWHC4JP0U type=write size=3135578 2024-09-22T08:48:43.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.733+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=OF49ETNII4PX type=del size=983118 2024-09-22T08:48:43.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.735+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=LJGZJM39NH3S type=write size=685714 2024-09-22T08:48:43.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.737+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~I3AW6YP7PM5Q.0 size=856855 2024-09-22T08:48:43.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.737+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=I3AW6YP7PM5Q tag=2BU1XPXYSZ0O type=write size=1905431 2024-09-22T08:48:43.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.739+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.0 size=1048576 2024-09-22T08:48:43.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.740+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.1 size=1048576 2024-09-22T08:48:43.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.741+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~96NCZYDYQQ8J.2 size=776051 2024-09-22T08:48:43.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.744+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=96NCZYDYQQ8J tag=NTWSAA6YDA3K type=write size=3921779 2024-09-22T08:48:43.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.745+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=DO03JUGCX7FH type=write size=876624 2024-09-22T08:48:43.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.746+0000 7f7b8ef90780 1 < completed write operation key=4J4EGI19N123 tag=6ROECDJZA3JY type=write size=322847 2024-09-22T08:48:43.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.749+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=RD8L700Q1GQE type=write size=9088 2024-09-22T08:48:43.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.750+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=KXBQZZHK5ESW type=del 2024-09-22T08:48:43.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.752+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=XPL2ZEWREEB7 type=del size=1552886 2024-09-22T08:48:43.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.754+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=JS5Z8C44D3KF type=del 2024-09-22T08:48:43.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.755+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=EI41PAQOJHXZ type=write size=667820 2024-09-22T08:48:43.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.756+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.0 size=1048576 2024-09-22T08:48:43.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.756+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.1 size=1048576 2024-09-22T08:48:43.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.757+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~55YIK33F9BLO.2 size=818525 2024-09-22T08:48:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.759+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=55YIK33F9BLO tag=TD2LOVZCFTVV type=write size=3964253 2024-09-22T08:48:43.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.760+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=M9OORUXZZA4K type=del size=3013576 2024-09-22T08:48:43.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.763+0000 7f7b8ef90780 1 < suggested update operation key=QQKJ4URBRF16 tag=TB4INFYZXA80 type=write size=915426 2024-09-22T08:48:43.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.765+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=49AA3SBJK67W type=write size=476976 2024-09-22T08:48:43.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.766+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=MWK4DX4VFWBS type=write size=972627: (22) Invalid argument 2024-09-22T08:48:43.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.768+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~GX2STJP2QIBV.0 size=1048576 2024-09-22T08:48:43.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.769+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~GX2STJP2QIBV.1 size=277372 2024-09-22T08:48:43.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.769+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=GX2STJP2QIBV tag=7QMQ23ZIAP45 type=write size=2374524 2024-09-22T08:48:43.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.770+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=AN4M7Y14Q84U type=write size=785583 2024-09-22T08:48:43.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.772+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~KW7E9PGCDT0L.0 size=321652 2024-09-22T08:48:43.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.772+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=KW7E9PGCDT0L tag=V8MDD7VEBGV1 type=write size=1370228 2024-09-22T08:48:43.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.774+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=GKYMJESK4470 type=del 2024-09-22T08:48:43.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.775+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=6XFDX9UFVW1U type=del size=4078816 2024-09-22T08:48:43.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.776+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=WMCNBXHZ6SMB type=del 2024-09-22T08:48:43.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.777+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=4PVSFUGB3UBJ type=del size=1038405 2024-09-22T08:48:43.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.779+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=O89MCJYWP6X9 type=del 2024-09-22T08:48:43.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.780+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=SBWACUIUP7O2 type=del size=3833009 2024-09-22T08:48:43.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.782+0000 7f7b8ef90780 1 < suggested remove operation key=YF94C9GVRXQP tag=8P42HBGSL7EE type=del 2024-09-22T08:48:43.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.783+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=HJMZFE4F4N4M type=del size=2771113 2024-09-22T08:48:43.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.785+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~0EOJNSKFOHWG.0 size=719805 2024-09-22T08:48:43.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.787+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=0EOJNSKFOHWG tag=M5G5BXQPR804 type=write size=1768381 2024-09-22T08:48:43.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.788+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=ANAX818XBZ58 type=del size=3659397 2024-09-22T08:48:43.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.789+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.0 size=1048576 2024-09-22T08:48:43.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.790+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.1 size=1048576 2024-09-22T08:48:43.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.791+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~FW8YJ4K2T31O.2 size=526076 2024-09-22T08:48:43.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.793+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=FW8YJ4K2T31O tag=Q6T3LTHJD0OZ type=write size=3671804 2024-09-22T08:48:43.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.795+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.0 size=1048576 2024-09-22T08:48:43.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.796+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.1 size=1048576 2024-09-22T08:48:43.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.797+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.2 size=483322 2024-09-22T08:48:43.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.797+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=CT1SVMZ2SQRC tag=3MJPBFB9P9WJ type=write size=3629050 2024-09-22T08:48:43.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.798+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=OF49ETNII4PX type=del size=983118: (22) Invalid argument 2024-09-22T08:48:43.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.799+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=D92FMIWGFKYG type=del size=2040793 2024-09-22T08:48:43.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.801+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~I3AW6YP7PM5Q.0 size=856855 2024-09-22T08:48:43.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.803+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=I3AW6YP7PM5Q tag=2BU1XPXYSZ0O type=write size=1905431 2024-09-22T08:48:43.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.805+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.0 size=1048576 2024-09-22T08:48:43.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.806+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.1 size=1048576 2024-09-22T08:48:43.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.807+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.2 size=767730 2024-09-22T08:48:43.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.807+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=L50UIU0Z9SSI tag=8RFSDW19WFHS type=write size=3913458 2024-09-22T08:48:43.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.808+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=DO03JUGCX7FH type=write size=876624 2024-09-22T08:48:43.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.809+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=Q2MQT283D0HK type=write size=769364 2024-09-22T08:48:43.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.810+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=RD8L700Q1GQE type=write size=9088: (22) Invalid argument 2024-09-22T08:48:43.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.812+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=ZAWEDU6ZRAT5 type=del size=3733311 2024-09-22T08:48:43.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.813+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=XPL2ZEWREEB7 type=del 2024-09-22T08:48:43.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.814+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=4ZKAB6D15I64 type=del size=830506 2024-09-22T08:48:43.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.815+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=EI41PAQOJHXZ type=write size=667820 2024-09-22T08:48:43.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.817+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.0 size=1048576 2024-09-22T08:48:43.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.818+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.1 size=1048576 2024-09-22T08:48:43.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.819+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.2 size=485245 2024-09-22T08:48:43.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.819+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=CX3USGRF8RX9 tag=XMA1KB95XQX1 type=write size=3630973 2024-09-22T08:48:43.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.822+0000 7f7b8ef90780 1 < suggested remove operation key=PODNY4NH4A9W tag=M9OORUXZZA4K type=del 2024-09-22T08:48:43.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.824+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~XLVPOQ07M46B.0 size=947577 2024-09-22T08:48:43.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.824+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=XLVPOQ07M46B tag=375UHZSKNL1H type=write size=1996153 2024-09-22T08:48:43.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.827+0000 7f7b8ef90780 1 < suggested update operation key=L3XF68XD23FP tag=49AA3SBJK67W type=write size=476976 2024-09-22T08:48:43.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.828+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=JTZZWOR2K19W type=del size=54114 2024-09-22T08:48:43.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.829+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~GX2STJP2QIBV.0 size=1048576 2024-09-22T08:48:43.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.830+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~GX2STJP2QIBV.1 size=277372 2024-09-22T08:48:43.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.832+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=GX2STJP2QIBV tag=7QMQ23ZIAP45 type=write size=2374524 2024-09-22T08:48:43.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.834+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~GBZ3PIG352BT.0 size=1048576 2024-09-22T08:48:43.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.835+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~GBZ3PIG352BT.1 size=211797 2024-09-22T08:48:43.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.835+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=GBZ3PIG352BT tag=CLNKK263RZI0 type=write size=2308949 2024-09-22T08:48:43.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.837+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~KW7E9PGCDT0L.0 size=321652 2024-09-22T08:48:43.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.839+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=KW7E9PGCDT0L tag=V8MDD7VEBGV1 type=write size=1370228 2024-09-22T08:48:43.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.841+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=J9WYAASD85U2 type=del size=2577761 2024-09-22T08:48:43.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.843+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=6XFDX9UFVW1U type=del size=4078816 2024-09-22T08:48:43.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.844+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=PMDI2KMFIE2I type=del size=3978473 2024-09-22T08:48:43.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.846+0000 7f7b8ef90780 1 < canceled operation key=G51KS3NM4VFY tag=4PVSFUGB3UBJ type=del size=1038405 2024-09-22T08:48:43.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.848+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~W276W3PJIHC7.0 size=1048576 2024-09-22T08:48:43.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.849+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~W276W3PJIHC7.1 size=824301 2024-09-22T08:48:43.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.849+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=W276W3PJIHC7 tag=3EOL5TJMSH4U type=write size=2921453 2024-09-22T08:48:43.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.850+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=SBWACUIUP7O2 type=del 2024-09-22T08:48:43.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.853+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~V3HYU6Y5EU7N.0 size=547933 2024-09-22T08:48:43.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.853+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=V3HYU6Y5EU7N tag=C9BOO3UGT4KR type=write size=1596509 2024-09-22T08:48:43.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.854+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=HJMZFE4F4N4M type=del 2024-09-22T08:48:43.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.856+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=MVRNB2UBLOJH type=del size=3925242 2024-09-22T08:48:43.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.859+0000 7f7b8ef90780 1 < suggested update operation key=UQPY2ITDMKGO tag=ANAX818XBZ58 type=del size=3659397 2024-09-22T08:48:43.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.861+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~CXAH3IP3C2Q5.0 size=395433 2024-09-22T08:48:43.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.861+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=CXAH3IP3C2Q5 tag=61H449HBT9SH type=write size=1444009 2024-09-22T08:48:43.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.862+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.0 size=1048576 2024-09-22T08:48:43.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.864+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.1 size=1048576 2024-09-22T08:48:43.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.865+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~CT1SVMZ2SQRC.2 size=483322 2024-09-22T08:48:43.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.867+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=CT1SVMZ2SQRC tag=3MJPBFB9P9WJ type=write size=3629050 2024-09-22T08:48:43.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.870+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.0 size=1048576 2024-09-22T08:48:43.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.871+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.1 size=1048576 2024-09-22T08:48:43.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.872+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.2 size=910973 2024-09-22T08:48:43.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.872+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=HL7NSSW05CDF tag=1FL8I625T6JJ type=write size=4056701 2024-09-22T08:48:43.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.873+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=D92FMIWGFKYG type=del 2024-09-22T08:48:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.874+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=GYKDZK8XZKNP type=del size=1113481 2024-09-22T08:48:43.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.876+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.0 size=1048576 2024-09-22T08:48:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.877+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.1 size=1048576 2024-09-22T08:48:43.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.878+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~L50UIU0Z9SSI.2 size=767730 2024-09-22T08:48:43.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.880+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=L50UIU0Z9SSI tag=8RFSDW19WFHS type=write size=3913458 2024-09-22T08:48:43.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.882+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~N0TTR96CADO9.0 size=704555 2024-09-22T08:48:43.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.882+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=N0TTR96CADO9 tag=FM8ND0MJ939Q type=write size=1753131 2024-09-22T08:48:43.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.885+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=Q2MQT283D0HK type=write 2024-09-22T08:48:43.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.886+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=DTR3NL5WNPLR type=del size=3438249 2024-09-22T08:48:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.887+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=ZAWEDU6ZRAT5 type=del 2024-09-22T08:48:43.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.889+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1SNS8PFLZAM4.0 size=762726 2024-09-22T08:48:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.889+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=1SNS8PFLZAM4 tag=RY0ZARQY1X6G type=write size=1811302 2024-09-22T08:48:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.891+0000 7f7b8ef90780 -1 < failed to complete operation key=UQPY2ITDMKGO tag=4ZKAB6D15I64 type=del size=830506: (22) Invalid argument 2024-09-22T08:48:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.892+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=8N0D6DI98X1G type=del size=3753106 2024-09-22T08:48:43.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.893+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.0 size=1048576 2024-09-22T08:48:43.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.894+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.1 size=1048576 2024-09-22T08:48:43.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.895+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~CX3USGRF8RX9.2 size=485245 2024-09-22T08:48:43.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.897+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=CX3USGRF8RX9 tag=XMA1KB95XQX1 type=write size=3630973 2024-09-22T08:48:43.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.899+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~EAXA590JUDKB.0 size=311269 2024-09-22T08:48:43.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.899+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=EAXA590JUDKB tag=CFPI6L67STRL type=write size=1359845 2024-09-22T08:48:43.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.900+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~XLVPOQ07M46B.0 size=947577 2024-09-22T08:48:43.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.902+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=XLVPOQ07M46B tag=375UHZSKNL1H type=write size=1996153 2024-09-22T08:48:43.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.903+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=R4SMI6R07QQG type=del size=1471335 2024-09-22T08:48:43.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.905+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=JTZZWOR2K19W type=del 2024-09-22T08:48:43.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.907+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=CSYKJTYN5NPW type=del size=2631467 2024-09-22T08:48:43.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.908+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~GBZ3PIG352BT.0 size=1048576 2024-09-22T08:48:43.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.908+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~GBZ3PIG352BT.1 size=211797 2024-09-22T08:48:43.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.910+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=GBZ3PIG352BT tag=CLNKK263RZI0 type=write size=2308949 2024-09-22T08:48:43.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.911+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=C2H0HJNTTWZC type=del size=3737743 2024-09-22T08:48:43.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.913+0000 7f7b8ef90780 1 < suggested remove operation key=7ZS8G8H6I957 tag=J9WYAASD85U2 type=del 2024-09-22T08:48:43.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.915+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=HA2AVY8PFT90 type=del size=3356609 2024-09-22T08:48:43.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.916+0000 7f7b8ef90780 1 < canceled operation key=WDGY8YL16UWI tag=PMDI2KMFIE2I type=del size=3978473 2024-09-22T08:48:43.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.917+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=F2D98PWKXSYR type=del size=3861962 2024-09-22T08:48:43.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.918+0000 7f7b8ef90780 1 < canceled part key=_multipart_VAO9MXRFGXFY.2~W276W3PJIHC7.0 size=1048576 2024-09-22T08:48:43.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.919+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~W276W3PJIHC7.1 size=824301 2024-09-22T08:48:43.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.921+0000 7f7b8ef90780 1 < canceled multipart upload key=VAO9MXRFGXFY upload=W276W3PJIHC7 tag=3EOL5TJMSH4U type=write size=2921453 2024-09-22T08:48:43.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.922+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=AG4G44NYW385 type=del size=1002029 2024-09-22T08:48:43.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.923+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~V3HYU6Y5EU7N.0 size=547933 2024-09-22T08:48:43.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.925+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=V3HYU6Y5EU7N tag=C9BOO3UGT4KR type=write size=1596509 2024-09-22T08:48:43.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.928+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.0 size=1048576 2024-09-22T08:48:43.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.929+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.1 size=1048576 2024-09-22T08:48:43.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.930+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.2 size=1046329 2024-09-22T08:48:43.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.930+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=6DS9LSKN3A61 tag=MMR6XNUOAJYP type=write size=4192057 2024-09-22T08:48:43.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.932+0000 7f7b8ef90780 1 < suggested update operation key=YDJLMBL7EQWN tag=MVRNB2UBLOJH type=del size=3925242 2024-09-22T08:48:43.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.935+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~Q0JB1N47A34I.0 size=497707 2024-09-22T08:48:43.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.935+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=Q0JB1N47A34I tag=6RZC9R28GCL3 type=write size=1546283 2024-09-22T08:48:43.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.935+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~CXAH3IP3C2Q5.0 size=395433 2024-09-22T08:48:43.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.937+0000 7f7b8ef90780 1 < canceled multipart upload key=L1URDVW43BUG upload=CXAH3IP3C2Q5 tag=61H449HBT9SH type=write size=1444009 2024-09-22T08:48:43.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.939+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~3J0WEL2UZ1Y2.0 size=1048576 2024-09-22T08:48:43.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.940+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~3J0WEL2UZ1Y2.1 size=827932 2024-09-22T08:48:43.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.940+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=3J0WEL2UZ1Y2 tag=X3DVS7K0JNT4 type=write size=2925084 2024-09-22T08:48:43.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.941+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.0 size=1048576 2024-09-22T08:48:43.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.942+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.1 size=1048576 2024-09-22T08:48:43.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.942+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~HL7NSSW05CDF.2 size=910973 2024-09-22T08:48:43.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.944+0000 7f7b8ef90780 1 < canceled multipart upload key=4J4EGI19N123 upload=HL7NSSW05CDF tag=1FL8I625T6JJ type=write size=4056701 2024-09-22T08:48:43.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.945+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=0NFCHVOXX0QN type=del size=2952869 2024-09-22T08:48:43.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.947+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=GYKDZK8XZKNP type=del 2024-09-22T08:48:43.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.948+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=0R6XJW0CMME3 type=write size=610807 2024-09-22T08:48:43.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.949+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~N0TTR96CADO9.0 size=704555 2024-09-22T08:48:43.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.951+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=N0TTR96CADO9 tag=FM8ND0MJ939Q type=write size=1753131 2024-09-22T08:48:43.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.953+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.0 size=1048576 2024-09-22T08:48:43.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.954+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.1 size=1048576 2024-09-22T08:48:43.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.955+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.2 size=407468 2024-09-22T08:48:43.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.955+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=IQUUHP4FTCNI tag=QHBHJGYNIBI5 type=write size=3553196 2024-09-22T08:48:43.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.958+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=DTR3NL5WNPLR type=del 2024-09-22T08:48:43.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.961+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~RXCSPJJD0XUN.0 size=969593 2024-09-22T08:48:43.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.961+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=RXCSPJJD0XUN tag=YFLSPWKE14QU type=write size=2018169 2024-09-22T08:48:43.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.962+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1SNS8PFLZAM4.0 size=762726 2024-09-22T08:48:43.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.965+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=1SNS8PFLZAM4 tag=RY0ZARQY1X6G type=write size=1811302 2024-09-22T08:48:43.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.966+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=N5AKULA8BJP3 type=write size=586693 2024-09-22T08:48:43.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.968+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=8N0D6DI98X1G type=del 2024-09-22T08:48:43.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.969+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=XCKJGFWUF80V type=del size=2188269 2024-09-22T08:48:43.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.971+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~EAXA590JUDKB.0 size=311269 2024-09-22T08:48:43.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.973+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=EAXA590JUDKB tag=CFPI6L67STRL type=write size=1359845 2024-09-22T08:48:43.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.974+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=6GFFFNTBJDIH type=del size=988081 2024-09-22T08:48:43.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.975+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=R4SMI6R07QQG type=del 2024-09-22T08:48:43.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.978+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~KHMJGQSYIU07.0 size=1048576 2024-09-22T08:48:43.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.979+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~KHMJGQSYIU07.1 size=274656 2024-09-22T08:48:43.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.979+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=KHMJGQSYIU07 tag=T05MBL9K6KPI type=write size=2371808 2024-09-22T08:48:43.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.981+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=CSYKJTYN5NPW type=del 2024-09-22T08:48:43.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.983+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~K42N3WK19CQ5.0 size=1048576 2024-09-22T08:48:43.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.985+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~K42N3WK19CQ5.1 size=259571 2024-09-22T08:48:43.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.985+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=K42N3WK19CQ5 tag=B0KJ56XXZU27 type=write size=2356723 2024-09-22T08:48:43.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.987+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=C2H0HJNTTWZC type=del size=3737743 2024-09-22T08:48:43.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.990+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~1AZXDXOZL1ZM.0 size=133286 2024-09-22T08:48:43.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.990+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=1AZXDXOZL1ZM tag=NVTKWIRV7RYZ type=write size=1181862 2024-09-22T08:48:43.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.991+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=HA2AVY8PFT90 type=del 2024-09-22T08:48:43.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.994+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~76K1REQAFXID.0 size=1048576 2024-09-22T08:48:43.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.995+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~76K1REQAFXID.1 size=195535 2024-09-22T08:48:43.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.995+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=76K1REQAFXID tag=XQ1YNLX0OMG4 type=write size=2292687 2024-09-22T08:48:43.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.996+0000 7f7b8ef90780 1 < canceled operation key=X9TWX0Z54MOO tag=F2D98PWKXSYR type=del size=3861962 2024-09-22T08:48:43.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.997+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=33EFZUY5UYS1 type=del size=387465 2024-09-22T08:48:43.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:43.999+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=AG4G44NYW385 type=del 2024-09-22T08:48:44.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.000+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=GTSB9O3PO1OW type=del size=2097184 2024-09-22T08:48:44.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.001+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.0 size=1048576 2024-09-22T08:48:44.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.002+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.1 size=1048576 2024-09-22T08:48:44.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.003+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~6DS9LSKN3A61.2 size=1046329 2024-09-22T08:48:44.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.006+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=6DS9LSKN3A61 tag=MMR6XNUOAJYP type=write size=4192057 2024-09-22T08:48:44.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.008+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~KBGIPLKMGLM9.0 size=1048576 2024-09-22T08:48:44.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.009+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~KBGIPLKMGLM9.1 size=741326 2024-09-22T08:48:44.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.009+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=KBGIPLKMGLM9 tag=GH9EDGQOY5HW type=write size=2838478 2024-09-22T08:48:44.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.011+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~Q0JB1N47A34I.0 size=497707 2024-09-22T08:48:44.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.013+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=Q0JB1N47A34I tag=6RZC9R28GCL3 type=write size=1546283 2024-09-22T08:48:44.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.015+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=1C16IR9HEC39 type=write size=678096 2024-09-22T08:48:44.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.016+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~3J0WEL2UZ1Y2.0 size=1048576 2024-09-22T08:48:44.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.017+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~3J0WEL2UZ1Y2.1 size=827932 2024-09-22T08:48:44.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.019+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=3J0WEL2UZ1Y2 tag=X3DVS7K0JNT4 type=write size=2925084 2024-09-22T08:48:44.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.021+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.0 size=1048576 2024-09-22T08:48:44.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.022+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.1 size=1048576 2024-09-22T08:48:44.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.023+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.2 size=456896 2024-09-22T08:48:44.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.024+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=25HF0PGEVAKA tag=FRVDO25JUHG5 type=write size=3602624 2024-09-22T08:48:44.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.025+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=0NFCHVOXX0QN type=del 2024-09-22T08:48:44.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.026+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=68HXZ47VJJQM type=del size=3225792 2024-09-22T08:48:44.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.028+0000 7f7b8ef90780 1 < completed write operation key=UQPY2ITDMKGO tag=0R6XJW0CMME3 type=write size=610807 2024-09-22T08:48:44.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.029+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=QU347G3Q1K31 type=del size=373280 2024-09-22T08:48:44.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.030+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.0 size=1048576 2024-09-22T08:48:44.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.031+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.1 size=1048576 2024-09-22T08:48:44.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.032+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~IQUUHP4FTCNI.2 size=407468 2024-09-22T08:48:44.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.035+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=IQUUHP4FTCNI tag=QHBHJGYNIBI5 type=write size=3553196 2024-09-22T08:48:44.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.036+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=S715CADCQFCW type=del size=2330551 2024-09-22T08:48:44.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.037+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~RXCSPJJD0XUN.0 size=969593 2024-09-22T08:48:44.040 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.039+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=RXCSPJJD0XUN tag=YFLSPWKE14QU type=write size=2018169 2024-09-22T08:48:44.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.041+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=KIYS02PB5500 type=del size=2894384 2024-09-22T08:48:44.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.042+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=N5AKULA8BJP3 type=write size=586693 2024-09-22T08:48:44.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.043+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=ZF8G8KCSRS34 type=write size=862526 2024-09-22T08:48:44.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.045+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=XCKJGFWUF80V type=del 2024-09-22T08:48:44.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.047+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.0 size=1048576 2024-09-22T08:48:44.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.048+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.1 size=1048576 2024-09-22T08:48:44.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.049+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.2 size=965997 2024-09-22T08:48:44.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.049+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=689W2037I50S tag=OB2PL3BS95FG type=write size=4111725 2024-09-22T08:48:44.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.050+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=6GFFFNTBJDIH type=del 2024-09-22T08:48:44.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.052+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=VRHUEN1QBFCL type=del size=4092535 2024-09-22T08:48:44.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.053+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~KHMJGQSYIU07.0 size=1048576 2024-09-22T08:48:44.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.054+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~KHMJGQSYIU07.1 size=274656 2024-09-22T08:48:44.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.056+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=KHMJGQSYIU07 tag=T05MBL9K6KPI type=write size=2371808 2024-09-22T08:48:44.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.058+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=LT5CTFWRBN84 type=write size=1022293 2024-09-22T08:48:44.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.059+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~K42N3WK19CQ5.0 size=1048576 2024-09-22T08:48:44.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.060+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~K42N3WK19CQ5.1 size=259571 2024-09-22T08:48:44.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.062+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=K42N3WK19CQ5 tag=B0KJ56XXZU27 type=write size=2356723 2024-09-22T08:48:44.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.063+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=GXIKP47CB8FA type=del size=2648724 2024-09-22T08:48:44.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.065+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~1AZXDXOZL1ZM.0 size=133286 2024-09-22T08:48:44.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.067+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=1AZXDXOZL1ZM tag=NVTKWIRV7RYZ type=write size=1181862 2024-09-22T08:48:44.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.068+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=MHOXVA0Y0TSC type=del size=767214 2024-09-22T08:48:44.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.069+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~76K1REQAFXID.0 size=1048576 2024-09-22T08:48:44.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.070+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~76K1REQAFXID.1 size=195535 2024-09-22T08:48:44.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.072+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=76K1REQAFXID tag=XQ1YNLX0OMG4 type=write size=2292687 2024-09-22T08:48:44.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.074+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=BBKBM25UXUAQ type=del size=93832 2024-09-22T08:48:44.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.076+0000 7f7b8ef90780 1 < suggested remove operation key=UQPY2ITDMKGO tag=33EFZUY5UYS1 type=del 2024-09-22T08:48:44.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.077+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=OV0000TWE48Z type=write size=500530 2024-09-22T08:48:44.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.078+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=GTSB9O3PO1OW type=del 2024-09-22T08:48:44.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.080+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=ZGC2DOYDDL2H type=del size=995135 2024-09-22T08:48:44.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.081+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~KBGIPLKMGLM9.0 size=1048576 2024-09-22T08:48:44.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.082+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~KBGIPLKMGLM9.1 size=741326 2024-09-22T08:48:44.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.084+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=KBGIPLKMGLM9 tag=GH9EDGQOY5HW type=write size=2838478 2024-09-22T08:48:44.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.085+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=G9TFWN13UJT8 type=del size=629648 2024-09-22T08:48:44.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.086+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=UQPY2ITDMKGO tag=1C16IR9HEC39 type=write size=678096: (2) No such file or directory 2024-09-22T08:48:44.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.087+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=GUQDFIGCYHNW type=write size=941139 2024-09-22T08:48:44.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.088+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.0 size=1048576 2024-09-22T08:48:44.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.089+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.1 size=1048576 2024-09-22T08:48:44.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.090+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~25HF0PGEVAKA.2 size=456896 2024-09-22T08:48:44.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.092+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=25HF0PGEVAKA tag=FRVDO25JUHG5 type=write size=3602624 2024-09-22T08:48:44.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.094+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.0 size=1048576 2024-09-22T08:48:44.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.095+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.1 size=1048576 2024-09-22T08:48:44.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.096+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.2 size=60838 2024-09-22T08:48:44.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.096+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=IB4PHK0KE70A tag=RAC9AE3A6VN4 type=write size=3206566 2024-09-22T08:48:44.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.097+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=68HXZ47VJJQM type=del 2024-09-22T08:48:44.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.098+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=CJGXT53B8IZV type=del size=2006781 2024-09-22T08:48:44.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.100+0000 7f7b8ef90780 -1 < failed to complete operation key=UQPY2ITDMKGO tag=QU347G3Q1K31 type=del size=373280: (22) Invalid argument 2024-09-22T08:48:44.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.101+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=HOYXJL4QKZKG type=write size=246082 2024-09-22T08:48:44.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.104+0000 7f7b8ef90780 1 < suggested update operation key=O81X7IWXN4VP tag=S715CADCQFCW type=del size=2330551 2024-09-22T08:48:44.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.105+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=GGUQ275TG1BH type=del size=1386797 2024-09-22T08:48:44.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.108+0000 7f7b8ef90780 1 < suggested update operation key=R0N30XP1BXY3 tag=KIYS02PB5500 type=del size=2894384 2024-09-22T08:48:44.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.110+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~QY4XR3MCOH7V.0 size=837870 2024-09-22T08:48:44.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.110+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=QY4XR3MCOH7V tag=JSNPUE4HNBX1 type=write size=1886446 2024-09-22T08:48:44.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.111+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=ZF8G8KCSRS34 type=write size=862526 2024-09-22T08:48:44.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.112+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=2QDDQ7TYMJ1N type=del size=1483518 2024-09-22T08:48:44.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.113+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.0 size=1048576 2024-09-22T08:48:44.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.114+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.1 size=1048576 2024-09-22T08:48:44.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.115+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~689W2037I50S.2 size=965997 2024-09-22T08:48:44.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.117+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=689W2037I50S tag=OB2PL3BS95FG type=write size=4111725 2024-09-22T08:48:44.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.119+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=KA2068CGGBT8 type=del size=2051341 2024-09-22T08:48:44.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.120+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=VRHUEN1QBFCL type=del 2024-09-22T08:48:44.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.121+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=J6F0RUSPXLTS type=write size=26746 2024-09-22T08:48:44.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.123+0000 7f7b8ef90780 1 < completed write operation key=G51KS3NM4VFY tag=LT5CTFWRBN84 type=write size=1022293 2024-09-22T08:48:44.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.124+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=BMJNJ5LCUDYY type=del size=1325681 2024-09-22T08:48:44.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.125+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=GXIKP47CB8FA type=del 2024-09-22T08:48:44.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.127+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.0 size=1048576 2024-09-22T08:48:44.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.128+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.1 size=1048576 2024-09-22T08:48:44.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.129+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.2 size=681419 2024-09-22T08:48:44.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.129+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=FKS88V30W26A tag=GKPM0W1D08UW type=write size=3827147 2024-09-22T08:48:44.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.131+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=MHOXVA0Y0TSC type=del 2024-09-22T08:48:44.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.132+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=A7RE83O4S53O type=del size=1300533 2024-09-22T08:48:44.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.134+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=BBKBM25UXUAQ type=del size=93832 2024-09-22T08:48:44.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.135+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=75FP6DACCZSR type=del size=1800416 2024-09-22T08:48:44.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.136+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=OV0000TWE48Z type=write size=500530 2024-09-22T08:48:44.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.138+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=Z1SLOIRIEQ5Z type=del size=3064116 2024-09-22T08:48:44.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.140+0000 7f7b8ef90780 1 < suggested remove operation key=4J4EGI19N123 tag=ZGC2DOYDDL2H type=del 2024-09-22T08:48:44.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.142+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~576E52FH24PZ.0 size=1048576 2024-09-22T08:48:44.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.143+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~576E52FH24PZ.1 size=714832 2024-09-22T08:48:44.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.143+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=576E52FH24PZ tag=L63ODR16GYG4 type=write size=2811984 2024-09-22T08:48:44.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.145+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=G9TFWN13UJT8 type=del 2024-09-22T08:48:44.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.147+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.0 size=1048576 2024-09-22T08:48:44.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.148+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.1 size=1048576 2024-09-22T08:48:44.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.149+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.2 size=883158 2024-09-22T08:48:44.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.149+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=OIQXLQNSMGQZ tag=BYDJV1V93DTW type=write size=4028886 2024-09-22T08:48:44.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.151+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=GUQDFIGCYHNW type=write size=941139 2024-09-22T08:48:44.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.152+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=Z9SQ0JAUO0I8 type=del size=2172514 2024-09-22T08:48:44.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.153+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.0 size=1048576 2024-09-22T08:48:44.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.154+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.1 size=1048576 2024-09-22T08:48:44.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.155+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~IB4PHK0KE70A.2 size=60838 2024-09-22T08:48:44.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.157+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=IB4PHK0KE70A tag=RAC9AE3A6VN4 type=write size=3206566 2024-09-22T08:48:44.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.159+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=SOJ0PZ162X1B type=del size=3970678 2024-09-22T08:48:44.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.160+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=CJGXT53B8IZV type=del 2024-09-22T08:48:44.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.161+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=ISMO1VC2DVHH type=del size=2247681 2024-09-22T08:48:44.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.163+0000 7f7b8ef90780 1 < canceled operation key=4ZJ4E4SUA01H tag=HOYXJL4QKZKG type=write size=246082 2024-09-22T08:48:44.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.164+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=ALXLWK5ZGVF3 type=del size=3812418 2024-09-22T08:48:44.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.165+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=GGUQ275TG1BH type=del 2024-09-22T08:48:44.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.166+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=JCUEK14XIV8Z type=del size=1489294 2024-09-22T08:48:44.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.167+0000 7f7b8ef90780 1 < canceled part key=_multipart_QH6TK0MJKYUO.2~QY4XR3MCOH7V.0 size=837870 2024-09-22T08:48:44.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.169+0000 7f7b8ef90780 1 < canceled multipart upload key=QH6TK0MJKYUO upload=QY4XR3MCOH7V tag=JSNPUE4HNBX1 type=write size=1886446 2024-09-22T08:48:44.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.171+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~R567OVEP91BJ.0 size=465235 2024-09-22T08:48:44.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.171+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=R567OVEP91BJ tag=CUC21ZOGMD13 type=write size=1513811 2024-09-22T08:48:44.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.174+0000 7f7b8ef90780 1 < suggested update operation key=UQPY2ITDMKGO tag=2QDDQ7TYMJ1N type=del size=1483518 2024-09-22T08:48:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.175+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=H7F37FJTUOJS type=write size=579342 2024-09-22T08:48:44.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.176+0000 7f7b8ef90780 -1 < failed to complete operation key=PODNY4NH4A9W tag=KA2068CGGBT8 type=del size=2051341: (22) Invalid argument 2024-09-22T08:48:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.178+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=KHJP8W399JU3 type=del size=4039728 2024-09-22T08:48:44.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.179+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=J6F0RUSPXLTS type=write size=26746 2024-09-22T08:48:44.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.180+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=1M7833683113 type=del size=3258451 2024-09-22T08:48:44.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.182+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=BMJNJ5LCUDYY type=del 2024-09-22T08:48:44.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.184+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~OM51FLHF7RUD.0 size=1048576 2024-09-22T08:48:44.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.185+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~OM51FLHF7RUD.1 size=296876 2024-09-22T08:48:44.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.185+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=OM51FLHF7RUD tag=NK1KG2Y4SSDZ type=write size=2394028 2024-09-22T08:48:44.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.186+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.0 size=1048576 2024-09-22T08:48:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.187+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.1 size=1048576 2024-09-22T08:48:44.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.188+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~FKS88V30W26A.2 size=681419 2024-09-22T08:48:44.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.190+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=FKS88V30W26A tag=GKPM0W1D08UW type=write size=3827147 2024-09-22T08:48:44.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.192+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=ZUQZTK2131GI type=del size=535413 2024-09-22T08:48:44.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.194+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=A7RE83O4S53O type=del 2024-09-22T08:48:44.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.196+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~4JJG7EPL0JXQ.0 size=1048576 2024-09-22T08:48:44.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.197+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~4JJG7EPL0JXQ.1 size=227471 2024-09-22T08:48:44.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.197+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=4JJG7EPL0JXQ tag=N3KY35ORC4PF type=write size=2324623 2024-09-22T08:48:44.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.199+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=75FP6DACCZSR type=del 2024-09-22T08:48:44.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.201+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1C4NUSOSH5PW.0 size=1048576 2024-09-22T08:48:44.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.202+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1C4NUSOSH5PW.1 size=219728 2024-09-22T08:48:44.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.202+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=1C4NUSOSH5PW tag=XPLAP2S8TVB7 type=write size=2316880 2024-09-22T08:48:44.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.203+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=Z1SLOIRIEQ5Z type=del 2024-09-22T08:48:44.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.204+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=JLNJJSR95IZI type=write size=895619 2024-09-22T08:48:44.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.206+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~576E52FH24PZ.0 size=1048576 2024-09-22T08:48:44.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.207+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~576E52FH24PZ.1 size=714832 2024-09-22T08:48:44.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.210+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=576E52FH24PZ tag=L63ODR16GYG4 type=write size=2811984 2024-09-22T08:48:44.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.212+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.0 size=1048576 2024-09-22T08:48:44.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.213+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.1 size=1048576 2024-09-22T08:48:44.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.214+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.2 size=880593 2024-09-22T08:48:44.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.214+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=R2KTQ63EU08D tag=8YYFG0YPIWFI type=write size=4026321 2024-09-22T08:48:44.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.216+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.0 size=1048576 2024-09-22T08:48:44.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.216+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.1 size=1048576 2024-09-22T08:48:44.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.217+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OIQXLQNSMGQZ.2 size=883158 2024-09-22T08:48:44.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.219+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=OIQXLQNSMGQZ tag=BYDJV1V93DTW type=write size=4028886 2024-09-22T08:48:44.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.220+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=6SY41HV3W8U1 type=del size=2777407 2024-09-22T08:48:44.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.222+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=Z9SQ0JAUO0I8 type=del 2024-09-22T08:48:44.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.224+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=CX097ZMZSGWG type=del size=903426 2024-09-22T08:48:44.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.225+0000 7f7b8ef90780 1 < canceled operation key=QH6TK0MJKYUO tag=SOJ0PZ162X1B type=del size=3970678 2024-09-22T08:48:44.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.227+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=3S9PVM93P3EL type=del size=2110656 2024-09-22T08:48:44.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.228+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=ISMO1VC2DVHH type=del size=2247681 2024-09-22T08:48:44.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.230+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.0 size=1048576 2024-09-22T08:48:44.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.231+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.1 size=1048576 2024-09-22T08:48:44.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.232+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.2 size=746075 2024-09-22T08:48:44.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.232+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=3IU30F35T1C2 tag=61SIOKIQ7B6T type=write size=3891803 2024-09-22T08:48:44.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.233+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=ALXLWK5ZGVF3 type=del 2024-09-22T08:48:44.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.234+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=NWJKD6HQ6560 type=del size=1629879 2024-09-22T08:48:44.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.236+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=JCUEK14XIV8Z type=del 2024-09-22T08:48:44.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.237+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=AYDE2DMHZVVI type=del size=1764591 2024-09-22T08:48:44.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.237+0000 7f7b8ef90780 1 < canceled part key=_multipart_VAO9MXRFGXFY.2~R567OVEP91BJ.0 size=465235 2024-09-22T08:48:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.239+0000 7f7b8ef90780 1 < canceled multipart upload key=VAO9MXRFGXFY upload=R567OVEP91BJ tag=CUC21ZOGMD13 type=write size=1513811 2024-09-22T08:48:44.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.241+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=WU039CRJICJF type=del size=2459550 2024-09-22T08:48:44.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.243+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=H7F37FJTUOJS type=write size=579342 2024-09-22T08:48:44.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.244+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=JBCKGE0Y0F15 type=del size=2451717 2024-09-22T08:48:44.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.245+0000 7f7b8ef90780 1 < canceled operation key=7ZS8G8H6I957 tag=KHJP8W399JU3 type=del size=4039728 2024-09-22T08:48:44.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.246+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=DC2X4WY1OVKC type=del size=3826079 2024-09-22T08:48:44.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.248+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=1M7833683113 type=del 2024-09-22T08:48:44.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.249+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=2EQ2CNVLKQTV type=del size=2400742 2024-09-22T08:48:44.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.250+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~OM51FLHF7RUD.0 size=1048576 2024-09-22T08:48:44.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.251+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~OM51FLHF7RUD.1 size=296876 2024-09-22T08:48:44.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.253+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=OM51FLHF7RUD tag=NK1KG2Y4SSDZ type=write size=2394028 2024-09-22T08:48:44.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.256+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YWEDJ0S168MW.0 size=1048576 2024-09-22T08:48:44.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.256+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YWEDJ0S168MW.1 size=131764 2024-09-22T08:48:44.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.256+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=YWEDJ0S168MW tag=NCY6GUW8B4MO type=write size=2228916 2024-09-22T08:48:44.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.258+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=ZUQZTK2131GI type=del size=535413 2024-09-22T08:48:44.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.259+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=HCFQX2RZBOA3 type=del size=1369635 2024-09-22T08:48:44.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.260+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~4JJG7EPL0JXQ.0 size=1048576 2024-09-22T08:48:44.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.261+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~4JJG7EPL0JXQ.1 size=227471 2024-09-22T08:48:44.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.263+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=4JJG7EPL0JXQ tag=N3KY35ORC4PF type=write size=2324623 2024-09-22T08:48:44.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.264+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=6NQL2PBP6IAN type=del size=3680092 2024-09-22T08:48:44.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.266+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~1C4NUSOSH5PW.0 size=1048576 2024-09-22T08:48:44.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.267+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~1C4NUSOSH5PW.1 size=219728 2024-09-22T08:48:44.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.269+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=1C4NUSOSH5PW tag=XPLAP2S8TVB7 type=write size=2316880 2024-09-22T08:48:44.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.270+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=FII0KL00J2X7 type=del size=1010795 2024-09-22T08:48:44.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.271+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=JLNJJSR95IZI type=write size=895619 2024-09-22T08:48:44.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.272+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=VEJN93Z1DQKN type=del size=1478847 2024-09-22T08:48:44.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.273+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.0 size=1048576 2024-09-22T08:48:44.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.273+0000 7f7b8ef90780 1 < canceled part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.1 size=1048576 2024-09-22T08:48:44.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.274+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~R2KTQ63EU08D.2 size=880593 2024-09-22T08:48:44.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.277+0000 7f7b8ef90780 1 < canceled multipart upload key=QH6TK0MJKYUO upload=R2KTQ63EU08D tag=8YYFG0YPIWFI type=write size=4026321 2024-09-22T08:48:44.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.278+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=S1ZU0HR969E2 type=del size=4061730 2024-09-22T08:48:44.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.279+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=6SY41HV3W8U1 type=del 2024-09-22T08:48:44.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.280+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=N0W032LSFSJG type=del size=1228008 2024-09-22T08:48:44.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.283+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=CX097ZMZSGWG type=del size=903426 2024-09-22T08:48:44.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.285+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.0 size=1048576 2024-09-22T08:48:44.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.286+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.1 size=1048576 2024-09-22T08:48:44.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.287+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.2 size=223433 2024-09-22T08:48:44.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.287+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=QQ24KU3NK8HL tag=DOEM1L93V5OY type=write size=3369161 2024-09-22T08:48:44.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.290+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=3S9PVM93P3EL type=del size=2110656 2024-09-22T08:48:44.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.291+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=A7SYJWU2104G type=del size=1077015 2024-09-22T08:48:44.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.292+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.0 size=1048576 2024-09-22T08:48:44.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.293+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.1 size=1048576 2024-09-22T08:48:44.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.294+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~3IU30F35T1C2.2 size=746075 2024-09-22T08:48:44.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.297+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=3IU30F35T1C2 tag=61SIOKIQ7B6T type=write size=3891803 2024-09-22T08:48:44.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.299+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~5RYP80NNZUMD.0 size=182945 2024-09-22T08:48:44.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.299+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=5RYP80NNZUMD tag=Y31J8JCX7T1J type=write size=1231521 2024-09-22T08:48:44.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.301+0000 7f7b8ef90780 1 < suggested update operation key=Z9CHXCJ02L85 tag=NWJKD6HQ6560 type=del size=1629879 2024-09-22T08:48:44.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.304+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~EYWKLZ5RO7KQ.0 size=902959 2024-09-22T08:48:44.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.304+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=EYWKLZ5RO7KQ tag=6TQ9QJ0YEMY1 type=write size=1951535 2024-09-22T08:48:44.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.305+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=AYDE2DMHZVVI type=del 2024-09-22T08:48:44.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.306+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=OKALDAWBOF8E type=del size=2390027 2024-09-22T08:48:44.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.307+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=WU039CRJICJF type=del 2024-09-22T08:48:44.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.309+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~AD51DFPV4L96.0 size=697336 2024-09-22T08:48:44.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.309+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=AD51DFPV4L96 tag=7TO25QAWUUOZ type=write size=1745912 2024-09-22T08:48:44.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.311+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=JBCKGE0Y0F15 type=del 2024-09-22T08:48:44.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.312+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=CIYDJ9K8R068 type=write size=159830 2024-09-22T08:48:44.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.315+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=DC2X4WY1OVKC type=del 2024-09-22T08:48:44.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.317+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~X4VOJTK92XZE.0 size=620322 2024-09-22T08:48:44.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.317+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=X4VOJTK92XZE tag=K3ZC6S4DUGUN type=write size=1668898 2024-09-22T08:48:44.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.319+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=2EQ2CNVLKQTV type=del 2024-09-22T08:48:44.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.320+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=0MO232S03UZH type=del size=1298884 2024-09-22T08:48:44.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.321+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YWEDJ0S168MW.0 size=1048576 2024-09-22T08:48:44.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.323+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YWEDJ0S168MW.1 size=131764 2024-09-22T08:48:44.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.325+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=YWEDJ0S168MW tag=NCY6GUW8B4MO type=write size=2228916 2024-09-22T08:48:44.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.327+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=DT6KK77049UW type=del size=3420640 2024-09-22T08:48:44.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.328+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=HCFQX2RZBOA3 type=del size=1369635 2024-09-22T08:48:44.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.330+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.0 size=1048576 2024-09-22T08:48:44.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.331+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.1 size=1048576 2024-09-22T08:48:44.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.332+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.2 size=240910 2024-09-22T08:48:44.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.332+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=UOS0ICX4F8LN tag=DS2BHS3MTV2H type=write size=3386638 2024-09-22T08:48:44.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.333+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=6NQL2PBP6IAN type=del size=3680092: (22) Invalid argument 2024-09-22T08:48:44.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.335+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=S7SWOWEKZYT7 type=del size=3429155 2024-09-22T08:48:44.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.337+0000 7f7b8ef90780 1 < suggested update operation key=R0N30XP1BXY3 tag=FII0KL00J2X7 type=del size=1010795 2024-09-22T08:48:44.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.338+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=W063D14CV0DE type=del size=3495011 2024-09-22T08:48:44.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.339+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=VEJN93Z1DQKN type=del size=1478847: (22) Invalid argument 2024-09-22T08:48:44.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.341+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=JKQHD6EJC5Z4 type=del size=1950651 2024-09-22T08:48:44.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.344+0000 7f7b8ef90780 1 < suggested update operation key=X9TWX0Z54MOO tag=S1ZU0HR969E2 type=del size=4061730 2024-09-22T08:48:44.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.346+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~P5RH7N0NOZPV.0 size=1048576 2024-09-22T08:48:44.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.347+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~P5RH7N0NOZPV.1 size=820844 2024-09-22T08:48:44.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.347+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=P5RH7N0NOZPV tag=I08J8JZB4MDO type=write size=2917996 2024-09-22T08:48:44.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.348+0000 7f7b8ef90780 -1 < failed to complete operation key=QH6TK0MJKYUO tag=N0W032LSFSJG type=del size=1228008: (22) Invalid argument 2024-09-22T08:48:44.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.349+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=VGAA058LOW86 type=del size=1121740 2024-09-22T08:48:44.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.351+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.0 size=1048576 2024-09-22T08:48:44.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.352+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.1 size=1048576 2024-09-22T08:48:44.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.353+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~QQ24KU3NK8HL.2 size=223433 2024-09-22T08:48:44.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.355+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=QQ24KU3NK8HL tag=DOEM1L93V5OY type=write size=3369161 2024-09-22T08:48:44.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.357+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~A0LIP1XYXELP.0 size=10112 2024-09-22T08:48:44.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.357+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=A0LIP1XYXELP tag=FZWI5CIY6PVS type=write size=1058688 2024-09-22T08:48:44.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.358+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=A7SYJWU2104G type=del size=1077015: (22) Invalid argument 2024-09-22T08:48:44.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.360+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=QRRTLDAIH4J0 type=del size=4020815 2024-09-22T08:48:44.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.361+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~5RYP80NNZUMD.0 size=182945 2024-09-22T08:48:44.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.363+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=5RYP80NNZUMD tag=Y31J8JCX7T1J type=write size=1231521 2024-09-22T08:48:44.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.366+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~LC1X4U4TEAL9.0 size=546579 2024-09-22T08:48:44.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.366+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=LC1X4U4TEAL9 tag=ORU2GPQOITBY type=write size=1595155 2024-09-22T08:48:44.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.367+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~EYWKLZ5RO7KQ.0 size=902959 2024-09-22T08:48:44.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.369+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=EYWKLZ5RO7KQ tag=6TQ9QJ0YEMY1 type=write size=1951535 2024-09-22T08:48:44.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.371+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=CYKK12I1WKMR type=write size=243486 2024-09-22T08:48:44.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.372+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=OKALDAWBOF8E type=del 2024-09-22T08:48:44.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.374+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~NA6U9OWEL6VR.0 size=1048576 2024-09-22T08:48:44.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.375+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~NA6U9OWEL6VR.1 size=193384 2024-09-22T08:48:44.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.375+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=NA6U9OWEL6VR tag=V22KFJPT6AEI type=write size=2290536 2024-09-22T08:48:44.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.376+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~AD51DFPV4L96.0 size=697336 2024-09-22T08:48:44.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.379+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=AD51DFPV4L96 tag=7TO25QAWUUOZ type=write size=1745912 2024-09-22T08:48:44.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.380+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=ZVN3S72FLQJM type=write size=863995 2024-09-22T08:48:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.381+0000 7f7b8ef90780 1 < completed write operation key=1U6T2BIZS72V tag=CIYDJ9K8R068 type=write size=159830 2024-09-22T08:48:44.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.382+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=RZD83LKH1RBS type=del size=1109819 2024-09-22T08:48:44.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.384+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~X4VOJTK92XZE.0 size=620322 2024-09-22T08:48:44.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.386+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=X4VOJTK92XZE tag=K3ZC6S4DUGUN type=write size=1668898 2024-09-22T08:48:44.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.387+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=D6Q0V9LLUE06 type=del size=4088804 2024-09-22T08:48:44.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.390+0000 7f7b8ef90780 1 < suggested remove operation key=6DC0SVAYR2DB tag=0MO232S03UZH type=del 2024-09-22T08:48:44.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.391+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=CKDF7I0366GN type=del size=99863 2024-09-22T08:48:44.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.392+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=DT6KK77049UW type=del 2024-09-22T08:48:44.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.394+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=YEZ6VZ0D0JTO type=del size=1194946 2024-09-22T08:48:44.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.395+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.0 size=1048576 2024-09-22T08:48:44.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.396+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.1 size=1048576 2024-09-22T08:48:44.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.397+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~UOS0ICX4F8LN.2 size=240910 2024-09-22T08:48:44.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.400+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=UOS0ICX4F8LN tag=DS2BHS3MTV2H type=write size=3386638 2024-09-22T08:48:44.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.402+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.0 size=1048576 2024-09-22T08:48:44.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.403+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.1 size=1048576 2024-09-22T08:48:44.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.405+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.2 size=552301 2024-09-22T08:48:44.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.405+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=SP5WFOM94HA1 tag=WOMTGZBYJDHA type=write size=3698029 2024-09-22T08:48:44.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.406+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=S7SWOWEKZYT7 type=del 2024-09-22T08:48:44.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.408+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~0LXX2618I6A8.0 size=683488 2024-09-22T08:48:44.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.408+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=0LXX2618I6A8 tag=XR2G39A9WYNP type=write size=1732064 2024-09-22T08:48:44.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.410+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=W063D14CV0DE type=del 2024-09-22T08:48:44.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.412+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~93WA7YM2OH4A.0 size=1048576 2024-09-22T08:48:44.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.414+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~93WA7YM2OH4A.1 size=793894 2024-09-22T08:48:44.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.414+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=93WA7YM2OH4A tag=PXSWJTKDQUV6 type=write size=2891046 2024-09-22T08:48:44.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.415+0000 7f7b8ef90780 1 < canceled operation key=1U6T2BIZS72V tag=JKQHD6EJC5Z4 type=del size=1950651 2024-09-22T08:48:44.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.416+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=CTUKAIHNRYE3 type=write size=874250 2024-09-22T08:48:44.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.418+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~P5RH7N0NOZPV.0 size=1048576 2024-09-22T08:48:44.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.419+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~P5RH7N0NOZPV.1 size=820844 2024-09-22T08:48:44.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.421+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=P5RH7N0NOZPV tag=I08J8JZB4MDO type=write size=2917996 2024-09-22T08:48:44.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.422+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=LHUGV3FKXIV5 type=del size=1524667 2024-09-22T08:48:44.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.424+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=VGAA058LOW86 type=del 2024-09-22T08:48:44.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.426+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.0 size=1048576 2024-09-22T08:48:44.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.427+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.1 size=1048576 2024-09-22T08:48:44.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.428+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.2 size=83676 2024-09-22T08:48:44.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.428+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=5U3QN3YLCD0T tag=TK225TABQ1PW type=write size=3229404 2024-09-22T08:48:44.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.430+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~A0LIP1XYXELP.0 size=10112 2024-09-22T08:48:44.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.432+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=A0LIP1XYXELP tag=FZWI5CIY6PVS type=write size=1058688 2024-09-22T08:48:44.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.434+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~97XJ5G4J5QXN.0 size=776854 2024-09-22T08:48:44.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.434+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=97XJ5G4J5QXN tag=PIU1WCXE2X3P type=write size=1825430 2024-09-22T08:48:44.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.435+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=QRRTLDAIH4J0 type=del 2024-09-22T08:48:44.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.437+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=7A15WJ5FHXEP type=del size=2782646 2024-09-22T08:48:44.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.438+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~LC1X4U4TEAL9.0 size=546579 2024-09-22T08:48:44.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.440+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=LC1X4U4TEAL9 tag=ORU2GPQOITBY type=write size=1595155 2024-09-22T08:48:44.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.442+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=ARI2P94YZECV type=del size=1810686 2024-09-22T08:48:44.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.443+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=CYKK12I1WKMR type=write size=243486 2024-09-22T08:48:44.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.445+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.0 size=1048576 2024-09-22T08:48:44.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.446+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.1 size=1048576 2024-09-22T08:48:44.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.448+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.2 size=67123 2024-09-22T08:48:44.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.448+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=0PBGCIDERJ57 tag=Z1QTWG3B1HOF type=write size=3212851 2024-09-22T08:48:44.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.448+0000 7f7b8ef90780 1 < canceled part key=_multipart_VAO9MXRFGXFY.2~NA6U9OWEL6VR.0 size=1048576 2024-09-22T08:48:44.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.449+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~NA6U9OWEL6VR.1 size=193384 2024-09-22T08:48:44.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.451+0000 7f7b8ef90780 1 < canceled multipart upload key=VAO9MXRFGXFY upload=NA6U9OWEL6VR tag=V22KFJPT6AEI type=write size=2290536 2024-09-22T08:48:44.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.452+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=4207IX7F43YD type=write size=632377 2024-09-22T08:48:44.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.453+0000 7f7b8ef90780 1 < canceled operation key=R0N30XP1BXY3 tag=ZVN3S72FLQJM type=write size=863995 2024-09-22T08:48:44.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.455+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=5CVIKXFIQ7TA type=del size=502186 2024-09-22T08:48:44.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.456+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=RZD83LKH1RBS type=del 2024-09-22T08:48:44.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.458+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~3HW5DUDMKHPF.0 size=1048576 2024-09-22T08:48:44.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.459+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~3HW5DUDMKHPF.1 size=842293 2024-09-22T08:48:44.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.459+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=3HW5DUDMKHPF tag=0VU8NNE38Y6U type=write size=2939445 2024-09-22T08:48:44.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.460+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=D6Q0V9LLUE06 type=del 2024-09-22T08:48:44.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.463+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~5TLW1DDGB1CO.0 size=1048576 2024-09-22T08:48:44.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.464+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~5TLW1DDGB1CO.1 size=938220 2024-09-22T08:48:44.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.464+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=5TLW1DDGB1CO tag=WK36N71YJ5SD type=write size=3035372 2024-09-22T08:48:44.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.467+0000 7f7b8ef90780 1 < suggested remove operation key=YF94C9GVRXQP tag=CKDF7I0366GN type=del 2024-09-22T08:48:44.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.469+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~HGLGOSYHDUYK.0 size=1048576 2024-09-22T08:48:44.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.470+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~HGLGOSYHDUYK.1 size=987106 2024-09-22T08:48:44.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.470+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=HGLGOSYHDUYK tag=9AQ0CT7YEQW1 type=write size=3084258 2024-09-22T08:48:44.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.472+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=YEZ6VZ0D0JTO type=del 2024-09-22T08:48:44.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.473+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=Z3W2LIUR0WGC type=del size=704407 2024-09-22T08:48:44.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.474+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.0 size=1048576 2024-09-22T08:48:44.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.475+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.1 size=1048576 2024-09-22T08:48:44.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.476+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~SP5WFOM94HA1.2 size=552301 2024-09-22T08:48:44.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.478+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=SP5WFOM94HA1 tag=WOMTGZBYJDHA type=write size=3698029 2024-09-22T08:48:44.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.480+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=ODD3BGQBAAW0 type=del size=3280638 2024-09-22T08:48:44.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.481+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~0LXX2618I6A8.0 size=683488 2024-09-22T08:48:44.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.483+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=0LXX2618I6A8 tag=XR2G39A9WYNP type=write size=1732064 2024-09-22T08:48:44.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.485+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=K6CJA2J9TXVZ type=del size=3492444 2024-09-22T08:48:44.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.486+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~93WA7YM2OH4A.0 size=1048576 2024-09-22T08:48:44.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.487+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~93WA7YM2OH4A.1 size=793894 2024-09-22T08:48:44.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.489+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=93WA7YM2OH4A tag=PXSWJTKDQUV6 type=write size=2891046 2024-09-22T08:48:44.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.490+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=4542XKPCMGUF type=del size=3425919 2024-09-22T08:48:44.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.493+0000 7f7b8ef90780 1 < suggested update operation key=GBNPVRO0JPF7 tag=CTUKAIHNRYE3 type=write size=874250 2024-09-22T08:48:44.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.494+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=3KHCG54HZFOA type=del size=3334110 2024-09-22T08:48:44.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.496+0000 7f7b8ef90780 1 < canceled operation key=L1URDVW43BUG tag=LHUGV3FKXIV5 type=del size=1524667 2024-09-22T08:48:44.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.497+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=HD3EHNMGYHAT type=del size=787170 2024-09-22T08:48:44.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.498+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.0 size=1048576 2024-09-22T08:48:44.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.499+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.1 size=1048576 2024-09-22T08:48:44.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.501+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~5U3QN3YLCD0T.2 size=83676 2024-09-22T08:48:44.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.503+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=5U3QN3YLCD0T tag=TK225TABQ1PW type=write size=3229404 2024-09-22T08:48:44.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.504+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=MK2MWKIPMZW5 type=del size=913781 2024-09-22T08:48:44.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.505+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~97XJ5G4J5QXN.0 size=776854 2024-09-22T08:48:44.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.508+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=97XJ5G4J5QXN tag=PIU1WCXE2X3P type=write size=1825430 2024-09-22T08:48:44.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.510+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~CTF7X7HDU5PM.0 size=489197 2024-09-22T08:48:44.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.510+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=CTF7X7HDU5PM tag=LD6QB533V9A2 type=write size=1537773 2024-09-22T08:48:44.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.511+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=7A15WJ5FHXEP type=del 2024-09-22T08:48:44.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.513+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=PJW8V0SON530 type=del size=73670 2024-09-22T08:48:44.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.514+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=ARI2P94YZECV type=del 2024-09-22T08:48:44.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.515+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=PMYZUA3IHLW4 type=del size=1793671 2024-09-22T08:48:44.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.517+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.0 size=1048576 2024-09-22T08:48:44.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.518+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.1 size=1048576 2024-09-22T08:48:44.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.519+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~0PBGCIDERJ57.2 size=67123 2024-09-22T08:48:44.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.521+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=0PBGCIDERJ57 tag=Z1QTWG3B1HOF type=write size=3212851 2024-09-22T08:48:44.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.523+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=Z2AYYUNJ8D9W type=del size=2565814 2024-09-22T08:48:44.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.524+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=4207IX7F43YD type=write size=632377 2024-09-22T08:48:44.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.526+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~LWJF2TBFGHD1.0 size=392092 2024-09-22T08:48:44.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.526+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=LWJF2TBFGHD1 tag=I400JHHTTX1Y type=write size=1440668 2024-09-22T08:48:44.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.528+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=5CVIKXFIQ7TA type=del 2024-09-22T08:48:44.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.530+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~1H4MDMMZRIC2.0 size=102097 2024-09-22T08:48:44.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.530+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=1H4MDMMZRIC2 tag=K2S918RMUGTK type=write size=1150673 2024-09-22T08:48:44.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.531+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~3HW5DUDMKHPF.0 size=1048576 2024-09-22T08:48:44.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.532+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~3HW5DUDMKHPF.1 size=842293 2024-09-22T08:48:44.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.534+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=3HW5DUDMKHPF tag=0VU8NNE38Y6U type=write size=2939445 2024-09-22T08:48:44.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.535+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=D2L42RAB3TU0 type=del size=3543482 2024-09-22T08:48:44.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.537+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~5TLW1DDGB1CO.0 size=1048576 2024-09-22T08:48:44.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.538+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~5TLW1DDGB1CO.1 size=938220 2024-09-22T08:48:44.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.540+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=5TLW1DDGB1CO tag=WK36N71YJ5SD type=write size=3035372 2024-09-22T08:48:44.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.541+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=D2WGML5XL89M type=del size=3837622 2024-09-22T08:48:44.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.542+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~HGLGOSYHDUYK.0 size=1048576 2024-09-22T08:48:44.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.543+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~HGLGOSYHDUYK.1 size=987106 2024-09-22T08:48:44.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.545+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=HGLGOSYHDUYK tag=9AQ0CT7YEQW1 type=write size=3084258 2024-09-22T08:48:44.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.547+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=4K0ZQURHFYTT type=del size=3293335 2024-09-22T08:48:44.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.548+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=Z3W2LIUR0WGC type=del 2024-09-22T08:48:44.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.550+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=E3LZKN86R9J3 type=del size=1330501 2024-09-22T08:48:44.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.551+0000 7f7b8ef90780 1 < canceled operation key=PODNY4NH4A9W tag=ODD3BGQBAAW0 type=del size=3280638 2024-09-22T08:48:44.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.552+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=YUGO2UUF9QQK type=del size=2427791 2024-09-22T08:48:44.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.554+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=K6CJA2J9TXVZ type=del 2024-09-22T08:48:44.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.555+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=MRPG4IYZ3DWL type=del size=1291128 2024-09-22T08:48:44.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.556+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=4542XKPCMGUF type=del 2024-09-22T08:48:44.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.558+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~GVYJZGI6BWWT.0 size=1048576 2024-09-22T08:48:44.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.559+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~GVYJZGI6BWWT.1 size=457167 2024-09-22T08:48:44.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.559+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=GVYJZGI6BWWT tag=8VF02UQUQVJU type=write size=2554319 2024-09-22T08:48:44.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.561+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=3KHCG54HZFOA type=del 2024-09-22T08:48:44.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.562+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=X847CT4UW0UF type=del size=925650 2024-09-22T08:48:44.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.563+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=HD3EHNMGYHAT type=del 2024-09-22T08:48:44.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.564+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=OUHS332TCEQA type=del size=1215019 2024-09-22T08:48:44.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.566+0000 7f7b8ef90780 1 < suggested update operation key=UQPY2ITDMKGO tag=MK2MWKIPMZW5 type=del size=913781 2024-09-22T08:48:44.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.567+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=VFAGZ97CNFPQ type=del size=4175484 2024-09-22T08:48:44.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.569+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~CTF7X7HDU5PM.0 size=489197 2024-09-22T08:48:44.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.571+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=CTF7X7HDU5PM tag=LD6QB533V9A2 type=write size=1537773 2024-09-22T08:48:44.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.572+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=NSZXVD4P4EOM type=write size=896854 2024-09-22T08:48:44.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.573+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=PJW8V0SON530 type=del 2024-09-22T08:48:44.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.575+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.0 size=1048576 2024-09-22T08:48:44.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.576+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.1 size=1048576 2024-09-22T08:48:44.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.577+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.2 size=317514 2024-09-22T08:48:44.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.577+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=E42XPWZ6E3GS tag=QBJM005XJHI4 type=write size=3463242 2024-09-22T08:48:44.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.578+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=PMYZUA3IHLW4 type=del 2024-09-22T08:48:44.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.580+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=N6JQSF4A97VZ type=del size=1308738 2024-09-22T08:48:44.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.581+0000 7f7b8ef90780 -1 < failed to complete operation key=UQPY2ITDMKGO tag=Z2AYYUNJ8D9W type=del size=2565814: (22) Invalid argument 2024-09-22T08:48:44.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.584+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.0 size=1048576 2024-09-22T08:48:44.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.585+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.1 size=1048576 2024-09-22T08:48:44.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.586+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.2 size=841225 2024-09-22T08:48:44.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.586+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=K203KXGV77CD tag=W0V53W1V9D58 type=write size=3986953 2024-09-22T08:48:44.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.587+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~LWJF2TBFGHD1.0 size=392092 2024-09-22T08:48:44.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.589+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=LWJF2TBFGHD1 tag=I400JHHTTX1Y type=write size=1440668 2024-09-22T08:48:44.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.590+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=H85ZRS9YH6IP type=del size=263909 2024-09-22T08:48:44.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.592+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~1H4MDMMZRIC2.0 size=102097 2024-09-22T08:48:44.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.594+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=1H4MDMMZRIC2 tag=K2S918RMUGTK type=write size=1150673 2024-09-22T08:48:44.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.595+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=3XWSNBG3E8TG type=del size=1482113 2024-09-22T08:48:44.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.596+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=D2L42RAB3TU0 type=del 2024-09-22T08:48:44.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.597+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=0WD3KWBKX2RF type=del size=3575700 2024-09-22T08:48:44.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.600+0000 7f7b8ef90780 1 < suggested remove operation key=O81X7IWXN4VP tag=D2WGML5XL89M type=del 2024-09-22T08:48:44.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.602+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~O8VONTUJ2QY6.0 size=923811 2024-09-22T08:48:44.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.602+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=O8VONTUJ2QY6 tag=9MJ09QR14ZE7 type=write size=1972387 2024-09-22T08:48:44.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.604+0000 7f7b8ef90780 1 < suggested update operation key=F3IHQ6Z9V1DX tag=4K0ZQURHFYTT type=del size=3293335 2024-09-22T08:48:44.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.606+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=USN13GOEJK8I type=del size=2067354 2024-09-22T08:48:44.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.607+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=E3LZKN86R9J3 type=del 2024-09-22T08:48:44.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.609+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.0 size=1048576 2024-09-22T08:48:44.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.610+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.1 size=1048576 2024-09-22T08:48:44.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.611+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.2 size=726378 2024-09-22T08:48:44.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.611+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=BHANAEMW7LKM tag=TUKF4WKUL1LG type=write size=3872106 2024-09-22T08:48:44.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.612+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=YUGO2UUF9QQK type=del 2024-09-22T08:48:44.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.613+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=3S8YXK3I04RZ type=del size=2577307 2024-09-22T08:48:44.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.614+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=MRPG4IYZ3DWL type=del 2024-09-22T08:48:44.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.616+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=OKVR2IO6Z5G9 type=del size=46402 2024-09-22T08:48:44.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.617+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~GVYJZGI6BWWT.0 size=1048576 2024-09-22T08:48:44.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.618+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~GVYJZGI6BWWT.1 size=457167 2024-09-22T08:48:44.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.620+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=GVYJZGI6BWWT tag=8VF02UQUQVJU type=write size=2554319 2024-09-22T08:48:44.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.621+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=BO7QAOCC1IDS type=del size=3030537 2024-09-22T08:48:44.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.622+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=X847CT4UW0UF type=del 2024-09-22T08:48:44.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.623+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=PXU7JR012UC5 type=del size=1115887 2024-09-22T08:48:44.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.625+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=OUHS332TCEQA type=del 2024-09-22T08:48:44.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.626+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=8HX1MXAL76O4 type=del size=3130818 2024-09-22T08:48:44.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.627+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=VFAGZ97CNFPQ type=del 2024-09-22T08:48:44.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.629+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~HTFW4CNYYLUY.0 size=1048576 2024-09-22T08:48:44.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.630+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~HTFW4CNYYLUY.1 size=181362 2024-09-22T08:48:44.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.630+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=HTFW4CNYYLUY tag=QSVCERFH5Y6J type=write size=2278514 2024-09-22T08:48:44.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.631+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=NSZXVD4P4EOM type=write size=896854 2024-09-22T08:48:44.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.633+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=JXG9E23400VE type=del size=318980 2024-09-22T08:48:44.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.634+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.0 size=1048576 2024-09-22T08:48:44.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.635+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.1 size=1048576 2024-09-22T08:48:44.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.636+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~E42XPWZ6E3GS.2 size=317514 2024-09-22T08:48:44.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.638+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=E42XPWZ6E3GS tag=QBJM005XJHI4 type=write size=3463242 2024-09-22T08:48:44.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.639+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=53FMGS8RY9MI type=write size=126440 2024-09-22T08:48:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.640+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=N6JQSF4A97VZ type=del 2024-09-22T08:48:44.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.642+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=XWOQ3QE2H0PY type=del size=2603661 2024-09-22T08:48:44.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.643+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.0 size=1048576 2024-09-22T08:48:44.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.644+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.1 size=1048576 2024-09-22T08:48:44.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.645+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~K203KXGV77CD.2 size=841225 2024-09-22T08:48:44.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.647+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=K203KXGV77CD tag=W0V53W1V9D58 type=write size=3986953 2024-09-22T08:48:44.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.648+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=0YL4KY3968EU type=write size=180355 2024-09-22T08:48:44.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.650+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=H85ZRS9YH6IP type=del 2024-09-22T08:48:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.653+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~VEU31QUERLX7.0 size=1048576 2024-09-22T08:48:44.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.653+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~VEU31QUERLX7.1 size=546203 2024-09-22T08:48:44.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.653+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=VEU31QUERLX7 tag=MCPGZNFZ76C4 type=write size=2643355 2024-09-22T08:48:44.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.655+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=3XWSNBG3E8TG type=del size=1482113: (22) Invalid argument 2024-09-22T08:48:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.656+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=V4B3DA3NZ0WY type=del size=707181 2024-09-22T08:48:44.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.658+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=0WD3KWBKX2RF type=del 2024-09-22T08:48:44.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.660+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~DCBTXM1704MS.0 size=1048576 2024-09-22T08:48:44.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.661+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~DCBTXM1704MS.1 size=672165 2024-09-22T08:48:44.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.661+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=DCBTXM1704MS tag=MWBP3NJ0CQD7 type=write size=2769317 2024-09-22T08:48:44.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.663+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~O8VONTUJ2QY6.0 size=923811 2024-09-22T08:48:44.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.664+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=O8VONTUJ2QY6 tag=9MJ09QR14ZE7 type=write size=1972387 2024-09-22T08:48:44.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.666+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=GDO0X91HW5AN type=del size=2359839 2024-09-22T08:48:44.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.667+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=USN13GOEJK8I type=del 2024-09-22T08:48:44.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.668+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=ANK7OQM3M3A5 type=del size=760413 2024-09-22T08:48:44.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.668+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.0 size=1048576 2024-09-22T08:48:44.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.669+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.1 size=1048576 2024-09-22T08:48:44.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.670+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~BHANAEMW7LKM.2 size=726378 2024-09-22T08:48:44.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.672+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=BHANAEMW7LKM tag=TUKF4WKUL1LG type=write size=3872106 2024-09-22T08:48:44.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.673+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=X1UBHASEWUJM type=write size=549836 2024-09-22T08:48:44.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.674+0000 7f7b8ef90780 -1 < failed to complete operation key=QQKJ4URBRF16 tag=3S8YXK3I04RZ type=del size=2577307: (22) Invalid argument 2024-09-22T08:48:44.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.676+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~6QZHC146G0RS.0 size=200707 2024-09-22T08:48:44.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.676+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=6QZHC146G0RS tag=HQUCCAMA9QAC type=write size=1249283 2024-09-22T08:48:44.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.679+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=OKVR2IO6Z5G9 type=del 2024-09-22T08:48:44.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.680+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=F7LL3Q4MGO5J type=del size=3772653 2024-09-22T08:48:44.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.682+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=BO7QAOCC1IDS type=del 2024-09-22T08:48:44.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.683+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=WTWEOQ4XUITM type=del size=1351072 2024-09-22T08:48:44.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.684+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=PXU7JR012UC5 type=del 2024-09-22T08:48:44.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.686+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6A6956YZI4O6.0 size=1048576 2024-09-22T08:48:44.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.687+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6A6956YZI4O6.1 size=983842 2024-09-22T08:48:44.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.687+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=6A6956YZI4O6 tag=T741LGWUJFL1 type=write size=3080994 2024-09-22T08:48:44.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.688+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=8HX1MXAL76O4 type=del 2024-09-22T08:48:44.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.690+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=S1AT484P55LJ type=del size=1941224 2024-09-22T08:48:44.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.691+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~HTFW4CNYYLUY.0 size=1048576 2024-09-22T08:48:44.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.692+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~HTFW4CNYYLUY.1 size=181362 2024-09-22T08:48:44.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.694+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=HTFW4CNYYLUY tag=QSVCERFH5Y6J type=write size=2278514 2024-09-22T08:48:44.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.698+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~H5WDN8J86POW.0 size=336123 2024-09-22T08:48:44.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.698+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=H5WDN8J86POW tag=CL5BGDU7NBHI type=write size=1384699 2024-09-22T08:48:44.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.699+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=JXG9E23400VE type=del 2024-09-22T08:48:44.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.700+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=ECRSCRD867S6 type=del size=1247779 2024-09-22T08:48:44.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.703+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=53FMGS8RY9MI type=write 2024-09-22T08:48:44.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.704+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=QU6DXYQUMSW6 type=del size=2624349 2024-09-22T08:48:44.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.705+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=XWOQ3QE2H0PY type=del 2024-09-22T08:48:44.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.707+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=BDUYVTA7X4WA type=del size=3971007 2024-09-22T08:48:44.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.709+0000 7f7b8ef90780 1 < suggested update operation key=G51KS3NM4VFY tag=0YL4KY3968EU type=write size=180355 2024-09-22T08:48:44.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.710+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=DRGNKAG3PAXD type=del size=1729198 2024-09-22T08:48:44.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.711+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~VEU31QUERLX7.0 size=1048576 2024-09-22T08:48:44.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.712+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~VEU31QUERLX7.1 size=546203 2024-09-22T08:48:44.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.714+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=VEU31QUERLX7 tag=MCPGZNFZ76C4 type=write size=2643355 2024-09-22T08:48:44.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.717+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.0 size=1048576 2024-09-22T08:48:44.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.718+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.1 size=1048576 2024-09-22T08:48:44.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.719+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.2 size=528479 2024-09-22T08:48:44.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.719+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=5D665FI5KUR8 tag=D9XS7D85IQXL type=write size=3674207 2024-09-22T08:48:44.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.721+0000 7f7b8ef90780 1 < suggested update operation key=YDJLMBL7EQWN tag=V4B3DA3NZ0WY type=del size=707181 2024-09-22T08:48:44.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.722+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=ZQ5FRPIRZ0FS type=del size=2318064 2024-09-22T08:48:44.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.723+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~DCBTXM1704MS.0 size=1048576 2024-09-22T08:48:44.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.725+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~DCBTXM1704MS.1 size=672165 2024-09-22T08:48:44.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.727+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=DCBTXM1704MS tag=MWBP3NJ0CQD7 type=write size=2769317 2024-09-22T08:48:44.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.728+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=SWH0CEOO70H5 type=del size=352536 2024-09-22T08:48:44.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.729+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=GDO0X91HW5AN type=del 2024-09-22T08:48:44.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.730+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=MFP6UXR8G9PT type=write size=577711 2024-09-22T08:48:44.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.732+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=ANK7OQM3M3A5 type=del 2024-09-22T08:48:44.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.733+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=3GGJYBMXJ03V type=del size=1652857 2024-09-22T08:48:44.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.735+0000 7f7b8ef90780 1 < suggested remove operation key=70WNR3KVU0BG tag=X1UBHASEWUJM type=write 2024-09-22T08:48:44.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.738+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.0 size=1048576 2024-09-22T08:48:44.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.739+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.1 size=1048576 2024-09-22T08:48:44.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.740+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.2 size=571168 2024-09-22T08:48:44.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.740+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=VS8TMXDMNHA8 tag=K8W865IF811L type=write size=3716896 2024-09-22T08:48:44.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.742+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~6QZHC146G0RS.0 size=200707 2024-09-22T08:48:44.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.744+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=6QZHC146G0RS tag=HQUCCAMA9QAC type=write size=1249283 2024-09-22T08:48:44.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.745+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=J06UFC23MNBG type=del size=770585 2024-09-22T08:48:44.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.746+0000 7f7b8ef90780 -1 < failed to complete operation key=70WNR3KVU0BG tag=F7LL3Q4MGO5J type=del size=3772653: (22) Invalid argument 2024-09-22T08:48:44.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.747+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=8VGJXHDHMQ7Q type=del size=1829009 2024-09-22T08:48:44.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.749+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=WTWEOQ4XUITM type=del 2024-09-22T08:48:44.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.750+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=N8SDQQ1273AN type=del size=1590279 2024-09-22T08:48:44.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.751+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~6A6956YZI4O6.0 size=1048576 2024-09-22T08:48:44.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.751+0000 7f7b8ef90780 1 < canceled part key=_multipart_PODNY4NH4A9W.2~6A6956YZI4O6.1 size=983842 2024-09-22T08:48:44.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.754+0000 7f7b8ef90780 1 < canceled multipart upload key=PODNY4NH4A9W upload=6A6956YZI4O6 tag=T741LGWUJFL1 type=write size=3080994 2024-09-22T08:48:44.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.755+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=6NQYZNJ5I31B type=del size=889200 2024-09-22T08:48:44.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.758+0000 7f7b8ef90780 1 < suggested update operation key=T43DW9JPG1BU tag=S1AT484P55LJ type=del size=1941224 2024-09-22T08:48:44.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.759+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=E0H0WP37LM4J type=del size=974267 2024-09-22T08:48:44.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.760+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~H5WDN8J86POW.0 size=336123 2024-09-22T08:48:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.762+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=H5WDN8J86POW tag=CL5BGDU7NBHI type=write size=1384699 2024-09-22T08:48:44.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.765+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.0 size=1048576 2024-09-22T08:48:44.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.766+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.1 size=1048576 2024-09-22T08:48:44.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.767+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.2 size=578712 2024-09-22T08:48:44.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.767+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=5D3L0TXRO42I tag=XF13KFMZOUZR type=write size=3724440 2024-09-22T08:48:44.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.768+0000 7f7b8ef90780 -1 < failed to complete operation key=4ZJ4E4SUA01H tag=ECRSCRD867S6 type=del size=1247779: (22) Invalid argument 2024-09-22T08:48:44.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.769+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=67Q8F9431WS5 type=del size=3217406 2024-09-22T08:48:44.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.771+0000 7f7b8ef90780 1 < suggested remove operation key=VAO9MXRFGXFY tag=QU6DXYQUMSW6 type=del 2024-09-22T08:48:44.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.774+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~MT86R27WUWI3.0 size=985784 2024-09-22T08:48:44.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.774+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=MT86R27WUWI3 tag=88CK6C0PNP4U type=write size=2034360 2024-09-22T08:48:44.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.775+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=BDUYVTA7X4WA type=del 2024-09-22T08:48:44.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.777+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.0 size=1048576 2024-09-22T08:48:44.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.778+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.1 size=1048576 2024-09-22T08:48:44.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.779+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.2 size=862573 2024-09-22T08:48:44.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.779+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=C2V9JRM2Q25C tag=G3RDJA9UXLU8 type=write size=4008301 2024-09-22T08:48:44.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.782+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=DRGNKAG3PAXD type=del 2024-09-22T08:48:44.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.783+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=OCZI480CF6P5 type=del size=1195436 2024-09-22T08:48:44.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.785+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.0 size=1048576 2024-09-22T08:48:44.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.786+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.1 size=1048576 2024-09-22T08:48:44.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.787+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~5D665FI5KUR8.2 size=528479 2024-09-22T08:48:44.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.789+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=5D665FI5KUR8 tag=D9XS7D85IQXL type=write size=3674207 2024-09-22T08:48:44.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.791+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=WI1JOED2FKC6 type=del size=2232430 2024-09-22T08:48:44.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.792+0000 7f7b8ef90780 1 < canceled operation key=Z9CHXCJ02L85 tag=ZQ5FRPIRZ0FS type=del size=2318064 2024-09-22T08:48:44.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.794+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=548UOKIJZUJ1 type=del size=2997826 2024-09-22T08:48:44.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.797+0000 7f7b8ef90780 1 < suggested update operation key=YXIZJPACZZFY tag=SWH0CEOO70H5 type=del size=352536 2024-09-22T08:48:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.799+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.0 size=1048576 2024-09-22T08:48:44.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.800+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.1 size=1048576 2024-09-22T08:48:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.801+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.2 size=427985 2024-09-22T08:48:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.801+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=1WJAPQYTM782 tag=SARNKKRKQ5WN type=write size=3573713 2024-09-22T08:48:44.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.803+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=MFP6UXR8G9PT type=write 2024-09-22T08:48:44.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.806+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~XV21V1191LP1.0 size=870487 2024-09-22T08:48:44.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.806+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=XV21V1191LP1 tag=OA26X4G4E1KP type=write size=1919063 2024-09-22T08:48:44.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.807+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=3GGJYBMXJ03V type=del 2024-09-22T08:48:44.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.808+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=BBNRTIZZE6RE type=del size=489653 2024-09-22T08:48:44.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.810+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.0 size=1048576 2024-09-22T08:48:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.811+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.1 size=1048576 2024-09-22T08:48:44.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.812+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~VS8TMXDMNHA8.2 size=571168 2024-09-22T08:48:44.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.814+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=VS8TMXDMNHA8 tag=K8W865IF811L type=write size=3716896 2024-09-22T08:48:44.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.817+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~BWLYGPXMUPZT.0 size=1048576 2024-09-22T08:48:44.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.818+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~BWLYGPXMUPZT.1 size=154857 2024-09-22T08:48:44.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.819+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=BWLYGPXMUPZT tag=YFIGSA007VZ5 type=write size=2252009 2024-09-22T08:48:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.820+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=J06UFC23MNBG type=del 2024-09-22T08:48:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.822+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~U4XU5J2JVMVJ.0 size=774878 2024-09-22T08:48:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.822+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=U4XU5J2JVMVJ tag=T2CAQ24DL0AA type=write size=1823454 2024-09-22T08:48:44.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.824+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=8VGJXHDHMQ7Q type=del 2024-09-22T08:48:44.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.826+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~MHOBH80AYWH8.0 size=341132 2024-09-22T08:48:44.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.826+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=MHOBH80AYWH8 tag=WUQUSN1D3RC0 type=write size=1389708 2024-09-22T08:48:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.828+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=N8SDQQ1273AN type=del 2024-09-22T08:48:44.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.829+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=UJDBY12V7F99 type=del size=1394867 2024-09-22T08:48:44.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.831+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=6NQYZNJ5I31B type=del 2024-09-22T08:48:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.832+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=O38CG3ILXYTX type=del size=1918650 2024-09-22T08:48:44.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.834+0000 7f7b8ef90780 1 < suggested remove operation key=X9TWX0Z54MOO tag=E0H0WP37LM4J type=del 2024-09-22T08:48:44.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.836+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=H4P034XK1R44 type=del size=1953420 2024-09-22T08:48:44.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.837+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.0 size=1048576 2024-09-22T08:48:44.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.838+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.1 size=1048576 2024-09-22T08:48:44.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.839+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~5D3L0TXRO42I.2 size=578712 2024-09-22T08:48:44.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.842+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=5D3L0TXRO42I tag=XF13KFMZOUZR type=write size=3724440 2024-09-22T08:48:44.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.844+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~QLK5S2ZWZ8B6.0 size=1048576 2024-09-22T08:48:44.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.845+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~QLK5S2ZWZ8B6.1 size=150674 2024-09-22T08:48:44.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.845+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=QLK5S2ZWZ8B6 tag=XWF3E9Q8Q841 type=write size=2247826 2024-09-22T08:48:44.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.846+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=67Q8F9431WS5 type=del 2024-09-22T08:48:44.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.848+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=KS61L4YY5HGT type=del size=103136 2024-09-22T08:48:44.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.849+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~MT86R27WUWI3.0 size=985784 2024-09-22T08:48:44.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.852+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=MT86R27WUWI3 tag=88CK6C0PNP4U type=write size=2034360 2024-09-22T08:48:44.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.854+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~KFC15HR5Q7WV.0 size=1048576 2024-09-22T08:48:44.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.855+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~KFC15HR5Q7WV.1 size=576416 2024-09-22T08:48:44.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.855+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=KFC15HR5Q7WV tag=5VHJ3EBKNEVT type=write size=2673568 2024-09-22T08:48:44.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.856+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.0 size=1048576 2024-09-22T08:48:44.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.857+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.1 size=1048576 2024-09-22T08:48:44.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.858+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~C2V9JRM2Q25C.2 size=862573 2024-09-22T08:48:44.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.861+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=C2V9JRM2Q25C tag=G3RDJA9UXLU8 type=write size=4008301 2024-09-22T08:48:44.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.862+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=SYTHQA120WQ6 type=del size=1002643 2024-09-22T08:48:44.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.863+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=OCZI480CF6P5 type=del 2024-09-22T08:48:44.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.865+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~7MJM2ZWDAHM9.0 size=222538 2024-09-22T08:48:44.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.865+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=7MJM2ZWDAHM9 tag=DISU35FE2RFZ type=write size=1271114 2024-09-22T08:48:44.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.866+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=WI1JOED2FKC6 type=del 2024-09-22T08:48:44.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.868+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=JA6EYABEH7AT type=del size=73758 2024-09-22T08:48:44.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.869+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=548UOKIJZUJ1 type=del 2024-09-22T08:48:44.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.870+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=6VAF3FZ5YYI9 type=write size=124757 2024-09-22T08:48:44.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.871+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.0 size=1048576 2024-09-22T08:48:44.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.873+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.1 size=1048576 2024-09-22T08:48:44.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.874+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~1WJAPQYTM782.2 size=427985 2024-09-22T08:48:44.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.876+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=1WJAPQYTM782 tag=SARNKKRKQ5WN type=write size=3573713 2024-09-22T08:48:44.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.878+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.0 size=1048576 2024-09-22T08:48:44.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.879+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.1 size=1048576 2024-09-22T08:48:44.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.880+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.2 size=245222 2024-09-22T08:48:44.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.880+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=GWY1WTBCXR01 tag=K7OBIOUIGKLK type=write size=3390950 2024-09-22T08:48:44.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.882+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~XV21V1191LP1.0 size=870487 2024-09-22T08:48:44.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.884+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=XV21V1191LP1 tag=OA26X4G4E1KP type=write size=1919063 2024-09-22T08:48:44.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.885+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=UZ5CPYW1F6MF type=del size=2802448 2024-09-22T08:48:44.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.886+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=BBNRTIZZE6RE type=del 2024-09-22T08:48:44.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.887+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=3XGNR5KJ2FR8 type=write size=201008 2024-09-22T08:48:44.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.889+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~BWLYGPXMUPZT.0 size=1048576 2024-09-22T08:48:44.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.890+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~BWLYGPXMUPZT.1 size=154857 2024-09-22T08:48:44.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.892+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=BWLYGPXMUPZT tag=YFIGSA007VZ5 type=write size=2252009 2024-09-22T08:48:44.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.893+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=GKYCRYZHS1JI type=write size=79693 2024-09-22T08:48:44.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.894+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~U4XU5J2JVMVJ.0 size=774878 2024-09-22T08:48:44.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.896+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=U4XU5J2JVMVJ tag=T2CAQ24DL0AA type=write size=1823454 2024-09-22T08:48:44.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.897+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=C4GBVSNROFM4 type=del size=2175486 2024-09-22T08:48:44.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.899+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~MHOBH80AYWH8.0 size=341132 2024-09-22T08:48:44.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.901+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=MHOBH80AYWH8 tag=WUQUSN1D3RC0 type=write size=1389708 2024-09-22T08:48:44.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.902+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=HWODZULWNMVL type=del size=132695 2024-09-22T08:48:44.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.903+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=UJDBY12V7F99 type=del 2024-09-22T08:48:44.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.906+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~SPXTCSQVTF9J.0 size=1048576 2024-09-22T08:48:44.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.907+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~SPXTCSQVTF9J.1 size=523754 2024-09-22T08:48:44.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.907+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=SPXTCSQVTF9J tag=NG6HFCLSM2YW type=write size=2620906 2024-09-22T08:48:44.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.908+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=O38CG3ILXYTX type=del 2024-09-22T08:48:44.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.909+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=C797XHQVV5ER type=del size=1073658 2024-09-22T08:48:44.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.910+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=H4P034XK1R44 type=del 2024-09-22T08:48:44.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.912+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=K790NQXBQS1C type=del size=2933088 2024-09-22T08:48:44.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.913+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~QLK5S2ZWZ8B6.0 size=1048576 2024-09-22T08:48:44.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.913+0000 7f7b8ef90780 1 < canceled part key=_multipart_QQKJ4URBRF16.2~QLK5S2ZWZ8B6.1 size=150674 2024-09-22T08:48:44.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.915+0000 7f7b8ef90780 1 < canceled multipart upload key=QQKJ4URBRF16 upload=QLK5S2ZWZ8B6 tag=XWF3E9Q8Q841 type=write size=2247826 2024-09-22T08:48:44.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.917+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~FBVG1L16GLPQ.0 size=1048576 2024-09-22T08:48:44.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.918+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~FBVG1L16GLPQ.1 size=379549 2024-09-22T08:48:44.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.918+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=FBVG1L16GLPQ tag=8Z61N7RE5RID type=write size=2476701 2024-09-22T08:48:44.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.920+0000 7f7b8ef90780 1 < canceled operation key=L3XF68XD23FP tag=KS61L4YY5HGT type=del size=103136 2024-09-22T08:48:44.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.922+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.0 size=1048576 2024-09-22T08:48:44.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.923+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.1 size=1048576 2024-09-22T08:48:44.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.925+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.2 size=19054 2024-09-22T08:48:44.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.925+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=9T6HWAXZFG3W tag=FEMGS2JYMO03 type=write size=3164782 2024-09-22T08:48:44.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.926+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~KFC15HR5Q7WV.0 size=1048576 2024-09-22T08:48:44.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.927+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~KFC15HR5Q7WV.1 size=576416 2024-09-22T08:48:44.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.930+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=KFC15HR5Q7WV tag=5VHJ3EBKNEVT type=write size=2673568 2024-09-22T08:48:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.931+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=IA0C2TBQ5OYF type=del size=1872942 2024-09-22T08:48:44.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.932+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=SYTHQA120WQ6 type=del 2024-09-22T08:48:44.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.934+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=E9KR061094L0 type=write size=868113 2024-09-22T08:48:44.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.936+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~7MJM2ZWDAHM9.0 size=222538 2024-09-22T08:48:44.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.938+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=7MJM2ZWDAHM9 tag=DISU35FE2RFZ type=write size=1271114 2024-09-22T08:48:44.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.940+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=UXAZ6PGYD0KD type=write size=87984 2024-09-22T08:48:44.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.941+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=JA6EYABEH7AT type=del 2024-09-22T08:48:44.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.943+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=S9GLTIAN1NJ8 type=write size=971609 2024-09-22T08:48:44.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.944+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=6VAF3FZ5YYI9 type=write size=124757 2024-09-22T08:48:44.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.945+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=2KPXF640VY7Y type=del size=3275698 2024-09-22T08:48:44.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.947+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.0 size=1048576 2024-09-22T08:48:44.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.947+0000 7f7b8ef90780 1 < canceled part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.1 size=1048576 2024-09-22T08:48:44.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.948+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~GWY1WTBCXR01.2 size=245222 2024-09-22T08:48:44.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.951+0000 7f7b8ef90780 1 < canceled multipart upload key=Z9CHXCJ02L85 upload=GWY1WTBCXR01 tag=K7OBIOUIGKLK type=write size=3390950 2024-09-22T08:48:44.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.953+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.0 size=1048576 2024-09-22T08:48:44.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.954+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.1 size=1048576 2024-09-22T08:48:44.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.955+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.2 size=618565 2024-09-22T08:48:44.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.955+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=NOCRN7LCBQN8 tag=Z1E74UTN6ZQD type=write size=3764293 2024-09-22T08:48:44.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.957+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=UZ5CPYW1F6MF type=del 2024-09-22T08:48:44.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.959+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~K11CZE6KMAX2.0 size=1048576 2024-09-22T08:48:44.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.960+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~K11CZE6KMAX2.1 size=540274 2024-09-22T08:48:44.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.960+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=K11CZE6KMAX2 tag=L27NMJIMPA73 type=write size=2637426 2024-09-22T08:48:44.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.961+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=3XGNR5KJ2FR8 type=write size=201008 2024-09-22T08:48:44.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.964+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~3TK1VGN1YONP.0 size=559285 2024-09-22T08:48:44.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.964+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=3TK1VGN1YONP tag=DK4DS0G5WD6G type=write size=1607861 2024-09-22T08:48:44.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.966+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=GKYCRYZHS1JI type=write 2024-09-22T08:48:44.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.968+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=HMNIP9VWJ1IB type=del size=4026654 2024-09-22T08:48:44.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.969+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=C4GBVSNROFM4 type=del 2024-09-22T08:48:44.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.971+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.0 size=1048576 2024-09-22T08:48:44.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.973+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.1 size=1048576 2024-09-22T08:48:44.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.974+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.2 size=821690 2024-09-22T08:48:44.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.974+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=OY495BNSE2I1 tag=6E65Z77HVL5J type=write size=3967418 2024-09-22T08:48:44.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.975+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=HWODZULWNMVL type=del 2024-09-22T08:48:44.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.977+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~Z6FWU4PSPHL4.0 size=158413 2024-09-22T08:48:44.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.977+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=Z6FWU4PSPHL4 tag=W99HVUHY0WAP type=write size=1206989 2024-09-22T08:48:44.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.978+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~SPXTCSQVTF9J.0 size=1048576 2024-09-22T08:48:44.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.978+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~SPXTCSQVTF9J.1 size=523754 2024-09-22T08:48:44.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.980+0000 7f7b8ef90780 1 < canceled multipart upload key=L1URDVW43BUG upload=SPXTCSQVTF9J tag=NG6HFCLSM2YW type=write size=2620906 2024-09-22T08:48:44.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.983+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.0 size=1048576 2024-09-22T08:48:44.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.984+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.1 size=1048576 2024-09-22T08:48:44.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.985+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.2 size=963280 2024-09-22T08:48:44.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.985+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=ILMOGF9D7E30 tag=JPHJS16IOEJB type=write size=4109008 2024-09-22T08:48:44.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.987+0000 7f7b8ef90780 1 < canceled operation key=X9TWX0Z54MOO tag=C797XHQVV5ER type=del size=1073658 2024-09-22T08:48:44.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.989+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~JJTP2MKLOUAJ.0 size=415389 2024-09-22T08:48:44.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.989+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=JJTP2MKLOUAJ tag=L0BZMX2H7XB8 type=write size=1463965 2024-09-22T08:48:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.990+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=K790NQXBQS1C type=del 2024-09-22T08:48:44.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.992+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=XHRKA6Y3YGZ6 type=write size=959881 2024-09-22T08:48:44.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.993+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~FBVG1L16GLPQ.0 size=1048576 2024-09-22T08:48:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.994+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~FBVG1L16GLPQ.1 size=379549 2024-09-22T08:48:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.996+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=FBVG1L16GLPQ tag=8Z61N7RE5RID type=write size=2476701 2024-09-22T08:48:44.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.998+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=2N2NC1DXWEOR type=del size=3917507 2024-09-22T08:48:45.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:44.999+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.0 size=1048576 2024-09-22T08:48:45.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.000+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.1 size=1048576 2024-09-22T08:48:45.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.001+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~9T6HWAXZFG3W.2 size=19054 2024-09-22T08:48:45.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.004+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=9T6HWAXZFG3W tag=FEMGS2JYMO03 type=write size=3164782 2024-09-22T08:48:45.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.006+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.0 size=1048576 2024-09-22T08:48:45.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.007+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.1 size=1048576 2024-09-22T08:48:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.008+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.2 size=631899 2024-09-22T08:48:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.008+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=RFVPP7EG8DV3 tag=H3I2DNLL3VPO type=write size=3777627 2024-09-22T08:48:45.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.010+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=IA0C2TBQ5OYF type=del 2024-09-22T08:48:45.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.011+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=HUKSUXSH83KS type=del size=3260173 2024-09-22T08:48:45.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.013+0000 7f7b8ef90780 1 < completed write operation key=PODNY4NH4A9W tag=E9KR061094L0 type=write size=868113 2024-09-22T08:48:45.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.014+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=NO6887O8EYME type=del size=2876014 2024-09-22T08:48:45.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.015+0000 7f7b8ef90780 1 < completed write operation key=WDGY8YL16UWI tag=UXAZ6PGYD0KD type=write size=87984 2024-09-22T08:48:45.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.018+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.0 size=1048576 2024-09-22T08:48:45.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.019+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.1 size=1048576 2024-09-22T08:48:45.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.020+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.2 size=817320 2024-09-22T08:48:45.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.020+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=QPUIMZ34ZH87 tag=J2I0UH0UIQM2 type=write size=3963048 2024-09-22T08:48:45.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.022+0000 7f7b8ef90780 1 < completed write operation key=9DO6M6UQ5A05 tag=S9GLTIAN1NJ8 type=write size=971609 2024-09-22T08:48:45.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.025+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6A1O70NHUGQP.0 size=1048576 2024-09-22T08:48:45.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.026+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6A1O70NHUGQP.1 size=494886 2024-09-22T08:48:45.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.026+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=6A1O70NHUGQP tag=BFLKP1AVCHTM type=write size=2592038 2024-09-22T08:48:45.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.029+0000 7f7b8ef90780 1 < suggested remove operation key=70WNR3KVU0BG tag=2KPXF640VY7Y type=del 2024-09-22T08:48:45.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.030+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=1I01A9UEEAT5 type=del size=158967 2024-09-22T08:48:45.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.032+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.0 size=1048576 2024-09-22T08:48:45.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.033+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.1 size=1048576 2024-09-22T08:48:45.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.034+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~NOCRN7LCBQN8.2 size=618565 2024-09-22T08:48:45.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.036+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=NOCRN7LCBQN8 tag=Z1E74UTN6ZQD type=write size=3764293 2024-09-22T08:48:45.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.038+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=TXJZARHDMVS9 type=write size=746703 2024-09-22T08:48:45.040 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.039+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~K11CZE6KMAX2.0 size=1048576 2024-09-22T08:48:45.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.040+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~K11CZE6KMAX2.1 size=540274 2024-09-22T08:48:45.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.042+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=K11CZE6KMAX2 tag=L27NMJIMPA73 type=write size=2637426 2024-09-22T08:48:45.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.043+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=8867M6BU3VUO type=del size=1546314 2024-09-22T08:48:45.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.045+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~3TK1VGN1YONP.0 size=559285 2024-09-22T08:48:45.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.048+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=3TK1VGN1YONP tag=DK4DS0G5WD6G type=write size=1607861 2024-09-22T08:48:45.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.049+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=9DUVAJ123O89 type=del size=1517027 2024-09-22T08:48:45.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.051+0000 7f7b8ef90780 1 < canceled operation key=YDJLMBL7EQWN tag=HMNIP9VWJ1IB type=del size=4026654 2024-09-22T08:48:45.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.053+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.0 size=1048576 2024-09-22T08:48:45.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.055+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.1 size=1048576 2024-09-22T08:48:45.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.056+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.2 size=135595 2024-09-22T08:48:45.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.056+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=3W8WM1UEBBXE tag=HYONQRXI7CDO type=write size=3281323 2024-09-22T08:48:45.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.057+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.0 size=1048576 2024-09-22T08:48:45.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.058+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.1 size=1048576 2024-09-22T08:48:45.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.059+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~OY495BNSE2I1.2 size=821690 2024-09-22T08:48:45.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.061+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=OY495BNSE2I1 tag=6E65Z77HVL5J type=write size=3967418 2024-09-22T08:48:45.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.063+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=0E1XFN7JBSCN type=del size=643193 2024-09-22T08:48:45.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.064+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~Z6FWU4PSPHL4.0 size=158413 2024-09-22T08:48:45.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.067+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=Z6FWU4PSPHL4 tag=W99HVUHY0WAP type=write size=1206989 2024-09-22T08:48:45.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.068+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=OFASOHU6OAZP type=del size=1327732 2024-09-22T08:48:45.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.069+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.0 size=1048576 2024-09-22T08:48:45.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.070+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.1 size=1048576 2024-09-22T08:48:45.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.070+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~ILMOGF9D7E30.2 size=963280 2024-09-22T08:48:45.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.072+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=ILMOGF9D7E30 tag=JPHJS16IOEJB type=write size=4109008 2024-09-22T08:48:45.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.074+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~RCVOL7BAX7M8.0 size=551729 2024-09-22T08:48:45.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.074+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=RCVOL7BAX7M8 tag=09F1ZFA3SCJ4 type=write size=1600305 2024-09-22T08:48:45.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.075+0000 7f7b8ef90780 1 < canceled part key=_multipart_QQKJ4URBRF16.2~JJTP2MKLOUAJ.0 size=415389 2024-09-22T08:48:45.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.077+0000 7f7b8ef90780 1 < canceled multipart upload key=QQKJ4URBRF16 upload=JJTP2MKLOUAJ tag=L0BZMX2H7XB8 type=write size=1463965 2024-09-22T08:48:45.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.079+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.0 size=1048576 2024-09-22T08:48:45.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.080+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.1 size=1048576 2024-09-22T08:48:45.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.081+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.2 size=842417 2024-09-22T08:48:45.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.081+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=ETSEI199LC4X tag=79QWS8YJ6P6U type=write size=3988145 2024-09-22T08:48:45.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.082+0000 7f7b8ef90780 1 < completed write operation key=WDGY8YL16UWI tag=XHRKA6Y3YGZ6 type=write size=959881 2024-09-22T08:48:45.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.084+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=48VXG30OBNGJ type=del size=4081752 2024-09-22T08:48:45.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.085+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=2N2NC1DXWEOR type=del size=3917507 2024-09-22T08:48:45.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.087+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=TCTG8U8DVQNL type=del size=2794674 2024-09-22T08:48:45.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.088+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.0 size=1048576 2024-09-22T08:48:45.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.089+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.1 size=1048576 2024-09-22T08:48:45.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.090+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~RFVPP7EG8DV3.2 size=631899 2024-09-22T08:48:45.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.092+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=RFVPP7EG8DV3 tag=H3I2DNLL3VPO type=write size=3777627 2024-09-22T08:48:45.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.095+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.0 size=1048576 2024-09-22T08:48:45.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.096+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.1 size=1048576 2024-09-22T08:48:45.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.097+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.2 size=860495 2024-09-22T08:48:45.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.097+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=0IOZ7PFG7GLI tag=T6JDT55UEX7P type=write size=4006223 2024-09-22T08:48:45.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.098+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=HUKSUXSH83KS type=del 2024-09-22T08:48:45.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.101+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~QLC3N3EQBZBG.0 size=1048576 2024-09-22T08:48:45.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.102+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~QLC3N3EQBZBG.1 size=596403 2024-09-22T08:48:45.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.102+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=QLC3N3EQBZBG tag=P1AV2FY0SYXY type=write size=2693555 2024-09-22T08:48:45.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.104+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=NO6887O8EYME type=del 2024-09-22T08:48:45.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.106+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=XDXK7KLQDQRH type=del size=1742378 2024-09-22T08:48:45.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.107+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.0 size=1048576 2024-09-22T08:48:45.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.108+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.1 size=1048576 2024-09-22T08:48:45.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.109+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~QPUIMZ34ZH87.2 size=817320 2024-09-22T08:48:45.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.111+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=QPUIMZ34ZH87 tag=J2I0UH0UIQM2 type=write size=3963048 2024-09-22T08:48:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.112+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=RNV7L3C13ZYY type=write size=511010 2024-09-22T08:48:45.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.114+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~6A1O70NHUGQP.0 size=1048576 2024-09-22T08:48:45.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.115+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~6A1O70NHUGQP.1 size=494886 2024-09-22T08:48:45.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.117+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=6A1O70NHUGQP tag=BFLKP1AVCHTM type=write size=2592038 2024-09-22T08:48:45.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.120+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~K519XGRG77RE.0 size=463347 2024-09-22T08:48:45.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.120+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=K519XGRG77RE tag=LW8TCHK7K073 type=write size=1511923 2024-09-22T08:48:45.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.121+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=1I01A9UEEAT5 type=del 2024-09-22T08:48:45.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.123+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~XXKJQVVLXEX3.0 size=383853 2024-09-22T08:48:45.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.123+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=XXKJQVVLXEX3 tag=GPFX3GJDT3MI type=write size=1432429 2024-09-22T08:48:45.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.124+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=TXJZARHDMVS9 type=write size=746703 2024-09-22T08:48:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.126+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=7JUNMFMU0MXF type=del size=3666284 2024-09-22T08:48:45.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.127+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=8867M6BU3VUO type=del 2024-09-22T08:48:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.128+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=HFOSLZFU8Y5T type=del size=3999176 2024-09-22T08:48:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.129+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=9DUVAJ123O89 type=del 2024-09-22T08:48:45.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.132+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.0 size=1048576 2024-09-22T08:48:45.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.132+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.1 size=1048576 2024-09-22T08:48:45.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.133+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.2 size=290548 2024-09-22T08:48:45.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.133+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=I2C6615QP15N tag=W3EYBJQ229WB type=write size=3436276 2024-09-22T08:48:45.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.135+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.0 size=1048576 2024-09-22T08:48:45.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.136+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.1 size=1048576 2024-09-22T08:48:45.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.136+0000 7f7b8ef90780 1 < canceled part key=_multipart_YF94C9GVRXQP.2~3W8WM1UEBBXE.2 size=135595 2024-09-22T08:48:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.138+0000 7f7b8ef90780 1 < canceled multipart upload key=YF94C9GVRXQP upload=3W8WM1UEBBXE tag=HYONQRXI7CDO type=write size=3281323 2024-09-22T08:48:45.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.140+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.0 size=1048576 2024-09-22T08:48:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.141+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.1 size=1048576 2024-09-22T08:48:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.142+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.2 size=499823 2024-09-22T08:48:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.142+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=3JG4PP7PKLYI tag=RSWK8UHJOFYW type=write size=3645551 2024-09-22T08:48:45.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.143+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=0E1XFN7JBSCN type=del 2024-09-22T08:48:45.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.144+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=MMCN5HIFIA5I type=write size=631888 2024-09-22T08:48:45.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.145+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=OFASOHU6OAZP type=del size=1327732 2024-09-22T08:48:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.147+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=3KPZX6Y8CHD0 type=del size=2462874 2024-09-22T08:48:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.148+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~RCVOL7BAX7M8.0 size=551729 2024-09-22T08:48:45.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.150+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=RCVOL7BAX7M8 tag=09F1ZFA3SCJ4 type=write size=1600305 2024-09-22T08:48:45.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.151+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=EZGJ5BXF3WR6 type=del size=971726 2024-09-22T08:48:45.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.153+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.0 size=1048576 2024-09-22T08:48:45.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.154+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.1 size=1048576 2024-09-22T08:48:45.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.155+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~ETSEI199LC4X.2 size=842417 2024-09-22T08:48:45.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.157+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=ETSEI199LC4X tag=79QWS8YJ6P6U type=write size=3988145 2024-09-22T08:48:45.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.158+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=U8QKTYBOO8O7 type=write size=837303 2024-09-22T08:48:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.159+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=48VXG30OBNGJ type=del 2024-09-22T08:48:45.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.161+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~ISHV80CQL6LJ.0 size=1048576 2024-09-22T08:48:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.162+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~ISHV80CQL6LJ.1 size=47255 2024-09-22T08:48:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.162+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=ISHV80CQL6LJ tag=01S7CHS7DZDX type=write size=2144407 2024-09-22T08:48:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.163+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=TCTG8U8DVQNL type=del size=2794674 2024-09-22T08:48:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.165+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.0 size=1048576 2024-09-22T08:48:45.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.166+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.1 size=1048576 2024-09-22T08:48:45.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.167+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.2 size=1020551 2024-09-22T08:48:45.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.167+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=P2R6KA93YJGR tag=RCLDOBKP9501 type=write size=4166279 2024-09-22T08:48:45.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.167+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.0 size=1048576 2024-09-22T08:48:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.167+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.1 size=1048576 2024-09-22T08:48:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.169+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0IOZ7PFG7GLI.2 size=860495 2024-09-22T08:48:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.170+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=0IOZ7PFG7GLI tag=T6JDT55UEX7P type=write size=4006223 2024-09-22T08:48:45.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.172+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=73TRL9L9XQ7Q type=del size=3484017 2024-09-22T08:48:45.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.173+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~QLC3N3EQBZBG.0 size=1048576 2024-09-22T08:48:45.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.174+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~QLC3N3EQBZBG.1 size=596403 2024-09-22T08:48:45.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.176+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=QLC3N3EQBZBG tag=P1AV2FY0SYXY type=write size=2693555 2024-09-22T08:48:45.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.177+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=177QTJMJNEAQ type=del size=3742799 2024-09-22T08:48:45.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.178+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=XDXK7KLQDQRH type=del 2024-09-22T08:48:45.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.180+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=TSIE0B2BE7K8 type=del size=3509827 2024-09-22T08:48:45.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.182+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=RNV7L3C13ZYY type=write size=511010 2024-09-22T08:48:45.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.183+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=8ODF42T86PTH type=del size=546718 2024-09-22T08:48:45.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.185+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~K519XGRG77RE.0 size=463347 2024-09-22T08:48:45.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.187+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=K519XGRG77RE tag=LW8TCHK7K073 type=write size=1511923 2024-09-22T08:48:45.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.188+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=NFAN04HE9G1D type=del size=174864 2024-09-22T08:48:45.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.190+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~XXKJQVVLXEX3.0 size=383853 2024-09-22T08:48:45.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.192+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=XXKJQVVLXEX3 tag=GPFX3GJDT3MI type=write size=1432429 2024-09-22T08:48:45.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.195+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~8Q2CZ7E0CRYL.0 size=864913 2024-09-22T08:48:45.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.195+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=8Q2CZ7E0CRYL tag=BBX2WBSL239N type=write size=1913489 2024-09-22T08:48:45.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.197+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=7JUNMFMU0MXF type=del 2024-09-22T08:48:45.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.198+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=OBBTPWTCAZ21 type=del size=561028 2024-09-22T08:48:45.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.199+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=HFOSLZFU8Y5T type=del 2024-09-22T08:48:45.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.200+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=3F9SGFOM4HGL type=del size=4055277 2024-09-22T08:48:45.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.202+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.0 size=1048576 2024-09-22T08:48:45.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.202+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.1 size=1048576 2024-09-22T08:48:45.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.203+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~I2C6615QP15N.2 size=290548 2024-09-22T08:48:45.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.205+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=I2C6615QP15N tag=W3EYBJQ229WB type=write size=3436276 2024-09-22T08:48:45.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.206+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=NAZLCGMSSV3I type=del size=1867149 2024-09-22T08:48:45.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.208+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.0 size=1048576 2024-09-22T08:48:45.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.209+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.1 size=1048576 2024-09-22T08:48:45.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.209+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~3JG4PP7PKLYI.2 size=499823 2024-09-22T08:48:45.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.211+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=3JG4PP7PKLYI tag=RSWK8UHJOFYW type=write size=3645551 2024-09-22T08:48:45.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.213+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.0 size=1048576 2024-09-22T08:48:45.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.214+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.1 size=1048576 2024-09-22T08:48:45.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.215+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.2 size=414967 2024-09-22T08:48:45.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.215+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=YO2JB0FR23JX tag=M3QPB9UTZAVZ type=write size=3560695 2024-09-22T08:48:45.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.218+0000 7f7b8ef90780 1 < suggested update operation key=7ZS8G8H6I957 tag=MMCN5HIFIA5I type=write size=631888 2024-09-22T08:48:45.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.219+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=L97PF94G9GNS type=del size=773482 2024-09-22T08:48:45.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.220+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=3KPZX6Y8CHD0 type=del 2024-09-22T08:48:45.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.222+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=UJ8EUNY78JGS type=del size=1514969 2024-09-22T08:48:45.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.223+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=EZGJ5BXF3WR6 type=del 2024-09-22T08:48:45.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.225+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.0 size=1048576 2024-09-22T08:48:45.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.226+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.1 size=1048576 2024-09-22T08:48:45.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.227+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.2 size=772358 2024-09-22T08:48:45.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.227+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=C4L7IADMNYUH tag=FQUH015MRG9F type=write size=3918086 2024-09-22T08:48:45.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.228+0000 7f7b8ef90780 1 < completed write operation key=T43DW9JPG1BU tag=U8QKTYBOO8O7 type=write size=837303 2024-09-22T08:48:45.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.230+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=HKBQK2Z8Z2T9 type=del size=2745778 2024-09-22T08:48:45.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.231+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~ISHV80CQL6LJ.0 size=1048576 2024-09-22T08:48:45.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.232+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~ISHV80CQL6LJ.1 size=47255 2024-09-22T08:48:45.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.234+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=ISHV80CQL6LJ tag=01S7CHS7DZDX type=write size=2144407 2024-09-22T08:48:45.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.236+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~Y9GASV9ENMLU.0 size=1048576 2024-09-22T08:48:45.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.237+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~Y9GASV9ENMLU.1 size=214822 2024-09-22T08:48:45.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.237+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=Y9GASV9ENMLU tag=9P4EMFVEMMUT type=write size=2311974 2024-09-22T08:48:45.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.238+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.0 size=1048576 2024-09-22T08:48:45.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.239+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.1 size=1048576 2024-09-22T08:48:45.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.241+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~P2R6KA93YJGR.2 size=1020551 2024-09-22T08:48:45.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.243+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=P2R6KA93YJGR tag=RCLDOBKP9501 type=write size=4166279 2024-09-22T08:48:45.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.245+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~1KZI0DIBK94R.0 size=674941 2024-09-22T08:48:45.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.245+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=1KZI0DIBK94R tag=5HWNIN20BIJW type=write size=1723517 2024-09-22T08:48:45.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.247+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=73TRL9L9XQ7Q type=del 2024-09-22T08:48:45.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.249+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.0 size=1048576 2024-09-22T08:48:45.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.250+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.1 size=1048576 2024-09-22T08:48:45.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.251+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.2 size=823299 2024-09-22T08:48:45.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.251+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=6735PQLGCJ4O tag=QUQ200S1ZWFO type=write size=3969027 2024-09-22T08:48:45.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.253+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=177QTJMJNEAQ type=del 2024-09-22T08:48:45.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.256+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~LNOGUOADNZUN.0 size=1048576 2024-09-22T08:48:45.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.257+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~LNOGUOADNZUN.1 size=1016065 2024-09-22T08:48:45.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.257+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=LNOGUOADNZUN tag=0SMQ2D49GJOV type=write size=3113217 2024-09-22T08:48:45.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.258+0000 7f7b8ef90780 -1 < failed to complete operation key=7ZS8G8H6I957 tag=TSIE0B2BE7K8 type=del size=3509827: (22) Invalid argument 2024-09-22T08:48:45.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.261+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~E0R8JVR7I110.0 size=816787 2024-09-22T08:48:45.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.261+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=E0R8JVR7I110 tag=OEHGPNOPK5PT type=write size=1865363 2024-09-22T08:48:45.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.262+0000 7f7b8ef90780 1 < canceled operation key=X9TWX0Z54MOO tag=8ODF42T86PTH type=del size=546718 2024-09-22T08:48:45.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.263+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=EOZ8ZIM6GY0G type=del size=4098244 2024-09-22T08:48:45.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.265+0000 7f7b8ef90780 1 < canceled operation key=4ZJ4E4SUA01H tag=NFAN04HE9G1D type=del size=174864 2024-09-22T08:48:45.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.266+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=HPTUWSXP3VN5 type=del size=1918200 2024-09-22T08:48:45.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.267+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~8Q2CZ7E0CRYL.0 size=864913 2024-09-22T08:48:45.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.269+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=8Q2CZ7E0CRYL tag=BBX2WBSL239N type=write size=1913489 2024-09-22T08:48:45.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.272+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~FMOPBUJFJRMM.0 size=729401 2024-09-22T08:48:45.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.272+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=FMOPBUJFJRMM tag=JTZDQRGR853I type=write size=1777977 2024-09-22T08:48:45.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.273+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=OBBTPWTCAZ21 type=del 2024-09-22T08:48:45.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.276+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~UNVX0TZPQE1B.0 size=718949 2024-09-22T08:48:45.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.276+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=UNVX0TZPQE1B tag=J5QXQ6FNY5X9 type=write size=1767525 2024-09-22T08:48:45.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.277+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=3F9SGFOM4HGL type=del 2024-09-22T08:48:45.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.279+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~Q2YLS29I7OQG.0 size=964493 2024-09-22T08:48:45.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.279+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=Q2YLS29I7OQG tag=QD030D0K2G8S type=write size=2013069 2024-09-22T08:48:45.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.280+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=NAZLCGMSSV3I type=del 2024-09-22T08:48:45.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.282+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.0 size=1048576 2024-09-22T08:48:45.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.283+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.1 size=1048576 2024-09-22T08:48:45.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.284+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.2 size=840638 2024-09-22T08:48:45.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.284+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=0RQS21208Y0H tag=5A4HOZHW283G type=write size=3986366 2024-09-22T08:48:45.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.286+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.0 size=1048576 2024-09-22T08:48:45.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.287+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.1 size=1048576 2024-09-22T08:48:45.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.288+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~YO2JB0FR23JX.2 size=414967 2024-09-22T08:48:45.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.290+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=YO2JB0FR23JX tag=M3QPB9UTZAVZ type=write size=3560695 2024-09-22T08:48:45.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.291+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=IZDTLUTKUUYH type=del size=798818 2024-09-22T08:48:45.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.292+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=L97PF94G9GNS type=del 2024-09-22T08:48:45.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.293+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=6JOJA1TGTNPU type=del size=322277 2024-09-22T08:48:45.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.295+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=UJ8EUNY78JGS type=del 2024-09-22T08:48:45.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.296+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=ES5TM0GSKCOR type=del size=3410218 2024-09-22T08:48:45.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.297+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.0 size=1048576 2024-09-22T08:48:45.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.297+0000 7f7b8ef90780 1 < canceled part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.1 size=1048576 2024-09-22T08:48:45.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.298+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~C4L7IADMNYUH.2 size=772358 2024-09-22T08:48:45.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.301+0000 7f7b8ef90780 1 < canceled multipart upload key=WDGY8YL16UWI upload=C4L7IADMNYUH tag=FQUH015MRG9F type=write size=3918086 2024-09-22T08:48:45.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.303+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=K382788N2U56 type=del size=1434083 2024-09-22T08:48:45.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.305+0000 7f7b8ef90780 1 < suggested remove operation key=L1URDVW43BUG tag=HKBQK2Z8Z2T9 type=del 2024-09-22T08:48:45.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.307+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~N8CL4H7OOZBS.0 size=1048576 2024-09-22T08:48:45.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.309+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~N8CL4H7OOZBS.1 size=495648 2024-09-22T08:48:45.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.309+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=N8CL4H7OOZBS tag=ZJ06BFMWT5CI type=write size=2592800 2024-09-22T08:48:45.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.310+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~Y9GASV9ENMLU.0 size=1048576 2024-09-22T08:48:45.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.311+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~Y9GASV9ENMLU.1 size=214822 2024-09-22T08:48:45.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.313+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=Y9GASV9ENMLU tag=9P4EMFVEMMUT type=write size=2311974 2024-09-22T08:48:45.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.315+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=D25RKTA1HNJG type=del size=1093773 2024-09-22T08:48:45.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.316+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~1KZI0DIBK94R.0 size=674941 2024-09-22T08:48:45.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.318+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=1KZI0DIBK94R tag=5HWNIN20BIJW type=write size=1723517 2024-09-22T08:48:45.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.319+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=3DD560MS7D0Q type=del size=1032616 2024-09-22T08:48:45.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.320+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.0 size=1048576 2024-09-22T08:48:45.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.321+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.1 size=1048576 2024-09-22T08:48:45.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.322+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~6735PQLGCJ4O.2 size=823299 2024-09-22T08:48:45.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.325+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=6735PQLGCJ4O tag=QUQ200S1ZWFO type=write size=3969027 2024-09-22T08:48:45.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.326+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=GSJW409TNHN2 type=write size=589123 2024-09-22T08:48:45.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.326+0000 7f7b8ef90780 1 < canceled part key=_multipart_QQKJ4URBRF16.2~LNOGUOADNZUN.0 size=1048576 2024-09-22T08:48:45.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.327+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~LNOGUOADNZUN.1 size=1016065 2024-09-22T08:48:45.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.330+0000 7f7b8ef90780 1 < canceled multipart upload key=QQKJ4URBRF16 upload=LNOGUOADNZUN tag=0SMQ2D49GJOV type=write size=3113217 2024-09-22T08:48:45.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.331+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=ISM5ZPRDQ3PY type=del size=1639095 2024-09-22T08:48:45.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.332+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~E0R8JVR7I110.0 size=816787 2024-09-22T08:48:45.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.334+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=E0R8JVR7I110 tag=OEHGPNOPK5PT type=write size=1865363 2024-09-22T08:48:45.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.337+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~WFSNE4IY8C8E.0 size=1048576 2024-09-22T08:48:45.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.337+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~WFSNE4IY8C8E.1 size=517141 2024-09-22T08:48:45.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.337+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=WFSNE4IY8C8E tag=VUY7XY4L9EJE type=write size=2614293 2024-09-22T08:48:45.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.340+0000 7f7b8ef90780 1 < suggested remove operation key=6DC0SVAYR2DB tag=EOZ8ZIM6GY0G type=del 2024-09-22T08:48:45.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.341+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=UAMOT37WJ935 type=del size=3731613 2024-09-22T08:48:45.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.342+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=HPTUWSXP3VN5 type=del 2024-09-22T08:48:45.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.343+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=JBG1P88XHGVX type=del size=1376283 2024-09-22T08:48:45.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.344+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~FMOPBUJFJRMM.0 size=729401 2024-09-22T08:48:45.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.347+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=FMOPBUJFJRMM tag=JTZDQRGR853I type=write size=1777977 2024-09-22T08:48:45.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.348+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=ST0C79UTFSZS type=del size=4039169 2024-09-22T08:48:45.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.350+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~UNVX0TZPQE1B.0 size=718949 2024-09-22T08:48:45.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.352+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=UNVX0TZPQE1B tag=J5QXQ6FNY5X9 type=write size=1767525 2024-09-22T08:48:45.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.354+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=J8Z7R50WXDUH type=del size=3430179 2024-09-22T08:48:45.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.355+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~Q2YLS29I7OQG.0 size=964493 2024-09-22T08:48:45.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.358+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=Q2YLS29I7OQG tag=QD030D0K2G8S type=write size=2013069 2024-09-22T08:48:45.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.360+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=II1WM3OJTTGA type=del size=1048123 2024-09-22T08:48:45.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.361+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.0 size=1048576 2024-09-22T08:48:45.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.363+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.1 size=1048576 2024-09-22T08:48:45.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.364+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0RQS21208Y0H.2 size=840638 2024-09-22T08:48:45.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.367+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=0RQS21208Y0H tag=5A4HOZHW283G type=write size=3986366 2024-09-22T08:48:45.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.369+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.0 size=1048576 2024-09-22T08:48:45.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.371+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.1 size=1048576 2024-09-22T08:48:45.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.372+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.2 size=253568 2024-09-22T08:48:45.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.372+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=RM25YUW7UC6C tag=2IV3ZB24PASO type=write size=3399296 2024-09-22T08:48:45.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.374+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=IZDTLUTKUUYH type=del 2024-09-22T08:48:45.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.376+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~M5UZK90N0SK3.0 size=587047 2024-09-22T08:48:45.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.376+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=M5UZK90N0SK3 tag=HMVTXNJNV70Q type=write size=1635623 2024-09-22T08:48:45.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.378+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=6JOJA1TGTNPU type=del 2024-09-22T08:48:45.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.380+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=75C7TDF20BDS type=del size=547378 2024-09-22T08:48:45.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.383+0000 7f7b8ef90780 1 < suggested update operation key=4J4EGI19N123 tag=ES5TM0GSKCOR type=del size=3410218 2024-09-22T08:48:45.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.384+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=EF02WVQNNTV5 type=del size=3733662 2024-09-22T08:48:45.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.386+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=K382788N2U56 type=del 2024-09-22T08:48:45.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.387+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=R45TUAPLD403 type=del size=954392 2024-09-22T08:48:45.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.388+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~N8CL4H7OOZBS.0 size=1048576 2024-09-22T08:48:45.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.389+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~N8CL4H7OOZBS.1 size=495648 2024-09-22T08:48:45.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.391+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=N8CL4H7OOZBS tag=ZJ06BFMWT5CI type=write size=2592800 2024-09-22T08:48:45.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.393+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=QCD5M10QCT4R type=del size=2218701 2024-09-22T08:48:45.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.396+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=D25RKTA1HNJG type=del size=1093773 2024-09-22T08:48:45.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.397+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=NDGAL29MPZV5 type=del size=3345198 2024-09-22T08:48:45.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.398+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=3DD560MS7D0Q type=del 2024-09-22T08:48:45.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.400+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=2UVG27L5WWWY type=del size=1514853 2024-09-22T08:48:45.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.401+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=GSJW409TNHN2 type=write size=589123 2024-09-22T08:48:45.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.402+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=OKSP4UPWRGKT type=del size=3958550 2024-09-22T08:48:45.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.404+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=ISM5ZPRDQ3PY type=del 2024-09-22T08:48:45.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.406+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.0 size=1048576 2024-09-22T08:48:45.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.407+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.1 size=1048576 2024-09-22T08:48:45.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.408+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.2 size=220051 2024-09-22T08:48:45.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.408+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=1QXFBLS3C3RH tag=AB7QW1HIDCWS type=write size=3365779 2024-09-22T08:48:45.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.409+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~WFSNE4IY8C8E.0 size=1048576 2024-09-22T08:48:45.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.410+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~WFSNE4IY8C8E.1 size=517141 2024-09-22T08:48:45.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.413+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=WFSNE4IY8C8E tag=VUY7XY4L9EJE type=write size=2614293 2024-09-22T08:48:45.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.414+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=V3ILH60LWGLA type=del size=452467 2024-09-22T08:48:45.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.415+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=UAMOT37WJ935 type=del 2024-09-22T08:48:45.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.417+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=UIENJ65GF299 type=del size=807302 2024-09-22T08:48:45.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.418+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=JBG1P88XHGVX type=del 2024-09-22T08:48:45.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.419+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=A76LO6SEF5PB type=del size=2126279 2024-09-22T08:48:45.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.421+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=ST0C79UTFSZS type=del 2024-09-22T08:48:45.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.422+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=W1QA9OLPTRHC type=write size=149841 2024-09-22T08:48:45.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.425+0000 7f7b8ef90780 1 < suggested remove operation key=T43DW9JPG1BU tag=J8Z7R50WXDUH type=del 2024-09-22T08:48:45.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.426+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=EQ250LV8W45Q type=del size=2190093 2024-09-22T08:48:45.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.427+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=II1WM3OJTTGA type=del 2024-09-22T08:48:45.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.430+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=LBMP9D8FQ77G type=del size=3538554 2024-09-22T08:48:45.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.431+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.0 size=1048576 2024-09-22T08:48:45.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.432+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.1 size=1048576 2024-09-22T08:48:45.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.433+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~RM25YUW7UC6C.2 size=253568 2024-09-22T08:48:45.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.435+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=RM25YUW7UC6C tag=2IV3ZB24PASO type=write size=3399296 2024-09-22T08:48:45.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.438+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.0 size=1048576 2024-09-22T08:48:45.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.439+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.1 size=1048576 2024-09-22T08:48:45.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.440+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.2 size=312792 2024-09-22T08:48:45.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.440+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=315BUGO8P4ZW tag=67XJBKDWCA7I type=write size=3458520 2024-09-22T08:48:45.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.441+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~M5UZK90N0SK3.0 size=587047 2024-09-22T08:48:45.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.443+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=M5UZK90N0SK3 tag=HMVTXNJNV70Q type=write size=1635623 2024-09-22T08:48:45.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.444+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=WWDQLJOTXNSF type=del size=234896 2024-09-22T08:48:45.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.446+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=75C7TDF20BDS type=del 2024-09-22T08:48:45.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.448+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~KO19QVBK7HZT.0 size=1048576 2024-09-22T08:48:45.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.449+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~KO19QVBK7HZT.1 size=815423 2024-09-22T08:48:45.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.449+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=KO19QVBK7HZT tag=GZFKS8XA50B2 type=write size=2912575 2024-09-22T08:48:45.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.452+0000 7f7b8ef90780 1 < suggested update operation key=L1URDVW43BUG tag=EF02WVQNNTV5 type=del size=3733662 2024-09-22T08:48:45.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.453+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=301Y1RT1E9PD type=del size=1273864 2024-09-22T08:48:45.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.454+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=R45TUAPLD403 type=del 2024-09-22T08:48:45.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.456+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=915I3Y4EZ6C8 type=del size=864622 2024-09-22T08:48:45.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.457+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=QCD5M10QCT4R type=del 2024-09-22T08:48:45.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.458+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=CLHXKABI89YJ type=del size=2555502 2024-09-22T08:48:45.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.461+0000 7f7b8ef90780 1 < suggested update operation key=6DC0SVAYR2DB tag=NDGAL29MPZV5 type=del size=3345198 2024-09-22T08:48:45.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.463+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.0 size=1048576 2024-09-22T08:48:45.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.464+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.1 size=1048576 2024-09-22T08:48:45.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.465+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.2 size=835867 2024-09-22T08:48:45.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.465+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=6PM7FSZZ767V tag=Y0ZB825HBBZ0 type=write size=3981595 2024-09-22T08:48:45.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.466+0000 7f7b8ef90780 -1 < failed to complete operation key=6DC0SVAYR2DB tag=2UVG27L5WWWY type=del size=1514853: (22) Invalid argument 2024-09-22T08:48:45.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.469+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~EBK65IEL4849.0 size=1013404 2024-09-22T08:48:45.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.469+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=EBK65IEL4849 tag=TRNYP51IIDWI type=write size=2061980 2024-09-22T08:48:45.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.470+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=OKSP4UPWRGKT type=del 2024-09-22T08:48:45.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.472+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TB5620YX732B.0 size=1048576 2024-09-22T08:48:45.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.473+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TB5620YX732B.1 size=456988 2024-09-22T08:48:45.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.473+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=TB5620YX732B tag=XTK2DTDJMJ1D type=write size=2554140 2024-09-22T08:48:45.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.475+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.0 size=1048576 2024-09-22T08:48:45.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.476+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.1 size=1048576 2024-09-22T08:48:45.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.477+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1QXFBLS3C3RH.2 size=220051 2024-09-22T08:48:45.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.479+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=1QXFBLS3C3RH tag=AB7QW1HIDCWS type=write size=3365779 2024-09-22T08:48:45.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.481+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=Z179JQ6SJG2J type=del size=3134495 2024-09-22T08:48:45.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.482+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=V3ILH60LWGLA type=del 2024-09-22T08:48:45.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.483+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=GH906S8ACNH3 type=write size=273023 2024-09-22T08:48:45.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.485+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=UIENJ65GF299 type=del 2024-09-22T08:48:45.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.486+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=3PD79UM1QH6O type=del size=2224727 2024-09-22T08:48:45.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.488+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=A76LO6SEF5PB type=del 2024-09-22T08:48:45.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.490+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=FVNK380JXTK5 type=del size=3590830 2024-09-22T08:48:45.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.491+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=W1QA9OLPTRHC type=write size=149841 2024-09-22T08:48:45.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.493+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~7LGG4Y4QJXGU.0 size=539133 2024-09-22T08:48:45.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.493+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=7LGG4Y4QJXGU tag=8IFIFP9F81GV type=write size=1587709 2024-09-22T08:48:45.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.495+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=EQ250LV8W45Q type=del 2024-09-22T08:48:45.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.496+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=44LSS82LVHYX type=del size=1100020 2024-09-22T08:48:45.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.498+0000 7f7b8ef90780 1 < suggested remove operation key=YXIZJPACZZFY tag=LBMP9D8FQ77G type=del 2024-09-22T08:48:45.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.500+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=E5U9TR4OWIIA type=del size=1714030 2024-09-22T08:48:45.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.501+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.0 size=1048576 2024-09-22T08:48:45.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.502+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.1 size=1048576 2024-09-22T08:48:45.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.503+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~315BUGO8P4ZW.2 size=312792 2024-09-22T08:48:45.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.505+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=315BUGO8P4ZW tag=67XJBKDWCA7I type=write size=3458520 2024-09-22T08:48:45.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.507+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~IMYTUMSIQYUP.0 size=1048576 2024-09-22T08:48:45.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.508+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~IMYTUMSIQYUP.1 size=674872 2024-09-22T08:48:45.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.508+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=IMYTUMSIQYUP tag=K3LNFWQPPCVJ type=write size=2772024 2024-09-22T08:48:45.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.510+0000 7f7b8ef90780 1 < canceled operation key=G51KS3NM4VFY tag=WWDQLJOTXNSF type=del size=234896 2024-09-22T08:48:45.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.512+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.0 size=1048576 2024-09-22T08:48:45.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.513+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.1 size=1048576 2024-09-22T08:48:45.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.514+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.2 size=443700 2024-09-22T08:48:45.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.514+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=CD77ES1LMWQE tag=Q7EX75RPPWKJ type=write size=3589428 2024-09-22T08:48:45.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.515+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~KO19QVBK7HZT.0 size=1048576 2024-09-22T08:48:45.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.516+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~KO19QVBK7HZT.1 size=815423 2024-09-22T08:48:45.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.518+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=KO19QVBK7HZT tag=GZFKS8XA50B2 type=write size=2912575 2024-09-22T08:48:45.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.519+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=8FP8CD1Z1NHE type=del size=3112421 2024-09-22T08:48:45.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.521+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=301Y1RT1E9PD type=del 2024-09-22T08:48:45.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.522+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=MXI1MJCOXL0G type=del size=2454291 2024-09-22T08:48:45.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.523+0000 7f7b8ef90780 -1 < failed to complete operation key=YXIZJPACZZFY tag=915I3Y4EZ6C8 type=del size=864622: (22) Invalid argument 2024-09-22T08:48:45.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.526+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~EEK8795GKCXU.0 size=1048576 2024-09-22T08:48:45.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.527+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~EEK8795GKCXU.1 size=116948 2024-09-22T08:48:45.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.527+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=EEK8795GKCXU tag=D7TSA7BH6VZG type=write size=2214100 2024-09-22T08:48:45.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.528+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=CLHXKABI89YJ type=del 2024-09-22T08:48:45.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.529+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=FGR2T1I49HUY type=del size=2358186 2024-09-22T08:48:45.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.529+0000 7f7b8ef90780 1 < canceled part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.0 size=1048576 2024-09-22T08:48:45.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.531+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.1 size=1048576 2024-09-22T08:48:45.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.531+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~6PM7FSZZ767V.2 size=835867 2024-09-22T08:48:45.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.534+0000 7f7b8ef90780 1 < canceled multipart upload key=UQPY2ITDMKGO upload=6PM7FSZZ767V tag=Y0ZB825HBBZ0 type=write size=3981595 2024-09-22T08:48:45.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.536+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~8I8PQGMZY37E.0 size=346777 2024-09-22T08:48:45.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.536+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=8I8PQGMZY37E tag=PQ4D3L6RQAUX type=write size=1395353 2024-09-22T08:48:45.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.537+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~EBK65IEL4849.0 size=1013404 2024-09-22T08:48:45.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.540+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=EBK65IEL4849 tag=TRNYP51IIDWI type=write size=2061980 2024-09-22T08:48:45.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.541+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=UVNGJD43H4LE type=del size=1358486 2024-09-22T08:48:45.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.542+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~TB5620YX732B.0 size=1048576 2024-09-22T08:48:45.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.543+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~TB5620YX732B.1 size=456988 2024-09-22T08:48:45.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.545+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=TB5620YX732B tag=XTK2DTDJMJ1D type=write size=2554140 2024-09-22T08:48:45.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.547+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=W85MP9BLAFX5 type=del size=3225883 2024-09-22T08:48:45.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.550+0000 7f7b8ef90780 1 < suggested update operation key=Y7W0V6YTDFIB tag=Z179JQ6SJG2J type=del size=3134495 2024-09-22T08:48:45.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.552+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.0 size=1048576 2024-09-22T08:48:45.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.553+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.1 size=1048576 2024-09-22T08:48:45.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.554+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.2 size=601736 2024-09-22T08:48:45.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.554+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=4IOXMFZP29CV tag=WFYL5DARJROI type=write size=3747464 2024-09-22T08:48:45.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.557+0000 7f7b8ef90780 1 < suggested update operation key=QQKJ4URBRF16 tag=GH906S8ACNH3 type=write size=273023 2024-09-22T08:48:45.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.558+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=IS3XQNLCF2SP type=del size=903528 2024-09-22T08:48:45.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.559+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=3PD79UM1QH6O type=del 2024-09-22T08:48:45.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.560+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=45JFARUAU2HY type=del size=36606 2024-09-22T08:48:45.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.562+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=FVNK380JXTK5 type=del 2024-09-22T08:48:45.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.564+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~BI94J4VNEC1Q.0 size=1024412 2024-09-22T08:48:45.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.564+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=BI94J4VNEC1Q tag=4ITQGPT12X5K type=write size=2072988 2024-09-22T08:48:45.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.565+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~7LGG4Y4QJXGU.0 size=539133 2024-09-22T08:48:45.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.568+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=7LGG4Y4QJXGU tag=8IFIFP9F81GV type=write size=1587709 2024-09-22T08:48:45.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.569+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=5CMKAK02TN9O type=del size=245782 2024-09-22T08:48:45.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.570+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=44LSS82LVHYX type=del 2024-09-22T08:48:45.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.573+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.0 size=1048576 2024-09-22T08:48:45.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.574+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.1 size=1048576 2024-09-22T08:48:45.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.575+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.2 size=715385 2024-09-22T08:48:45.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.575+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=HDFJIWVL5F77 tag=58421IL2OOTN type=write size=3861113 2024-09-22T08:48:45.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.577+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=E5U9TR4OWIIA type=del 2024-09-22T08:48:45.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.579+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~ARNGKHYXSUJ8.0 size=351705 2024-09-22T08:48:45.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.579+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=ARNGKHYXSUJ8 tag=0Z46N62NAG80 type=write size=1400281 2024-09-22T08:48:45.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.580+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~IMYTUMSIQYUP.0 size=1048576 2024-09-22T08:48:45.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.582+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~IMYTUMSIQYUP.1 size=674872 2024-09-22T08:48:45.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.584+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=IMYTUMSIQYUP tag=K3LNFWQPPCVJ type=write size=2772024 2024-09-22T08:48:45.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.587+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.0 size=1048576 2024-09-22T08:48:45.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.588+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.1 size=1048576 2024-09-22T08:48:45.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.589+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.2 size=79316 2024-09-22T08:48:45.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.589+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=TYQOMX8Z1GQE tag=O40YB3DX155R type=write size=3225044 2024-09-22T08:48:45.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.590+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.0 size=1048576 2024-09-22T08:48:45.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.592+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.1 size=1048576 2024-09-22T08:48:45.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.593+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~CD77ES1LMWQE.2 size=443700 2024-09-22T08:48:45.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.595+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=CD77ES1LMWQE tag=Q7EX75RPPWKJ type=write size=3589428 2024-09-22T08:48:45.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.597+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.0 size=1048576 2024-09-22T08:48:45.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.598+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.1 size=1048576 2024-09-22T08:48:45.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.599+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.2 size=710256 2024-09-22T08:48:45.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.599+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=KLD0IIU54B2T tag=MAL58KKNI79P type=write size=3855984 2024-09-22T08:48:45.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.601+0000 7f7b8ef90780 1 < suggested update operation key=YF94C9GVRXQP tag=8FP8CD1Z1NHE type=del size=3112421 2024-09-22T08:48:45.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.603+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~42ZSWQ9Y7965.0 size=147774 2024-09-22T08:48:45.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.603+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=42ZSWQ9Y7965 tag=KTNU9WR3GR01 type=write size=1196350 2024-09-22T08:48:45.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.605+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=MXI1MJCOXL0G type=del 2024-09-22T08:48:45.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.607+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.0 size=1048576 2024-09-22T08:48:45.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.608+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.1 size=1048576 2024-09-22T08:48:45.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.609+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.2 size=482458 2024-09-22T08:48:45.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.609+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=8KCTKNVX2HBG tag=IY7PLV5D91X8 type=write size=3628186 2024-09-22T08:48:45.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.610+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~EEK8795GKCXU.0 size=1048576 2024-09-22T08:48:45.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.610+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~EEK8795GKCXU.1 size=116948 2024-09-22T08:48:45.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.612+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=EEK8795GKCXU tag=D7TSA7BH6VZG type=write size=2214100 2024-09-22T08:48:45.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.614+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~YEF1PAF49A6W.0 size=1048576 2024-09-22T08:48:45.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.615+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~YEF1PAF49A6W.1 size=56323 2024-09-22T08:48:45.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.615+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=YEF1PAF49A6W tag=49MUW62STK8I type=write size=2153475 2024-09-22T08:48:45.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.617+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=FGR2T1I49HUY type=del 2024-09-22T08:48:45.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.618+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=H98DVYX98U35 type=write size=200803 2024-09-22T08:48:45.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.618+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~8I8PQGMZY37E.0 size=346777 2024-09-22T08:48:45.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.620+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=8I8PQGMZY37E tag=PQ4D3L6RQAUX type=write size=1395353 2024-09-22T08:48:45.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.621+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=RCEHSE7D5EUP type=del size=753322 2024-09-22T08:48:45.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.623+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=UVNGJD43H4LE type=del 2024-09-22T08:48:45.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.624+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=WSLZ7D85T1P8 type=write size=17398 2024-09-22T08:48:45.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.625+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=W85MP9BLAFX5 type=del 2024-09-22T08:48:45.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.627+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~17CHJ511KAJB.0 size=894030 2024-09-22T08:48:45.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.627+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=17CHJ511KAJB tag=3324JM7THDAA type=write size=1942606 2024-09-22T08:48:45.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.628+0000 7f7b8ef90780 1 < canceled part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.0 size=1048576 2024-09-22T08:48:45.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.629+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.1 size=1048576 2024-09-22T08:48:45.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.630+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~4IOXMFZP29CV.2 size=601736 2024-09-22T08:48:45.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.632+0000 7f7b8ef90780 1 < canceled multipart upload key=UQPY2ITDMKGO upload=4IOXMFZP29CV tag=WFYL5DARJROI type=write size=3747464 2024-09-22T08:48:45.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.634+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~L0MMYFQ9UXFQ.0 size=220851 2024-09-22T08:48:45.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.634+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=L0MMYFQ9UXFQ tag=FFAM9LP3B478 type=write size=1269427 2024-09-22T08:48:45.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.635+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=IS3XQNLCF2SP type=del 2024-09-22T08:48:45.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.638+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.0 size=1048576 2024-09-22T08:48:45.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.639+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.1 size=1048576 2024-09-22T08:48:45.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.639+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.2 size=302788 2024-09-22T08:48:45.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.639+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=GUMH1JKCXQCG tag=87BM0B8MLB0D type=write size=3448516 2024-09-22T08:48:45.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.641+0000 7f7b8ef90780 -1 < failed to complete operation key=YF94C9GVRXQP tag=45JFARUAU2HY type=del size=36606: (22) Invalid argument 2024-09-22T08:48:45.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.0 size=1048576 2024-09-22T08:48:45.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.644+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.1 size=1048576 2024-09-22T08:48:45.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.645+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.2 size=306761 2024-09-22T08:48:45.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.645+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=54W5N0WKEDCH tag=X5W48B6SEKLD type=write size=3452489 2024-09-22T08:48:45.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.646+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~BI94J4VNEC1Q.0 size=1024412 2024-09-22T08:48:45.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.648+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=BI94J4VNEC1Q tag=4ITQGPT12X5K type=write size=2072988 2024-09-22T08:48:45.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.650+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~FTC1LYHET2B6.0 size=1048576 2024-09-22T08:48:45.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.651+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~FTC1LYHET2B6.1 size=447368 2024-09-22T08:48:45.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.651+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=FTC1LYHET2B6 tag=TSSZMVOMO26P type=write size=2544520 2024-09-22T08:48:45.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.653+0000 7f7b8ef90780 1 < suggested remove operation key=6DC0SVAYR2DB tag=5CMKAK02TN9O type=del 2024-09-22T08:48:45.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.654+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=715WZSTZGUA6 type=del size=606169 2024-09-22T08:48:45.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.656+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.0 size=1048576 2024-09-22T08:48:45.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.656+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.1 size=1048576 2024-09-22T08:48:45.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.658+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~HDFJIWVL5F77.2 size=715385 2024-09-22T08:48:45.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.660+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=HDFJIWVL5F77 tag=58421IL2OOTN type=write size=3861113 2024-09-22T08:48:45.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.661+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=DTIL0WM9WGJK type=del size=997751 2024-09-22T08:48:45.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.662+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~ARNGKHYXSUJ8.0 size=351705 2024-09-22T08:48:45.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.665+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=ARNGKHYXSUJ8 tag=0Z46N62NAG80 type=write size=1400281 2024-09-22T08:48:45.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.666+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=CTIRNF9N4XFZ type=del size=4087602 2024-09-22T08:48:45.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.667+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.0 size=1048576 2024-09-22T08:48:45.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.668+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.1 size=1048576 2024-09-22T08:48:45.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.669+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~TYQOMX8Z1GQE.2 size=79316 2024-09-22T08:48:45.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.672+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=TYQOMX8Z1GQE tag=O40YB3DX155R type=write size=3225044 2024-09-22T08:48:45.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.673+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=JMOYS7LJWKYS type=del size=700104 2024-09-22T08:48:45.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.674+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.0 size=1048576 2024-09-22T08:48:45.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.674+0000 7f7b8ef90780 1 < canceled part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.1 size=1048576 2024-09-22T08:48:45.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.675+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~KLD0IIU54B2T.2 size=710256 2024-09-22T08:48:45.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.678+0000 7f7b8ef90780 1 < canceled multipart upload key=9DO6M6UQ5A05 upload=KLD0IIU54B2T tag=MAL58KKNI79P type=write size=3855984 2024-09-22T08:48:45.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.679+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=MU35XEIZSANH type=write size=756812 2024-09-22T08:48:45.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.680+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~42ZSWQ9Y7965.0 size=147774 2024-09-22T08:48:45.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.682+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=42ZSWQ9Y7965 tag=KTNU9WR3GR01 type=write size=1196350 2024-09-22T08:48:45.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.683+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=1GQP0HHHWYG8 type=write size=196549 2024-09-22T08:48:45.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.684+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.0 size=1048576 2024-09-22T08:48:45.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.685+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.1 size=1048576 2024-09-22T08:48:45.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.685+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~8KCTKNVX2HBG.2 size=482458 2024-09-22T08:48:45.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.688+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=8KCTKNVX2HBG tag=IY7PLV5D91X8 type=write size=3628186 2024-09-22T08:48:45.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.689+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=ZZVYNK1PM6OW type=write size=436494 2024-09-22T08:48:45.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.690+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~YEF1PAF49A6W.0 size=1048576 2024-09-22T08:48:45.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.691+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~YEF1PAF49A6W.1 size=56323 2024-09-22T08:48:45.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.693+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=YEF1PAF49A6W tag=49MUW62STK8I type=write size=2153475 2024-09-22T08:48:45.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.695+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.0 size=1048576 2024-09-22T08:48:45.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.696+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.1 size=1048576 2024-09-22T08:48:45.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.697+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.2 size=816144 2024-09-22T08:48:45.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.697+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=370D70QN0N6E tag=HMLJG2WK6OME type=write size=3961872 2024-09-22T08:48:45.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.698+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=H98DVYX98U35 type=write size=200803 2024-09-22T08:48:45.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.700+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.0 size=1048576 2024-09-22T08:48:45.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.701+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.1 size=1048576 2024-09-22T08:48:45.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.702+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.2 size=242337 2024-09-22T08:48:45.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.702+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=YZQH1J2UYKGD tag=T3COSEM67V5E type=write size=3388065 2024-09-22T08:48:45.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.704+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=RCEHSE7D5EUP type=del 2024-09-22T08:48:45.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.705+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=WGC7S7QV0MF8 type=del size=2385935 2024-09-22T08:48:45.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.706+0000 7f7b8ef90780 1 < canceled operation key=7ZS8G8H6I957 tag=WSLZ7D85T1P8 type=write size=17398 2024-09-22T08:48:45.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.708+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=1ZN9VQP2ES3W type=del size=2612757 2024-09-22T08:48:45.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.709+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~17CHJ511KAJB.0 size=894030 2024-09-22T08:48:45.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.711+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=17CHJ511KAJB tag=3324JM7THDAA type=write size=1942606 2024-09-22T08:48:45.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.714+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~14NQW0O0ZXHZ.0 size=885533 2024-09-22T08:48:45.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.714+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=14NQW0O0ZXHZ tag=7J6HRDVVDDQK type=write size=1934109 2024-09-22T08:48:45.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.714+0000 7f7b8ef90780 1 < canceled part key=_multipart_YF94C9GVRXQP.2~L0MMYFQ9UXFQ.0 size=220851 2024-09-22T08:48:45.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.716+0000 7f7b8ef90780 1 < canceled multipart upload key=YF94C9GVRXQP upload=L0MMYFQ9UXFQ tag=FFAM9LP3B478 type=write size=1269427 2024-09-22T08:48:45.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.718+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.0 size=1048576 2024-09-22T08:48:45.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.719+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.1 size=1048576 2024-09-22T08:48:45.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.721+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.2 size=19799 2024-09-22T08:48:45.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.721+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=B82XUND33CTK tag=EWS0JQ98172E type=write size=3165527 2024-09-22T08:48:45.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.722+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.0 size=1048576 2024-09-22T08:48:45.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.723+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.1 size=1048576 2024-09-22T08:48:45.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.724+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~GUMH1JKCXQCG.2 size=302788 2024-09-22T08:48:45.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.726+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=GUMH1JKCXQCG tag=87BM0B8MLB0D type=write size=3448516 2024-09-22T08:48:45.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.727+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=R12J3E247PX3 type=del size=2303108 2024-09-22T08:48:45.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.729+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.0 size=1048576 2024-09-22T08:48:45.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.730+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.1 size=1048576 2024-09-22T08:48:45.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.731+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~54W5N0WKEDCH.2 size=306761 2024-09-22T08:48:45.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.733+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=54W5N0WKEDCH tag=X5W48B6SEKLD type=write size=3452489 2024-09-22T08:48:45.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.734+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=YY4LI6NGX9R3 type=del size=2567253 2024-09-22T08:48:45.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.735+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~FTC1LYHET2B6.0 size=1048576 2024-09-22T08:48:45.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.736+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~FTC1LYHET2B6.1 size=447368 2024-09-22T08:48:45.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.738+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=FTC1LYHET2B6 tag=TSSZMVOMO26P type=write size=2544520 2024-09-22T08:48:45.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.740+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=5MD214O0C4H6 type=del size=944317 2024-09-22T08:48:45.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.741+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=715WZSTZGUA6 type=del 2024-09-22T08:48:45.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.742+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=2Z9OWILESU5K type=del size=166661 2024-09-22T08:48:45.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.743+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=DTIL0WM9WGJK type=del 2024-09-22T08:48:45.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.746+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~EKGW63YLX29R.0 size=1048576 2024-09-22T08:48:45.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.747+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~EKGW63YLX29R.1 size=613677 2024-09-22T08:48:45.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.747+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=EKGW63YLX29R tag=91PB9TR1F1JP type=write size=2710829 2024-09-22T08:48:45.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.748+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=CTIRNF9N4XFZ type=del 2024-09-22T08:48:45.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.750+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~GEGXPS66PNCT.0 size=752383 2024-09-22T08:48:45.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.750+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=GEGXPS66PNCT tag=D6KNQNUWG8H5 type=write size=1800959 2024-09-22T08:48:45.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.751+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=JMOYS7LJWKYS type=del 2024-09-22T08:48:45.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.753+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=UPQI1SYLMOCE type=del size=1096739 2024-09-22T08:48:45.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.756+0000 7f7b8ef90780 1 < suggested update operation key=4ZJ4E4SUA01H tag=MU35XEIZSANH type=write size=756812 2024-09-22T08:48:45.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.758+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=YEWMTV0XB81W type=del size=1870454 2024-09-22T08:48:45.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.759+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=1GQP0HHHWYG8 type=write size=196549 2024-09-22T08:48:45.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.760+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=3RU7RV91HBDE type=write size=885420 2024-09-22T08:48:45.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.762+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=ZZVYNK1PM6OW type=write size=436494 2024-09-22T08:48:45.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.764+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~SQRK1O2W3217.0 size=527801 2024-09-22T08:48:45.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.764+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=SQRK1O2W3217 tag=L08ROUUET9RI type=write size=1576377 2024-09-22T08:48:45.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.765+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.0 size=1048576 2024-09-22T08:48:45.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.766+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.1 size=1048576 2024-09-22T08:48:45.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.767+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~370D70QN0N6E.2 size=816144 2024-09-22T08:48:45.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.770+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=370D70QN0N6E tag=HMLJG2WK6OME type=write size=3961872 2024-09-22T08:48:45.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.771+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=UU4D6S39JG25 type=del size=298058 2024-09-22T08:48:45.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.771+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.0 size=1048576 2024-09-22T08:48:45.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.772+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.1 size=1048576 2024-09-22T08:48:45.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.773+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YZQH1J2UYKGD.2 size=242337 2024-09-22T08:48:45.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.776+0000 7f7b8ef90780 1 < canceled multipart upload key=L1URDVW43BUG upload=YZQH1J2UYKGD tag=T3COSEM67V5E type=write size=3388065 2024-09-22T08:48:45.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.777+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=403Z8ST69WB6 type=del size=2914882 2024-09-22T08:48:45.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.778+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=WGC7S7QV0MF8 type=del 2024-09-22T08:48:45.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.781+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~L4A6EZHLD6IG.0 size=424299 2024-09-22T08:48:45.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.781+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=L4A6EZHLD6IG tag=MLDBAGU2ASU7 type=write size=1472875 2024-09-22T08:48:45.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.782+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=1ZN9VQP2ES3W type=del 2024-09-22T08:48:45.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.783+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=F7GA78S0VRQ1 type=del size=1332489 2024-09-22T08:48:45.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.785+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~14NQW0O0ZXHZ.0 size=885533 2024-09-22T08:48:45.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.787+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=14NQW0O0ZXHZ tag=7J6HRDVVDDQK type=write size=1934109 2024-09-22T08:48:45.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.788+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=KNHJLD0XMQVW type=write size=309803 2024-09-22T08:48:45.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.789+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.0 size=1048576 2024-09-22T08:48:45.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.790+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.1 size=1048576 2024-09-22T08:48:45.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.791+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~B82XUND33CTK.2 size=19799 2024-09-22T08:48:45.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.793+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=B82XUND33CTK tag=EWS0JQ98172E type=write size=3165527 2024-09-22T08:48:45.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.795+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=D1RCLE367R60 type=write size=855190 2024-09-22T08:48:45.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.797+0000 7f7b8ef90780 1 < suggested update operation key=9DO6M6UQ5A05 tag=R12J3E247PX3 type=del size=2303108 2024-09-22T08:48:45.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.800+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~K2WCG6MWUTRE.0 size=608286 2024-09-22T08:48:45.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.800+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=K2WCG6MWUTRE tag=DUF115I3R1IY type=write size=1656862 2024-09-22T08:48:45.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.802+0000 7f7b8ef90780 1 < suggested remove operation key=70WNR3KVU0BG tag=YY4LI6NGX9R3 type=del 2024-09-22T08:48:45.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.804+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=MZ8HLWELOFEY type=write size=396076 2024-09-22T08:48:45.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.805+0000 7f7b8ef90780 1 < canceled operation key=WDGY8YL16UWI tag=5MD214O0C4H6 type=del size=944317 2024-09-22T08:48:45.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.807+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=6DVRMQHMXLLA type=del size=58293 2024-09-22T08:48:45.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.810+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=2Z9OWILESU5K type=del size=166661 2024-09-22T08:48:45.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.811+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=8WB3H7J1U2YP type=del size=4168656 2024-09-22T08:48:45.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.813+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~EKGW63YLX29R.0 size=1048576 2024-09-22T08:48:45.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.814+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~EKGW63YLX29R.1 size=613677 2024-09-22T08:48:45.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.816+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=EKGW63YLX29R tag=91PB9TR1F1JP type=write size=2710829 2024-09-22T08:48:45.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.818+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=BBXA7DCX594U type=write size=790786 2024-09-22T08:48:45.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.819+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~GEGXPS66PNCT.0 size=752383 2024-09-22T08:48:45.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.821+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=GEGXPS66PNCT tag=D6KNQNUWG8H5 type=write size=1800959 2024-09-22T08:48:45.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.823+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~IITULCY51ZVQ.0 size=1048576 2024-09-22T08:48:45.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.824+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~IITULCY51ZVQ.1 size=912619 2024-09-22T08:48:45.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.824+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=IITULCY51ZVQ tag=PUGB1W2UYJ89 type=write size=3009771 2024-09-22T08:48:45.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.825+0000 7f7b8ef90780 -1 < failed to complete operation key=4ZJ4E4SUA01H tag=UPQI1SYLMOCE type=del size=1096739: (22) Invalid argument 2024-09-22T08:48:45.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.827+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=926H8BK3UV12 type=del size=1641598 2024-09-22T08:48:45.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.829+0000 7f7b8ef90780 1 < suggested update operation key=L1URDVW43BUG tag=YEWMTV0XB81W type=del size=1870454 2024-09-22T08:48:45.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.830+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=HH8GCC6KZK56 type=del size=3370159 2024-09-22T08:48:45.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.833+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=3RU7RV91HBDE type=write size=885420 2024-09-22T08:48:45.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.834+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=73OIQOHF8Z34 type=del size=2983699 2024-09-22T08:48:45.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.835+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~SQRK1O2W3217.0 size=527801 2024-09-22T08:48:45.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.837+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=SQRK1O2W3217 tag=L08ROUUET9RI type=write size=1576377 2024-09-22T08:48:45.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.838+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=H94LR07JK39S type=del size=1993361 2024-09-22T08:48:45.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.840+0000 7f7b8ef90780 -1 < failed to complete operation key=1U6T2BIZS72V tag=UU4D6S39JG25 type=del size=298058: (22) Invalid argument 2024-09-22T08:48:45.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.842+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~KT5SGI9UL9VQ.0 size=1048576 2024-09-22T08:48:45.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.843+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~KT5SGI9UL9VQ.1 size=353244 2024-09-22T08:48:45.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.843+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=KT5SGI9UL9VQ tag=CQY3S05IKCK7 type=write size=2450396 2024-09-22T08:48:45.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.844+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=403Z8ST69WB6 type=del 2024-09-22T08:48:45.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.846+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=ETWP73QTF9AD type=write size=329956 2024-09-22T08:48:45.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.847+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~L4A6EZHLD6IG.0 size=424299 2024-09-22T08:48:45.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.849+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=L4A6EZHLD6IG tag=MLDBAGU2ASU7 type=write size=1472875 2024-09-22T08:48:45.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.851+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.0 size=1048576 2024-09-22T08:48:45.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.853+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.1 size=1048576 2024-09-22T08:48:45.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.854+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.2 size=599228 2024-09-22T08:48:45.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.854+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=3NU2B3ZMN6RW tag=NHQI8TBTBS0B type=write size=3744956 2024-09-22T08:48:45.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.856+0000 7f7b8ef90780 1 < suggested update operation key=F3IHQ6Z9V1DX tag=F7GA78S0VRQ1 type=del size=1332489 2024-09-22T08:48:45.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.857+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=54YEEDJPL8TZ type=del size=2289502 2024-09-22T08:48:45.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.859+0000 7f7b8ef90780 1 < completed write operation key=PODNY4NH4A9W tag=KNHJLD0XMQVW type=write size=309803 2024-09-22T08:48:45.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.860+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=5IV98794XJDT type=write size=581690 2024-09-22T08:48:45.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.861+0000 7f7b8ef90780 1 < completed write operation key=4J4EGI19N123 tag=D1RCLE367R60 type=write size=855190 2024-09-22T08:48:45.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.864+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.0 size=1048576 2024-09-22T08:48:45.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.864+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.1 size=1048576 2024-09-22T08:48:45.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.866+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.2 size=484699 2024-09-22T08:48:45.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.866+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=M6JMSOS1STEF tag=N39P30QBPZOK type=write size=3630427 2024-09-22T08:48:45.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.866+0000 7f7b8ef90780 1 < canceled part key=_multipart_YDJLMBL7EQWN.2~K2WCG6MWUTRE.0 size=608286 2024-09-22T08:48:45.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.868+0000 7f7b8ef90780 1 < canceled multipart upload key=YDJLMBL7EQWN upload=K2WCG6MWUTRE tag=DUF115I3R1IY type=write size=1656862 2024-09-22T08:48:45.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.869+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=UL1IDMX23QJP type=write size=907890 2024-09-22T08:48:45.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.870+0000 7f7b8ef90780 -1 < failed to complete operation key=F3IHQ6Z9V1DX tag=MZ8HLWELOFEY type=write size=396076: (22) Invalid argument 2024-09-22T08:48:45.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.871+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=CTS5D7AOQJFN type=del size=3642119 2024-09-22T08:48:45.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.873+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=6DVRMQHMXLLA type=del 2024-09-22T08:48:45.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.874+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=LILL2FUAHYVB type=del size=2339099 2024-09-22T08:48:45.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.875+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=8WB3H7J1U2YP type=del 2024-09-22T08:48:45.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.877+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.0 size=1048576 2024-09-22T08:48:45.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.879+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.1 size=1048576 2024-09-22T08:48:45.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.879+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.2 size=797731 2024-09-22T08:48:45.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.879+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=MKGWC2NVOOXY tag=AY7P2Y0YJQ0R type=write size=3943459 2024-09-22T08:48:45.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.881+0000 7f7b8ef90780 1 < completed write operation key=Y7W0V6YTDFIB tag=BBXA7DCX594U type=write size=790786 2024-09-22T08:48:45.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.883+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~BCKXPH17YC8I.0 size=60405 2024-09-22T08:48:45.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.883+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=BCKXPH17YC8I tag=56O8WKOU8Y14 type=write size=1108981 2024-09-22T08:48:45.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.885+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~IITULCY51ZVQ.0 size=1048576 2024-09-22T08:48:45.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.886+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~IITULCY51ZVQ.1 size=912619 2024-09-22T08:48:45.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.888+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=IITULCY51ZVQ tag=PUGB1W2UYJ89 type=write size=3009771 2024-09-22T08:48:45.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.890+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~BP5A5OHIK4YQ.0 size=1048576 2024-09-22T08:48:45.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.891+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~BP5A5OHIK4YQ.1 size=1047245 2024-09-22T08:48:45.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.891+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=BP5A5OHIK4YQ tag=FJXYVO2NL1G3 type=write size=3144397 2024-09-22T08:48:45.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.892+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=926H8BK3UV12 type=del 2024-09-22T08:48:45.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.894+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=43A0018UICG3 type=del size=1274734 2024-09-22T08:48:45.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.895+0000 7f7b8ef90780 1 < canceled operation key=9DO6M6UQ5A05 tag=HH8GCC6KZK56 type=del size=3370159 2024-09-22T08:48:45.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.896+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=RLHLEYVSLB32 type=del size=3827931 2024-09-22T08:48:45.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.897+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=73OIQOHF8Z34 type=del 2024-09-22T08:48:45.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.899+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=V2BICJPXBPY6 type=del size=3685236 2024-09-22T08:48:45.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.902+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=H94LR07JK39S type=del 2024-09-22T08:48:45.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.905+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.0 size=1048576 2024-09-22T08:48:45.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.906+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.1 size=1048576 2024-09-22T08:48:45.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.907+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.2 size=121065 2024-09-22T08:48:45.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.907+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=YILYB76NYS43 tag=W1AQOPGFXF00 type=write size=3266793 2024-09-22T08:48:45.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.908+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~KT5SGI9UL9VQ.0 size=1048576 2024-09-22T08:48:45.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.909+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~KT5SGI9UL9VQ.1 size=353244 2024-09-22T08:48:45.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.911+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=KT5SGI9UL9VQ tag=CQY3S05IKCK7 type=write size=2450396 2024-09-22T08:48:45.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.913+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=09Z7MCYC5GUO type=del size=3875419 2024-09-22T08:48:45.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.914+0000 7f7b8ef90780 1 < completed write operation key=4J4EGI19N123 tag=ETWP73QTF9AD type=write size=329956 2024-09-22T08:48:45.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.915+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=LJ05O56X0N0Z type=del size=2722537 2024-09-22T08:48:45.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.916+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.0 size=1048576 2024-09-22T08:48:45.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.917+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.1 size=1048576 2024-09-22T08:48:45.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.918+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~3NU2B3ZMN6RW.2 size=599228 2024-09-22T08:48:45.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.920+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=3NU2B3ZMN6RW tag=NHQI8TBTBS0B type=write size=3744956 2024-09-22T08:48:45.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.923+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.0 size=1048576 2024-09-22T08:48:45.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.924+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.1 size=1048576 2024-09-22T08:48:45.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.925+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.2 size=308861 2024-09-22T08:48:45.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.925+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=K28OCANG5N5N tag=4UGYQIXU34YQ type=write size=3454589 2024-09-22T08:48:45.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.926+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=54YEEDJPL8TZ type=del 2024-09-22T08:48:45.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.929+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~T4KN26ZMM39P.0 size=1048576 2024-09-22T08:48:45.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.929+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~T4KN26ZMM39P.1 size=306874 2024-09-22T08:48:45.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.929+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=T4KN26ZMM39P tag=EANC85CB6DE8 type=write size=2404026 2024-09-22T08:48:45.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.931+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=5IV98794XJDT type=write size=581690 2024-09-22T08:48:45.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.933+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~9EHCPZMKACD6.0 size=817419 2024-09-22T08:48:45.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.933+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=9EHCPZMKACD6 tag=M9YH4I5GO6D5 type=write size=1865995 2024-09-22T08:48:45.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.934+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.0 size=1048576 2024-09-22T08:48:45.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.935+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.1 size=1048576 2024-09-22T08:48:45.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.936+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~M6JMSOS1STEF.2 size=484699 2024-09-22T08:48:45.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.938+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=M6JMSOS1STEF tag=N39P30QBPZOK type=write size=3630427 2024-09-22T08:48:45.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.940+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=DMMPBXH2O6N7 type=write size=82153 2024-09-22T08:48:45.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.941+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=UL1IDMX23QJP type=write size=907890 2024-09-22T08:48:45.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.942+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=ALFNZ3Q8CHT2 type=del size=427977 2024-09-22T08:48:45.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.944+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=CTS5D7AOQJFN type=del 2024-09-22T08:48:45.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.946+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~SPCT0VIB5RA8.0 size=1048576 2024-09-22T08:48:45.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.947+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~SPCT0VIB5RA8.1 size=947651 2024-09-22T08:48:45.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.947+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=SPCT0VIB5RA8 tag=6QL5SKYQ948L type=write size=3044803 2024-09-22T08:48:45.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.949+0000 7f7b8ef90780 1 < canceled operation key=X9TWX0Z54MOO tag=LILL2FUAHYVB type=del size=2339099 2024-09-22T08:48:45.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.950+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=1DINT4HFQLYC type=write size=401751 2024-09-22T08:48:45.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.952+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.0 size=1048576 2024-09-22T08:48:45.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.952+0000 7f7b8ef90780 1 < canceled part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.1 size=1048576 2024-09-22T08:48:45.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.953+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~MKGWC2NVOOXY.2 size=797731 2024-09-22T08:48:45.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.955+0000 7f7b8ef90780 1 < canceled multipart upload key=R0N30XP1BXY3 upload=MKGWC2NVOOXY tag=AY7P2Y0YJQ0R type=write size=3943459 2024-09-22T08:48:45.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.957+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=2AW12BTUL872 type=del size=1596352 2024-09-22T08:48:45.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.958+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~BCKXPH17YC8I.0 size=60405 2024-09-22T08:48:45.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.960+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=BCKXPH17YC8I tag=56O8WKOU8Y14 type=write size=1108981 2024-09-22T08:48:45.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.963+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.0 size=1048576 2024-09-22T08:48:45.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.964+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.1 size=1048576 2024-09-22T08:48:45.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.965+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.2 size=573435 2024-09-22T08:48:45.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.965+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=LMCBB8FARE60 tag=W2X6YJY4IRET type=write size=3719163 2024-09-22T08:48:45.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.966+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~BP5A5OHIK4YQ.0 size=1048576 2024-09-22T08:48:45.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.967+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~BP5A5OHIK4YQ.1 size=1047245 2024-09-22T08:48:45.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.969+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=BP5A5OHIK4YQ tag=FJXYVO2NL1G3 type=write size=3144397 2024-09-22T08:48:45.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.971+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~MYO9EV26ZD9V.0 size=683612 2024-09-22T08:48:45.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.971+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=MYO9EV26ZD9V tag=NA63E2KME0LG type=write size=1732188 2024-09-22T08:48:45.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.973+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=43A0018UICG3 type=del 2024-09-22T08:48:45.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.974+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=FIQGXKQXRBTB type=del size=101131 2024-09-22T08:48:45.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.976+0000 7f7b8ef90780 -1 < failed to complete operation key=4ZJ4E4SUA01H tag=RLHLEYVSLB32 type=del size=3827931: (22) Invalid argument 2024-09-22T08:48:45.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.978+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.0 size=1048576 2024-09-22T08:48:45.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.979+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.1 size=1048576 2024-09-22T08:48:45.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.981+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.2 size=543307 2024-09-22T08:48:45.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.981+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=IWKUKTTDLWEN tag=1OK2M207Z7CV type=write size=3689035 2024-09-22T08:48:45.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.982+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=V2BICJPXBPY6 type=del 2024-09-22T08:48:45.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.983+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=VDBV0WIJOJDD type=write size=1687 2024-09-22T08:48:45.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.985+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.0 size=1048576 2024-09-22T08:48:45.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.986+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.1 size=1048576 2024-09-22T08:48:45.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.986+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~YILYB76NYS43.2 size=121065 2024-09-22T08:48:45.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.988+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=YILYB76NYS43 tag=W1AQOPGFXF00 type=write size=3266793 2024-09-22T08:48:45.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.990+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~LVMG9VC1Q0AL.0 size=523174 2024-09-22T08:48:45.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.990+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=LVMG9VC1Q0AL tag=537R0UVBZ5JX type=write size=1571750 2024-09-22T08:48:45.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.991+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=09Z7MCYC5GUO type=del 2024-09-22T08:48:45.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.994+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~GD67YKH0GCUP.0 size=1038991 2024-09-22T08:48:45.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.994+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=GD67YKH0GCUP tag=GQB0H2WKZZNA type=write size=2087567 2024-09-22T08:48:45.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.995+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=LJ05O56X0N0Z type=del 2024-09-22T08:48:45.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.996+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=1FREWXM36VQ3 type=del size=4134528 2024-09-22T08:48:45.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.997+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.0 size=1048576 2024-09-22T08:48:45.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.998+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.1 size=1048576 2024-09-22T08:48:46.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:45.999+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~K28OCANG5N5N.2 size=308861 2024-09-22T08:48:46.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.001+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=K28OCANG5N5N tag=4UGYQIXU34YQ type=write size=3454589 2024-09-22T08:48:46.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.004+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~AKZ77CF65NEU.0 size=1048576 2024-09-22T08:48:46.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.005+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~AKZ77CF65NEU.1 size=996338 2024-09-22T08:48:46.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.005+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=AKZ77CF65NEU tag=FX2S0WJ50KC0 type=write size=3093490 2024-09-22T08:48:46.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.006+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~T4KN26ZMM39P.0 size=1048576 2024-09-22T08:48:46.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.007+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~T4KN26ZMM39P.1 size=306874 2024-09-22T08:48:46.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.009+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=T4KN26ZMM39P tag=EANC85CB6DE8 type=write size=2404026 2024-09-22T08:48:46.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.011+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=V93IYS2SBPZQ type=del size=377992 2024-09-22T08:48:46.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.012+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~9EHCPZMKACD6.0 size=817419 2024-09-22T08:48:46.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.014+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=9EHCPZMKACD6 tag=M9YH4I5GO6D5 type=write size=1865995 2024-09-22T08:48:46.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.015+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=FJNA3U6VITDG type=del size=1267593 2024-09-22T08:48:46.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.017+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=DMMPBXH2O6N7 type=write size=82153 2024-09-22T08:48:46.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.018+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=5QABTTEEHRY8 type=del size=2341374 2024-09-22T08:48:46.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.019+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=ALFNZ3Q8CHT2 type=del 2024-09-22T08:48:46.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.021+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=S89P9NZFK113 type=del size=3932744 2024-09-22T08:48:46.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.023+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~SPCT0VIB5RA8.0 size=1048576 2024-09-22T08:48:46.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.024+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~SPCT0VIB5RA8.1 size=947651 2024-09-22T08:48:46.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.026+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=SPCT0VIB5RA8 tag=6QL5SKYQ948L type=write size=3044803 2024-09-22T08:48:46.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.028+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.0 size=1048576 2024-09-22T08:48:46.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.029+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.1 size=1048576 2024-09-22T08:48:46.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.030+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.2 size=804663 2024-09-22T08:48:46.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.030+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=QDWAOGUL1TC1 tag=M5YEWDW3CG0I type=write size=3950391 2024-09-22T08:48:46.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.032+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=1DINT4HFQLYC type=write size=401751 2024-09-22T08:48:46.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.033+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=I20HU4EMQ4PE type=del size=3192992 2024-09-22T08:48:46.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.034+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=2AW12BTUL872 type=del 2024-09-22T08:48:46.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.035+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=JHL4KTMB0EM0 type=del size=3335465 2024-09-22T08:48:46.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.037+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.0 size=1048576 2024-09-22T08:48:46.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.038+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.1 size=1048576 2024-09-22T08:48:46.040 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.039+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~LMCBB8FARE60.2 size=573435 2024-09-22T08:48:46.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.041+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=LMCBB8FARE60 tag=W2X6YJY4IRET type=write size=3719163 2024-09-22T08:48:46.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.043+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~D66Z0U6AU7T7.0 size=1048576 2024-09-22T08:48:46.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.044+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~D66Z0U6AU7T7.1 size=195375 2024-09-22T08:48:46.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.044+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=D66Z0U6AU7T7 tag=OIMY01QJOYF3 type=write size=2292527 2024-09-22T08:48:46.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.046+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~MYO9EV26ZD9V.0 size=683612 2024-09-22T08:48:46.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.048+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=MYO9EV26ZD9V tag=NA63E2KME0LG type=write size=1732188 2024-09-22T08:48:46.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.050+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~7O30N82FHW50.0 size=595274 2024-09-22T08:48:46.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.050+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=7O30N82FHW50 tag=308YYF47AQ07 type=write size=1643850 2024-09-22T08:48:46.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.053+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=FIQGXKQXRBTB type=del 2024-09-22T08:48:46.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.056+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~32360SWR85N9.0 size=1048576 2024-09-22T08:48:46.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.057+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~32360SWR85N9.1 size=206505 2024-09-22T08:48:46.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.057+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=32360SWR85N9 tag=20GLE0NJ3UWC type=write size=2303657 2024-09-22T08:48:46.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.058+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.0 size=1048576 2024-09-22T08:48:46.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.059+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.1 size=1048576 2024-09-22T08:48:46.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.060+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~IWKUKTTDLWEN.2 size=543307 2024-09-22T08:48:46.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.062+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=IWKUKTTDLWEN tag=1OK2M207Z7CV type=write size=3689035 2024-09-22T08:48:46.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.064+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=0PCK4BBFRSJV type=del size=821022 2024-09-22T08:48:46.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.065+0000 7f7b8ef90780 1 < completed write operation key=ZM6ITJ2QUIPJ tag=VDBV0WIJOJDD type=write size=1687 2024-09-22T08:48:46.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.067+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~31GMJTRKPANP.0 size=1048576 2024-09-22T08:48:46.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.069+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~31GMJTRKPANP.1 size=278090 2024-09-22T08:48:46.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.069+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=31GMJTRKPANP tag=3RQOVN604LGN type=write size=2375242 2024-09-22T08:48:46.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.070+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~LVMG9VC1Q0AL.0 size=523174 2024-09-22T08:48:46.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.072+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=LVMG9VC1Q0AL tag=537R0UVBZ5JX type=write size=1571750 2024-09-22T08:48:46.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.073+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=QTUXJ18C7IJ0 type=del size=2904378 2024-09-22T08:48:46.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.075+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~GD67YKH0GCUP.0 size=1038991 2024-09-22T08:48:46.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.077+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=GD67YKH0GCUP tag=GQB0H2WKZZNA type=write size=2087567 2024-09-22T08:48:46.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.079+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~815108BAT0IS.0 size=1048576 2024-09-22T08:48:46.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.080+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~815108BAT0IS.1 size=808230 2024-09-22T08:48:46.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.080+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=815108BAT0IS tag=LPDQCALNITI4 type=write size=2905382 2024-09-22T08:48:46.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.081+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=1FREWXM36VQ3 type=del 2024-09-22T08:48:46.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.082+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=U30A71EOBE9I type=del size=91392 2024-09-22T08:48:46.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.084+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~AKZ77CF65NEU.0 size=1048576 2024-09-22T08:48:46.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.085+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~AKZ77CF65NEU.1 size=996338 2024-09-22T08:48:46.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.087+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=AKZ77CF65NEU tag=FX2S0WJ50KC0 type=write size=3093490 2024-09-22T08:48:46.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.088+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=3MFG80BSOPTR type=write size=237794 2024-09-22T08:48:46.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.089+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=V93IYS2SBPZQ type=del size=377992 2024-09-22T08:48:46.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.092+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.0 size=1048576 2024-09-22T08:48:46.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.093+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.1 size=1048576 2024-09-22T08:48:46.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.094+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.2 size=259475 2024-09-22T08:48:46.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.094+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=R170J2O7K08B tag=JN1V78KKIYK6 type=write size=3405203 2024-09-22T08:48:46.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.095+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=FJNA3U6VITDG type=del 2024-09-22T08:48:46.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.096+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=QLH2K925QKIT type=del size=1394762 2024-09-22T08:48:46.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.097+0000 7f7b8ef90780 1 < canceled operation key=G51KS3NM4VFY tag=5QABTTEEHRY8 type=del size=2341374 2024-09-22T08:48:46.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.099+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=2N2QA3EQXH6W type=del size=1256583 2024-09-22T08:48:46.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.100+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=S89P9NZFK113 type=del 2024-09-22T08:48:46.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.102+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~5D3YUZYMVW0V.0 size=863074 2024-09-22T08:48:46.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.102+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=5D3YUZYMVW0V tag=F09DGUC91AFP type=write size=1911650 2024-09-22T08:48:46.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.103+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.0 size=1048576 2024-09-22T08:48:46.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.104+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.1 size=1048576 2024-09-22T08:48:46.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.105+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~QDWAOGUL1TC1.2 size=804663 2024-09-22T08:48:46.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.107+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=QDWAOGUL1TC1 tag=M5YEWDW3CG0I type=write size=3950391 2024-09-22T08:48:46.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.108+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=VJ8Q0TSZNL2E type=del size=1770678 2024-09-22T08:48:46.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.110+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=I20HU4EMQ4PE type=del 2024-09-22T08:48:46.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.111+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=N22PWTUNJ3FZ type=del size=724275 2024-09-22T08:48:46.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.112+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=JHL4KTMB0EM0 type=del 2024-09-22T08:48:46.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.114+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=HP0VM00S3H5B type=del size=2422852 2024-09-22T08:48:46.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.115+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~D66Z0U6AU7T7.0 size=1048576 2024-09-22T08:48:46.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.116+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~D66Z0U6AU7T7.1 size=195375 2024-09-22T08:48:46.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.118+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=D66Z0U6AU7T7 tag=OIMY01QJOYF3 type=write size=2292527 2024-09-22T08:48:46.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.120+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~LFTQ9EBVOJX2.0 size=444091 2024-09-22T08:48:46.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.120+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=LFTQ9EBVOJX2 tag=VDZWAU2OBR6R type=write size=1492667 2024-09-22T08:48:46.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.122+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~7O30N82FHW50.0 size=595274 2024-09-22T08:48:46.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.124+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=7O30N82FHW50 tag=308YYF47AQ07 type=write size=1643850 2024-09-22T08:48:46.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.126+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~2FC94Z9F504Y.0 size=145589 2024-09-22T08:48:46.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.126+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=2FC94Z9F504Y tag=VN5UXL9YVFG5 type=write size=1194165 2024-09-22T08:48:46.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.128+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~32360SWR85N9.0 size=1048576 2024-09-22T08:48:46.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.129+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~32360SWR85N9.1 size=206505 2024-09-22T08:48:46.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.131+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=32360SWR85N9 tag=20GLE0NJ3UWC type=write size=2303657 2024-09-22T08:48:46.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.132+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=MJDU1OC4RN0N type=write size=659385 2024-09-22T08:48:46.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.134+0000 7f7b8ef90780 1 < canceled operation key=Z9CHXCJ02L85 tag=0PCK4BBFRSJV type=del size=821022 2024-09-22T08:48:46.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.136+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.0 size=1048576 2024-09-22T08:48:46.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.137+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.1 size=1048576 2024-09-22T08:48:46.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.139+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.2 size=656829 2024-09-22T08:48:46.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.140+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=S39QP1EN5PCX tag=PRKP1CZQZ9M6 type=write size=3802557 2024-09-22T08:48:46.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.141+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~31GMJTRKPANP.0 size=1048576 2024-09-22T08:48:46.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.142+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~31GMJTRKPANP.1 size=278090 2024-09-22T08:48:46.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.144+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=31GMJTRKPANP tag=3RQOVN604LGN type=write size=2375242 2024-09-22T08:48:46.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.146+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~WTSWB6D35P4E.0 size=1048576 2024-09-22T08:48:46.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.147+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~WTSWB6D35P4E.1 size=463953 2024-09-22T08:48:46.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.147+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=WTSWB6D35P4E tag=BPOQ3DM3DYQS type=write size=2561105 2024-09-22T08:48:46.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.149+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=QTUXJ18C7IJ0 type=del 2024-09-22T08:48:46.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.150+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=MZ65C1KUVFW7 type=del size=1917196 2024-09-22T08:48:46.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.151+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~815108BAT0IS.0 size=1048576 2024-09-22T08:48:46.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.152+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~815108BAT0IS.1 size=808230 2024-09-22T08:48:46.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.154+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=815108BAT0IS tag=LPDQCALNITI4 type=write size=2905382 2024-09-22T08:48:46.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.157+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~7KK12ESUOZ0G.0 size=85109 2024-09-22T08:48:46.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.157+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=7KK12ESUOZ0G tag=SRIB7XXHO8FV type=write size=1133685 2024-09-22T08:48:46.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.158+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=U30A71EOBE9I type=del 2024-09-22T08:48:46.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.159+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=BR4QIW2MA7YM type=del size=2406833 2024-09-22T08:48:46.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.161+0000 7f7b8ef90780 1 < completed write operation key=WDGY8YL16UWI tag=3MFG80BSOPTR type=write size=237794 2024-09-22T08:48:46.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.162+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=EP60Y7XTIQU6 type=del size=710383 2024-09-22T08:48:46.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.162+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.0 size=1048576 2024-09-22T08:48:46.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.163+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.1 size=1048576 2024-09-22T08:48:46.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.164+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~R170J2O7K08B.2 size=259475 2024-09-22T08:48:46.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.166+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=R170J2O7K08B tag=JN1V78KKIYK6 type=write size=3405203 2024-09-22T08:48:46.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.168+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=3WMFS0FH0GKG type=del size=1131031 2024-09-22T08:48:46.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.169+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=QLH2K925QKIT type=del 2024-09-22T08:48:46.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.170+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=W64SCLE9XDIY type=del size=225737 2024-09-22T08:48:46.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.172+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=2N2QA3EQXH6W type=del 2024-09-22T08:48:46.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.173+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=NOHX61N125IO type=del size=1584243 2024-09-22T08:48:46.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.174+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~5D3YUZYMVW0V.0 size=863074 2024-09-22T08:48:46.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.176+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=5D3YUZYMVW0V tag=F09DGUC91AFP type=write size=1911650 2024-09-22T08:48:46.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.178+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=1HUW51LHDQYT type=del size=1698908 2024-09-22T08:48:46.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.179+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=VJ8Q0TSZNL2E type=del 2024-09-22T08:48:46.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.182+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~PF7YXCBB0GS8.0 size=1048576 2024-09-22T08:48:46.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.183+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~PF7YXCBB0GS8.1 size=970319 2024-09-22T08:48:46.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.183+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=PF7YXCBB0GS8 tag=A9EXDHWYXHRP type=write size=3067471 2024-09-22T08:48:46.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.185+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=N22PWTUNJ3FZ type=del 2024-09-22T08:48:46.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.186+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=Y37Y8WB8PVS7 type=del size=2163083 2024-09-22T08:48:46.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.187+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=HP0VM00S3H5B type=del 2024-09-22T08:48:46.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.189+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=ZFIQ6R0J9XTE type=del size=438270 2024-09-22T08:48:46.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.190+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~LFTQ9EBVOJX2.0 size=444091 2024-09-22T08:48:46.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.192+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=LFTQ9EBVOJX2 tag=VDZWAU2OBR6R type=write size=1492667 2024-09-22T08:48:46.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.194+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~M627CR3BCSJT.0 size=741863 2024-09-22T08:48:46.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.194+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=M627CR3BCSJT tag=MW661DAYRW7U type=write size=1790439 2024-09-22T08:48:46.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.195+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~2FC94Z9F504Y.0 size=145589 2024-09-22T08:48:46.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.197+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=2FC94Z9F504Y tag=VN5UXL9YVFG5 type=write size=1194165 2024-09-22T08:48:46.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.200+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.0 size=1048576 2024-09-22T08:48:46.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.201+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.1 size=1048576 2024-09-22T08:48:46.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.201+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.2 size=212408 2024-09-22T08:48:46.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.202+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=E6JDLMD7495A tag=TK9EYC3D96LN type=write size=3358136 2024-09-22T08:48:46.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.204+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=MJDU1OC4RN0N type=write size=659385 2024-09-22T08:48:46.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.206+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.0 size=1048576 2024-09-22T08:48:46.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.207+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.1 size=1048576 2024-09-22T08:48:46.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.208+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.2 size=459475 2024-09-22T08:48:46.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.208+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=S9FG57TQB4HQ tag=NT4PY9UZV6AL type=write size=3605203 2024-09-22T08:48:46.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.210+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.0 size=1048576 2024-09-22T08:48:46.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.211+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.1 size=1048576 2024-09-22T08:48:46.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.212+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~S39QP1EN5PCX.2 size=656829 2024-09-22T08:48:46.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.214+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=S39QP1EN5PCX tag=PRKP1CZQZ9M6 type=write size=3802557 2024-09-22T08:48:46.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.216+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~5BPWVZYJFE9R.0 size=1048576 2024-09-22T08:48:46.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.217+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~5BPWVZYJFE9R.1 size=126871 2024-09-22T08:48:46.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.217+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=5BPWVZYJFE9R tag=8T7DDJVTCYZE type=write size=2224023 2024-09-22T08:48:46.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.218+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~WTSWB6D35P4E.0 size=1048576 2024-09-22T08:48:46.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.220+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~WTSWB6D35P4E.1 size=463953 2024-09-22T08:48:46.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.222+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=WTSWB6D35P4E tag=BPOQ3DM3DYQS type=write size=2561105 2024-09-22T08:48:46.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.224+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~V2HSBCHJXNN6.0 size=1048576 2024-09-22T08:48:46.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.225+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~V2HSBCHJXNN6.1 size=798570 2024-09-22T08:48:46.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.225+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=V2HSBCHJXNN6 tag=S601PKYP2UMH type=write size=2895722 2024-09-22T08:48:46.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.226+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=MZ65C1KUVFW7 type=del 2024-09-22T08:48:46.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.227+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=5ZNAR5CVVXGT type=del size=2339146 2024-09-22T08:48:46.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.229+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~7KK12ESUOZ0G.0 size=85109 2024-09-22T08:48:46.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.231+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=7KK12ESUOZ0G tag=SRIB7XXHO8FV type=write size=1133685 2024-09-22T08:48:46.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.232+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=WAHV8LKX3IH7 type=del size=1235085 2024-09-22T08:48:46.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.233+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=BR4QIW2MA7YM type=del 2024-09-22T08:48:46.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.234+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=123EJPWZ7LKG type=del size=1593953 2024-09-22T08:48:46.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.236+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=EP60Y7XTIQU6 type=del 2024-09-22T08:48:46.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.238+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~W7X3PSTQE0OX.0 size=12222 2024-09-22T08:48:46.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.238+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=W7X3PSTQE0OX tag=C3WYBESF5SFK type=write size=1060798 2024-09-22T08:48:46.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.239+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=3WMFS0FH0GKG type=del 2024-09-22T08:48:46.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.241+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=TVDKK47GBMVH type=del size=1498067 2024-09-22T08:48:46.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.244+0000 7f7b8ef90780 1 < suggested update operation key=4J4EGI19N123 tag=W64SCLE9XDIY type=del size=225737 2024-09-22T08:48:46.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.245+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=32EPB8TG0MHY type=write size=121924 2024-09-22T08:48:46.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.247+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=NOHX61N125IO type=del 2024-09-22T08:48:46.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.248+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=Y46E4ED33Z5Q type=del size=2035494 2024-09-22T08:48:46.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.249+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=1HUW51LHDQYT type=del 2024-09-22T08:48:46.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.250+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=YA58W8U3KIFG type=del size=628761 2024-09-22T08:48:46.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.252+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~PF7YXCBB0GS8.0 size=1048576 2024-09-22T08:48:46.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.253+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~PF7YXCBB0GS8.1 size=970319 2024-09-22T08:48:46.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.255+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=PF7YXCBB0GS8 tag=A9EXDHWYXHRP type=write size=3067471 2024-09-22T08:48:46.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.257+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.0 size=1048576 2024-09-22T08:48:46.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.259+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.1 size=1048576 2024-09-22T08:48:46.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.260+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.2 size=663380 2024-09-22T08:48:46.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.260+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=OQ035MF4BE23 tag=D2HD6X5BE4O2 type=write size=3809108 2024-09-22T08:48:46.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.261+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=Y37Y8WB8PVS7 type=del 2024-09-22T08:48:46.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.262+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=PKDIDD8S9GII type=write size=962085 2024-09-22T08:48:46.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.263+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=ZFIQ6R0J9XTE type=del 2024-09-22T08:48:46.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.266+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.0 size=1048576 2024-09-22T08:48:46.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.267+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.1 size=1048576 2024-09-22T08:48:46.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.268+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.2 size=55728 2024-09-22T08:48:46.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.268+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=Y6CTG56UKFD0 tag=WY4PX5JKTVUE type=write size=3201456 2024-09-22T08:48:46.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.269+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~M627CR3BCSJT.0 size=741863 2024-09-22T08:48:46.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.271+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=M627CR3BCSJT tag=MW661DAYRW7U type=write size=1790439 2024-09-22T08:48:46.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.273+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.0 size=1048576 2024-09-22T08:48:46.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.274+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.1 size=1048576 2024-09-22T08:48:46.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.275+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.2 size=442433 2024-09-22T08:48:46.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.275+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=YAY2KRYS93ZW tag=SAE49BXWJYIB type=write size=3588161 2024-09-22T08:48:46.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.276+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.0 size=1048576 2024-09-22T08:48:46.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.277+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.1 size=1048576 2024-09-22T08:48:46.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.278+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~E6JDLMD7495A.2 size=212408 2024-09-22T08:48:46.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.280+0000 7f7b8ef90780 1 < canceled multipart upload key=4J4EGI19N123 upload=E6JDLMD7495A tag=TK9EYC3D96LN type=write size=3358136 2024-09-22T08:48:46.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.282+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~1JXVI3UEG3N1.0 size=1048576 2024-09-22T08:48:46.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.283+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~1JXVI3UEG3N1.1 size=640198 2024-09-22T08:48:46.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.283+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=1JXVI3UEG3N1 tag=WOMEZZSUDW48 type=write size=2737350 2024-09-22T08:48:46.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.284+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.0 size=1048576 2024-09-22T08:48:46.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.285+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.1 size=1048576 2024-09-22T08:48:46.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.286+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~S9FG57TQB4HQ.2 size=459475 2024-09-22T08:48:46.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.288+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=S9FG57TQB4HQ tag=NT4PY9UZV6AL type=write size=3605203 2024-09-22T08:48:46.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.290+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=ZFB11818JUK9 type=del size=531233 2024-09-22T08:48:46.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.291+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~5BPWVZYJFE9R.0 size=1048576 2024-09-22T08:48:46.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.292+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~5BPWVZYJFE9R.1 size=126871 2024-09-22T08:48:46.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.294+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=5BPWVZYJFE9R tag=8T7DDJVTCYZE type=write size=2224023 2024-09-22T08:48:46.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.295+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=X8CGCN5IK2S0 type=del size=3277937 2024-09-22T08:48:46.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.296+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~V2HSBCHJXNN6.0 size=1048576 2024-09-22T08:48:46.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.297+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~V2HSBCHJXNN6.1 size=798570 2024-09-22T08:48:46.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.299+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=V2HSBCHJXNN6 tag=S601PKYP2UMH type=write size=2895722 2024-09-22T08:48:46.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.300+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=BICT8G88JZI1 type=del size=1945359 2024-09-22T08:48:46.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.302+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=5ZNAR5CVVXGT type=del size=2339146 2024-09-22T08:48:46.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.304+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~25011EMUIV3H.0 size=121853 2024-09-22T08:48:46.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.304+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=25011EMUIV3H tag=O97746R0MDCZ type=write size=1170429 2024-09-22T08:48:46.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.305+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=WAHV8LKX3IH7 type=del 2024-09-22T08:48:46.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.306+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=H27O1VMA1495 type=del size=439740 2024-09-22T08:48:46.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.307+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=123EJPWZ7LKG type=del 2024-09-22T08:48:46.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.309+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=8QB43Y58P93J type=del size=2170107 2024-09-22T08:48:46.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.310+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~W7X3PSTQE0OX.0 size=12222 2024-09-22T08:48:46.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.312+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=W7X3PSTQE0OX tag=C3WYBESF5SFK type=write size=1060798 2024-09-22T08:48:46.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.313+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=5YOIY23DL0BP type=del size=2654491 2024-09-22T08:48:46.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.314+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=TVDKK47GBMVH type=del size=1498067 2024-09-22T08:48:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.316+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.0 size=1048576 2024-09-22T08:48:46.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.317+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.1 size=1048576 2024-09-22T08:48:46.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.318+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.2 size=771833 2024-09-22T08:48:46.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.318+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=1WQYBA5W98OE tag=EZZTTEE2NT6Q type=write size=3917561 2024-09-22T08:48:46.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.319+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=32EPB8TG0MHY type=write size=121924 2024-09-22T08:48:46.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.321+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=R3KVOKDTA7P8 type=del size=2072288 2024-09-22T08:48:46.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.322+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=Y46E4ED33Z5Q type=del 2024-09-22T08:48:46.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.324+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~PK0M1OIXCYC0.0 size=1048576 2024-09-22T08:48:46.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.325+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~PK0M1OIXCYC0.1 size=1042531 2024-09-22T08:48:46.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.325+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=PK0M1OIXCYC0 tag=7G6LS7MU8R4W type=write size=3139683 2024-09-22T08:48:46.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.326+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=YA58W8U3KIFG type=del 2024-09-22T08:48:46.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.327+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=PBRGIV8QJ63S type=del size=633442 2024-09-22T08:48:46.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.329+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.0 size=1048576 2024-09-22T08:48:46.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.330+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.1 size=1048576 2024-09-22T08:48:46.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.331+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OQ035MF4BE23.2 size=663380 2024-09-22T08:48:46.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.333+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=OQ035MF4BE23 tag=D2HD6X5BE4O2 type=write size=3809108 2024-09-22T08:48:46.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.334+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=I0YOJDWFL41Y type=del size=3996871 2024-09-22T08:48:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.335+0000 7f7b8ef90780 1 < completed write operation key=1U6T2BIZS72V tag=PKDIDD8S9GII type=write size=962085 2024-09-22T08:48:46.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.336+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=6BLNK87OKQ3U type=del size=1417429 2024-09-22T08:48:46.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.337+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.0 size=1048576 2024-09-22T08:48:46.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.338+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.1 size=1048576 2024-09-22T08:48:46.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.339+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y6CTG56UKFD0.2 size=55728 2024-09-22T08:48:46.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.342+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=Y6CTG56UKFD0 tag=WY4PX5JKTVUE type=write size=3201456 2024-09-22T08:48:46.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.344+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.0 size=1048576 2024-09-22T08:48:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.345+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.1 size=1048576 2024-09-22T08:48:46.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.346+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.2 size=265953 2024-09-22T08:48:46.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.346+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=GLBX1V3ET21Q tag=R00P1NT100P8 type=write size=3411681 2024-09-22T08:48:46.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.348+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.0 size=1048576 2024-09-22T08:48:46.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.349+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.1 size=1048576 2024-09-22T08:48:46.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.350+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~YAY2KRYS93ZW.2 size=442433 2024-09-22T08:48:46.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.352+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=YAY2KRYS93ZW tag=SAE49BXWJYIB type=write size=3588161 2024-09-22T08:48:46.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.353+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=XC5YYCXFNZA5 type=write size=165374 2024-09-22T08:48:46.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.355+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~1JXVI3UEG3N1.0 size=1048576 2024-09-22T08:48:46.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.355+0000 7f7b8ef90780 1 < canceled part key=_multipart_YDJLMBL7EQWN.2~1JXVI3UEG3N1.1 size=640198 2024-09-22T08:48:46.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.357+0000 7f7b8ef90780 1 < canceled multipart upload key=YDJLMBL7EQWN upload=1JXVI3UEG3N1 tag=WOMEZZSUDW48 type=write size=2737350 2024-09-22T08:48:46.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.358+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=932QN2V3EJ8C type=del size=2676074 2024-09-22T08:48:46.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.359+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=ZFB11818JUK9 type=del 2024-09-22T08:48:46.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.362+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~HI6XG60F2E0N.0 size=1048576 2024-09-22T08:48:46.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.363+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~HI6XG60F2E0N.1 size=609305 2024-09-22T08:48:46.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.363+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=HI6XG60F2E0N tag=8Q2728I7QMX2 type=write size=2706457 2024-09-22T08:48:46.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.364+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=X8CGCN5IK2S0 type=del 2024-09-22T08:48:46.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.365+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=SL5YI1AP8PD5 type=del size=4001052 2024-09-22T08:48:46.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.367+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=BICT8G88JZI1 type=del 2024-09-22T08:48:46.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.368+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=IKBCZK7EWT2Q type=del size=1761829 2024-09-22T08:48:46.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.368+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~25011EMUIV3H.0 size=121853 2024-09-22T08:48:46.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.371+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=25011EMUIV3H tag=O97746R0MDCZ type=write size=1170429 2024-09-22T08:48:46.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.374+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=6CWKT6YO7IPT type=del size=1989754 2024-09-22T08:48:46.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.376+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=H27O1VMA1495 type=del 2024-09-22T08:48:46.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.378+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.0 size=1048576 2024-09-22T08:48:46.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.379+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.1 size=1048576 2024-09-22T08:48:46.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.380+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.2 size=798033 2024-09-22T08:48:46.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.380+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=EXP4NVE05ZTZ tag=XJNQ9C0DAR3A type=write size=3943761 2024-09-22T08:48:46.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.383+0000 7f7b8ef90780 1 < suggested update operation key=T43DW9JPG1BU tag=8QB43Y58P93J type=del size=2170107 2024-09-22T08:48:46.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.384+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=5IKKJVDIK53D type=del size=3068703 2024-09-22T08:48:46.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.386+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=5YOIY23DL0BP type=del 2024-09-22T08:48:46.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.387+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=7WYFBTS3V6BS type=del size=1603683 2024-09-22T08:48:46.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.388+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.0 size=1048576 2024-09-22T08:48:46.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.389+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.1 size=1048576 2024-09-22T08:48:46.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.389+0000 7f7b8ef90780 1 < canceled part key=_multipart_UQPY2ITDMKGO.2~1WQYBA5W98OE.2 size=771833 2024-09-22T08:48:46.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.392+0000 7f7b8ef90780 1 < canceled multipart upload key=UQPY2ITDMKGO upload=1WQYBA5W98OE tag=EZZTTEE2NT6Q type=write size=3917561 2024-09-22T08:48:46.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.394+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~LOGTITI24JYO.0 size=1043354 2024-09-22T08:48:46.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.394+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=LOGTITI24JYO tag=8MKXCED069CB type=write size=2091930 2024-09-22T08:48:46.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.396+0000 7f7b8ef90780 1 < suggested remove operation key=L3XF68XD23FP tag=R3KVOKDTA7P8 type=del 2024-09-22T08:48:46.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.398+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=RQGMQ9ONV9DZ type=del size=3261747 2024-09-22T08:48:46.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.399+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~PK0M1OIXCYC0.0 size=1048576 2024-09-22T08:48:46.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.399+0000 7f7b8ef90780 1 < canceled part key=_multipart_F3IHQ6Z9V1DX.2~PK0M1OIXCYC0.1 size=1042531 2024-09-22T08:48:46.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.402+0000 7f7b8ef90780 1 < canceled multipart upload key=F3IHQ6Z9V1DX upload=PK0M1OIXCYC0 tag=7G6LS7MU8R4W type=write size=3139683 2024-09-22T08:48:46.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.403+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=9WRLGB6YHXRD type=del size=3589561 2024-09-22T08:48:46.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.405+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=PBRGIV8QJ63S type=del 2024-09-22T08:48:46.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.406+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=W4PUJJ3Q8UEU type=del size=2055883 2024-09-22T08:48:46.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.408+0000 7f7b8ef90780 1 < canceled operation key=4J4EGI19N123 tag=I0YOJDWFL41Y type=del size=3996871 2024-09-22T08:48:46.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.410+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~P9YP87GE0YL0.0 size=1048576 2024-09-22T08:48:46.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.411+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~P9YP87GE0YL0.1 size=777563 2024-09-22T08:48:46.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.411+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=P9YP87GE0YL0 tag=JLB5GHU39I4T type=write size=2874715 2024-09-22T08:48:46.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.412+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=6BLNK87OKQ3U type=del 2024-09-22T08:48:46.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.414+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=6KXLCZMB9PF0 type=write size=947568 2024-09-22T08:48:46.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.415+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.0 size=1048576 2024-09-22T08:48:46.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.416+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.1 size=1048576 2024-09-22T08:48:46.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.417+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~GLBX1V3ET21Q.2 size=265953 2024-09-22T08:48:46.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.419+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=GLBX1V3ET21Q tag=R00P1NT100P8 type=write size=3411681 2024-09-22T08:48:46.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.420+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=29O04I3V0KTR type=del size=3012677 2024-09-22T08:48:46.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.422+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=XC5YYCXFNZA5 type=write size=165374 2024-09-22T08:48:46.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.423+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=7OX7NPRZ8T2H type=del size=1182485 2024-09-22T08:48:46.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.424+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=932QN2V3EJ8C type=del size=2676074 2024-09-22T08:48:46.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.426+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=9NJC0TGNVA99 type=del size=3643027 2024-09-22T08:48:46.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.427+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~HI6XG60F2E0N.0 size=1048576 2024-09-22T08:48:46.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.427+0000 7f7b8ef90780 1 < canceled part key=_multipart_R0N30XP1BXY3.2~HI6XG60F2E0N.1 size=609305 2024-09-22T08:48:46.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.429+0000 7f7b8ef90780 1 < canceled multipart upload key=R0N30XP1BXY3 upload=HI6XG60F2E0N tag=8Q2728I7QMX2 type=write size=2706457 2024-09-22T08:48:46.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.430+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=8FDI5VK942TB type=del size=2812442 2024-09-22T08:48:46.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.432+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=SL5YI1AP8PD5 type=del 2024-09-22T08:48:46.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.433+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=EZN4P5LTMN7S type=del size=320311 2024-09-22T08:48:46.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.434+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=IKBCZK7EWT2Q type=del size=1761829 2024-09-22T08:48:46.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.436+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=BT1LZ6LIVN29 type=del size=1812233 2024-09-22T08:48:46.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.437+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=6CWKT6YO7IPT type=del 2024-09-22T08:48:46.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.438+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=7NSABSROQHTE type=del size=1110104 2024-09-22T08:48:46.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.439+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.0 size=1048576 2024-09-22T08:48:46.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.440+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.1 size=1048576 2024-09-22T08:48:46.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.442+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~EXP4NVE05ZTZ.2 size=798033 2024-09-22T08:48:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.444+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=EXP4NVE05ZTZ tag=XJNQ9C0DAR3A type=write size=3943761 2024-09-22T08:48:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.446+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~LR5NAN90Q8ZA.0 size=1048576 2024-09-22T08:48:46.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.447+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~LR5NAN90Q8ZA.1 size=577065 2024-09-22T08:48:46.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.447+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=LR5NAN90Q8ZA tag=BSITQXUV2J0Q type=write size=2674217 2024-09-22T08:48:46.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.448+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=5IKKJVDIK53D type=del 2024-09-22T08:48:46.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.450+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=WWF2133KMW0U type=del size=503718 2024-09-22T08:48:46.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.451+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=7WYFBTS3V6BS type=del 2024-09-22T08:48:46.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.454+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~MCDA36653VFY.0 size=1048576 2024-09-22T08:48:46.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.455+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~MCDA36653VFY.1 size=936496 2024-09-22T08:48:46.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.455+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=MCDA36653VFY tag=X9KRN08D8LW9 type=write size=3033648 2024-09-22T08:48:46.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.456+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~LOGTITI24JYO.0 size=1043354 2024-09-22T08:48:46.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.458+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=LOGTITI24JYO tag=8MKXCED069CB type=write size=2091930 2024-09-22T08:48:46.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.460+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~WFNINSHQI3HV.0 size=361633 2024-09-22T08:48:46.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.460+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=WFNINSHQI3HV tag=YXFWQE7PBCLG type=write size=1410209 2024-09-22T08:48:46.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.462+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=RQGMQ9ONV9DZ type=del 2024-09-22T08:48:46.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.464+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.0 size=1048576 2024-09-22T08:48:46.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.465+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.1 size=1048576 2024-09-22T08:48:46.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.466+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.2 size=245230 2024-09-22T08:48:46.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.466+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=LS8449SN7KYF tag=87SNLPH987UK type=write size=3390958 2024-09-22T08:48:46.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.467+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=9WRLGB6YHXRD type=del 2024-09-22T08:48:46.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.469+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=8FVPIHF32ZAM type=write size=494437 2024-09-22T08:48:46.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.470+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=W4PUJJ3Q8UEU type=del 2024-09-22T08:48:46.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.471+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=RAAT224E6QHH type=write size=406260 2024-09-22T08:48:46.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.472+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~P9YP87GE0YL0.0 size=1048576 2024-09-22T08:48:46.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.473+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~P9YP87GE0YL0.1 size=777563 2024-09-22T08:48:46.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.476+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=P9YP87GE0YL0 tag=JLB5GHU39I4T type=write size=2874715 2024-09-22T08:48:46.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.478+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~SF67B3SAW907.0 size=1048576 2024-09-22T08:48:46.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.479+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~SF67B3SAW907.1 size=461912 2024-09-22T08:48:46.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.479+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=SF67B3SAW907 tag=WHXU2K6UQWCT type=write size=2559064 2024-09-22T08:48:46.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.480+0000 7f7b8ef90780 1 < completed write operation key=VAO9MXRFGXFY tag=6KXLCZMB9PF0 type=write size=947568 2024-09-22T08:48:46.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.483+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~ZFJ87YYYQTOU.0 size=119032 2024-09-22T08:48:46.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.483+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=ZFJ87YYYQTOU tag=Z7OH7077YACH type=write size=1167608 2024-09-22T08:48:46.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.484+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=29O04I3V0KTR type=del 2024-09-22T08:48:46.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.485+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=UVLZ41ZXNXRW type=del size=884118 2024-09-22T08:48:46.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.487+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=7OX7NPRZ8T2H type=del 2024-09-22T08:48:46.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.489+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.0 size=1048576 2024-09-22T08:48:46.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.490+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.1 size=1048576 2024-09-22T08:48:46.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.492+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.2 size=351136 2024-09-22T08:48:46.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.492+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=CR0NVJK1Z50J tag=7Y1USBGFENM9 type=write size=3496864 2024-09-22T08:48:46.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.493+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=9NJC0TGNVA99 type=del 2024-09-22T08:48:46.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.494+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=E2GIHYVC1SCM type=del size=894246 2024-09-22T08:48:46.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.496+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=8FDI5VK942TB type=del 2024-09-22T08:48:46.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.499+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=VQPEVAVGVXYG type=del size=267764 2024-09-22T08:48:46.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.500+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=EZN4P5LTMN7S type=del 2024-09-22T08:48:46.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.503+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.0 size=1048576 2024-09-22T08:48:46.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.504+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.1 size=1048576 2024-09-22T08:48:46.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.505+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.2 size=297439 2024-09-22T08:48:46.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.505+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=UVEAC5DQJI7D tag=ODTAN57ES5BJ type=write size=3443167 2024-09-22T08:48:46.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.507+0000 7f7b8ef90780 1 < suggested update operation key=4J4EGI19N123 tag=BT1LZ6LIVN29 type=del size=1812233 2024-09-22T08:48:46.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.510+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.0 size=1048576 2024-09-22T08:48:46.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.511+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.1 size=1048576 2024-09-22T08:48:46.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.512+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.2 size=841427 2024-09-22T08:48:46.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.512+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=MPPA13OBT2K3 tag=V9F6WREVLR5I type=write size=3987155 2024-09-22T08:48:46.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.514+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=7NSABSROQHTE type=del 2024-09-22T08:48:46.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.515+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=XJP4JX56X9Q3 type=del size=526269 2024-09-22T08:48:46.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.516+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~LR5NAN90Q8ZA.0 size=1048576 2024-09-22T08:48:46.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.518+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~LR5NAN90Q8ZA.1 size=577065 2024-09-22T08:48:46.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.520+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=LR5NAN90Q8ZA tag=BSITQXUV2J0Q type=write size=2674217 2024-09-22T08:48:46.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.522+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.0 size=1048576 2024-09-22T08:48:46.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.523+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.1 size=1048576 2024-09-22T08:48:46.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.524+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.2 size=399662 2024-09-22T08:48:46.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.524+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=1VWISAYXIM89 tag=SFBYT7LP4H31 type=write size=3545390 2024-09-22T08:48:46.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.526+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=WWF2133KMW0U type=del 2024-09-22T08:48:46.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.527+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=CCZCRL4RHC1H type=del size=3760569 2024-09-22T08:48:46.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.528+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~MCDA36653VFY.0 size=1048576 2024-09-22T08:48:46.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.529+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~MCDA36653VFY.1 size=936496 2024-09-22T08:48:46.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.531+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=MCDA36653VFY tag=X9KRN08D8LW9 type=write size=3033648 2024-09-22T08:48:46.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.532+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=JNBWMIXKH0S8 type=del size=1122502 2024-09-22T08:48:46.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.533+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~WFNINSHQI3HV.0 size=361633 2024-09-22T08:48:46.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.536+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=WFNINSHQI3HV tag=YXFWQE7PBCLG type=write size=1410209 2024-09-22T08:48:46.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.538+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~1MDYUF5II51Z.0 size=890168 2024-09-22T08:48:46.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.538+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=1MDYUF5II51Z tag=TJYEF6BX2W9X type=write size=1938744 2024-09-22T08:48:46.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.539+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.0 size=1048576 2024-09-22T08:48:46.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.540+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.1 size=1048576 2024-09-22T08:48:46.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.542+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~LS8449SN7KYF.2 size=245230 2024-09-22T08:48:46.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.544+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=LS8449SN7KYF tag=87SNLPH987UK type=write size=3390958 2024-09-22T08:48:46.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.545+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=3TJS6Q2TT1OR type=del size=1214991 2024-09-22T08:48:46.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.546+0000 7f7b8ef90780 1 < canceled operation key=1U6T2BIZS72V tag=8FVPIHF32ZAM type=write size=494437 2024-09-22T08:48:46.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.548+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=W7TGPOBY9VSB type=del size=903193 2024-09-22T08:48:46.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.551+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=RAAT224E6QHH type=write size=406260 2024-09-22T08:48:46.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.553+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~MWP3V1MYSMBE.0 size=563936 2024-09-22T08:48:46.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.553+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=MWP3V1MYSMBE tag=X2ARU8J55F5R type=write size=1612512 2024-09-22T08:48:46.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.555+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~SF67B3SAW907.0 size=1048576 2024-09-22T08:48:46.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.556+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~SF67B3SAW907.1 size=461912 2024-09-22T08:48:46.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.558+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=SF67B3SAW907 tag=WHXU2K6UQWCT type=write size=2559064 2024-09-22T08:48:46.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.561+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~2V8BQR2RUA9H.0 size=409182 2024-09-22T08:48:46.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.561+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=2V8BQR2RUA9H tag=XBOJW7C70B08 type=write size=1457758 2024-09-22T08:48:46.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.562+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~ZFJ87YYYQTOU.0 size=119032 2024-09-22T08:48:46.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.564+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=ZFJ87YYYQTOU tag=Z7OH7077YACH type=write size=1167608 2024-09-22T08:48:46.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.565+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=KPL6SSQT3LED type=del size=1815410 2024-09-22T08:48:46.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.567+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=UVLZ41ZXNXRW type=del 2024-09-22T08:48:46.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.569+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.0 size=1048576 2024-09-22T08:48:46.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.570+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.1 size=1048576 2024-09-22T08:48:46.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.571+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.2 size=24081 2024-09-22T08:48:46.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.571+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=QU14XP7A217F tag=O2S8GWX1EL4M type=write size=3169809 2024-09-22T08:48:46.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.572+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.0 size=1048576 2024-09-22T08:48:46.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.572+0000 7f7b8ef90780 1 < canceled part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.1 size=1048576 2024-09-22T08:48:46.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.573+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~CR0NVJK1Z50J.2 size=351136 2024-09-22T08:48:46.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.575+0000 7f7b8ef90780 1 < canceled multipart upload key=IRFUEK82X28U upload=CR0NVJK1Z50J tag=7Y1USBGFENM9 type=write size=3496864 2024-09-22T08:48:46.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.577+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=3FB4FQWUVJ2Q type=del size=761529 2024-09-22T08:48:46.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.578+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=E2GIHYVC1SCM type=del 2024-09-22T08:48:46.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.579+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=XL5VEN5GYGLK type=del size=577777 2024-09-22T08:48:46.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.581+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=VQPEVAVGVXYG type=del 2024-09-22T08:48:46.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.582+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=5IO3PFGAZL6R type=del size=3256513 2024-09-22T08:48:46.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.583+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.0 size=1048576 2024-09-22T08:48:46.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.584+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.1 size=1048576 2024-09-22T08:48:46.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.584+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~UVEAC5DQJI7D.2 size=297439 2024-09-22T08:48:46.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.586+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=UVEAC5DQJI7D tag=ODTAN57ES5BJ type=write size=3443167 2024-09-22T08:48:46.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.589+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~4JZPW3K6CFRG.0 size=897641 2024-09-22T08:48:46.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.589+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=4JZPW3K6CFRG tag=GQCXHJFERIF3 type=write size=1946217 2024-09-22T08:48:46.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.590+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.0 size=1048576 2024-09-22T08:48:46.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.591+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.1 size=1048576 2024-09-22T08:48:46.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.592+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~MPPA13OBT2K3.2 size=841427 2024-09-22T08:48:46.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.594+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=MPPA13OBT2K3 tag=V9F6WREVLR5I type=write size=3987155 2024-09-22T08:48:46.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.596+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=ZKSY156DVTQY type=del size=2372031 2024-09-22T08:48:46.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.597+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=XJP4JX56X9Q3 type=del 2024-09-22T08:48:46.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.600+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~R92XZE0TVLMS.0 size=465319 2024-09-22T08:48:46.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.600+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=R92XZE0TVLMS tag=HMPGENQVCHVL type=write size=1513895 2024-09-22T08:48:46.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.601+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.0 size=1048576 2024-09-22T08:48:46.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.602+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.1 size=1048576 2024-09-22T08:48:46.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.602+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~1VWISAYXIM89.2 size=399662 2024-09-22T08:48:46.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.604+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=1VWISAYXIM89 tag=SFBYT7LP4H31 type=write size=3545390 2024-09-22T08:48:46.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.607+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.0 size=1048576 2024-09-22T08:48:46.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.608+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.1 size=1048576 2024-09-22T08:48:46.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.609+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.2 size=675224 2024-09-22T08:48:46.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.609+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=RITEG7OW8TRV tag=P3R6HII78BUO type=write size=3820952 2024-09-22T08:48:46.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.610+0000 7f7b8ef90780 1 < canceled operation key=1U6T2BIZS72V tag=CCZCRL4RHC1H type=del size=3760569 2024-09-22T08:48:46.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.612+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=QZE0T83567PM type=del size=728451 2024-09-22T08:48:46.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.614+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=JNBWMIXKH0S8 type=del 2024-09-22T08:48:46.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.616+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=BZG4BMQ6MN1I type=write size=768519 2024-09-22T08:48:46.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.617+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~1MDYUF5II51Z.0 size=890168 2024-09-22T08:48:46.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.620+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=1MDYUF5II51Z tag=TJYEF6BX2W9X type=write size=1938744 2024-09-22T08:48:46.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.622+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=4014PI8EB1Y2 type=del size=2161031 2024-09-22T08:48:46.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.623+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=3TJS6Q2TT1OR type=del 2024-09-22T08:48:46.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.625+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=X1QM74HQ4183 type=write size=269299 2024-09-22T08:48:46.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.626+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=W7TGPOBY9VSB type=del 2024-09-22T08:48:46.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.627+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=OPEISAMZ2VXQ type=write size=654730 2024-09-22T08:48:46.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.629+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~MWP3V1MYSMBE.0 size=563936 2024-09-22T08:48:46.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.631+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=MWP3V1MYSMBE tag=X2ARU8J55F5R type=write size=1612512 2024-09-22T08:48:46.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.632+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=8OSXJH0JCBWD type=write size=41861 2024-09-22T08:48:46.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.634+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~2V8BQR2RUA9H.0 size=409182 2024-09-22T08:48:46.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.636+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=2V8BQR2RUA9H tag=XBOJW7C70B08 type=write size=1457758 2024-09-22T08:48:46.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.638+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~7R8K4K4OUZHU.0 size=1048576 2024-09-22T08:48:46.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.639+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~7R8K4K4OUZHU.1 size=911026 2024-09-22T08:48:46.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.639+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=7R8K4K4OUZHU tag=4PYBILH7Z133 type=write size=3008178 2024-09-22T08:48:46.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.640+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=KPL6SSQT3LED type=del 2024-09-22T08:48:46.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~OB0F5VG53U8A.0 size=1048576 2024-09-22T08:48:46.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.644+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~OB0F5VG53U8A.1 size=634305 2024-09-22T08:48:46.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.644+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=OB0F5VG53U8A tag=RKUYN8YEEJ9T type=write size=2731457 2024-09-22T08:48:46.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.645+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.0 size=1048576 2024-09-22T08:48:46.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.646+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.1 size=1048576 2024-09-22T08:48:46.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.646+0000 7f7b8ef90780 1 < canceled part key=_multipart_VAO9MXRFGXFY.2~QU14XP7A217F.2 size=24081 2024-09-22T08:48:46.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.649+0000 7f7b8ef90780 1 < canceled multipart upload key=VAO9MXRFGXFY upload=QU14XP7A217F tag=O2S8GWX1EL4M type=write size=3169809 2024-09-22T08:48:46.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.651+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.0 size=1048576 2024-09-22T08:48:46.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.652+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.1 size=1048576 2024-09-22T08:48:46.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.653+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.2 size=199070 2024-09-22T08:48:46.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.653+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=UL9VSID9IKGL tag=5VM99QJ194I3 type=write size=3344798 2024-09-22T08:48:46.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.654+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=3FB4FQWUVJ2Q type=del 2024-09-22T08:48:46.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.657+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~8ZIPDORPDDJ8.0 size=1048576 2024-09-22T08:48:46.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.658+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~8ZIPDORPDDJ8.1 size=1007734 2024-09-22T08:48:46.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.658+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=8ZIPDORPDDJ8 tag=PCYXQXX4QI7X type=write size=3104886 2024-09-22T08:48:46.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.660+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=XL5VEN5GYGLK type=del 2024-09-22T08:48:46.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.662+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~20V28S1N6MGY.0 size=579578 2024-09-22T08:48:46.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.662+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=20V28S1N6MGY tag=IS77NKZZ3X0H type=write size=1628154 2024-09-22T08:48:46.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.664+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=5IO3PFGAZL6R type=del 2024-09-22T08:48:46.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.666+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.0 size=1048576 2024-09-22T08:48:46.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.668+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.1 size=1048576 2024-09-22T08:48:46.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.669+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.2 size=699993 2024-09-22T08:48:46.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.669+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=KBZ0V3J0W8Z2 tag=BDRGWBL6JGE0 type=write size=3845721 2024-09-22T08:48:46.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.669+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~4JZPW3K6CFRG.0 size=897641 2024-09-22T08:48:46.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.671+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=4JZPW3K6CFRG tag=GQCXHJFERIF3 type=write size=1946217 2024-09-22T08:48:46.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.672+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=27EY8C7Z6DWR type=write size=529453 2024-09-22T08:48:46.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.673+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=ZKSY156DVTQY type=del 2024-09-22T08:48:46.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.675+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=2FSYQ8U67FJP type=write size=1032049 2024-09-22T08:48:46.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.676+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~R92XZE0TVLMS.0 size=465319 2024-09-22T08:48:46.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.678+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=R92XZE0TVLMS tag=HMPGENQVCHVL type=write size=1513895 2024-09-22T08:48:46.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.680+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~MFKPU2MHY058.0 size=998062 2024-09-22T08:48:46.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.680+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=MFKPU2MHY058 tag=JRT5IILIGFNS type=write size=2046638 2024-09-22T08:48:46.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.681+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.0 size=1048576 2024-09-22T08:48:46.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.682+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.1 size=1048576 2024-09-22T08:48:46.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.683+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~RITEG7OW8TRV.2 size=675224 2024-09-22T08:48:46.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.685+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=RITEG7OW8TRV tag=P3R6HII78BUO type=write size=3820952 2024-09-22T08:48:46.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.686+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=KH8UT1J8QXNN type=del size=3821807 2024-09-22T08:48:46.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.687+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=QZE0T83567PM type=del 2024-09-22T08:48:46.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.689+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=RMCKO70GJL6B type=del size=2507135 2024-09-22T08:48:46.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.690+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=BZG4BMQ6MN1I type=write size=768519 2024-09-22T08:48:46.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.691+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=MCAXSQ5VUVD0 type=write size=200539 2024-09-22T08:48:46.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.692+0000 7f7b8ef90780 1 < canceled operation key=YXIZJPACZZFY tag=4014PI8EB1Y2 type=del size=2161031 2024-09-22T08:48:46.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.694+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=CBXWE32WT9FQ type=del size=1603260 2024-09-22T08:48:46.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.695+0000 7f7b8ef90780 1 < completed write operation key=UQPY2ITDMKGO tag=X1QM74HQ4183 type=write size=269299 2024-09-22T08:48:46.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.697+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~A9RVP8AEXYW7.0 size=570892 2024-09-22T08:48:46.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.697+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=A9RVP8AEXYW7 tag=25LR5V6GIZP6 type=write size=1619468 2024-09-22T08:48:46.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.698+0000 7f7b8ef90780 1 < completed write operation key=4J4EGI19N123 tag=OPEISAMZ2VXQ type=write size=654730 2024-09-22T08:48:46.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.701+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~BYNG0P5GR9B1.0 size=928392 2024-09-22T08:48:46.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.701+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=BYNG0P5GR9B1 tag=W1K3K7ECSHDM type=write size=1976968 2024-09-22T08:48:46.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.702+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=8OSXJH0JCBWD type=write size=41861 2024-09-22T08:48:46.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.703+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=Y6WMIBRIUF54 type=del size=2747238 2024-09-22T08:48:46.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.704+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~7R8K4K4OUZHU.0 size=1048576 2024-09-22T08:48:46.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.706+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~7R8K4K4OUZHU.1 size=911026 2024-09-22T08:48:46.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.708+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=7R8K4K4OUZHU tag=4PYBILH7Z133 type=write size=3008178 2024-09-22T08:48:46.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.709+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=R316ZOHGXD4U type=del size=3994954 2024-09-22T08:48:46.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.710+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~OB0F5VG53U8A.0 size=1048576 2024-09-22T08:48:46.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.711+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~OB0F5VG53U8A.1 size=634305 2024-09-22T08:48:46.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.713+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=OB0F5VG53U8A tag=RKUYN8YEEJ9T type=write size=2731457 2024-09-22T08:48:46.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.715+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.0 size=1048576 2024-09-22T08:48:46.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.716+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.1 size=1048576 2024-09-22T08:48:46.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.717+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.2 size=774882 2024-09-22T08:48:46.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.717+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=9H6TEAU940QX tag=IHGAGPKPQR54 type=write size=3920610 2024-09-22T08:48:46.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.719+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.0 size=1048576 2024-09-22T08:48:46.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.720+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.1 size=1048576 2024-09-22T08:48:46.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.721+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~UL9VSID9IKGL.2 size=199070 2024-09-22T08:48:46.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.723+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=UL9VSID9IKGL tag=5VM99QJ194I3 type=write size=3344798 2024-09-22T08:48:46.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.724+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=XF1C1QMCQ5SM type=del size=1643371 2024-09-22T08:48:46.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.726+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~8ZIPDORPDDJ8.0 size=1048576 2024-09-22T08:48:46.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.727+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~8ZIPDORPDDJ8.1 size=1007734 2024-09-22T08:48:46.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.729+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=8ZIPDORPDDJ8 tag=PCYXQXX4QI7X type=write size=3104886 2024-09-22T08:48:46.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.730+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=0U0EBBTDL3ZU type=del size=2401198 2024-09-22T08:48:46.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.731+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~20V28S1N6MGY.0 size=579578 2024-09-22T08:48:46.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.733+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=20V28S1N6MGY tag=IS77NKZZ3X0H type=write size=1628154 2024-09-22T08:48:46.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.734+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=H743U4ZAJRKT type=write size=703443 2024-09-22T08:48:46.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.735+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.0 size=1048576 2024-09-22T08:48:46.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.737+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.1 size=1048576 2024-09-22T08:48:46.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.738+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KBZ0V3J0W8Z2.2 size=699993 2024-09-22T08:48:46.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.741+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=KBZ0V3J0W8Z2 tag=BDRGWBL6JGE0 type=write size=3845721 2024-09-22T08:48:46.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.742+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=3RYF6AC1F323 type=write size=435704 2024-09-22T08:48:46.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.743+0000 7f7b8ef90780 1 < completed write operation key=9DO6M6UQ5A05 tag=27EY8C7Z6DWR type=write size=529453 2024-09-22T08:48:46.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.745+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=TI6MMOAN08W0 type=del size=1973355 2024-09-22T08:48:46.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.746+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=2FSYQ8U67FJP type=write size=1032049 2024-09-22T08:48:46.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.747+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=979OXUYFI9U0 type=del size=3122784 2024-09-22T08:48:46.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.748+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~MFKPU2MHY058.0 size=998062 2024-09-22T08:48:46.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.750+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=MFKPU2MHY058 tag=JRT5IILIGFNS type=write size=2046638 2024-09-22T08:48:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.752+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=8O2BXDPSSSA7 type=del size=3180603 2024-09-22T08:48:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.754+0000 7f7b8ef90780 1 < suggested update operation key=R0N30XP1BXY3 tag=KH8UT1J8QXNN type=del size=3821807 2024-09-22T08:48:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.756+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=3KCZDK5BBZ1A type=del size=3525441 2024-09-22T08:48:46.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.758+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=RMCKO70GJL6B type=del 2024-09-22T08:48:46.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.759+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=FS4TD8UC9MZZ type=del size=4194227 2024-09-22T08:48:46.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.761+0000 7f7b8ef90780 1 < completed write operation key=L1URDVW43BUG tag=MCAXSQ5VUVD0 type=write size=200539 2024-09-22T08:48:46.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.762+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=BWWZOGLKM1XO type=del size=46668 2024-09-22T08:48:46.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.763+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=CBXWE32WT9FQ type=del 2024-09-22T08:48:46.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.765+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=8480CU9Y3CRG type=del size=2137838 2024-09-22T08:48:46.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.766+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~A9RVP8AEXYW7.0 size=570892 2024-09-22T08:48:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.768+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=A9RVP8AEXYW7 tag=25LR5V6GIZP6 type=write size=1619468 2024-09-22T08:48:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.770+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~B3NW5KIA3WXG.0 size=289390 2024-09-22T08:48:46.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.770+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=B3NW5KIA3WXG tag=RA53M0IAIAQY type=write size=1337966 2024-09-22T08:48:46.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.772+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~BYNG0P5GR9B1.0 size=928392 2024-09-22T08:48:46.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.774+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=BYNG0P5GR9B1 tag=W1K3K7ECSHDM type=write size=1976968 2024-09-22T08:48:46.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.775+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=P51GE4H12BM9 type=del size=290588 2024-09-22T08:48:46.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.778+0000 7f7b8ef90780 1 < suggested update operation key=Z9CHXCJ02L85 tag=Y6WMIBRIUF54 type=del size=2747238 2024-09-22T08:48:46.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.780+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~VA4468L3FJ8I.0 size=595035 2024-09-22T08:48:46.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.780+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=VA4468L3FJ8I tag=WU0YSN2AIDH8 type=write size=1643611 2024-09-22T08:48:46.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.782+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=R316ZOHGXD4U type=del 2024-09-22T08:48:46.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.784+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=RC67Z4E2MPL0 type=del size=306230 2024-09-22T08:48:46.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.785+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.0 size=1048576 2024-09-22T08:48:46.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.786+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.1 size=1048576 2024-09-22T08:48:46.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.787+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~9H6TEAU940QX.2 size=774882 2024-09-22T08:48:46.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.789+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=9H6TEAU940QX tag=IHGAGPKPQR54 type=write size=3920610 2024-09-22T08:48:46.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.791+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.0 size=1048576 2024-09-22T08:48:46.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.792+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.1 size=1048576 2024-09-22T08:48:46.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.793+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.2 size=598691 2024-09-22T08:48:46.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.793+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=A83IV7SEDXHT tag=U6E1FAUK30Q8 type=write size=3744419 2024-09-22T08:48:46.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.794+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=XF1C1QMCQ5SM type=del 2024-09-22T08:48:46.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.797+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.0 size=1048576 2024-09-22T08:48:46.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.798+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.1 size=1048576 2024-09-22T08:48:46.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.799+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.2 size=810762 2024-09-22T08:48:46.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.799+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=7AWE2KZ10798 tag=PUEBKC2ZNP1P type=write size=3956490 2024-09-22T08:48:46.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.800+0000 7f7b8ef90780 1 < canceled operation key=QH6TK0MJKYUO tag=0U0EBBTDL3ZU type=del size=2401198 2024-09-22T08:48:46.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.801+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=19EX8E5CCL8E type=del size=2758362 2024-09-22T08:48:46.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.802+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=H743U4ZAJRKT type=write size=703443 2024-09-22T08:48:46.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.805+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~TI8DPRIFFFZW.0 size=1048576 2024-09-22T08:48:46.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.806+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~TI8DPRIFFFZW.1 size=541016 2024-09-22T08:48:46.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.806+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=TI8DPRIFFFZW tag=VT1893UAP1FK type=write size=2638168 2024-09-22T08:48:46.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.807+0000 7f7b8ef90780 1 < completed write operation key=T43DW9JPG1BU tag=3RYF6AC1F323 type=write size=435704 2024-09-22T08:48:46.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.809+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=VMM1VCO2AINW type=write size=925834 2024-09-22T08:48:46.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.810+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=TI6MMOAN08W0 type=del 2024-09-22T08:48:46.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.812+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~G84PQY5RLZ7B.0 size=1048576 2024-09-22T08:48:46.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.813+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~G84PQY5RLZ7B.1 size=602885 2024-09-22T08:48:46.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.813+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=G84PQY5RLZ7B tag=TVPYCD5KYN9O type=write size=2700037 2024-09-22T08:48:46.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.816+0000 7f7b8ef90780 1 < suggested update operation key=GBNPVRO0JPF7 tag=979OXUYFI9U0 type=del size=3122784 2024-09-22T08:48:46.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.817+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=W0IOLEKKHC45 type=del size=840586 2024-09-22T08:48:46.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.818+0000 7f7b8ef90780 -1 < failed to complete operation key=ZM6ITJ2QUIPJ tag=8O2BXDPSSSA7 type=del size=3180603: (22) Invalid argument 2024-09-22T08:48:46.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.819+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=3U3NH0DUG7P2 type=del size=3581674 2024-09-22T08:48:46.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.821+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=3KCZDK5BBZ1A type=del size=3525441 2024-09-22T08:48:46.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.822+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=JZZWNP7W49SV type=write size=846310 2024-09-22T08:48:46.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.823+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=FS4TD8UC9MZZ type=del 2024-09-22T08:48:46.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.826+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~MNGBZK67NJ16.0 size=491624 2024-09-22T08:48:46.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.826+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=MNGBZK67NJ16 tag=JZBQLE0EWIHR type=write size=1540200 2024-09-22T08:48:46.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.827+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=BWWZOGLKM1XO type=del 2024-09-22T08:48:46.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.828+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=1JPBULPG19SR type=del size=3421561 2024-09-22T08:48:46.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.830+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=8480CU9Y3CRG type=del size=2137838: (22) Invalid argument 2024-09-22T08:48:46.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.831+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=B4ZLQCBNULG6 type=del size=3357417 2024-09-22T08:48:46.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.832+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~B3NW5KIA3WXG.0 size=289390 2024-09-22T08:48:46.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.835+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=B3NW5KIA3WXG tag=RA53M0IAIAQY type=write size=1337966 2024-09-22T08:48:46.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.836+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=WZM271ZYZ73D type=del size=1995359 2024-09-22T08:48:46.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.837+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=P51GE4H12BM9 type=del 2024-09-22T08:48:46.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.840+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~IAUJQ78BCMOE.0 size=1048576 2024-09-22T08:48:46.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.841+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~IAUJQ78BCMOE.1 size=744711 2024-09-22T08:48:46.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.841+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=IAUJQ78BCMOE tag=7MCERJA6WR6Q type=write size=2841863 2024-09-22T08:48:46.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.842+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~VA4468L3FJ8I.0 size=595035 2024-09-22T08:48:46.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.844+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=VA4468L3FJ8I tag=WU0YSN2AIDH8 type=write size=1643611 2024-09-22T08:48:46.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.847+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.0 size=1048576 2024-09-22T08:48:46.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.848+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.1 size=1048576 2024-09-22T08:48:46.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.849+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.2 size=780538 2024-09-22T08:48:46.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.849+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=RJQ7NAA1K9BJ tag=ZS8SRTOHPMGF type=write size=3926266 2024-09-22T08:48:46.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.851+0000 7f7b8ef90780 1 < suggested remove operation key=ORON3U0WY2K5 tag=RC67Z4E2MPL0 type=del 2024-09-22T08:48:46.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.854+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~H3TQ3ZIEYBGW.0 size=1048576 2024-09-22T08:48:46.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.855+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~H3TQ3ZIEYBGW.1 size=155698 2024-09-22T08:48:46.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.855+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=H3TQ3ZIEYBGW tag=414G0SRCN4LD type=write size=2252850 2024-09-22T08:48:46.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.856+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.0 size=1048576 2024-09-22T08:48:46.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.857+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.1 size=1048576 2024-09-22T08:48:46.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.858+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~A83IV7SEDXHT.2 size=598691 2024-09-22T08:48:46.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.861+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=A83IV7SEDXHT tag=U6E1FAUK30Q8 type=write size=3744419 2024-09-22T08:48:46.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.863+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~JP1VWSESTJ51.0 size=455477 2024-09-22T08:48:46.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.863+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=JP1VWSESTJ51 tag=B1DRYT0XBM4C type=write size=1504053 2024-09-22T08:48:46.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.865+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.0 size=1048576 2024-09-22T08:48:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.866+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.1 size=1048576 2024-09-22T08:48:46.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.867+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~7AWE2KZ10798.2 size=810762 2024-09-22T08:48:46.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.869+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=7AWE2KZ10798 tag=PUEBKC2ZNP1P type=write size=3956490 2024-09-22T08:48:46.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.870+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=PAF3BW0W02FF type=del size=3522218 2024-09-22T08:48:46.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.871+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=19EX8E5CCL8E type=del 2024-09-22T08:48:46.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.873+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=DO0H5EQX1HCP type=write size=564176 2024-09-22T08:48:46.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.874+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~TI8DPRIFFFZW.0 size=1048576 2024-09-22T08:48:46.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.874+0000 7f7b8ef90780 1 < canceled part key=_multipart_YF94C9GVRXQP.2~TI8DPRIFFFZW.1 size=541016 2024-09-22T08:48:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.876+0000 7f7b8ef90780 1 < canceled multipart upload key=YF94C9GVRXQP upload=TI8DPRIFFFZW tag=VT1893UAP1FK type=write size=2638168 2024-09-22T08:48:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.878+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=YOESC74UMA2L type=write size=1043046 2024-09-22T08:48:46.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.879+0000 7f7b8ef90780 1 < completed write operation key=G51KS3NM4VFY tag=VMM1VCO2AINW type=write size=925834 2024-09-22T08:48:46.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.880+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=MB582DT5H1DW type=write size=858158 2024-09-22T08:48:46.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.880+0000 7f7b8ef90780 1 < canceled part key=_multipart_9DO6M6UQ5A05.2~G84PQY5RLZ7B.0 size=1048576 2024-09-22T08:48:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.881+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~G84PQY5RLZ7B.1 size=602885 2024-09-22T08:48:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.884+0000 7f7b8ef90780 1 < canceled multipart upload key=9DO6M6UQ5A05 upload=G84PQY5RLZ7B tag=TVPYCD5KYN9O type=write size=2700037 2024-09-22T08:48:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.885+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=2WOL2UH4PIXC type=del size=1527464 2024-09-22T08:48:46.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.886+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=W0IOLEKKHC45 type=del 2024-09-22T08:48:46.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.888+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YGDARCKUVH9I.0 size=1048576 2024-09-22T08:48:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.889+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~YGDARCKUVH9I.1 size=1006555 2024-09-22T08:48:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.889+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=YGDARCKUVH9I tag=LB8FXVT2B01H type=write size=3103707 2024-09-22T08:48:46.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.890+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=3U3NH0DUG7P2 type=del 2024-09-22T08:48:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.893+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~TJBDLCG34OON.0 size=968597 2024-09-22T08:48:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.893+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=TJBDLCG34OON tag=LM7GSXGRLKO0 type=write size=2017173 2024-09-22T08:48:46.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.895+0000 7f7b8ef90780 1 < suggested remove operation key=ORON3U0WY2K5 tag=JZZWNP7W49SV type=write 2024-09-22T08:48:46.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.896+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=1SRBGRZE3A72 type=del size=1949493 2024-09-22T08:48:46.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.897+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~MNGBZK67NJ16.0 size=491624 2024-09-22T08:48:46.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.899+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=MNGBZK67NJ16 tag=JZBQLE0EWIHR type=write size=1540200 2024-09-22T08:48:46.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.901+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=YIJXTAEP6B41 type=del size=2487435 2024-09-22T08:48:46.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.902+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=1JPBULPG19SR type=del 2024-09-22T08:48:46.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.903+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=U5DBQKFQ72N3 type=del size=3715012 2024-09-22T08:48:46.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.904+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=B4ZLQCBNULG6 type=del 2024-09-22T08:48:46.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.905+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=9PM6RLUZD0ME type=del size=736350 2024-09-22T08:48:46.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.907+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=WZM271ZYZ73D type=del 2024-09-22T08:48:46.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.909+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~6QFH7HUOUH5K.0 size=1048576 2024-09-22T08:48:46.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.910+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~6QFH7HUOUH5K.1 size=578420 2024-09-22T08:48:46.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.910+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=6QFH7HUOUH5K tag=11T26V35YAUQ type=write size=2675572 2024-09-22T08:48:46.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.911+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~IAUJQ78BCMOE.0 size=1048576 2024-09-22T08:48:46.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.912+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~IAUJQ78BCMOE.1 size=744711 2024-09-22T08:48:46.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.914+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=IAUJQ78BCMOE tag=7MCERJA6WR6Q type=write size=2841863 2024-09-22T08:48:46.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.915+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=RD6WFD1LQIXY type=del size=1418554 2024-09-22T08:48:46.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.916+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.0 size=1048576 2024-09-22T08:48:46.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.917+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.1 size=1048576 2024-09-22T08:48:46.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.918+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~RJQ7NAA1K9BJ.2 size=780538 2024-09-22T08:48:46.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.920+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=RJQ7NAA1K9BJ tag=ZS8SRTOHPMGF type=write size=3926266 2024-09-22T08:48:46.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.922+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=DY5QBC1FBILF type=write size=776684 2024-09-22T08:48:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.923+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~H3TQ3ZIEYBGW.0 size=1048576 2024-09-22T08:48:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.924+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~H3TQ3ZIEYBGW.1 size=155698 2024-09-22T08:48:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.926+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=H3TQ3ZIEYBGW tag=414G0SRCN4LD type=write size=2252850 2024-09-22T08:48:46.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.927+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=K8484FOLVCS3 type=del size=3114936 2024-09-22T08:48:46.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.928+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~JP1VWSESTJ51.0 size=455477 2024-09-22T08:48:46.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.930+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=JP1VWSESTJ51 tag=B1DRYT0XBM4C type=write size=1504053 2024-09-22T08:48:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.933+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.0 size=1048576 2024-09-22T08:48:46.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.934+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.1 size=1048576 2024-09-22T08:48:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.935+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.2 size=951658 2024-09-22T08:48:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.935+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=2TYJXGJUKAXA tag=6Z603H55NKJN type=write size=4097386 2024-09-22T08:48:46.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.936+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=PAF3BW0W02FF type=del 2024-09-22T08:48:46.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.938+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~X82RS0O8OIOB.0 size=1048576 2024-09-22T08:48:46.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.939+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~X82RS0O8OIOB.1 size=731323 2024-09-22T08:48:46.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.939+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=X82RS0O8OIOB tag=J3IVUYXZ2P0E type=write size=2828475 2024-09-22T08:48:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.940+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=DO0H5EQX1HCP type=write size=564176 2024-09-22T08:48:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.942+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=OA6U0B8K3NFG type=del size=272251 2024-09-22T08:48:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.943+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=YOESC74UMA2L type=write size=1043046 2024-09-22T08:48:46.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.944+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=4N87E002TGH0 type=del size=661384 2024-09-22T08:48:46.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.945+0000 7f7b8ef90780 -1 < failed to complete operation key=ORON3U0WY2K5 tag=MB582DT5H1DW type=write size=858158: (22) Invalid argument 2024-09-22T08:48:46.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.946+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=19AEROW4M07G type=del size=4014100 2024-09-22T08:48:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.948+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=2WOL2UH4PIXC type=del 2024-09-22T08:48:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.949+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=4LYK9U5T31DM type=del size=3764559 2024-09-22T08:48:46.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.950+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YGDARCKUVH9I.0 size=1048576 2024-09-22T08:48:46.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.951+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~YGDARCKUVH9I.1 size=1006555 2024-09-22T08:48:46.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.954+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=YGDARCKUVH9I tag=LB8FXVT2B01H type=write size=3103707 2024-09-22T08:48:46.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.956+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~PHI9RSN13NXT.0 size=1048576 2024-09-22T08:48:46.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.957+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~PHI9RSN13NXT.1 size=286020 2024-09-22T08:48:46.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.957+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=PHI9RSN13NXT tag=J7I0NWUCITYG type=write size=2383172 2024-09-22T08:48:46.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.958+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~TJBDLCG34OON.0 size=968597 2024-09-22T08:48:46.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.960+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=TJBDLCG34OON tag=LM7GSXGRLKO0 type=write size=2017173 2024-09-22T08:48:46.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.962+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=28UPDAZQWTXB type=del size=1503913 2024-09-22T08:48:46.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.963+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=1SRBGRZE3A72 type=del 2024-09-22T08:48:46.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.964+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=ZRSQA4M8BODH type=del size=4035247 2024-09-22T08:48:46.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.965+0000 7f7b8ef90780 1 < canceled operation key=Y7W0V6YTDFIB tag=YIJXTAEP6B41 type=del size=2487435 2024-09-22T08:48:46.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.967+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=ZOY6N2SGRKUP type=del size=1063941 2024-09-22T08:48:46.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.968+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=U5DBQKFQ72N3 type=del 2024-09-22T08:48:46.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.970+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~B1A7JCIUJQXN.0 size=350373 2024-09-22T08:48:46.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.970+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=B1A7JCIUJQXN tag=D6EY01SPAIB1 type=write size=1398949 2024-09-22T08:48:46.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.971+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=9PM6RLUZD0ME type=del 2024-09-22T08:48:46.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.974+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~Q1D5B39L1R8G.0 size=471754 2024-09-22T08:48:46.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.974+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=Q1D5B39L1R8G tag=EPL6G8L94YHA type=write size=1520330 2024-09-22T08:48:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.976+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~6QFH7HUOUH5K.0 size=1048576 2024-09-22T08:48:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.977+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~6QFH7HUOUH5K.1 size=578420 2024-09-22T08:48:46.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.979+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=6QFH7HUOUH5K tag=11T26V35YAUQ type=write size=2675572 2024-09-22T08:48:46.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.981+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~XPMZMO0EMBJX.0 size=731115 2024-09-22T08:48:46.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.981+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=XPMZMO0EMBJX tag=ZWLUFTQSRZMF type=write size=1779691 2024-09-22T08:48:46.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.982+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=RD6WFD1LQIXY type=del 2024-09-22T08:48:46.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.984+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~FYDOTV1KPNGP.0 size=416908 2024-09-22T08:48:46.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.984+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=FYDOTV1KPNGP tag=IRBGU1343UBE type=write size=1465484 2024-09-22T08:48:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.985+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=DY5QBC1FBILF type=write size=776684 2024-09-22T08:48:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.988+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~LUWN7XMQCU37.0 size=1048576 2024-09-22T08:48:46.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.989+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~LUWN7XMQCU37.1 size=442554 2024-09-22T08:48:46.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.989+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=LUWN7XMQCU37 tag=B0SK5UC2TW0V type=write size=2539706 2024-09-22T08:48:46.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.990+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=K8484FOLVCS3 type=del 2024-09-22T08:48:46.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.992+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~KTGW0RMP3FL8.0 size=344894 2024-09-22T08:48:46.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.992+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=KTGW0RMP3FL8 tag=I1THQAPAXY7Y type=write size=1393470 2024-09-22T08:48:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.994+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.0 size=1048576 2024-09-22T08:48:46.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.995+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.1 size=1048576 2024-09-22T08:48:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.995+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~2TYJXGJUKAXA.2 size=951658 2024-09-22T08:48:46.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:46.997+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=2TYJXGJUKAXA tag=6Z603H55NKJN type=write size=4097386 2024-09-22T08:48:47.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.000+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~ARGNG2QY300J.0 size=1048576 2024-09-22T08:48:47.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.001+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~ARGNG2QY300J.1 size=745858 2024-09-22T08:48:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.001+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=ARGNG2QY300J tag=YCM9Z8R7UHE1 type=write size=2843010 2024-09-22T08:48:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.002+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~X82RS0O8OIOB.0 size=1048576 2024-09-22T08:48:47.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.003+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~X82RS0O8OIOB.1 size=731323 2024-09-22T08:48:47.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.005+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=X82RS0O8OIOB tag=J3IVUYXZ2P0E type=write size=2828475 2024-09-22T08:48:47.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.007+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.0 size=1048576 2024-09-22T08:48:47.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.008+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.1 size=1048576 2024-09-22T08:48:47.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.009+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.2 size=438415 2024-09-22T08:48:47.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.009+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=DZS6D9V1PYFP tag=TYTKOXXO0FUU type=write size=3584143 2024-09-22T08:48:47.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.011+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=OA6U0B8K3NFG type=del 2024-09-22T08:48:47.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.012+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=3J7AAZ7S0XAT type=del size=1093088 2024-09-22T08:48:47.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.013+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=4N87E002TGH0 type=del 2024-09-22T08:48:47.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.016+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5L8XPNKJBBJY.0 size=1048576 2024-09-22T08:48:47.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.017+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5L8XPNKJBBJY.1 size=275393 2024-09-22T08:48:47.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.017+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=5L8XPNKJBBJY tag=660YJJLGKDYL type=write size=2372545 2024-09-22T08:48:47.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.018+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=19AEROW4M07G type=del 2024-09-22T08:48:47.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.020+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XOAZ035SJTSQ.0 size=1048576 2024-09-22T08:48:47.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.021+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XOAZ035SJTSQ.1 size=451112 2024-09-22T08:48:47.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.021+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=XOAZ035SJTSQ tag=449ZQPQXGRFW type=write size=2548264 2024-09-22T08:48:47.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.023+0000 7f7b8ef90780 1 < suggested remove operation key=WDGY8YL16UWI tag=4LYK9U5T31DM type=del 2024-09-22T08:48:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.024+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=29TX2VZ246R7 type=del size=2740877 2024-09-22T08:48:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.025+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~PHI9RSN13NXT.0 size=1048576 2024-09-22T08:48:47.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.026+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~PHI9RSN13NXT.1 size=286020 2024-09-22T08:48:47.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.028+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=PHI9RSN13NXT tag=J7I0NWUCITYG type=write size=2383172 2024-09-22T08:48:47.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.031+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~YA1BJ5WDF29C.0 size=544888 2024-09-22T08:48:47.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.031+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=YA1BJ5WDF29C tag=VLS7E2V7GU42 type=write size=1593464 2024-09-22T08:48:47.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.032+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=28UPDAZQWTXB type=del 2024-09-22T08:48:47.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.034+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~6JFXN66BWCVB.0 size=1048576 2024-09-22T08:48:47.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.035+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~6JFXN66BWCVB.1 size=486825 2024-09-22T08:48:47.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.035+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=6JFXN66BWCVB tag=V3K6NSUJL6ZT type=write size=2583977 2024-09-22T08:48:47.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.036+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=ZRSQA4M8BODH type=del size=4035247 2024-09-22T08:48:47.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.037+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=XCQEJ1XEJAT2 type=write size=986484 2024-09-22T08:48:47.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.040+0000 7f7b8ef90780 1 < suggested remove operation key=1U6T2BIZS72V tag=ZOY6N2SGRKUP type=del 2024-09-22T08:48:47.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.041+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=I04BOFB8T6O0 type=del size=3116600 2024-09-22T08:48:47.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.042+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~B1A7JCIUJQXN.0 size=350373 2024-09-22T08:48:47.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.044+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=B1A7JCIUJQXN tag=D6EY01SPAIB1 type=write size=1398949 2024-09-22T08:48:47.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.045+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=XDVU17WLWZEC type=del size=1081121 2024-09-22T08:48:47.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.047+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~Q1D5B39L1R8G.0 size=471754 2024-09-22T08:48:47.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.049+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=Q1D5B39L1R8G tag=EPL6G8L94YHA type=write size=1520330 2024-09-22T08:48:47.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.051+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~QFBX83QDC6WP.0 size=1048576 2024-09-22T08:48:47.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.052+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~QFBX83QDC6WP.1 size=808105 2024-09-22T08:48:47.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.052+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=QFBX83QDC6WP tag=E96OJLR6ONGH type=write size=2905257 2024-09-22T08:48:47.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.053+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~XPMZMO0EMBJX.0 size=731115 2024-09-22T08:48:47.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.055+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=XPMZMO0EMBJX tag=ZWLUFTQSRZMF type=write size=1779691 2024-09-22T08:48:47.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.056+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=RBFRJ1KK2N3V type=del size=1265488 2024-09-22T08:48:47.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.056+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~FYDOTV1KPNGP.0 size=416908 2024-09-22T08:48:47.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.058+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=FYDOTV1KPNGP tag=IRBGU1343UBE type=write size=1465484 2024-09-22T08:48:47.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.060+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=IGT267A1C5CF type=del size=1931332 2024-09-22T08:48:47.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.061+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~LUWN7XMQCU37.0 size=1048576 2024-09-22T08:48:47.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.062+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~LUWN7XMQCU37.1 size=442554 2024-09-22T08:48:47.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.064+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=LUWN7XMQCU37 tag=B0SK5UC2TW0V type=write size=2539706 2024-09-22T08:48:47.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.066+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.0 size=1048576 2024-09-22T08:48:47.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.068+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.1 size=1048576 2024-09-22T08:48:47.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.069+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.2 size=864168 2024-09-22T08:48:47.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.069+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=X718ELWDRAGH tag=JMHWB5L3SFLO type=write size=4009896 2024-09-22T08:48:47.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.070+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~KTGW0RMP3FL8.0 size=344894 2024-09-22T08:48:47.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.072+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=KTGW0RMP3FL8 tag=I1THQAPAXY7Y type=write size=1393470 2024-09-22T08:48:47.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.074+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=RRGLRLJ4IC75 type=del size=878329 2024-09-22T08:48:47.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.075+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~ARGNG2QY300J.0 size=1048576 2024-09-22T08:48:47.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.076+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~ARGNG2QY300J.1 size=745858 2024-09-22T08:48:47.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.078+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=ARGNG2QY300J tag=YCM9Z8R7UHE1 type=write size=2843010 2024-09-22T08:48:47.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.080+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=7RFO0OYJN57Q type=write size=373866 2024-09-22T08:48:47.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.081+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.0 size=1048576 2024-09-22T08:48:47.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.082+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.1 size=1048576 2024-09-22T08:48:47.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.083+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~DZS6D9V1PYFP.2 size=438415 2024-09-22T08:48:47.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.085+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=DZS6D9V1PYFP tag=TYTKOXXO0FUU type=write size=3584143 2024-09-22T08:48:47.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.086+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=89YCI670AX1E type=del size=2415460 2024-09-22T08:48:47.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.089+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=3J7AAZ7S0XAT type=del size=1093088 2024-09-22T08:48:47.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.091+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.0 size=1048576 2024-09-22T08:48:47.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.092+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.1 size=1048576 2024-09-22T08:48:47.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.093+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.2 size=415417 2024-09-22T08:48:47.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.093+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=AP8FSEFOZD3D tag=JBNMULHN34P7 type=write size=3561145 2024-09-22T08:48:47.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.095+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~5L8XPNKJBBJY.0 size=1048576 2024-09-22T08:48:47.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.096+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~5L8XPNKJBBJY.1 size=275393 2024-09-22T08:48:47.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.098+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=5L8XPNKJBBJY tag=660YJJLGKDYL type=write size=2372545 2024-09-22T08:48:47.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.100+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~IYDDE3AIRVZ8.0 size=1048576 2024-09-22T08:48:47.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.101+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~IYDDE3AIRVZ8.1 size=582008 2024-09-22T08:48:47.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.101+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=IYDDE3AIRVZ8 tag=7IR54P6MXMTN type=write size=2679160 2024-09-22T08:48:47.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.102+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XOAZ035SJTSQ.0 size=1048576 2024-09-22T08:48:47.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.103+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XOAZ035SJTSQ.1 size=451112 2024-09-22T08:48:47.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.105+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=XOAZ035SJTSQ tag=449ZQPQXGRFW type=write size=2548264 2024-09-22T08:48:47.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.106+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=A5U7VZJGH0Z1 type=del size=2047992 2024-09-22T08:48:47.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.107+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=29TX2VZ246R7 type=del 2024-09-22T08:48:47.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.109+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~W69PUQ2G51QL.0 size=1048576 2024-09-22T08:48:47.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.110+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~W69PUQ2G51QL.1 size=265562 2024-09-22T08:48:47.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.110+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=W69PUQ2G51QL tag=0PIL3NZ1HGHE type=write size=2362714 2024-09-22T08:48:47.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.111+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~YA1BJ5WDF29C.0 size=544888 2024-09-22T08:48:47.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.113+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=YA1BJ5WDF29C tag=VLS7E2V7GU42 type=write size=1593464 2024-09-22T08:48:47.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.115+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=PJ0DET825WGV type=write size=630835 2024-09-22T08:48:47.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.116+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~6JFXN66BWCVB.0 size=1048576 2024-09-22T08:48:47.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.117+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~6JFXN66BWCVB.1 size=486825 2024-09-22T08:48:47.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.119+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=6JFXN66BWCVB tag=V3K6NSUJL6ZT type=write size=2583977 2024-09-22T08:48:47.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.121+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~U8CKCGFNQ410.0 size=1048576 2024-09-22T08:48:47.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.122+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~U8CKCGFNQ410.1 size=481969 2024-09-22T08:48:47.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.122+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=U8CKCGFNQ410 tag=4R9ZPXAV2H9Z type=write size=2579121 2024-09-22T08:48:47.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.123+0000 7f7b8ef90780 1 < completed write operation key=L3XF68XD23FP tag=XCQEJ1XEJAT2 type=write size=986484 2024-09-22T08:48:47.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.125+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=AIKXVG9N5KA4 type=del size=2620032 2024-09-22T08:48:47.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.127+0000 7f7b8ef90780 1 < suggested remove operation key=R0N30XP1BXY3 tag=I04BOFB8T6O0 type=del 2024-09-22T08:48:47.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.128+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=I7EU3OQAE3KA type=del size=2848706 2024-09-22T08:48:47.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.129+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=XDVU17WLWZEC type=del 2024-09-22T08:48:47.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.131+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=794BH59Q70B1 type=del size=3860109 2024-09-22T08:48:47.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.132+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~QFBX83QDC6WP.0 size=1048576 2024-09-22T08:48:47.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.133+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~QFBX83QDC6WP.1 size=808105 2024-09-22T08:48:47.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.135+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=QFBX83QDC6WP tag=E96OJLR6ONGH type=write size=2905257 2024-09-22T08:48:47.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.137+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.0 size=1048576 2024-09-22T08:48:47.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.138+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.1 size=1048576 2024-09-22T08:48:47.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.139+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.2 size=590647 2024-09-22T08:48:47.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.139+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=GOAUKI7GMWXX tag=SLPELYG0JJGF type=write size=3736375 2024-09-22T08:48:47.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.140+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=RBFRJ1KK2N3V type=del 2024-09-22T08:48:47.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.141+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=K83ZHMQPMNQV type=del size=3927094 2024-09-22T08:48:47.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.143+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=IGT267A1C5CF type=del 2024-09-22T08:48:47.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.145+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~DJGDBBYAVB2I.0 size=631393 2024-09-22T08:48:47.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.145+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=DJGDBBYAVB2I tag=LAX1CR7GGKNC type=write size=1679969 2024-09-22T08:48:47.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.146+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.0 size=1048576 2024-09-22T08:48:47.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.146+0000 7f7b8ef90780 1 < canceled part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.1 size=1048576 2024-09-22T08:48:47.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.147+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~X718ELWDRAGH.2 size=864168 2024-09-22T08:48:47.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.149+0000 7f7b8ef90780 1 < canceled multipart upload key=F3IHQ6Z9V1DX upload=X718ELWDRAGH tag=JMHWB5L3SFLO type=write size=4009896 2024-09-22T08:48:47.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.150+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=A2KK22X1PM5W type=del size=3377526 2024-09-22T08:48:47.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.151+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=RRGLRLJ4IC75 type=del 2024-09-22T08:48:47.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.153+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=6MN3500ZAMUD type=del size=4188303 2024-09-22T08:48:47.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.155+0000 7f7b8ef90780 1 < suggested update operation key=7ZS8G8H6I957 tag=7RFO0OYJN57Q type=write size=373866 2024-09-22T08:48:47.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.156+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=EQBKN4VIBII4 type=del size=2468760 2024-09-22T08:48:47.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.158+0000 7f7b8ef90780 1 < suggested remove operation key=4J4EGI19N123 tag=89YCI670AX1E type=del 2024-09-22T08:48:47.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.161+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~Z6QF2PHZK3JK.0 size=873510 2024-09-22T08:48:47.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.161+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=Z6QF2PHZK3JK tag=869D2WDADGU8 type=write size=1922086 2024-09-22T08:48:47.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.162+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.0 size=1048576 2024-09-22T08:48:47.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.163+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.1 size=1048576 2024-09-22T08:48:47.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.164+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~AP8FSEFOZD3D.2 size=415417 2024-09-22T08:48:47.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.166+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=AP8FSEFOZD3D tag=JBNMULHN34P7 type=write size=3561145 2024-09-22T08:48:47.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.169+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=5LDUQLA2YAD8 type=del size=2050841 2024-09-22T08:48:47.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.170+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~IYDDE3AIRVZ8.0 size=1048576 2024-09-22T08:48:47.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.171+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~IYDDE3AIRVZ8.1 size=582008 2024-09-22T08:48:47.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.173+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=IYDDE3AIRVZ8 tag=7IR54P6MXMTN type=write size=2679160 2024-09-22T08:48:47.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.175+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=5A0AE838WG22 type=write size=1007876 2024-09-22T08:48:47.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.176+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=A5U7VZJGH0Z1 type=del size=2047992: (22) Invalid argument 2024-09-22T08:48:47.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.178+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~EXYE1CG0QQHK.0 size=834882 2024-09-22T08:48:47.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.178+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=EXYE1CG0QQHK tag=BFCM2Y4ZSIX1 type=write size=1883458 2024-09-22T08:48:47.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.180+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~W69PUQ2G51QL.0 size=1048576 2024-09-22T08:48:47.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.180+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~W69PUQ2G51QL.1 size=265562 2024-09-22T08:48:47.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.183+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=W69PUQ2G51QL tag=0PIL3NZ1HGHE type=write size=2362714 2024-09-22T08:48:47.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.185+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~XCXJIIMJIMTR.0 size=1048576 2024-09-22T08:48:47.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.186+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~XCXJIIMJIMTR.1 size=441462 2024-09-22T08:48:47.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.186+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=XCXJIIMJIMTR tag=GBBO9SLZGAR3 type=write size=2538614 2024-09-22T08:48:47.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.187+0000 7f7b8ef90780 1 < completed write operation key=Y7W0V6YTDFIB tag=PJ0DET825WGV type=write size=630835 2024-09-22T08:48:47.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.190+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.0 size=1048576 2024-09-22T08:48:47.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.191+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.1 size=1048576 2024-09-22T08:48:47.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.192+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.2 size=147883 2024-09-22T08:48:47.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.192+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=9QOD5Y93ZKRQ tag=KMRMYOG6HDU8 type=write size=3293611 2024-09-22T08:48:47.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.192+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~U8CKCGFNQ410.0 size=1048576 2024-09-22T08:48:47.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.193+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~U8CKCGFNQ410.1 size=481969 2024-09-22T08:48:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.195+0000 7f7b8ef90780 1 < canceled multipart upload key=L1URDVW43BUG upload=U8CKCGFNQ410 tag=4R9ZPXAV2H9Z type=write size=2579121 2024-09-22T08:48:47.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.197+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=BPTE96S6OZXJ type=del size=1766683 2024-09-22T08:48:47.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.198+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=AIKXVG9N5KA4 type=del 2024-09-22T08:48:47.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.199+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=1C004PZXYRLI type=del size=2198171 2024-09-22T08:48:47.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.200+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=I7EU3OQAE3KA type=del size=2848706 2024-09-22T08:48:47.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.204+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.0 size=1048576 2024-09-22T08:48:47.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.205+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.1 size=1048576 2024-09-22T08:48:47.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.205+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.2 size=705677 2024-09-22T08:48:47.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.205+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=3SJT07T16QNW tag=RQ60AIZQLGKP type=write size=3851405 2024-09-22T08:48:47.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.207+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=794BH59Q70B1 type=del 2024-09-22T08:48:47.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.209+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.0 size=1048576 2024-09-22T08:48:47.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.210+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.1 size=1048576 2024-09-22T08:48:47.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.211+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.2 size=7067 2024-09-22T08:48:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.211+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=AR95VNMM9N6M tag=20UL3LC3EMAU type=write size=3152795 2024-09-22T08:48:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.212+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.0 size=1048576 2024-09-22T08:48:47.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.213+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.1 size=1048576 2024-09-22T08:48:47.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.213+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~GOAUKI7GMWXX.2 size=590647 2024-09-22T08:48:47.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.215+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=GOAUKI7GMWXX tag=SLPELYG0JJGF type=write size=3736375 2024-09-22T08:48:47.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.217+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~4L3PSZQPNUAQ.0 size=24717 2024-09-22T08:48:47.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.217+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=4L3PSZQPNUAQ tag=41CVQREHQ0J0 type=write size=1073293 2024-09-22T08:48:47.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.218+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=K83ZHMQPMNQV type=del 2024-09-22T08:48:47.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.219+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=8BMKQNU9Q4AX type=del size=2926765 2024-09-22T08:48:47.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.220+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~DJGDBBYAVB2I.0 size=631393 2024-09-22T08:48:47.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.222+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=DJGDBBYAVB2I tag=LAX1CR7GGKNC type=write size=1679969 2024-09-22T08:48:47.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.224+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=LMKE8QJ121KB type=del size=3715108 2024-09-22T08:48:47.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.225+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=A2KK22X1PM5W type=del 2024-09-22T08:48:47.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.228+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.0 size=1048576 2024-09-22T08:48:47.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.229+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.1 size=1048576 2024-09-22T08:48:47.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.230+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.2 size=305081 2024-09-22T08:48:47.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.230+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=8D1JQZIS277J tag=U81K3FVFZLA9 type=write size=3450809 2024-09-22T08:48:47.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.231+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=6MN3500ZAMUD type=del 2024-09-22T08:48:47.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.232+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=KGB9ZKI4DQWU type=del size=1074724 2024-09-22T08:48:47.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.234+0000 7f7b8ef90780 1 < suggested update operation key=QQKJ4URBRF16 tag=EQBKN4VIBII4 type=del size=2468760 2024-09-22T08:48:47.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.237+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~SJ5D1X5ZP48E.0 size=862477 2024-09-22T08:48:47.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.237+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=SJ5D1X5ZP48E tag=WRVENFE0HW4U type=write size=1911053 2024-09-22T08:48:47.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.238+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~Z6QF2PHZK3JK.0 size=873510 2024-09-22T08:48:47.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.240+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=Z6QF2PHZK3JK tag=869D2WDADGU8 type=write size=1922086 2024-09-22T08:48:47.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.243+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~XD9A42FJ1C0X.0 size=1048576 2024-09-22T08:48:47.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.244+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~XD9A42FJ1C0X.1 size=929449 2024-09-22T08:48:47.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.244+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=XD9A42FJ1C0X tag=4WUOXKQQLL86 type=write size=3026601 2024-09-22T08:48:47.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.246+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=5LDUQLA2YAD8 type=del 2024-09-22T08:48:47.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.247+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=7V0YTS5BR6CD type=del size=4078448 2024-09-22T08:48:47.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.249+0000 7f7b8ef90780 1 < completed write operation key=R0N30XP1BXY3 tag=5A0AE838WG22 type=write size=1007876 2024-09-22T08:48:47.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.251+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~J2XRO9DQXU7N.0 size=1048576 2024-09-22T08:48:47.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.252+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~J2XRO9DQXU7N.1 size=493253 2024-09-22T08:48:47.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.252+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=J2XRO9DQXU7N tag=9595BGFWA3VE type=write size=2590405 2024-09-22T08:48:47.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.253+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~EXYE1CG0QQHK.0 size=834882 2024-09-22T08:48:47.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.255+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=EXYE1CG0QQHK tag=BFCM2Y4ZSIX1 type=write size=1883458 2024-09-22T08:48:47.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.256+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=3UF0F254ODY3 type=del size=1793232 2024-09-22T08:48:47.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.257+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~XCXJIIMJIMTR.0 size=1048576 2024-09-22T08:48:47.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.258+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~XCXJIIMJIMTR.1 size=441462 2024-09-22T08:48:47.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.260+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=XCXJIIMJIMTR tag=GBBO9SLZGAR3 type=write size=2538614 2024-09-22T08:48:47.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.262+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=C7ZJITXPA190 type=write size=869066 2024-09-22T08:48:47.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.263+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.0 size=1048576 2024-09-22T08:48:47.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.264+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.1 size=1048576 2024-09-22T08:48:47.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.265+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~9QOD5Y93ZKRQ.2 size=147883 2024-09-22T08:48:47.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.267+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=9QOD5Y93ZKRQ tag=KMRMYOG6HDU8 type=write size=3293611 2024-09-22T08:48:47.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.268+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=6FYRFQYA0M4R type=del size=3373411 2024-09-22T08:48:47.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.270+0000 7f7b8ef90780 1 < suggested update operation key=YXIZJPACZZFY tag=BPTE96S6OZXJ type=del size=1766683 2024-09-22T08:48:47.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.272+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=L7OSCUMXV23H type=del size=4121277 2024-09-22T08:48:47.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.274+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=1C004PZXYRLI type=del size=2198171 2024-09-22T08:48:47.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.276+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=B69WTTGKHMQR type=del size=1756407 2024-09-22T08:48:47.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.277+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.0 size=1048576 2024-09-22T08:48:47.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.278+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.1 size=1048576 2024-09-22T08:48:47.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.279+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~3SJT07T16QNW.2 size=705677 2024-09-22T08:48:47.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.281+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=3SJT07T16QNW tag=RQ60AIZQLGKP type=write size=3851405 2024-09-22T08:48:47.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.283+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=YOLFH1UQCZ1O type=del size=3571765 2024-09-22T08:48:47.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.284+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.0 size=1048576 2024-09-22T08:48:47.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.285+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.1 size=1048576 2024-09-22T08:48:47.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.286+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~AR95VNMM9N6M.2 size=7067 2024-09-22T08:48:47.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.288+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=AR95VNMM9N6M tag=20UL3LC3EMAU type=write size=3152795 2024-09-22T08:48:47.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.290+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=DVKHMFI37PQX type=write size=844347 2024-09-22T08:48:47.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.291+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~4L3PSZQPNUAQ.0 size=24717 2024-09-22T08:48:47.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.293+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=4L3PSZQPNUAQ tag=41CVQREHQ0J0 type=write size=1073293 2024-09-22T08:48:47.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.296+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.0 size=1048576 2024-09-22T08:48:47.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.297+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.1 size=1048576 2024-09-22T08:48:47.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.298+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.2 size=357472 2024-09-22T08:48:47.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.298+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=LW6AZQO5C13L tag=OK7GGUNBUNLK type=write size=3503200 2024-09-22T08:48:47.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.301+0000 7f7b8ef90780 1 < suggested remove operation key=IEZKK9YIIF33 tag=8BMKQNU9Q4AX type=del 2024-09-22T08:48:47.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.303+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~FW9J06IJ6K02.0 size=657843 2024-09-22T08:48:47.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.303+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=FW9J06IJ6K02 tag=EBAFI1FAEN22 type=write size=1706419 2024-09-22T08:48:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.305+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=LMKE8QJ121KB type=del 2024-09-22T08:48:47.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.306+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=VRRXZ3PR6Z5K type=del size=868562 2024-09-22T08:48:47.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.307+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.0 size=1048576 2024-09-22T08:48:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.309+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.1 size=1048576 2024-09-22T08:48:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.310+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~8D1JQZIS277J.2 size=305081 2024-09-22T08:48:47.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.312+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=8D1JQZIS277J tag=U81K3FVFZLA9 type=write size=3450809 2024-09-22T08:48:47.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.314+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=KPXOTOCDSVNH type=del size=1966904 2024-09-22T08:48:47.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.316+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=KGB9ZKI4DQWU type=del size=1074724 2024-09-22T08:48:47.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.319+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~YZ6PFE3X9K2O.0 size=771098 2024-09-22T08:48:47.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.319+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=YZ6PFE3X9K2O tag=T9634CCI0468 type=write size=1819674 2024-09-22T08:48:47.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.321+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~SJ5D1X5ZP48E.0 size=862477 2024-09-22T08:48:47.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.323+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=SJ5D1X5ZP48E tag=WRVENFE0HW4U type=write size=1911053 2024-09-22T08:48:47.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.325+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=H5AOA1MVG5Z0 type=del size=2179602 2024-09-22T08:48:47.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.326+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~XD9A42FJ1C0X.0 size=1048576 2024-09-22T08:48:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.327+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~XD9A42FJ1C0X.1 size=929449 2024-09-22T08:48:47.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.329+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=XD9A42FJ1C0X tag=4WUOXKQQLL86 type=write size=3026601 2024-09-22T08:48:47.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.330+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=W2WLNRJUO35L type=del size=630561 2024-09-22T08:48:47.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.331+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=7V0YTS5BR6CD type=del 2024-09-22T08:48:47.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.332+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=MGJ2NLEWXRQB type=del size=3443595 2024-09-22T08:48:47.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.334+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~J2XRO9DQXU7N.0 size=1048576 2024-09-22T08:48:47.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.335+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~J2XRO9DQXU7N.1 size=493253 2024-09-22T08:48:47.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.337+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=J2XRO9DQXU7N tag=9595BGFWA3VE type=write size=2590405 2024-09-22T08:48:47.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.338+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=FQEQDT6IFE58 type=del size=606073 2024-09-22T08:48:47.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.339+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=3UF0F254ODY3 type=del 2024-09-22T08:48:47.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.340+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=AQC3HWWIHUKL type=del size=3174025 2024-09-22T08:48:47.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.342+0000 7f7b8ef90780 1 < completed write operation key=G51KS3NM4VFY tag=C7ZJITXPA190 type=write size=869066 2024-09-22T08:48:47.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.343+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=MBH3SCK3FIGP type=del size=949846 2024-09-22T08:48:47.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.344+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=6FYRFQYA0M4R type=del 2024-09-22T08:48:47.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.346+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~VM71ZUIDN8L8.0 size=1048576 2024-09-22T08:48:47.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.347+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~VM71ZUIDN8L8.1 size=692239 2024-09-22T08:48:47.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.347+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=VM71ZUIDN8L8 tag=F87J3Z2FAPFB type=write size=2789391 2024-09-22T08:48:47.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.348+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=L7OSCUMXV23H type=del 2024-09-22T08:48:47.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.351+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~BWA0AQA3EW3M.0 size=368615 2024-09-22T08:48:47.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.351+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=BWA0AQA3EW3M tag=I9HFF5W9Y05S type=write size=1417191 2024-09-22T08:48:47.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.352+0000 7f7b8ef90780 -1 < failed to complete operation key=IEZKK9YIIF33 tag=B69WTTGKHMQR type=del size=1756407: (22) Invalid argument 2024-09-22T08:48:47.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.353+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=TUTXCA1ZJ2V2 type=del size=3894753 2024-09-22T08:48:47.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.355+0000 7f7b8ef90780 1 < suggested update operation key=X9TWX0Z54MOO tag=YOLFH1UQCZ1O type=del size=3571765 2024-09-22T08:48:47.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.358+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ZQ0EOLKDKEYK.0 size=1048576 2024-09-22T08:48:47.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.359+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ZQ0EOLKDKEYK.1 size=666088 2024-09-22T08:48:47.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.359+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=ZQ0EOLKDKEYK tag=ESM5XH1BB9DC type=write size=2763240 2024-09-22T08:48:47.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.360+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=DVKHMFI37PQX type=write size=844347 2024-09-22T08:48:47.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.361+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=I2V1N36TPBB5 type=del size=1832811 2024-09-22T08:48:47.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.362+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.0 size=1048576 2024-09-22T08:48:47.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.363+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.1 size=1048576 2024-09-22T08:48:47.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.364+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~LW6AZQO5C13L.2 size=357472 2024-09-22T08:48:47.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.366+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=LW6AZQO5C13L tag=OK7GGUNBUNLK type=write size=3503200 2024-09-22T08:48:47.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.368+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~C8LEMXV848DQ.0 size=15102 2024-09-22T08:48:47.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.368+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=C8LEMXV848DQ tag=IRX7JFE0GPIV type=write size=1063678 2024-09-22T08:48:47.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.370+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~FW9J06IJ6K02.0 size=657843 2024-09-22T08:48:47.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.371+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=FW9J06IJ6K02 tag=EBAFI1FAEN22 type=write size=1706419 2024-09-22T08:48:47.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.373+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=3KLAXZJOK4Q3 type=del size=1939188 2024-09-22T08:48:47.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.374+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=VRRXZ3PR6Z5K type=del 2024-09-22T08:48:47.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.376+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~VLP1K2ZVO18D.0 size=46132 2024-09-22T08:48:47.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.376+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=VLP1K2ZVO18D tag=MQQNQ1HPC68C type=write size=1094708 2024-09-22T08:48:47.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.378+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=KPXOTOCDSVNH type=del size=1966904 2024-09-22T08:48:47.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.379+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=T9UI8I22V7NN type=del size=3350610 2024-09-22T08:48:47.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.379+0000 7f7b8ef90780 1 < canceled part key=_multipart_IEZKK9YIIF33.2~YZ6PFE3X9K2O.0 size=771098 2024-09-22T08:48:47.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.381+0000 7f7b8ef90780 1 < canceled multipart upload key=IEZKK9YIIF33 upload=YZ6PFE3X9K2O tag=T9634CCI0468 type=write size=1819674 2024-09-22T08:48:47.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.382+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=D9Y31HQGY9LW type=del size=1577600 2024-09-22T08:48:47.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.385+0000 7f7b8ef90780 1 < suggested remove operation key=YXIZJPACZZFY tag=H5AOA1MVG5Z0 type=del 2024-09-22T08:48:47.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.387+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~QWZ47VYPCT3N.0 size=1048576 2024-09-22T08:48:47.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.388+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~QWZ47VYPCT3N.1 size=701575 2024-09-22T08:48:47.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.388+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=QWZ47VYPCT3N tag=3T3YBQ1E0K3Y type=write size=2798727 2024-09-22T08:48:47.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.389+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=W2WLNRJUO35L type=del 2024-09-22T08:48:47.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.391+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~Q7V0Q0L5QSKQ.0 size=98815 2024-09-22T08:48:47.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.391+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=Q7V0Q0L5QSKQ tag=24JQ037M0MPC type=write size=1147391 2024-09-22T08:48:47.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.393+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=MGJ2NLEWXRQB type=del 2024-09-22T08:48:47.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.394+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=V8NVMNA8YP3O type=del size=2587540 2024-09-22T08:48:47.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.397+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=FQEQDT6IFE58 type=del 2024-09-22T08:48:47.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.398+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=PLL7D4ST2UYZ type=del size=1587988 2024-09-22T08:48:47.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.399+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=AQC3HWWIHUKL type=del 2024-09-22T08:48:47.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.402+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.0 size=1048576 2024-09-22T08:48:47.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.403+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.1 size=1048576 2024-09-22T08:48:47.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.404+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.2 size=537951 2024-09-22T08:48:47.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.404+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=25YNIVHHSDYL tag=47PIH9IS0TBL type=write size=3683679 2024-09-22T08:48:47.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.406+0000 7f7b8ef90780 1 < canceled operation key=7ZS8G8H6I957 tag=MBH3SCK3FIGP type=del size=949846 2024-09-22T08:48:47.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.407+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=RIBXOMC0RCZU type=del size=1370109 2024-09-22T08:48:47.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.408+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~VM71ZUIDN8L8.0 size=1048576 2024-09-22T08:48:47.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.409+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~VM71ZUIDN8L8.1 size=692239 2024-09-22T08:48:47.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.412+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=VM71ZUIDN8L8 tag=F87J3Z2FAPFB type=write size=2789391 2024-09-22T08:48:47.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.413+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=D96U8THNASQH type=del size=1896760 2024-09-22T08:48:47.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.414+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~BWA0AQA3EW3M.0 size=368615 2024-09-22T08:48:47.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.417+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=BWA0AQA3EW3M tag=I9HFF5W9Y05S type=write size=1417191 2024-09-22T08:48:47.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.418+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=STNDEWPAWPPB type=del size=1483064 2024-09-22T08:48:47.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.420+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=TUTXCA1ZJ2V2 type=del size=3894753 2024-09-22T08:48:47.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.422+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=UOLX64P4TXM8 type=del size=3458809 2024-09-22T08:48:47.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.423+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ZQ0EOLKDKEYK.0 size=1048576 2024-09-22T08:48:47.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.424+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ZQ0EOLKDKEYK.1 size=666088 2024-09-22T08:48:47.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.427+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=ZQ0EOLKDKEYK tag=ESM5XH1BB9DC type=write size=2763240 2024-09-22T08:48:47.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.429+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.0 size=1048576 2024-09-22T08:48:47.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.430+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.1 size=1048576 2024-09-22T08:48:47.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.431+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.2 size=286006 2024-09-22T08:48:47.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.431+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=NUN4MSJDF2HS tag=SVDEJ1HHE5FS type=write size=3431734 2024-09-22T08:48:47.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.432+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=I2V1N36TPBB5 type=del 2024-09-22T08:48:47.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.435+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~2W227385WAZL.0 size=1048576 2024-09-22T08:48:47.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.436+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~2W227385WAZL.1 size=140772 2024-09-22T08:48:47.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.436+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=2W227385WAZL tag=DQND270RE27V type=write size=2237924 2024-09-22T08:48:47.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.436+0000 7f7b8ef90780 1 < canceled part key=_multipart_T43DW9JPG1BU.2~C8LEMXV848DQ.0 size=15102 2024-09-22T08:48:47.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.439+0000 7f7b8ef90780 1 < canceled multipart upload key=T43DW9JPG1BU upload=C8LEMXV848DQ tag=IRX7JFE0GPIV type=write size=1063678 2024-09-22T08:48:47.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.441+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~DXN34B27MJR6.0 size=1048576 2024-09-22T08:48:47.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.442+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~DXN34B27MJR6.1 size=355859 2024-09-22T08:48:47.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.442+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=DXN34B27MJR6 tag=LH9QET8Z2PPR type=write size=2453011 2024-09-22T08:48:47.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.444+0000 7f7b8ef90780 1 < suggested remove operation key=IRFUEK82X28U tag=3KLAXZJOK4Q3 type=del 2024-09-22T08:48:47.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.445+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=OTJQWDACEDT5 type=write size=354708 2024-09-22T08:48:47.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.447+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~VLP1K2ZVO18D.0 size=46132 2024-09-22T08:48:47.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.448+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=VLP1K2ZVO18D tag=MQQNQ1HPC68C type=write size=1094708 2024-09-22T08:48:47.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.450+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6XZGHN0X8HPD.0 size=1048576 2024-09-22T08:48:47.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.451+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6XZGHN0X8HPD.1 size=120653 2024-09-22T08:48:47.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.451+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=6XZGHN0X8HPD tag=56D488IC01QK type=write size=2217805 2024-09-22T08:48:47.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.453+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=T9UI8I22V7NN type=del 2024-09-22T08:48:47.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.455+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~1SWANQXGPTXF.0 size=1048576 2024-09-22T08:48:47.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.456+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~1SWANQXGPTXF.1 size=930563 2024-09-22T08:48:47.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.456+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=1SWANQXGPTXF tag=W543ZEZARFZA type=write size=3027715 2024-09-22T08:48:47.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.457+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=D9Y31HQGY9LW type=del 2024-09-22T08:48:47.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.459+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5AEV1K0JXA79.0 size=1048576 2024-09-22T08:48:47.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.460+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~5AEV1K0JXA79.1 size=531811 2024-09-22T08:48:47.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.460+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=5AEV1K0JXA79 tag=JW5ND58MLSJB type=write size=2628963 2024-09-22T08:48:47.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.461+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~QWZ47VYPCT3N.0 size=1048576 2024-09-22T08:48:47.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.462+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~QWZ47VYPCT3N.1 size=701575 2024-09-22T08:48:47.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.464+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=QWZ47VYPCT3N tag=3T3YBQ1E0K3Y type=write size=2798727 2024-09-22T08:48:47.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.467+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~GCYD3S39032L.0 size=8756 2024-09-22T08:48:47.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.467+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=GCYD3S39032L tag=LXBPD8KPI64J type=write size=1057332 2024-09-22T08:48:47.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.468+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~Q7V0Q0L5QSKQ.0 size=98815 2024-09-22T08:48:47.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.470+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=Q7V0Q0L5QSKQ tag=24JQ037M0MPC type=write size=1147391 2024-09-22T08:48:47.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.471+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=GFSHLWZFDDY6 type=write size=421161 2024-09-22T08:48:47.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.472+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=V8NVMNA8YP3O type=del 2024-09-22T08:48:47.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.475+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~XX88RN2JVN1W.0 size=784616 2024-09-22T08:48:47.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.475+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=XX88RN2JVN1W tag=FQZJVG3LW5P2 type=write size=1833192 2024-09-22T08:48:47.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.476+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=PLL7D4ST2UYZ type=del 2024-09-22T08:48:47.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.477+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=FAO730Z1RABS type=del size=2865228 2024-09-22T08:48:47.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.478+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.0 size=1048576 2024-09-22T08:48:47.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.480+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.1 size=1048576 2024-09-22T08:48:47.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.480+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~25YNIVHHSDYL.2 size=537951 2024-09-22T08:48:47.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.483+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=25YNIVHHSDYL tag=47PIH9IS0TBL type=write size=3683679 2024-09-22T08:48:47.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.484+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=W878WP3KB1CA type=del size=1666250 2024-09-22T08:48:47.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.485+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=RIBXOMC0RCZU type=del 2024-09-22T08:48:47.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.486+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=VQ663CRZKV4L type=write size=145646 2024-09-22T08:48:47.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.487+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=D96U8THNASQH type=del 2024-09-22T08:48:47.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.489+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=G5KJ6MYZ6R6J type=del size=1833483 2024-09-22T08:48:47.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.490+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=STNDEWPAWPPB type=del 2024-09-22T08:48:47.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.491+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=D9QKDXOZ992C type=write size=32605 2024-09-22T08:48:47.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.492+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=UOLX64P4TXM8 type=del 2024-09-22T08:48:47.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.494+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~POX6KTVU9X2Z.0 size=1048576 2024-09-22T08:48:47.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.495+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~POX6KTVU9X2Z.1 size=8459 2024-09-22T08:48:47.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.495+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=POX6KTVU9X2Z tag=PMWH5MPAD4PT type=write size=2105611 2024-09-22T08:48:47.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.497+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.0 size=1048576 2024-09-22T08:48:47.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.497+0000 7f7b8ef90780 1 < canceled part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.1 size=1048576 2024-09-22T08:48:47.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.498+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~NUN4MSJDF2HS.2 size=286006 2024-09-22T08:48:47.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.500+0000 7f7b8ef90780 1 < canceled multipart upload key=T43DW9JPG1BU upload=NUN4MSJDF2HS tag=SVDEJ1HHE5FS type=write size=3431734 2024-09-22T08:48:47.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.502+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=E4ZGWC2FQXLS type=del size=1358437 2024-09-22T08:48:47.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.503+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~2W227385WAZL.0 size=1048576 2024-09-22T08:48:47.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.504+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~2W227385WAZL.1 size=140772 2024-09-22T08:48:47.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.507+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=2W227385WAZL tag=DQND270RE27V type=write size=2237924 2024-09-22T08:48:47.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.509+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.0 size=1048576 2024-09-22T08:48:47.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.511+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.1 size=1048576 2024-09-22T08:48:47.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.512+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.2 size=813949 2024-09-22T08:48:47.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.512+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=BEQPVU9XF3S8 tag=JMM7J7WMNQ82 type=write size=3959677 2024-09-22T08:48:47.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.513+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~DXN34B27MJR6.0 size=1048576 2024-09-22T08:48:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.515+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~DXN34B27MJR6.1 size=355859 2024-09-22T08:48:47.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.517+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=DXN34B27MJR6 tag=LH9QET8Z2PPR type=write size=2453011 2024-09-22T08:48:47.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.518+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=MQ5TT2GT51XS type=del size=275568 2024-09-22T08:48:47.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.519+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=OTJQWDACEDT5 type=write size=354708 2024-09-22T08:48:47.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.521+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=7C8UMWASH63T type=del size=3047212 2024-09-22T08:48:47.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.522+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~6XZGHN0X8HPD.0 size=1048576 2024-09-22T08:48:47.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.523+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~6XZGHN0X8HPD.1 size=120653 2024-09-22T08:48:47.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.525+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=6XZGHN0X8HPD tag=56D488IC01QK type=write size=2217805 2024-09-22T08:48:47.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.527+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=QNIO5V06JWH1 type=del size=4154986 2024-09-22T08:48:47.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.528+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~1SWANQXGPTXF.0 size=1048576 2024-09-22T08:48:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.529+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~1SWANQXGPTXF.1 size=930563 2024-09-22T08:48:47.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.532+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=1SWANQXGPTXF tag=W543ZEZARFZA type=write size=3027715 2024-09-22T08:48:47.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.534+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~YUJLB0W19D4U.0 size=1048576 2024-09-22T08:48:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.535+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~YUJLB0W19D4U.1 size=1007421 2024-09-22T08:48:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.535+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=YUJLB0W19D4U tag=3TP8BLW8WRSU type=write size=3104573 2024-09-22T08:48:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.536+0000 7f7b8ef90780 1 < canceled part key=_multipart_L3XF68XD23FP.2~5AEV1K0JXA79.0 size=1048576 2024-09-22T08:48:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.536+0000 7f7b8ef90780 1 < canceled part key=_multipart_L3XF68XD23FP.2~5AEV1K0JXA79.1 size=531811 2024-09-22T08:48:47.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.538+0000 7f7b8ef90780 1 < canceled multipart upload key=L3XF68XD23FP upload=5AEV1K0JXA79 tag=JW5ND58MLSJB type=write size=2628963 2024-09-22T08:48:47.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.539+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=GDYT7MX4TIPH type=del size=2617925 2024-09-22T08:48:47.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.541+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~GCYD3S39032L.0 size=8756 2024-09-22T08:48:47.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.543+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=GCYD3S39032L tag=LXBPD8KPI64J type=write size=1057332 2024-09-22T08:48:47.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.544+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=AVSM7GABMEO3 type=del size=3375623 2024-09-22T08:48:47.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.545+0000 7f7b8ef90780 1 < canceled operation key=70WNR3KVU0BG tag=GFSHLWZFDDY6 type=write size=421161 2024-09-22T08:48:47.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.548+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.0 size=1048576 2024-09-22T08:48:47.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.549+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.1 size=1048576 2024-09-22T08:48:47.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.550+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.2 size=40037 2024-09-22T08:48:47.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.550+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=047Q8V8Q5RBS tag=0J9RCSGK2TGK type=write size=3185765 2024-09-22T08:48:47.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.551+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~XX88RN2JVN1W.0 size=784616 2024-09-22T08:48:47.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.553+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=XX88RN2JVN1W tag=FQZJVG3LW5P2 type=write size=1833192 2024-09-22T08:48:47.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.555+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=IVQJ48PM12GM type=del size=3978910 2024-09-22T08:48:47.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.558+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=FAO730Z1RABS type=del 2024-09-22T08:48:47.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.559+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=Q2FA9715G9DX type=del size=3719804 2024-09-22T08:48:47.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.561+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=W878WP3KB1CA type=del 2024-09-22T08:48:47.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.562+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=9H5F3COBYPIR type=del size=4050417 2024-09-22T08:48:47.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.563+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=VQ663CRZKV4L type=write size=145646 2024-09-22T08:48:47.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.565+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=0YEHPPTP2LDW type=del size=1768873 2024-09-22T08:48:47.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.567+0000 7f7b8ef90780 1 < suggested remove operation key=X9TWX0Z54MOO tag=G5KJ6MYZ6R6J type=del 2024-09-22T08:48:47.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.568+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=BB41YKMFQM5G type=write size=817898 2024-09-22T08:48:47.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.570+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=D9QKDXOZ992C type=write size=32605 2024-09-22T08:48:47.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.571+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=8NTHS5K2NP3S type=del size=2899471 2024-09-22T08:48:47.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.572+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~POX6KTVU9X2Z.0 size=1048576 2024-09-22T08:48:47.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.572+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~POX6KTVU9X2Z.1 size=8459 2024-09-22T08:48:47.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.574+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=POX6KTVU9X2Z tag=PMWH5MPAD4PT type=write size=2105611 2024-09-22T08:48:47.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.577+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.0 size=1048576 2024-09-22T08:48:47.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.578+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.1 size=1048576 2024-09-22T08:48:47.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.578+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.2 size=86376 2024-09-22T08:48:47.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.578+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=9INAFXMFI9CS tag=O0V3NHN4FNWE type=write size=3232104 2024-09-22T08:48:47.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.580+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=E4ZGWC2FQXLS type=del size=1358437 2024-09-22T08:48:47.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.582+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~6J64NUWCHFBH.0 size=89813 2024-09-22T08:48:47.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.582+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=6J64NUWCHFBH tag=6ZFFIM2WBTNA type=write size=1138389 2024-09-22T08:48:47.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.584+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.0 size=1048576 2024-09-22T08:48:47.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.585+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.1 size=1048576 2024-09-22T08:48:47.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.586+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~BEQPVU9XF3S8.2 size=813949 2024-09-22T08:48:47.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.588+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=BEQPVU9XF3S8 tag=JMM7J7WMNQ82 type=write size=3959677 2024-09-22T08:48:47.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.589+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=9UH261A764IQ type=del size=1030524 2024-09-22T08:48:47.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.590+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=MQ5TT2GT51XS type=del 2024-09-22T08:48:47.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.591+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=LF0V9MHWWTNE type=del size=3145949 2024-09-22T08:48:47.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.593+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=7C8UMWASH63T type=del 2024-09-22T08:48:47.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.594+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=AD1EJVZSSMVR type=del size=383700 2024-09-22T08:48:47.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.595+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=QNIO5V06JWH1 type=del 2024-09-22T08:48:47.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.597+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=LAWZ17FRHOA8 type=del size=1099615 2024-09-22T08:48:47.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.598+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~YUJLB0W19D4U.0 size=1048576 2024-09-22T08:48:47.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.599+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~YUJLB0W19D4U.1 size=1007421 2024-09-22T08:48:47.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.601+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=YUJLB0W19D4U tag=3TP8BLW8WRSU type=write size=3104573 2024-09-22T08:48:47.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.603+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~87LXF43U8EJH.0 size=777332 2024-09-22T08:48:47.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.603+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=87LXF43U8EJH tag=WAY2RFXCRPTY type=write size=1825908 2024-09-22T08:48:47.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.604+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=GDYT7MX4TIPH type=del 2024-09-22T08:48:47.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.606+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=R3A0X1IMSFJR type=del size=1182837 2024-09-22T08:48:47.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.607+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=AVSM7GABMEO3 type=del 2024-09-22T08:48:47.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.608+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=MM8NDJDHFXMU type=del size=1182185 2024-09-22T08:48:47.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.609+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.0 size=1048576 2024-09-22T08:48:47.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.610+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.1 size=1048576 2024-09-22T08:48:47.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.611+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~047Q8V8Q5RBS.2 size=40037 2024-09-22T08:48:47.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.613+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=047Q8V8Q5RBS tag=0J9RCSGK2TGK type=write size=3185765 2024-09-22T08:48:47.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.616+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.0 size=1048576 2024-09-22T08:48:47.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.617+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.1 size=1048576 2024-09-22T08:48:47.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.618+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.2 size=234607 2024-09-22T08:48:47.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.618+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=JAPJAV2PPK1H tag=NTAQMGNGXT6J type=write size=3380335 2024-09-22T08:48:47.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.619+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=IVQJ48PM12GM type=del 2024-09-22T08:48:47.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.620+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=NERN7DHNB3TZ type=del size=655396 2024-09-22T08:48:47.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.623+0000 7f7b8ef90780 1 < suggested update operation key=RX3H0G6WHB9L tag=Q2FA9715G9DX type=del size=3719804 2024-09-22T08:48:47.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.625+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~241AWWC2F1RH.0 size=1048576 2024-09-22T08:48:47.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.626+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~241AWWC2F1RH.1 size=663857 2024-09-22T08:48:47.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.626+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=241AWWC2F1RH tag=IR0T7V3CJOO8 type=write size=2761009 2024-09-22T08:48:47.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.627+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=9H5F3COBYPIR type=del size=4050417 2024-09-22T08:48:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.629+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=C6ZSY0X87JGO type=del size=1608305 2024-09-22T08:48:47.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.630+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=0YEHPPTP2LDW type=del size=1768873 2024-09-22T08:48:47.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.632+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~0XZHSFWGTU4M.0 size=737442 2024-09-22T08:48:47.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.632+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=0XZHSFWGTU4M tag=64RW8059ZBWI type=write size=1786018 2024-09-22T08:48:47.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.633+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=BB41YKMFQM5G type=write size=817898 2024-09-22T08:48:47.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.636+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~3GP4JFO9JCQC.0 size=722801 2024-09-22T08:48:47.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.636+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=3GP4JFO9JCQC tag=CUNMU47L90GB type=write size=1771377 2024-09-22T08:48:47.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.638+0000 7f7b8ef90780 1 < suggested remove operation key=1U6T2BIZS72V tag=8NTHS5K2NP3S type=del 2024-09-22T08:48:47.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.640+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.0 size=1048576 2024-09-22T08:48:47.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.642+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.1 size=1048576 2024-09-22T08:48:47.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.2 size=966544 2024-09-22T08:48:47.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.643+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=3EUS54GNG6UQ tag=LCUYTJF99EEL type=write size=4112272 2024-09-22T08:48:47.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.644+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.0 size=1048576 2024-09-22T08:48:47.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.645+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.1 size=1048576 2024-09-22T08:48:47.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.646+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~9INAFXMFI9CS.2 size=86376 2024-09-22T08:48:47.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.648+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=9INAFXMFI9CS tag=O0V3NHN4FNWE type=write size=3232104 2024-09-22T08:48:47.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.649+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=2HDIE99MXWA9 type=del size=3425887 2024-09-22T08:48:47.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.650+0000 7f7b8ef90780 1 < canceled part key=_multipart_PODNY4NH4A9W.2~6J64NUWCHFBH.0 size=89813 2024-09-22T08:48:47.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.651+0000 7f7b8ef90780 1 < canceled multipart upload key=PODNY4NH4A9W upload=6J64NUWCHFBH tag=6ZFFIM2WBTNA type=write size=1138389 2024-09-22T08:48:47.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.654+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~K2MXIIG3ECQS.0 size=1048576 2024-09-22T08:48:47.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.655+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~K2MXIIG3ECQS.1 size=611851 2024-09-22T08:48:47.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.655+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=K2MXIIG3ECQS tag=9JOD72XVG12O type=write size=2709003 2024-09-22T08:48:47.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.656+0000 7f7b8ef90780 1 < canceled operation key=70WNR3KVU0BG tag=9UH261A764IQ type=del size=1030524 2024-09-22T08:48:47.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.658+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=LS52P4OVRDNN type=del size=531062 2024-09-22T08:48:47.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.659+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=LF0V9MHWWTNE type=del 2024-09-22T08:48:47.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.661+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~HNSJY21KFRH0.0 size=150003 2024-09-22T08:48:47.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.661+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=HNSJY21KFRH0 tag=WKXDO5ZIH3NK type=write size=1198579 2024-09-22T08:48:47.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.662+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=AD1EJVZSSMVR type=del 2024-09-22T08:48:47.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.665+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~RF833JDI1PET.0 size=8024 2024-09-22T08:48:47.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.665+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=RF833JDI1PET tag=CF7GMW7V9T2D type=write size=1056600 2024-09-22T08:48:47.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.666+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=LAWZ17FRHOA8 type=del 2024-09-22T08:48:47.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.668+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.0 size=1048576 2024-09-22T08:48:47.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.669+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.1 size=1048576 2024-09-22T08:48:47.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.670+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.2 size=596691 2024-09-22T08:48:47.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.670+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=LSW4GZX21EGL tag=9CL0M468I8DJ type=write size=3742419 2024-09-22T08:48:47.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.672+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~87LXF43U8EJH.0 size=777332 2024-09-22T08:48:47.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.674+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=87LXF43U8EJH tag=WAY2RFXCRPTY type=write size=1825908 2024-09-22T08:48:47.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.676+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=S8FNQS78PGQL type=del size=4114622 2024-09-22T08:48:47.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.678+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=R3A0X1IMSFJR type=del 2024-09-22T08:48:47.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.681+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~0SVTBU5QM6M8.0 size=267104 2024-09-22T08:48:47.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.681+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=0SVTBU5QM6M8 tag=B5KIOR0AI7L7 type=write size=1315680 2024-09-22T08:48:47.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.682+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=MM8NDJDHFXMU type=del 2024-09-22T08:48:47.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.683+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=KJKHBELJ1SYC type=del size=1259813 2024-09-22T08:48:47.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.685+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.0 size=1048576 2024-09-22T08:48:47.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.686+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.1 size=1048576 2024-09-22T08:48:47.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.687+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~JAPJAV2PPK1H.2 size=234607 2024-09-22T08:48:47.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.689+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=JAPJAV2PPK1H tag=NTAQMGNGXT6J type=write size=3380335 2024-09-22T08:48:47.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.691+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~F9YDLQOK7EHT.0 size=1048576 2024-09-22T08:48:47.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.692+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~F9YDLQOK7EHT.1 size=90861 2024-09-22T08:48:47.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.692+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=F9YDLQOK7EHT tag=JE7IIT2PQP4R type=write size=2188013 2024-09-22T08:48:47.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.694+0000 7f7b8ef90780 -1 < failed to complete operation key=RX3H0G6WHB9L tag=NERN7DHNB3TZ type=del size=655396: (22) Invalid argument 2024-09-22T08:48:47.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.696+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.0 size=1048576 2024-09-22T08:48:47.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.697+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.1 size=1048576 2024-09-22T08:48:47.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.698+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.2 size=992349 2024-09-22T08:48:47.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.698+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=VGVT3HXKSP9B tag=QVZ4HZ8X403C type=write size=4138077 2024-09-22T08:48:47.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.699+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~241AWWC2F1RH.0 size=1048576 2024-09-22T08:48:47.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.700+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~241AWWC2F1RH.1 size=663857 2024-09-22T08:48:47.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.702+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=241AWWC2F1RH tag=IR0T7V3CJOO8 type=write size=2761009 2024-09-22T08:48:47.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.704+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~N8IBDZ9VQRRU.0 size=1048576 2024-09-22T08:48:47.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.705+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~N8IBDZ9VQRRU.1 size=816077 2024-09-22T08:48:47.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.705+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=N8IBDZ9VQRRU tag=IM9JJCKCU7XU type=write size=2913229 2024-09-22T08:48:47.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.707+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=C6ZSY0X87JGO type=del 2024-09-22T08:48:47.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.708+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=7PZKM0SX63XA type=del size=3622916 2024-09-22T08:48:47.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.708+0000 7f7b8ef90780 1 < canceled part key=_multipart_UQPY2ITDMKGO.2~0XZHSFWGTU4M.0 size=737442 2024-09-22T08:48:47.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.710+0000 7f7b8ef90780 1 < canceled multipart upload key=UQPY2ITDMKGO upload=0XZHSFWGTU4M tag=64RW8059ZBWI type=write size=1786018 2024-09-22T08:48:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.711+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=HUU8S0PWU602 type=write size=418353 2024-09-22T08:48:47.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.712+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~3GP4JFO9JCQC.0 size=722801 2024-09-22T08:48:47.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.714+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=3GP4JFO9JCQC tag=CUNMU47L90GB type=write size=1771377 2024-09-22T08:48:47.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.716+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~H651KV9CCAWT.0 size=1048576 2024-09-22T08:48:47.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.717+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~H651KV9CCAWT.1 size=967860 2024-09-22T08:48:47.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.717+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=H651KV9CCAWT tag=7NCTA9OW4FOH type=write size=3065012 2024-09-22T08:48:47.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.719+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.0 size=1048576 2024-09-22T08:48:47.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.720+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.1 size=1048576 2024-09-22T08:48:47.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.720+0000 7f7b8ef90780 1 < canceled part key=_multipart_X9TWX0Z54MOO.2~3EUS54GNG6UQ.2 size=966544 2024-09-22T08:48:47.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.722+0000 7f7b8ef90780 1 < canceled multipart upload key=X9TWX0Z54MOO upload=3EUS54GNG6UQ tag=LCUYTJF99EEL type=write size=4112272 2024-09-22T08:48:47.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.723+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=J52OT2Y63QVT type=write size=901777 2024-09-22T08:48:47.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.724+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=2HDIE99MXWA9 type=del 2024-09-22T08:48:47.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.727+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.0 size=1048576 2024-09-22T08:48:47.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.728+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.1 size=1048576 2024-09-22T08:48:47.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.729+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.2 size=858835 2024-09-22T08:48:47.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.729+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=2R2E9AEUQJ4C tag=9P9A04ZNRL1F type=write size=4004563 2024-09-22T08:48:47.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.730+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~K2MXIIG3ECQS.0 size=1048576 2024-09-22T08:48:47.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.731+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~K2MXIIG3ECQS.1 size=611851 2024-09-22T08:48:47.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.733+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=K2MXIIG3ECQS tag=9JOD72XVG12O type=write size=2709003 2024-09-22T08:48:47.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.735+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=7XQG0ZQG8PM1 type=del size=1339622 2024-09-22T08:48:47.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.736+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=LS52P4OVRDNN type=del 2024-09-22T08:48:47.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.738+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.0 size=1048576 2024-09-22T08:48:47.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.739+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.1 size=1048576 2024-09-22T08:48:47.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.741+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.2 size=960607 2024-09-22T08:48:47.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.741+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=TI8OV0VL0WDH tag=P8JB4M3CWEQ6 type=write size=4106335 2024-09-22T08:48:47.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.742+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~HNSJY21KFRH0.0 size=150003 2024-09-22T08:48:47.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.744+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=HNSJY21KFRH0 tag=WKXDO5ZIH3NK type=write size=1198579 2024-09-22T08:48:47.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.745+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=4L7YJ3S0CL2B type=del size=2425151 2024-09-22T08:48:47.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.747+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~RF833JDI1PET.0 size=8024 2024-09-22T08:48:47.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.749+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=RF833JDI1PET tag=CF7GMW7V9T2D type=write size=1056600 2024-09-22T08:48:47.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.750+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=GARA9X00XM9S type=del size=1235546 2024-09-22T08:48:47.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.752+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.0 size=1048576 2024-09-22T08:48:47.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.753+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.1 size=1048576 2024-09-22T08:48:47.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.754+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~LSW4GZX21EGL.2 size=596691 2024-09-22T08:48:47.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.756+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=LSW4GZX21EGL tag=9CL0M468I8DJ type=write size=3742419 2024-09-22T08:48:47.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.757+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=EUD80RGKXMWG type=del size=475271 2024-09-22T08:48:47.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.758+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=S8FNQS78PGQL type=del 2024-09-22T08:48:47.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.761+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.0 size=1048576 2024-09-22T08:48:47.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.762+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.1 size=1048576 2024-09-22T08:48:47.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.763+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.2 size=826102 2024-09-22T08:48:47.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.763+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=V78FZ15RGEX5 tag=26YYV344R1VS type=write size=3971830 2024-09-22T08:48:47.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.764+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~0SVTBU5QM6M8.0 size=267104 2024-09-22T08:48:47.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.766+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=0SVTBU5QM6M8 tag=B5KIOR0AI7L7 type=write size=1315680 2024-09-22T08:48:47.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.767+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=MIE04JHZW0NX type=del size=3543951 2024-09-22T08:48:47.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.770+0000 7f7b8ef90780 1 < suggested remove operation key=YDJLMBL7EQWN tag=KJKHBELJ1SYC type=del 2024-09-22T08:48:47.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.771+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=UU4FV83JPKX9 type=del size=3449063 2024-09-22T08:48:47.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.772+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~F9YDLQOK7EHT.0 size=1048576 2024-09-22T08:48:47.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.773+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~F9YDLQOK7EHT.1 size=90861 2024-09-22T08:48:47.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.775+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=F9YDLQOK7EHT tag=JE7IIT2PQP4R type=write size=2188013 2024-09-22T08:48:47.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.776+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=MKD8EKZWFVAK type=write size=34647 2024-09-22T08:48:47.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.778+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.0 size=1048576 2024-09-22T08:48:47.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.779+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.1 size=1048576 2024-09-22T08:48:47.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.780+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~VGVT3HXKSP9B.2 size=992349 2024-09-22T08:48:47.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.782+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=VGVT3HXKSP9B tag=QVZ4HZ8X403C type=write size=4138077 2024-09-22T08:48:47.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.784+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~6BTGRB7D3ZKV.0 size=1048576 2024-09-22T08:48:47.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.785+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~6BTGRB7D3ZKV.1 size=437728 2024-09-22T08:48:47.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.785+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=6BTGRB7D3ZKV tag=NTUFIVYWSHLK type=write size=2534880 2024-09-22T08:48:47.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.786+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~N8IBDZ9VQRRU.0 size=1048576 2024-09-22T08:48:47.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.787+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~N8IBDZ9VQRRU.1 size=816077 2024-09-22T08:48:47.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.789+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=N8IBDZ9VQRRU tag=IM9JJCKCU7XU type=write size=2913229 2024-09-22T08:48:47.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.792+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=09DXXDDNHFL8 type=del size=2900247 2024-09-22T08:48:47.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.793+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=7PZKM0SX63XA type=del 2024-09-22T08:48:47.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.795+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=QJ07408T4782 type=del size=3667247 2024-09-22T08:48:47.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.796+0000 7f7b8ef90780 1 < completed write operation key=R0N30XP1BXY3 tag=HUU8S0PWU602 type=write size=418353 2024-09-22T08:48:47.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.798+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~S23JHK6GKUJ6.0 size=1048576 2024-09-22T08:48:47.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.799+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~S23JHK6GKUJ6.1 size=257734 2024-09-22T08:48:47.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.799+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=S23JHK6GKUJ6 tag=1E1Z80ES1W8T type=write size=2354886 2024-09-22T08:48:47.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.800+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~H651KV9CCAWT.0 size=1048576 2024-09-22T08:48:47.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.801+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~H651KV9CCAWT.1 size=967860 2024-09-22T08:48:47.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.803+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=H651KV9CCAWT tag=7NCTA9OW4FOH type=write size=3065012 2024-09-22T08:48:47.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.805+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=SIL7U6RUWPDZ type=del size=3649840 2024-09-22T08:48:47.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.806+0000 7f7b8ef90780 1 < completed write operation key=ZM6ITJ2QUIPJ tag=J52OT2Y63QVT type=write size=901777 2024-09-22T08:48:47.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.809+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.0 size=1048576 2024-09-22T08:48:47.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.810+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.1 size=1048576 2024-09-22T08:48:47.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.810+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.2 size=38131 2024-09-22T08:48:47.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.811+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=NXA4OLQMOV66 tag=D06PFVTE1LIM type=write size=3183859 2024-09-22T08:48:47.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.812+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.0 size=1048576 2024-09-22T08:48:47.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.813+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.1 size=1048576 2024-09-22T08:48:47.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.814+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~2R2E9AEUQJ4C.2 size=858835 2024-09-22T08:48:47.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.816+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=2R2E9AEUQJ4C tag=9P9A04ZNRL1F type=write size=4004563 2024-09-22T08:48:47.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.818+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~6PRSRVFNBPQ1.0 size=1048576 2024-09-22T08:48:47.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.819+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~6PRSRVFNBPQ1.1 size=825745 2024-09-22T08:48:47.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.819+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=6PRSRVFNBPQ1 tag=X3BFL4CRMWBE type=write size=2922897 2024-09-22T08:48:47.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.820+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=7XQG0ZQG8PM1 type=del 2024-09-22T08:48:47.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.822+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~QNGZWFF1QIJK.0 size=135808 2024-09-22T08:48:47.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.822+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=QNGZWFF1QIJK tag=YEH6B9RWWIOH type=write size=1184384 2024-09-22T08:48:47.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.824+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.0 size=1048576 2024-09-22T08:48:47.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.825+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.1 size=1048576 2024-09-22T08:48:47.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.826+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~TI8OV0VL0WDH.2 size=960607 2024-09-22T08:48:47.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.828+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=TI8OV0VL0WDH tag=P8JB4M3CWEQ6 type=write size=4106335 2024-09-22T08:48:47.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.829+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=02RUW6Y7V0ND type=del size=2734106 2024-09-22T08:48:47.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.830+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=4L7YJ3S0CL2B type=del 2024-09-22T08:48:47.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.831+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=575Z3SD6UFYJ type=del size=3550046 2024-09-22T08:48:47.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.833+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=GARA9X00XM9S type=del 2024-09-22T08:48:47.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.835+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~ROOI1LN9ND3S.0 size=1048576 2024-09-22T08:48:47.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.836+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~ROOI1LN9ND3S.1 size=919760 2024-09-22T08:48:47.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.836+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=ROOI1LN9ND3S tag=IQZETR2CINJB type=write size=3016912 2024-09-22T08:48:47.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.837+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=EUD80RGKXMWG type=del 2024-09-22T08:48:47.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.840+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.0 size=1048576 2024-09-22T08:48:47.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.841+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.1 size=1048576 2024-09-22T08:48:47.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.842+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.2 size=717332 2024-09-22T08:48:47.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.842+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=V12UL11UYU3J tag=DWEQ9J2SU1IV type=write size=3863060 2024-09-22T08:48:47.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.843+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.0 size=1048576 2024-09-22T08:48:47.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.844+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.1 size=1048576 2024-09-22T08:48:47.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.845+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~V78FZ15RGEX5.2 size=826102 2024-09-22T08:48:47.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.847+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=V78FZ15RGEX5 tag=26YYV344R1VS type=write size=3971830 2024-09-22T08:48:47.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.850+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~1URAEN84RKIA.0 size=814072 2024-09-22T08:48:47.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.850+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=1URAEN84RKIA tag=40GWJ4X2JXAE type=write size=1862648 2024-09-22T08:48:47.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.852+0000 7f7b8ef90780 1 < suggested remove operation key=WDGY8YL16UWI tag=MIE04JHZW0NX type=del 2024-09-22T08:48:47.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.854+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~TT57FV6509N3.0 size=1048576 2024-09-22T08:48:47.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.855+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~TT57FV6509N3.1 size=342883 2024-09-22T08:48:47.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.855+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=TT57FV6509N3 tag=B3EG28VZIZYJ type=write size=2440035 2024-09-22T08:48:47.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.857+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=UU4FV83JPKX9 type=del 2024-09-22T08:48:47.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.858+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=0XZYEM0DTANL type=del size=4017519 2024-09-22T08:48:47.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.859+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=WDGY8YL16UWI tag=MKD8EKZWFVAK type=write size=34647: (2) No such file or directory 2024-09-22T08:48:47.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.860+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=6IFH65FAWM73 type=write size=948417 2024-09-22T08:48:47.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.861+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~6BTGRB7D3ZKV.0 size=1048576 2024-09-22T08:48:47.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.862+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~6BTGRB7D3ZKV.1 size=437728 2024-09-22T08:48:47.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.865+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=6BTGRB7D3ZKV tag=NTUFIVYWSHLK type=write size=2534880 2024-09-22T08:48:47.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.866+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=NZ2PTV6ED8PG type=del size=1505838 2024-09-22T08:48:47.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.869+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=09DXXDDNHFL8 type=del 2024-09-22T08:48:47.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.871+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~GQ8XUTW8ZFWA.0 size=834624 2024-09-22T08:48:47.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.871+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=GQ8XUTW8ZFWA tag=UJS3ODFFTDT1 type=write size=1883200 2024-09-22T08:48:47.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.872+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=QJ07408T4782 type=del 2024-09-22T08:48:47.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.874+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~UQXEFIQSDF6C.0 size=1048576 2024-09-22T08:48:47.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.875+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~UQXEFIQSDF6C.1 size=565079 2024-09-22T08:48:47.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.875+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=UQXEFIQSDF6C tag=MO2B46CJ0R17 type=write size=2662231 2024-09-22T08:48:47.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.877+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~S23JHK6GKUJ6.0 size=1048576 2024-09-22T08:48:47.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.877+0000 7f7b8ef90780 1 < canceled part key=_multipart_YDJLMBL7EQWN.2~S23JHK6GKUJ6.1 size=257734 2024-09-22T08:48:47.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.879+0000 7f7b8ef90780 1 < canceled multipart upload key=YDJLMBL7EQWN upload=S23JHK6GKUJ6 tag=1E1Z80ES1W8T type=write size=2354886 2024-09-22T08:48:47.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.880+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=RTKJO40FUVHT type=write size=229608 2024-09-22T08:48:47.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.882+0000 7f7b8ef90780 1 < suggested remove operation key=YXIZJPACZZFY tag=SIL7U6RUWPDZ type=del 2024-09-22T08:48:47.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.884+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=86LTOTFJ0RCF type=del size=2334943 2024-09-22T08:48:47.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.884+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.0 size=1048576 2024-09-22T08:48:47.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.885+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.1 size=1048576 2024-09-22T08:48:47.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.886+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~NXA4OLQMOV66.2 size=38131 2024-09-22T08:48:47.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.888+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=NXA4OLQMOV66 tag=D06PFVTE1LIM type=write size=3183859 2024-09-22T08:48:47.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.890+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=I5PH0N4UH3GG type=write size=581696 2024-09-22T08:48:47.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.891+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~6PRSRVFNBPQ1.0 size=1048576 2024-09-22T08:48:47.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.893+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~6PRSRVFNBPQ1.1 size=825745 2024-09-22T08:48:47.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.895+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=6PRSRVFNBPQ1 tag=X3BFL4CRMWBE type=write size=2922897 2024-09-22T08:48:47.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.896+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=HY05RYZH60DX type=del size=1889960 2024-09-22T08:48:47.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.898+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~QNGZWFF1QIJK.0 size=135808 2024-09-22T08:48:47.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.900+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=QNGZWFF1QIJK tag=YEH6B9RWWIOH type=write size=1184384 2024-09-22T08:48:47.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.902+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=WNY38XMHDTJ8 type=del size=4026539 2024-09-22T08:48:47.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.905+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=02RUW6Y7V0ND type=del 2024-09-22T08:48:47.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.907+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.0 size=1048576 2024-09-22T08:48:47.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.908+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.1 size=1048576 2024-09-22T08:48:47.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.910+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.2 size=742205 2024-09-22T08:48:47.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.910+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=H6CUL3VD5J2Y tag=AGYBLEUO32AF type=write size=3887933 2024-09-22T08:48:47.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.912+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=575Z3SD6UFYJ type=del 2024-09-22T08:48:47.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.914+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=AN2OVUGXXJ0K type=del size=1764022 2024-09-22T08:48:47.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.915+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~ROOI1LN9ND3S.0 size=1048576 2024-09-22T08:48:47.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.916+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~ROOI1LN9ND3S.1 size=919760 2024-09-22T08:48:47.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.919+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=ROOI1LN9ND3S tag=IQZETR2CINJB type=write size=3016912 2024-09-22T08:48:47.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.921+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.0 size=1048576 2024-09-22T08:48:47.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.923+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.1 size=1048576 2024-09-22T08:48:47.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.924+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.2 size=368272 2024-09-22T08:48:47.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.924+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=9PEVTZNKX2VV tag=GI90MT184TVU type=write size=3514000 2024-09-22T08:48:47.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.925+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.0 size=1048576 2024-09-22T08:48:47.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.926+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.1 size=1048576 2024-09-22T08:48:47.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.928+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~V12UL11UYU3J.2 size=717332 2024-09-22T08:48:47.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.930+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=V12UL11UYU3J tag=DWEQ9J2SU1IV type=write size=3863060 2024-09-22T08:48:47.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.931+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=CTCDVC8BQ13C type=del size=1330326 2024-09-22T08:48:47.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.932+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~1URAEN84RKIA.0 size=814072 2024-09-22T08:48:47.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.935+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=1URAEN84RKIA tag=40GWJ4X2JXAE type=write size=1862648 2024-09-22T08:48:47.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.936+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=VHOVOBJ8J0SD type=del size=2559527 2024-09-22T08:48:47.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.938+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~TT57FV6509N3.0 size=1048576 2024-09-22T08:48:47.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.939+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~TT57FV6509N3.1 size=342883 2024-09-22T08:48:47.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.941+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=TT57FV6509N3 tag=B3EG28VZIZYJ type=write size=2440035 2024-09-22T08:48:47.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.943+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=75W3NPFP8B22 type=del size=2531046 2024-09-22T08:48:47.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.945+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=0XZYEM0DTANL type=del 2024-09-22T08:48:47.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.946+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=5X1WTMIFO5RA type=del size=3286633 2024-09-22T08:48:47.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.948+0000 7f7b8ef90780 1 < suggested update operation key=QQKJ4URBRF16 tag=6IFH65FAWM73 type=write size=948417 2024-09-22T08:48:47.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.951+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.0 size=1048576 2024-09-22T08:48:47.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.952+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.1 size=1048576 2024-09-22T08:48:47.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.953+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.2 size=482408 2024-09-22T08:48:47.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.953+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=3UXK1QN3YMMS tag=VW1JZD8059PH type=write size=3628136 2024-09-22T08:48:47.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.954+0000 7f7b8ef90780 -1 < failed to complete operation key=F3IHQ6Z9V1DX tag=NZ2PTV6ED8PG type=del size=1505838: (22) Invalid argument 2024-09-22T08:48:47.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.955+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=B1WHN30R3FX2 type=del size=580977 2024-09-22T08:48:47.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.957+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~GQ8XUTW8ZFWA.0 size=834624 2024-09-22T08:48:47.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.959+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=GQ8XUTW8ZFWA tag=UJS3ODFFTDT1 type=write size=1883200 2024-09-22T08:48:47.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.960+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=QAE1DV1H7EXQ type=del size=835351 2024-09-22T08:48:47.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.962+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~UQXEFIQSDF6C.0 size=1048576 2024-09-22T08:48:47.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.963+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~UQXEFIQSDF6C.1 size=565079 2024-09-22T08:48:47.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.965+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=UQXEFIQSDF6C tag=MO2B46CJ0R17 type=write size=2662231 2024-09-22T08:48:47.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.966+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=YL7JKS1CGBO3 type=del size=67755 2024-09-22T08:48:47.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.967+0000 7f7b8ef90780 1 < completed write operation key=WDGY8YL16UWI tag=RTKJO40FUVHT type=write size=229608 2024-09-22T08:48:47.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.970+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~G9LIQ2O3TPD8.0 size=992880 2024-09-22T08:48:47.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.970+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=G9LIQ2O3TPD8 tag=7D8XVKLWX0KO type=write size=2041456 2024-09-22T08:48:47.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.971+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=86LTOTFJ0RCF type=del 2024-09-22T08:48:47.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.972+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=QQQT4BOBXS3W type=write size=227344 2024-09-22T08:48:47.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.975+0000 7f7b8ef90780 1 < suggested remove operation key=YF94C9GVRXQP tag=I5PH0N4UH3GG type=write 2024-09-22T08:48:47.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.976+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=6W0GEJ9UK7PO type=del size=3946179 2024-09-22T08:48:47.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.977+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=HY05RYZH60DX type=del 2024-09-22T08:48:47.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.979+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=8J1J6KHI0CCS type=del size=2488928 2024-09-22T08:48:47.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.980+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=WNY38XMHDTJ8 type=del 2024-09-22T08:48:47.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.983+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~4ED6HAOD70X6.0 size=1048576 2024-09-22T08:48:47.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.984+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~4ED6HAOD70X6.1 size=855943 2024-09-22T08:48:47.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.984+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=4ED6HAOD70X6 tag=DTULDH966LHN type=write size=2953095 2024-09-22T08:48:47.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.985+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.0 size=1048576 2024-09-22T08:48:47.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.986+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.1 size=1048576 2024-09-22T08:48:47.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.987+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~H6CUL3VD5J2Y.2 size=742205 2024-09-22T08:48:47.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.989+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=H6CUL3VD5J2Y tag=AGYBLEUO32AF type=write size=3887933 2024-09-22T08:48:47.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.991+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=NNHHUS3T0GTN type=write size=994403 2024-09-22T08:48:47.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.992+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=AN2OVUGXXJ0K type=del 2024-09-22T08:48:47.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.993+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=OEY43IIYG3BM type=del size=3623034 2024-09-22T08:48:47.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.994+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.0 size=1048576 2024-09-22T08:48:47.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.995+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.1 size=1048576 2024-09-22T08:48:47.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.995+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~9PEVTZNKX2VV.2 size=368272 2024-09-22T08:48:47.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.997+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=9PEVTZNKX2VV tag=GI90MT184TVU type=write size=3514000 2024-09-22T08:48:48.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:47.999+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=S70ZO11OT54K type=del size=568849 2024-09-22T08:48:48.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.000+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=CTCDVC8BQ13C type=del 2024-09-22T08:48:48.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.001+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=FWZOC7JJSFBY type=del size=4008740 2024-09-22T08:48:48.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.003+0000 7f7b8ef90780 1 < canceled operation key=9DO6M6UQ5A05 tag=VHOVOBJ8J0SD type=del size=2559527 2024-09-22T08:48:48.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.004+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=0E3JTY34RX3R type=write size=687153 2024-09-22T08:48:48.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.007+0000 7f7b8ef90780 1 < suggested update operation key=X9TWX0Z54MOO tag=75W3NPFP8B22 type=del size=2531046 2024-09-22T08:48:48.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.009+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.0 size=1048576 2024-09-22T08:48:48.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.010+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.1 size=1048576 2024-09-22T08:48:48.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.011+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.2 size=983818 2024-09-22T08:48:48.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.011+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=C7BMKOYFA1AM tag=AE53IUVFTQYU type=write size=4129546 2024-09-22T08:48:48.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.014+0000 7f7b8ef90780 1 < suggested update operation key=O81X7IWXN4VP tag=5X1WTMIFO5RA type=del size=3286633 2024-09-22T08:48:48.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.016+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~LEGB2EL042ZG.0 size=727126 2024-09-22T08:48:48.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.016+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=LEGB2EL042ZG tag=12V14VINUTM8 type=write size=1775702 2024-09-22T08:48:48.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.018+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.0 size=1048576 2024-09-22T08:48:48.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.019+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.1 size=1048576 2024-09-22T08:48:48.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.020+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~3UXK1QN3YMMS.2 size=482408 2024-09-22T08:48:48.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.022+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=3UXK1QN3YMMS tag=VW1JZD8059PH type=write size=3628136 2024-09-22T08:48:48.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.023+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=DFOW655P2YMF type=del size=1132467 2024-09-22T08:48:48.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.024+0000 7f7b8ef90780 1 < canceled operation key=PODNY4NH4A9W tag=B1WHN30R3FX2 type=del size=580977 2024-09-22T08:48:48.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.027+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~YK4QHX9LCHR3.0 size=825287 2024-09-22T08:48:48.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.027+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=YK4QHX9LCHR3 tag=73ET49HHDGQS type=write size=1873863 2024-09-22T08:48:48.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.028+0000 7f7b8ef90780 1 < canceled operation key=4J4EGI19N123 tag=QAE1DV1H7EXQ type=del size=835351 2024-09-22T08:48:48.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.029+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=V19CGPI2PRF5 type=write size=1032571 2024-09-22T08:48:48.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.031+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=YL7JKS1CGBO3 type=del 2024-09-22T08:48:48.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.033+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~ECZ85V9H4VBM.0 size=1048576 2024-09-22T08:48:48.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.034+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~ECZ85V9H4VBM.1 size=950874 2024-09-22T08:48:48.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.034+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=ECZ85V9H4VBM tag=9G1GD2TV23JB type=write size=3048026 2024-09-22T08:48:48.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.036+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~G9LIQ2O3TPD8.0 size=992880 2024-09-22T08:48:48.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.038+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=G9LIQ2O3TPD8 tag=7D8XVKLWX0KO type=write size=2041456 2024-09-22T08:48:48.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.041+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.0 size=1048576 2024-09-22T08:48:48.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.042+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.1 size=1048576 2024-09-22T08:48:48.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.043+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.2 size=863946 2024-09-22T08:48:48.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.043+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=MVAV05EY0ZDD tag=7CIINUA1J8M2 type=write size=4009674 2024-09-22T08:48:48.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.044+0000 7f7b8ef90780 -1 < failed to complete operation key=O81X7IWXN4VP tag=QQQT4BOBXS3W type=write size=227344: (22) Invalid argument 2024-09-22T08:48:48.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.046+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.0 size=1048576 2024-09-22T08:48:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.048+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.1 size=1048576 2024-09-22T08:48:48.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.049+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.2 size=958104 2024-09-22T08:48:48.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.049+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=1H0F6XHH9TH1 tag=D59JUUEWZIJ8 type=write size=4103832 2024-09-22T08:48:48.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.050+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=6W0GEJ9UK7PO type=del 2024-09-22T08:48:48.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.051+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=0QFP8JMI820V type=del size=1443654 2024-09-22T08:48:48.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.052+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=8J1J6KHI0CCS type=del 2024-09-22T08:48:48.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.054+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=Q3R23PBXI55F type=del size=561834 2024-09-22T08:48:48.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.055+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~4ED6HAOD70X6.0 size=1048576 2024-09-22T08:48:48.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.056+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~4ED6HAOD70X6.1 size=855943 2024-09-22T08:48:48.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.058+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=4ED6HAOD70X6 tag=DTULDH966LHN type=write size=2953095 2024-09-22T08:48:48.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.059+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=52OK5FRUDQYS type=del size=3549176 2024-09-22T08:48:48.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.062+0000 7f7b8ef90780 1 < suggested update operation key=Y7W0V6YTDFIB tag=NNHHUS3T0GTN type=write size=994403 2024-09-22T08:48:48.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.064+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.0 size=1048576 2024-09-22T08:48:48.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.065+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.1 size=1048576 2024-09-22T08:48:48.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.066+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.2 size=916708 2024-09-22T08:48:48.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.066+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=N8KOILH312A9 tag=JBNTN78QP3S2 type=write size=4062436 2024-09-22T08:48:48.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.067+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=OEY43IIYG3BM type=del 2024-09-22T08:48:48.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.070+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~ZRY46C5T2U51.0 size=1048576 2024-09-22T08:48:48.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.071+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~ZRY46C5T2U51.1 size=444848 2024-09-22T08:48:48.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.071+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=ZRY46C5T2U51 tag=O0K0TJ1635RD type=write size=2542000 2024-09-22T08:48:48.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.073+0000 7f7b8ef90780 1 < suggested update operation key=IRFUEK82X28U tag=S70ZO11OT54K type=del size=568849 2024-09-22T08:48:48.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.075+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.0 size=1048576 2024-09-22T08:48:48.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.076+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.1 size=1048576 2024-09-22T08:48:48.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.077+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.2 size=82313 2024-09-22T08:48:48.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.077+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=40EZ34P1EUWX tag=IHQVUCJAW91I type=write size=3228041 2024-09-22T08:48:48.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.079+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=FWZOC7JJSFBY type=del 2024-09-22T08:48:48.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.080+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=0SCPLTMO60Z3 type=del size=1240670 2024-09-22T08:48:48.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.081+0000 7f7b8ef90780 -1 < failed to complete operation key=Y7W0V6YTDFIB tag=0E3JTY34RX3R type=write size=687153: (22) Invalid argument 2024-09-22T08:48:48.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.083+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~3ZMNO31JL29G.0 size=1048576 2024-09-22T08:48:48.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.084+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~3ZMNO31JL29G.1 size=796385 2024-09-22T08:48:48.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.084+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=3ZMNO31JL29G tag=NCP8UNXA2N3R type=write size=2893537 2024-09-22T08:48:48.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.084+0000 7f7b8ef90780 1 < canceled part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.0 size=1048576 2024-09-22T08:48:48.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.084+0000 7f7b8ef90780 1 < canceled part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.1 size=1048576 2024-09-22T08:48:48.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.085+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~C7BMKOYFA1AM.2 size=983818 2024-09-22T08:48:48.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.087+0000 7f7b8ef90780 1 < canceled multipart upload key=IRFUEK82X28U upload=C7BMKOYFA1AM tag=AE53IUVFTQYU type=write size=4129546 2024-09-22T08:48:48.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.089+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=4YQ5N3S8N0HG type=del size=3565244 2024-09-22T08:48:48.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.090+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~LEGB2EL042ZG.0 size=727126 2024-09-22T08:48:48.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.092+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=LEGB2EL042ZG tag=12V14VINUTM8 type=write size=1775702 2024-09-22T08:48:48.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.094+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=5K30C0EUK31I type=del size=1621174 2024-09-22T08:48:48.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.096+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=DFOW655P2YMF type=del 2024-09-22T08:48:48.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.097+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=EDILILBQE83S type=del size=2155242 2024-09-22T08:48:48.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.098+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~YK4QHX9LCHR3.0 size=825287 2024-09-22T08:48:48.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.101+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=YK4QHX9LCHR3 tag=73ET49HHDGQS type=write size=1873863 2024-09-22T08:48:48.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.104+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~P0C7UWOSV70O.0 size=1048576 2024-09-22T08:48:48.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.105+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~P0C7UWOSV70O.1 size=36033 2024-09-22T08:48:48.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.105+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=P0C7UWOSV70O tag=JAUBB046UR1T type=write size=2133185 2024-09-22T08:48:48.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.108+0000 7f7b8ef90780 1 < suggested update operation key=G51KS3NM4VFY tag=V19CGPI2PRF5 type=write size=1032571 2024-09-22T08:48:48.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.110+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~IX2YJIKQNMU0.0 size=429366 2024-09-22T08:48:48.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.110+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=IX2YJIKQNMU0 tag=Z2UN7GMCD4OT type=write size=1477942 2024-09-22T08:48:48.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.111+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~ECZ85V9H4VBM.0 size=1048576 2024-09-22T08:48:48.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.112+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~ECZ85V9H4VBM.1 size=950874 2024-09-22T08:48:48.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.115+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=ECZ85V9H4VBM tag=9G1GD2TV23JB type=write size=3048026 2024-09-22T08:48:48.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.116+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=JALBB317NY9R type=write size=608310 2024-09-22T08:48:48.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.117+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.0 size=1048576 2024-09-22T08:48:48.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.118+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.1 size=1048576 2024-09-22T08:48:48.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.119+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~MVAV05EY0ZDD.2 size=863946 2024-09-22T08:48:48.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.121+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=MVAV05EY0ZDD tag=7CIINUA1J8M2 type=write size=4009674 2024-09-22T08:48:48.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.123+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=TMHI4E0IRCYY type=write size=846314 2024-09-22T08:48:48.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.124+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.0 size=1048576 2024-09-22T08:48:48.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.125+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.1 size=1048576 2024-09-22T08:48:48.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.126+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~1H0F6XHH9TH1.2 size=958104 2024-09-22T08:48:48.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.128+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=1H0F6XHH9TH1 tag=D59JUUEWZIJ8 type=write size=4103832 2024-09-22T08:48:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.130+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=V27XNTLBTD6W type=del size=1792900 2024-09-22T08:48:48.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.132+0000 7f7b8ef90780 1 < suggested remove operation key=9DO6M6UQ5A05 tag=0QFP8JMI820V type=del 2024-09-22T08:48:48.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.134+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~TIEHA5P31ACA.0 size=1048576 2024-09-22T08:48:48.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.136+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~TIEHA5P31ACA.1 size=565939 2024-09-22T08:48:48.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.136+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=TIEHA5P31ACA tag=YEKE3SV7TNFX type=write size=2663091 2024-09-22T08:48:48.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.137+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=Q3R23PBXI55F type=del 2024-09-22T08:48:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.139+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.0 size=1048576 2024-09-22T08:48:48.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.140+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.1 size=1048576 2024-09-22T08:48:48.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.141+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.2 size=731768 2024-09-22T08:48:48.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.141+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=4OGKHE55SSLH tag=3A55XVGN4DJG type=write size=3877496 2024-09-22T08:48:48.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.144+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=52OK5FRUDQYS type=del size=3549176 2024-09-22T08:48:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.146+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=Z0G9W317PW4O type=del size=2033566 2024-09-22T08:48:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.147+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.0 size=1048576 2024-09-22T08:48:48.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.148+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.1 size=1048576 2024-09-22T08:48:48.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.149+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~N8KOILH312A9.2 size=916708 2024-09-22T08:48:48.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.152+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=N8KOILH312A9 tag=JBNTN78QP3S2 type=write size=4062436 2024-09-22T08:48:48.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.153+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=6NFZNB7EH2N9 type=del size=3759377 2024-09-22T08:48:48.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.155+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~ZRY46C5T2U51.0 size=1048576 2024-09-22T08:48:48.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.157+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~ZRY46C5T2U51.1 size=444848 2024-09-22T08:48:48.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.160+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=ZRY46C5T2U51 tag=O0K0TJ1635RD type=write size=2542000 2024-09-22T08:48:48.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.162+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.0 size=1048576 2024-09-22T08:48:48.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.163+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.1 size=1048576 2024-09-22T08:48:48.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.164+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.2 size=904551 2024-09-22T08:48:48.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.164+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=KLQUDB028OEU tag=ZVL1VK8MCRI0 type=write size=4050279 2024-09-22T08:48:48.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.166+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.0 size=1048576 2024-09-22T08:48:48.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.167+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.1 size=1048576 2024-09-22T08:48:48.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.168+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~40EZ34P1EUWX.2 size=82313 2024-09-22T08:48:48.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.170+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=40EZ34P1EUWX tag=IHQVUCJAW91I type=write size=3228041 2024-09-22T08:48:48.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.171+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=C30GAJK1VYNA type=del size=2105563 2024-09-22T08:48:48.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.172+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=0SCPLTMO60Z3 type=del 2024-09-22T08:48:48.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.174+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=RFF5TERRZHSR type=del size=40154 2024-09-22T08:48:48.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.175+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~3ZMNO31JL29G.0 size=1048576 2024-09-22T08:48:48.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.176+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~3ZMNO31JL29G.1 size=796385 2024-09-22T08:48:48.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.178+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=3ZMNO31JL29G tag=NCP8UNXA2N3R type=write size=2893537 2024-09-22T08:48:48.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.180+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~1VF2718CSXRU.0 size=1048576 2024-09-22T08:48:48.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.181+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~1VF2718CSXRU.1 size=75901 2024-09-22T08:48:48.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.181+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=1VF2718CSXRU tag=NDDFI8WI4DX3 type=write size=2173053 2024-09-22T08:48:48.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.183+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=4YQ5N3S8N0HG type=del 2024-09-22T08:48:48.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.185+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.0 size=1048576 2024-09-22T08:48:48.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.186+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.1 size=1048576 2024-09-22T08:48:48.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.187+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.2 size=289198 2024-09-22T08:48:48.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.187+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=ODCTS2T8AMUL tag=BMKD9RE2H2W4 type=write size=3434926 2024-09-22T08:48:48.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.190+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=5K30C0EUK31I type=del 2024-09-22T08:48:48.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.191+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=XG2VA3JK71CR type=write size=452910 2024-09-22T08:48:48.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.192+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=EDILILBQE83S type=del 2024-09-22T08:48:48.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.195+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~LQ7A9QRD61PF.0 size=632257 2024-09-22T08:48:48.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.195+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=LQ7A9QRD61PF tag=DHL6FPWTMUQY type=write size=1680833 2024-09-22T08:48:48.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.196+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~P0C7UWOSV70O.0 size=1048576 2024-09-22T08:48:48.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.197+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~P0C7UWOSV70O.1 size=36033 2024-09-22T08:48:48.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.199+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=P0C7UWOSV70O tag=JAUBB046UR1T type=write size=2133185 2024-09-22T08:48:48.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.200+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=S6I1LVQ2T5JB type=del size=1467939 2024-09-22T08:48:48.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.201+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~IX2YJIKQNMU0.0 size=429366 2024-09-22T08:48:48.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.203+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=IX2YJIKQNMU0 tag=Z2UN7GMCD4OT type=write size=1477942 2024-09-22T08:48:48.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.205+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=96GJBRZTPEFW type=del size=2902084 2024-09-22T08:48:48.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.207+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=JALBB317NY9R type=write 2024-09-22T08:48:48.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.208+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=Z4MQZCUDR3LB type=del size=2872449 2024-09-22T08:48:48.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.209+0000 7f7b8ef90780 1 < completed write operation key=ZM6ITJ2QUIPJ tag=TMHI4E0IRCYY type=write size=846314 2024-09-22T08:48:48.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.212+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~825Y2GH7TLR8.0 size=1048576 2024-09-22T08:48:48.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.213+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~825Y2GH7TLR8.1 size=106246 2024-09-22T08:48:48.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.213+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=825Y2GH7TLR8 tag=NEIFER801K51 type=write size=2203398 2024-09-22T08:48:48.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.214+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=V27XNTLBTD6W type=del 2024-09-22T08:48:48.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.215+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=31MQSZ9DHW74 type=del size=3306117 2024-09-22T08:48:48.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.216+0000 7f7b8ef90780 1 < canceled part key=_multipart_IEZKK9YIIF33.2~TIEHA5P31ACA.0 size=1048576 2024-09-22T08:48:48.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.216+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~TIEHA5P31ACA.1 size=565939 2024-09-22T08:48:48.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.219+0000 7f7b8ef90780 1 < canceled multipart upload key=IEZKK9YIIF33 upload=TIEHA5P31ACA tag=YEKE3SV7TNFX type=write size=2663091 2024-09-22T08:48:48.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.220+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=3WRGIIV4DGUJ type=del size=4114440 2024-09-22T08:48:48.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.221+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.0 size=1048576 2024-09-22T08:48:48.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.221+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.1 size=1048576 2024-09-22T08:48:48.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.222+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~4OGKHE55SSLH.2 size=731768 2024-09-22T08:48:48.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.224+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=4OGKHE55SSLH tag=3A55XVGN4DJG type=write size=3877496 2024-09-22T08:48:48.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.226+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=3J410F74W6B1 type=write size=777886 2024-09-22T08:48:48.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.227+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=Z0G9W317PW4O type=del 2024-09-22T08:48:48.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.228+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=32SY0GQL163L type=write size=385352 2024-09-22T08:48:48.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.230+0000 7f7b8ef90780 1 < suggested update operation key=VAO9MXRFGXFY tag=6NFZNB7EH2N9 type=del size=3759377 2024-09-22T08:48:48.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.233+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~U2Z2C67QKAAY.0 size=1048576 2024-09-22T08:48:48.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.234+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~U2Z2C67QKAAY.1 size=611530 2024-09-22T08:48:48.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.234+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=U2Z2C67QKAAY tag=ATDHRCFLBK9C type=write size=2708682 2024-09-22T08:48:48.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.235+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.0 size=1048576 2024-09-22T08:48:48.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.236+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.1 size=1048576 2024-09-22T08:48:48.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.237+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~KLQUDB028OEU.2 size=904551 2024-09-22T08:48:48.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.239+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=KLQUDB028OEU tag=ZVL1VK8MCRI0 type=write size=4050279 2024-09-22T08:48:48.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.240+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=I5SOJQTUBLB0 type=del size=669960 2024-09-22T08:48:48.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.241+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=C30GAJK1VYNA type=del 2024-09-22T08:48:48.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.244+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~16GEU7BQ3NZT.0 size=1048576 2024-09-22T08:48:48.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.245+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~16GEU7BQ3NZT.1 size=489783 2024-09-22T08:48:48.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.245+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=16GEU7BQ3NZT tag=RW27Y6CDP8NU type=write size=2586935 2024-09-22T08:48:48.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.247+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=RFF5TERRZHSR type=del 2024-09-22T08:48:48.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.249+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~CWCT9IDY090Z.0 size=335336 2024-09-22T08:48:48.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.249+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=CWCT9IDY090Z tag=W9UU1OXM69CA type=write size=1383912 2024-09-22T08:48:48.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.250+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~1VF2718CSXRU.0 size=1048576 2024-09-22T08:48:48.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.251+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~1VF2718CSXRU.1 size=75901 2024-09-22T08:48:48.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.254+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=1VF2718CSXRU tag=NDDFI8WI4DX3 type=write size=2173053 2024-09-22T08:48:48.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.255+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=EPYLALHCZR04 type=del size=1984478 2024-09-22T08:48:48.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.257+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.0 size=1048576 2024-09-22T08:48:48.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.258+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.1 size=1048576 2024-09-22T08:48:48.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.259+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ODCTS2T8AMUL.2 size=289198 2024-09-22T08:48:48.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.261+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=ODCTS2T8AMUL tag=BMKD9RE2H2W4 type=write size=3434926 2024-09-22T08:48:48.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.262+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=GHB2BZSOFXSY type=del size=3607417 2024-09-22T08:48:48.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.264+0000 7f7b8ef90780 1 < canceled operation key=O81X7IWXN4VP tag=XG2VA3JK71CR type=write size=452910 2024-09-22T08:48:48.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.266+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.0 size=1048576 2024-09-22T08:48:48.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.268+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.1 size=1048576 2024-09-22T08:48:48.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.269+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.2 size=493807 2024-09-22T08:48:48.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.269+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=WUC0YMOJA26K tag=QYEQ5IUIQH6F type=write size=3639535 2024-09-22T08:48:48.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.270+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~LQ7A9QRD61PF.0 size=632257 2024-09-22T08:48:48.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.272+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=LQ7A9QRD61PF tag=DHL6FPWTMUQY type=write size=1680833 2024-09-22T08:48:48.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.274+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=VF1WFCIQFAO7 type=del size=3025487 2024-09-22T08:48:48.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.276+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=S6I1LVQ2T5JB type=del 2024-09-22T08:48:48.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.279+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.0 size=1048576 2024-09-22T08:48:48.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.280+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.1 size=1048576 2024-09-22T08:48:48.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.281+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.2 size=199103 2024-09-22T08:48:48.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.281+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=THJM9XAN3TYR tag=K46AAU5GD29R type=write size=3344831 2024-09-22T08:48:48.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.282+0000 7f7b8ef90780 -1 < failed to complete operation key=QH6TK0MJKYUO tag=96GJBRZTPEFW type=del size=2902084: (22) Invalid argument 2024-09-22T08:48:48.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.283+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=2S3BYUVP02F4 type=del size=3356389 2024-09-22T08:48:48.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.286+0000 7f7b8ef90780 1 < suggested update operation key=QQKJ4URBRF16 tag=Z4MQZCUDR3LB type=del size=2872449 2024-09-22T08:48:48.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.288+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~JWYZ8QXGE3QX.0 size=549908 2024-09-22T08:48:48.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.288+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=JWYZ8QXGE3QX tag=2GDNTENN1YLM type=write size=1598484 2024-09-22T08:48:48.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.289+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~825Y2GH7TLR8.0 size=1048576 2024-09-22T08:48:48.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.290+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~825Y2GH7TLR8.1 size=106246 2024-09-22T08:48:48.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.292+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=825Y2GH7TLR8 tag=NEIFER801K51 type=write size=2203398 2024-09-22T08:48:48.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.294+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~UML17D6OMOPW.0 size=823848 2024-09-22T08:48:48.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.294+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=UML17D6OMOPW tag=80L8MXM3KZA8 type=write size=1872424 2024-09-22T08:48:48.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.296+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=31MQSZ9DHW74 type=del 2024-09-22T08:48:48.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.297+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=DNL2JMSK7MH2 type=del size=309614 2024-09-22T08:48:48.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.300+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=3WRGIIV4DGUJ type=del 2024-09-22T08:48:48.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.302+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~A9PZIRGQ3863.0 size=1048576 2024-09-22T08:48:48.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.303+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~A9PZIRGQ3863.1 size=953998 2024-09-22T08:48:48.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.303+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=A9PZIRGQ3863 tag=KFNN04Z2MSQ7 type=write size=3051150 2024-09-22T08:48:48.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.305+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=3J410F74W6B1 type=write size=777886 2024-09-22T08:48:48.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.306+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=P9QIBCILWBA5 type=write size=892856 2024-09-22T08:48:48.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.307+0000 7f7b8ef90780 1 < completed write operation key=T43DW9JPG1BU tag=32SY0GQL163L type=write size=385352 2024-09-22T08:48:48.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.310+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~0KMERJ9RNKK4.0 size=986788 2024-09-22T08:48:48.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.310+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=0KMERJ9RNKK4 tag=X5UVTU8G9S6F type=write size=2035364 2024-09-22T08:48:48.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.311+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~U2Z2C67QKAAY.0 size=1048576 2024-09-22T08:48:48.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.312+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~U2Z2C67QKAAY.1 size=611530 2024-09-22T08:48:48.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.314+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=U2Z2C67QKAAY tag=ATDHRCFLBK9C type=write size=2708682 2024-09-22T08:48:48.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.316+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=0R240I7T3X7H type=del size=2657927 2024-09-22T08:48:48.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.317+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=I5SOJQTUBLB0 type=del 2024-09-22T08:48:48.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.318+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=DZLMU3DDGP4V type=write size=755744 2024-09-22T08:48:48.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.320+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~16GEU7BQ3NZT.0 size=1048576 2024-09-22T08:48:48.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.321+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~16GEU7BQ3NZT.1 size=489783 2024-09-22T08:48:48.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.323+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=16GEU7BQ3NZT tag=RW27Y6CDP8NU type=write size=2586935 2024-09-22T08:48:48.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.325+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~W5JNBNSF6RYM.0 size=828067 2024-09-22T08:48:48.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.325+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=W5JNBNSF6RYM tag=GX0XCVKZEU9E type=write size=1876643 2024-09-22T08:48:48.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.326+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~CWCT9IDY090Z.0 size=335336 2024-09-22T08:48:48.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.328+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=CWCT9IDY090Z tag=W9UU1OXM69CA type=write size=1383912 2024-09-22T08:48:48.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.329+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=ZJJO1RA24LKR type=del size=2710570 2024-09-22T08:48:48.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.331+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=EPYLALHCZR04 type=del 2024-09-22T08:48:48.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.332+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=CP07NC9INA76 type=del size=1018331 2024-09-22T08:48:48.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.333+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=GHB2BZSOFXSY type=del 2024-09-22T08:48:48.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.335+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=WVZX82AW6QC5 type=del size=359303 2024-09-22T08:48:48.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.336+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.0 size=1048576 2024-09-22T08:48:48.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.337+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.1 size=1048576 2024-09-22T08:48:48.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.338+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~WUC0YMOJA26K.2 size=493807 2024-09-22T08:48:48.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.341+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=WUC0YMOJA26K tag=QYEQ5IUIQH6F type=write size=3639535 2024-09-22T08:48:48.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.342+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=937N54JB3HEC type=del size=1348622 2024-09-22T08:48:48.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.343+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=VF1WFCIQFAO7 type=del 2024-09-22T08:48:48.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.345+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=GZYZ2C8I8U9Z type=write size=794549 2024-09-22T08:48:48.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.346+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.0 size=1048576 2024-09-22T08:48:48.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.347+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.1 size=1048576 2024-09-22T08:48:48.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.348+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~THJM9XAN3TYR.2 size=199103 2024-09-22T08:48:48.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.350+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=THJM9XAN3TYR tag=K46AAU5GD29R type=write size=3344831 2024-09-22T08:48:48.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.352+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=J0IH08CPZEI5 type=del size=1376957 2024-09-22T08:48:48.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.353+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=2S3BYUVP02F4 type=del 2024-09-22T08:48:48.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.355+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.0 size=1048576 2024-09-22T08:48:48.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.356+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.1 size=1048576 2024-09-22T08:48:48.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.357+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.2 size=1018971 2024-09-22T08:48:48.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.357+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=SY3MPUV82TZ1 tag=V3GVMJN9ZN1P type=write size=4164699 2024-09-22T08:48:48.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.359+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~JWYZ8QXGE3QX.0 size=549908 2024-09-22T08:48:48.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.361+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=JWYZ8QXGE3QX tag=2GDNTENN1YLM type=write size=1598484 2024-09-22T08:48:48.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.362+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=W36KRK6VVC6R type=del size=782448 2024-09-22T08:48:48.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.363+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~UML17D6OMOPW.0 size=823848 2024-09-22T08:48:48.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.365+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=UML17D6OMOPW tag=80L8MXM3KZA8 type=write size=1872424 2024-09-22T08:48:48.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.368+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~JNGNIIQZWSRE.0 size=1048576 2024-09-22T08:48:48.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.369+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~JNGNIIQZWSRE.1 size=720180 2024-09-22T08:48:48.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.369+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=JNGNIIQZWSRE tag=OVZLELTKTNIE type=write size=2817332 2024-09-22T08:48:48.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.371+0000 7f7b8ef90780 1 < suggested remove operation key=T43DW9JPG1BU tag=DNL2JMSK7MH2 type=del 2024-09-22T08:48:48.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.373+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=1QLTY0EHDWRZ type=del size=2919077 2024-09-22T08:48:48.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.374+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~A9PZIRGQ3863.0 size=1048576 2024-09-22T08:48:48.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.375+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~A9PZIRGQ3863.1 size=953998 2024-09-22T08:48:48.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.378+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=A9PZIRGQ3863 tag=KFNN04Z2MSQ7 type=write size=3051150 2024-09-22T08:48:48.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.380+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=ZLQSTZDFIEI2 type=del size=2360035 2024-09-22T08:48:48.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.381+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=P9QIBCILWBA5 type=write size=892856 2024-09-22T08:48:48.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.382+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=XWNCVAODF5S9 type=del size=3975726 2024-09-22T08:48:48.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.383+0000 7f7b8ef90780 1 < canceled part key=_multipart_70WNR3KVU0BG.2~0KMERJ9RNKK4.0 size=986788 2024-09-22T08:48:48.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.385+0000 7f7b8ef90780 1 < canceled multipart upload key=70WNR3KVU0BG upload=0KMERJ9RNKK4 tag=X5UVTU8G9S6F type=write size=2035364 2024-09-22T08:48:48.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.387+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~G3VVAB9O9L2U.0 size=1048576 2024-09-22T08:48:48.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.388+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~G3VVAB9O9L2U.1 size=594312 2024-09-22T08:48:48.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.388+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=G3VVAB9O9L2U tag=T75B8MIJMO3O type=write size=2691464 2024-09-22T08:48:48.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.389+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=0R240I7T3X7H type=del 2024-09-22T08:48:48.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.392+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~BB8UC1E8XQR0.0 size=545695 2024-09-22T08:48:48.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.392+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=BB8UC1E8XQR0 tag=WAOEGDENVISL type=write size=1594271 2024-09-22T08:48:48.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.393+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=DZLMU3DDGP4V type=write size=755744 2024-09-22T08:48:48.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.394+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=L8PR2O6AXC3O type=del size=1316611 2024-09-22T08:48:48.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.396+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~W5JNBNSF6RYM.0 size=828067 2024-09-22T08:48:48.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.399+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=W5JNBNSF6RYM tag=GX0XCVKZEU9E type=write size=1876643 2024-09-22T08:48:48.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.400+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=PCLM7HTXEY3L type=del size=2783441 2024-09-22T08:48:48.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.401+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=ZJJO1RA24LKR type=del 2024-09-22T08:48:48.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.402+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=HPHQD0LKHJVY type=del size=672673 2024-09-22T08:48:48.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.405+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=CP07NC9INA76 type=del 2024-09-22T08:48:48.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.406+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=EKDUCPSOXYXR type=del size=1550804 2024-09-22T08:48:48.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.408+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=WVZX82AW6QC5 type=del size=359303 2024-09-22T08:48:48.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.409+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=LASCHY8OOX03 type=write size=524579 2024-09-22T08:48:48.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.410+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=937N54JB3HEC type=del 2024-09-22T08:48:48.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.411+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=O4O2324X3URQ type=del size=762300 2024-09-22T08:48:48.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.413+0000 7f7b8ef90780 1 < completed write operation key=7ZS8G8H6I957 tag=GZYZ2C8I8U9Z type=write size=794549 2024-09-22T08:48:48.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.414+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=CBM40CLMPP3E type=del size=1120609 2024-09-22T08:48:48.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.415+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=J0IH08CPZEI5 type=del 2024-09-22T08:48:48.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.418+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~2V9W9NRANH7J.0 size=1048576 2024-09-22T08:48:48.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.419+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~2V9W9NRANH7J.1 size=403692 2024-09-22T08:48:48.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.419+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=2V9W9NRANH7J tag=3GCCRLUJHR60 type=write size=2500844 2024-09-22T08:48:48.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.420+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.0 size=1048576 2024-09-22T08:48:48.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.421+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.1 size=1048576 2024-09-22T08:48:48.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.422+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~SY3MPUV82TZ1.2 size=1018971 2024-09-22T08:48:48.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.425+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=SY3MPUV82TZ1 tag=V3GVMJN9ZN1P type=write size=4164699 2024-09-22T08:48:48.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.426+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=KKHR8C559DGN type=del size=1619916 2024-09-22T08:48:48.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.427+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=W36KRK6VVC6R type=del 2024-09-22T08:48:48.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.429+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=MK1NKR3LGTG1 type=write size=147269 2024-09-22T08:48:48.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.430+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~JNGNIIQZWSRE.0 size=1048576 2024-09-22T08:48:48.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.431+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~JNGNIIQZWSRE.1 size=720180 2024-09-22T08:48:48.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.433+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=JNGNIIQZWSRE tag=OVZLELTKTNIE type=write size=2817332 2024-09-22T08:48:48.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.434+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=3HUKC28IWW9U type=del size=3681505 2024-09-22T08:48:48.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.435+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=1QLTY0EHDWRZ type=del 2024-09-22T08:48:48.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.438+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~8JA0V3TNZOKA.0 size=1048576 2024-09-22T08:48:48.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.438+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~8JA0V3TNZOKA.1 size=209733 2024-09-22T08:48:48.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.438+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=8JA0V3TNZOKA tag=ALMNTCNT4ZD1 type=write size=2306885 2024-09-22T08:48:48.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.440+0000 7f7b8ef90780 -1 < failed to complete operation key=F3IHQ6Z9V1DX tag=ZLQSTZDFIEI2 type=del size=2360035: (22) Invalid argument 2024-09-22T08:48:48.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.441+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=7VJFZGTORYCT type=del size=3772497 2024-09-22T08:48:48.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.443+0000 7f7b8ef90780 1 < suggested remove operation key=GBNPVRO0JPF7 tag=XWNCVAODF5S9 type=del 2024-09-22T08:48:48.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.445+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=9IE9LJDXS5NY type=del size=2255467 2024-09-22T08:48:48.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.446+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~G3VVAB9O9L2U.0 size=1048576 2024-09-22T08:48:48.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.447+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~G3VVAB9O9L2U.1 size=594312 2024-09-22T08:48:48.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.449+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=G3VVAB9O9L2U tag=T75B8MIJMO3O type=write size=2691464 2024-09-22T08:48:48.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.451+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=4Z39AEW5K1A2 type=del size=1635428 2024-09-22T08:48:48.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.452+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~BB8UC1E8XQR0.0 size=545695 2024-09-22T08:48:48.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.455+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=BB8UC1E8XQR0 tag=WAOEGDENVISL type=write size=1594271 2024-09-22T08:48:48.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.456+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=0DHKJZAVTIQX type=del size=4037203 2024-09-22T08:48:48.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.457+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=L8PR2O6AXC3O type=del 2024-09-22T08:48:48.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.458+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=AMA437CGM2MA type=del size=1227062 2024-09-22T08:48:48.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.459+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=PCLM7HTXEY3L type=del 2024-09-22T08:48:48.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.461+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~WBLO553UI852.0 size=551255 2024-09-22T08:48:48.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.461+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=WBLO553UI852 tag=LW2PYRNUMC2V type=write size=1599831 2024-09-22T08:48:48.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.464+0000 7f7b8ef90780 1 < suggested update operation key=WDGY8YL16UWI tag=HPHQD0LKHJVY type=del size=672673 2024-09-22T08:48:48.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.465+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=1264806SKRTP type=del size=3414162 2024-09-22T08:48:48.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.468+0000 7f7b8ef90780 1 < suggested update operation key=9DO6M6UQ5A05 tag=EKDUCPSOXYXR type=del size=1550804 2024-09-22T08:48:48.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.470+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.0 size=1048576 2024-09-22T08:48:48.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.471+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.1 size=1048576 2024-09-22T08:48:48.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.472+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.2 size=537057 2024-09-22T08:48:48.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.472+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=5VKLH3HVJ9TX tag=FTH3EQX4V6W7 type=write size=3682785 2024-09-22T08:48:48.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.473+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=LASCHY8OOX03 type=write size=524579 2024-09-22T08:48:48.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.474+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=JY2LHNA9B0KG type=del size=2550459 2024-09-22T08:48:48.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.476+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=O4O2324X3URQ type=del 2024-09-22T08:48:48.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.477+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=UA9FK2I1E2BN type=write size=99678 2024-09-22T08:48:48.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.479+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=CBM40CLMPP3E type=del 2024-09-22T08:48:48.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.480+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=DYZXMLY1RHR3 type=del size=365209 2024-09-22T08:48:48.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.482+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~2V9W9NRANH7J.0 size=1048576 2024-09-22T08:48:48.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.483+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~2V9W9NRANH7J.1 size=403692 2024-09-22T08:48:48.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.485+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=2V9W9NRANH7J tag=3GCCRLUJHR60 type=write size=2500844 2024-09-22T08:48:48.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.487+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=0LQUMY6Y757V type=del size=3291109 2024-09-22T08:48:48.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.488+0000 7f7b8ef90780 1 < canceled operation key=ORON3U0WY2K5 tag=KKHR8C559DGN type=del size=1619916 2024-09-22T08:48:48.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.491+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ZSWVYD9UUY4B.0 size=1048576 2024-09-22T08:48:48.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.492+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~ZSWVYD9UUY4B.1 size=24911 2024-09-22T08:48:48.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.492+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=ZSWVYD9UUY4B tag=NVP734PNV5LV type=write size=2122063 2024-09-22T08:48:48.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.493+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=MK1NKR3LGTG1 type=write size=147269 2024-09-22T08:48:48.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.494+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=QQB0UKYW9HA0 type=del size=1187955 2024-09-22T08:48:48.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.495+0000 7f7b8ef90780 -1 < failed to complete operation key=GBNPVRO0JPF7 tag=3HUKC28IWW9U type=del size=3681505: (22) Invalid argument 2024-09-22T08:48:48.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.497+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.0 size=1048576 2024-09-22T08:48:48.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.498+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.1 size=1048576 2024-09-22T08:48:48.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.499+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.2 size=586760 2024-09-22T08:48:48.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.499+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=X3B9HOPXSP81 tag=VUKFLTD9MFT1 type=write size=3732488 2024-09-22T08:48:48.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.501+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~8JA0V3TNZOKA.0 size=1048576 2024-09-22T08:48:48.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.501+0000 7f7b8ef90780 1 < canceled part key=_multipart_YDJLMBL7EQWN.2~8JA0V3TNZOKA.1 size=209733 2024-09-22T08:48:48.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.503+0000 7f7b8ef90780 1 < canceled multipart upload key=YDJLMBL7EQWN upload=8JA0V3TNZOKA tag=ALMNTCNT4ZD1 type=write size=2306885 2024-09-22T08:48:48.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.504+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=T7JRRPA5YQTI type=del size=934343 2024-09-22T08:48:48.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.505+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=7VJFZGTORYCT type=del 2024-09-22T08:48:48.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.506+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=DA4UJDY3XZ60 type=del size=2154158 2024-09-22T08:48:48.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.508+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=9IE9LJDXS5NY type=del size=2255467 2024-09-22T08:48:48.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.509+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=L3MPZNO7JCAL type=del size=1469696 2024-09-22T08:48:48.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.510+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=4Z39AEW5K1A2 type=del 2024-09-22T08:48:48.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.511+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=Q2WRJH9K7UAZ type=del size=3715197 2024-09-22T08:48:48.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.512+0000 7f7b8ef90780 1 < canceled operation key=YF94C9GVRXQP tag=0DHKJZAVTIQX type=del size=4037203 2024-09-22T08:48:48.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.514+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=3ZH3DG8MTF22 type=del size=2764559 2024-09-22T08:48:48.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.516+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=AMA437CGM2MA type=del 2024-09-22T08:48:48.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.520+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.0 size=1048576 2024-09-22T08:48:48.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.521+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.1 size=1048576 2024-09-22T08:48:48.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.522+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.2 size=299979 2024-09-22T08:48:48.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.522+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=PZC3X09DGCYP tag=9OSBV637M067 type=write size=3445707 2024-09-22T08:48:48.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.523+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~WBLO553UI852.0 size=551255 2024-09-22T08:48:48.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.525+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=WBLO553UI852 tag=LW2PYRNUMC2V type=write size=1599831 2024-09-22T08:48:48.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.527+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=WZASLOGS381Q type=write size=1047116 2024-09-22T08:48:48.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.528+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=1264806SKRTP type=del 2024-09-22T08:48:48.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.529+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=U7R742GRKZ4S type=del size=2578614 2024-09-22T08:48:48.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.531+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.0 size=1048576 2024-09-22T08:48:48.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.531+0000 7f7b8ef90780 1 < canceled part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.1 size=1048576 2024-09-22T08:48:48.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.532+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~5VKLH3HVJ9TX.2 size=537057 2024-09-22T08:48:48.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.534+0000 7f7b8ef90780 1 < canceled multipart upload key=Z9CHXCJ02L85 upload=5VKLH3HVJ9TX tag=FTH3EQX4V6W7 type=write size=3682785 2024-09-22T08:48:48.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.535+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=3VPAF15NGH1J type=del size=2094998 2024-09-22T08:48:48.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.536+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=JY2LHNA9B0KG type=del 2024-09-22T08:48:48.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.537+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=G9160O17ZQHV type=del size=449528 2024-09-22T08:48:48.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.539+0000 7f7b8ef90780 1 < completed write operation key=QH6TK0MJKYUO tag=UA9FK2I1E2BN type=write size=99678 2024-09-22T08:48:48.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.541+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3BTL41JGSS9V.0 size=1048576 2024-09-22T08:48:48.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.542+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3BTL41JGSS9V.1 size=785268 2024-09-22T08:48:48.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.542+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=3BTL41JGSS9V tag=OU6OU2JFNAT6 type=write size=2882420 2024-09-22T08:48:48.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.543+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=DYZXMLY1RHR3 type=del 2024-09-22T08:48:48.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.544+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=SH34VTB41L4R type=del size=502022 2024-09-22T08:48:48.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.546+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=0LQUMY6Y757V type=del 2024-09-22T08:48:48.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.547+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=CKUROLDJC0NB type=write size=405285 2024-09-22T08:48:48.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.548+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ZSWVYD9UUY4B.0 size=1048576 2024-09-22T08:48:48.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.549+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~ZSWVYD9UUY4B.1 size=24911 2024-09-22T08:48:48.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.552+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=ZSWVYD9UUY4B tag=NVP734PNV5LV type=write size=2122063 2024-09-22T08:48:48.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.553+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=DWN6VIWLGAIE type=del size=154621 2024-09-22T08:48:48.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.554+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=QQB0UKYW9HA0 type=del 2024-09-22T08:48:48.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.555+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=QR92O9N6UDQH type=write size=701991 2024-09-22T08:48:48.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.557+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.0 size=1048576 2024-09-22T08:48:48.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.558+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.1 size=1048576 2024-09-22T08:48:48.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.559+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~X3B9HOPXSP81.2 size=586760 2024-09-22T08:48:48.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.561+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=X3B9HOPXSP81 tag=VUKFLTD9MFT1 type=write size=3732488 2024-09-22T08:48:48.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.563+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.0 size=1048576 2024-09-22T08:48:48.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.565+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.1 size=1048576 2024-09-22T08:48:48.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.565+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.2 size=496102 2024-09-22T08:48:48.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.565+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=VMNB05VMWGHJ tag=WA2BUTLY03EL type=write size=3641830 2024-09-22T08:48:48.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.567+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=T7JRRPA5YQTI type=del 2024-09-22T08:48:48.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.568+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=4KK0VGEUJC66 type=del size=2530948 2024-09-22T08:48:48.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.569+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=DA4UJDY3XZ60 type=del 2024-09-22T08:48:48.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.571+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=1Y7UJ0XAGV80 type=del size=2641735 2024-09-22T08:48:48.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.572+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=L3MPZNO7JCAL type=del size=1469696 2024-09-22T08:48:48.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.573+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=WSFQO0CHNXM0 type=del size=3302404 2024-09-22T08:48:48.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.575+0000 7f7b8ef90780 1 < suggested remove operation key=9DO6M6UQ5A05 tag=Q2WRJH9K7UAZ type=del 2024-09-22T08:48:48.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.578+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~ZHE2I9O98FWQ.0 size=968260 2024-09-22T08:48:48.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.578+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=ZHE2I9O98FWQ tag=0M3WD1J3QPG9 type=write size=2016836 2024-09-22T08:48:48.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.579+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=3ZH3DG8MTF22 type=del 2024-09-22T08:48:48.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.581+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~8RUCY8WPFWX5.0 size=1048576 2024-09-22T08:48:48.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.582+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~8RUCY8WPFWX5.1 size=591590 2024-09-22T08:48:48.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.582+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=8RUCY8WPFWX5 tag=HEN3GJKYXMC5 type=write size=2688742 2024-09-22T08:48:48.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.583+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.0 size=1048576 2024-09-22T08:48:48.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.584+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.1 size=1048576 2024-09-22T08:48:48.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.585+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~PZC3X09DGCYP.2 size=299979 2024-09-22T08:48:48.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.587+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=PZC3X09DGCYP tag=9OSBV637M067 type=write size=3445707 2024-09-22T08:48:48.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.588+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=EJNLNE9K1UTI type=del size=3973785 2024-09-22T08:48:48.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.591+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=WZASLOGS381Q type=write 2024-09-22T08:48:48.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.592+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=IC3PCLW0I4U9 type=del size=2286899 2024-09-22T08:48:48.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.594+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=U7R742GRKZ4S type=del 2024-09-22T08:48:48.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.596+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~A95B948HJPVH.0 size=194052 2024-09-22T08:48:48.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.596+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=A95B948HJPVH tag=89KEIYJDB5FW type=write size=1242628 2024-09-22T08:48:48.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.598+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=3VPAF15NGH1J type=del 2024-09-22T08:48:48.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.600+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~VHNDVLVZCIL6.0 size=421738 2024-09-22T08:48:48.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.600+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=VHNDVLVZCIL6 tag=XRGNLIANNE10 type=write size=1470314 2024-09-22T08:48:48.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.603+0000 7f7b8ef90780 1 < suggested update operation key=VAO9MXRFGXFY tag=G9160O17ZQHV type=del size=449528 2024-09-22T08:48:48.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.604+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=LX9KERC0647F type=write size=795705 2024-09-22T08:48:48.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.606+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3BTL41JGSS9V.0 size=1048576 2024-09-22T08:48:48.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.607+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3BTL41JGSS9V.1 size=785268 2024-09-22T08:48:48.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.609+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=3BTL41JGSS9V tag=OU6OU2JFNAT6 type=write size=2882420 2024-09-22T08:48:48.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.611+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=CSSSUI57AC4M type=del size=3294595 2024-09-22T08:48:48.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.612+0000 7f7b8ef90780 -1 < failed to complete operation key=9DO6M6UQ5A05 tag=SH34VTB41L4R type=del size=502022: (22) Invalid argument 2024-09-22T08:48:48.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.615+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.0 size=1048576 2024-09-22T08:48:48.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.616+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.1 size=1048576 2024-09-22T08:48:48.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.617+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.2 size=711844 2024-09-22T08:48:48.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.617+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=0M7K69DUA4UJ tag=XUZI6EAH01LX type=write size=3857572 2024-09-22T08:48:48.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.618+0000 7f7b8ef90780 1 < completed write operation key=R0N30XP1BXY3 tag=CKUROLDJC0NB type=write size=405285 2024-09-22T08:48:48.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.620+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=3BDU6RBSHCFC type=write size=987918 2024-09-22T08:48:48.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.621+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=DWN6VIWLGAIE type=del 2024-09-22T08:48:48.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.622+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=IQA6JERXCNOC type=del size=1365468 2024-09-22T08:48:48.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.624+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=QR92O9N6UDQH type=write size=701991 2024-09-22T08:48:48.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.626+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~W4RCLOIS76S0.0 size=1048576 2024-09-22T08:48:48.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.627+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~W4RCLOIS76S0.1 size=808736 2024-09-22T08:48:48.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.627+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=W4RCLOIS76S0 tag=UGJZAQXG6PVQ type=write size=2905888 2024-09-22T08:48:48.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.628+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.0 size=1048576 2024-09-22T08:48:48.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.629+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.1 size=1048576 2024-09-22T08:48:48.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.629+0000 7f7b8ef90780 1 < canceled part key=_multipart_PODNY4NH4A9W.2~VMNB05VMWGHJ.2 size=496102 2024-09-22T08:48:48.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.632+0000 7f7b8ef90780 1 < canceled multipart upload key=PODNY4NH4A9W upload=VMNB05VMWGHJ tag=WA2BUTLY03EL type=write size=3641830 2024-09-22T08:48:48.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.633+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=HQXE9NTHT6IX type=del size=4116795 2024-09-22T08:48:48.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.635+0000 7f7b8ef90780 1 < suggested update operation key=T43DW9JPG1BU tag=4KK0VGEUJC66 type=del size=2530948 2024-09-22T08:48:48.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.637+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~44IOX7V7WOEY.0 size=524871 2024-09-22T08:48:48.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.637+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=44IOX7V7WOEY tag=C0NY3KY77QYN type=write size=1573447 2024-09-22T08:48:48.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.639+0000 7f7b8ef90780 -1 < failed to complete operation key=T43DW9JPG1BU tag=1Y7UJ0XAGV80 type=del size=2641735: (22) Invalid argument 2024-09-22T08:48:48.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.640+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=5GF96MS6MCQI type=del size=898812 2024-09-22T08:48:48.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.642+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=WSFQO0CHNXM0 type=del 2024-09-22T08:48:48.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.645+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~35IY5SJPZ2CT.0 size=857738 2024-09-22T08:48:48.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.645+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=35IY5SJPZ2CT tag=IWB8VBHN3TEC type=write size=1906314 2024-09-22T08:48:48.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.646+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~ZHE2I9O98FWQ.0 size=968260 2024-09-22T08:48:48.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.648+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=ZHE2I9O98FWQ tag=0M3WD1J3QPG9 type=write size=2016836 2024-09-22T08:48:48.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.650+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=6SKZA2AWZXAN type=del size=3147395 2024-09-22T08:48:48.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.651+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~8RUCY8WPFWX5.0 size=1048576 2024-09-22T08:48:48.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.652+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~8RUCY8WPFWX5.1 size=591590 2024-09-22T08:48:48.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.654+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=8RUCY8WPFWX5 tag=HEN3GJKYXMC5 type=write size=2688742 2024-09-22T08:48:48.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.657+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.0 size=1048576 2024-09-22T08:48:48.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.658+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.1 size=1048576 2024-09-22T08:48:48.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.659+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.2 size=414473 2024-09-22T08:48:48.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.659+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=2A0L5BSJA68K tag=0F1RWNXC8L6I type=write size=3560201 2024-09-22T08:48:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.662+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=EJNLNE9K1UTI type=del 2024-09-22T08:48:48.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.664+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~T33Z9V2WYF32.0 size=1048576 2024-09-22T08:48:48.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.665+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~T33Z9V2WYF32.1 size=259999 2024-09-22T08:48:48.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.665+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=T33Z9V2WYF32 tag=DJZ6PDDFX3IB type=write size=2357151 2024-09-22T08:48:48.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.667+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=IC3PCLW0I4U9 type=del 2024-09-22T08:48:48.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.669+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.0 size=1048576 2024-09-22T08:48:48.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.670+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.1 size=1048576 2024-09-22T08:48:48.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.671+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.2 size=699092 2024-09-22T08:48:48.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.671+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=G9K4VKIGUBH1 tag=CK4993BMXBQP type=write size=3844820 2024-09-22T08:48:48.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.672+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~A95B948HJPVH.0 size=194052 2024-09-22T08:48:48.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.674+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=A95B948HJPVH tag=89KEIYJDB5FW type=write size=1242628 2024-09-22T08:48:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.677+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~875ILFB4RQ56.0 size=1048576 2024-09-22T08:48:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.678+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~875ILFB4RQ56.1 size=256658 2024-09-22T08:48:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.678+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=875ILFB4RQ56 tag=146DN0O7721I type=write size=2353810 2024-09-22T08:48:48.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.679+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~VHNDVLVZCIL6.0 size=421738 2024-09-22T08:48:48.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.681+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=VHNDVLVZCIL6 tag=XRGNLIANNE10 type=write size=1470314 2024-09-22T08:48:48.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.684+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~C7DL6FC17X0Z.0 size=894754 2024-09-22T08:48:48.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.684+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=C7DL6FC17X0Z tag=Q9BDQR0W1KVL type=write size=1943330 2024-09-22T08:48:48.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.685+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=LX9KERC0647F type=write size=795705 2024-09-22T08:48:48.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.686+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=FF0ML0G6GEUL type=del size=1999233 2024-09-22T08:48:48.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.688+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=CSSSUI57AC4M type=del 2024-09-22T08:48:48.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.689+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=FTBM9GCKHCM4 type=write size=48747 2024-09-22T08:48:48.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.690+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.0 size=1048576 2024-09-22T08:48:48.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.691+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.1 size=1048576 2024-09-22T08:48:48.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.692+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~0M7K69DUA4UJ.2 size=711844 2024-09-22T08:48:48.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.694+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=0M7K69DUA4UJ tag=XUZI6EAH01LX type=write size=3857572 2024-09-22T08:48:48.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.695+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=3HL20CH2R9WF type=del size=3720524 2024-09-22T08:48:48.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.697+0000 7f7b8ef90780 1 < completed write operation key=VAO9MXRFGXFY tag=3BDU6RBSHCFC type=write size=987918 2024-09-22T08:48:48.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.698+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=L9W0TDBC9ROY type=del size=1018275 2024-09-22T08:48:48.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.699+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=IQA6JERXCNOC type=del 2024-09-22T08:48:48.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.702+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~BMUJRLZ1XM3A.0 size=1048576 2024-09-22T08:48:48.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.703+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~BMUJRLZ1XM3A.1 size=82782 2024-09-22T08:48:48.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.703+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=BMUJRLZ1XM3A tag=01T1EIV6IEMZ type=write size=2179934 2024-09-22T08:48:48.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.704+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~W4RCLOIS76S0.0 size=1048576 2024-09-22T08:48:48.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.705+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~W4RCLOIS76S0.1 size=808736 2024-09-22T08:48:48.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.707+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=W4RCLOIS76S0 tag=UGJZAQXG6PVQ type=write size=2905888 2024-09-22T08:48:48.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.709+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~VU99WH30Y20N.0 size=1048407 2024-09-22T08:48:48.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.709+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=VU99WH30Y20N tag=38AG61HHKHJT type=write size=2096983 2024-09-22T08:48:48.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.710+0000 7f7b8ef90780 -1 < failed to complete operation key=4ZJ4E4SUA01H tag=HQXE9NTHT6IX type=del size=4116795: (22) Invalid argument 2024-09-22T08:48:48.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.711+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=Z61PZZEGXLGZ type=del size=3872637 2024-09-22T08:48:48.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.713+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~44IOX7V7WOEY.0 size=524871 2024-09-22T08:48:48.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.715+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=44IOX7V7WOEY tag=C0NY3KY77QYN type=write size=1573447 2024-09-22T08:48:48.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.716+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=0N2UG72RRF0M type=del size=675378 2024-09-22T08:48:48.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.717+0000 7f7b8ef90780 1 < canceled operation key=ORON3U0WY2K5 tag=5GF96MS6MCQI type=del size=898812 2024-09-22T08:48:48.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.720+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~R5EYMBA6E8ZV.0 size=541718 2024-09-22T08:48:48.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.720+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=R5EYMBA6E8ZV tag=NP7R0LZ26KBO type=write size=1590294 2024-09-22T08:48:48.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.720+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~35IY5SJPZ2CT.0 size=857738 2024-09-22T08:48:48.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.722+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=35IY5SJPZ2CT tag=IWB8VBHN3TEC type=write size=1906314 2024-09-22T08:48:48.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.723+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=LS8ALCMLQ8P5 type=del size=2005357 2024-09-22T08:48:48.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.725+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=6SKZA2AWZXAN type=del 2024-09-22T08:48:48.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.727+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~GZRPPQHT0CBO.0 size=300187 2024-09-22T08:48:48.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.727+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=GZRPPQHT0CBO tag=NVEB31I0AAED type=write size=1348763 2024-09-22T08:48:48.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.727+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.0 size=1048576 2024-09-22T08:48:48.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.728+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.1 size=1048576 2024-09-22T08:48:48.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.729+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~2A0L5BSJA68K.2 size=414473 2024-09-22T08:48:48.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.731+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=2A0L5BSJA68K tag=0F1RWNXC8L6I type=write size=3560201 2024-09-22T08:48:48.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.733+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=WMZ4HK431B0M type=del size=759796 2024-09-22T08:48:48.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.734+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~T33Z9V2WYF32.0 size=1048576 2024-09-22T08:48:48.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.734+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~T33Z9V2WYF32.1 size=259999 2024-09-22T08:48:48.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.736+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=T33Z9V2WYF32 tag=DJZ6PDDFX3IB type=write size=2357151 2024-09-22T08:48:48.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.738+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=36ZOGERQ2MPM type=del size=3088388 2024-09-22T08:48:48.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.739+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.0 size=1048576 2024-09-22T08:48:48.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.740+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.1 size=1048576 2024-09-22T08:48:48.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.741+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~G9K4VKIGUBH1.2 size=699092 2024-09-22T08:48:48.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.743+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=G9K4VKIGUBH1 tag=CK4993BMXBQP type=write size=3844820 2024-09-22T08:48:48.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.746+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.0 size=1048576 2024-09-22T08:48:48.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.747+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.1 size=1048576 2024-09-22T08:48:48.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.748+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.2 size=5743 2024-09-22T08:48:48.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.748+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=9LS282EFD4NC tag=JU0IINYTM2TQ type=write size=3151471 2024-09-22T08:48:48.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.750+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~875ILFB4RQ56.0 size=1048576 2024-09-22T08:48:48.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.751+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~875ILFB4RQ56.1 size=256658 2024-09-22T08:48:48.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.753+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=875ILFB4RQ56 tag=146DN0O7721I type=write size=2353810 2024-09-22T08:48:48.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.754+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=G4OV3BIZW5RN type=del size=3984166 2024-09-22T08:48:48.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.755+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~C7DL6FC17X0Z.0 size=894754 2024-09-22T08:48:48.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.757+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=C7DL6FC17X0Z tag=Q9BDQR0W1KVL type=write size=1943330 2024-09-22T08:48:48.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.761+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~4OZCKVX99DPB.0 size=1048576 2024-09-22T08:48:48.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.762+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~4OZCKVX99DPB.1 size=222837 2024-09-22T08:48:48.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.762+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=4OZCKVX99DPB tag=4MN23W1O2HMK type=write size=2319989 2024-09-22T08:48:48.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.764+0000 7f7b8ef90780 1 < suggested remove operation key=6DC0SVAYR2DB tag=FF0ML0G6GEUL type=del 2024-09-22T08:48:48.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.766+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=YNX2CCMMWHDK type=del size=952520 2024-09-22T08:48:48.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.767+0000 7f7b8ef90780 1 < completed write operation key=L3XF68XD23FP tag=FTBM9GCKHCM4 type=write size=48747 2024-09-22T08:48:48.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.769+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~LIFBRF2QZP3U.0 size=789453 2024-09-22T08:48:48.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.769+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=LIFBRF2QZP3U tag=TVDT3VL8LNXV type=write size=1838029 2024-09-22T08:48:48.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.771+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=3HL20CH2R9WF type=del 2024-09-22T08:48:48.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.772+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=E6DQ4JQT61VK type=del size=3011798 2024-09-22T08:48:48.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.773+0000 7f7b8ef90780 1 < canceled operation key=YDJLMBL7EQWN tag=L9W0TDBC9ROY type=del size=1018275 2024-09-22T08:48:48.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.776+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~M4FBX8XT0ZB2.0 size=1016769 2024-09-22T08:48:48.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.776+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=M4FBX8XT0ZB2 tag=HFBAS5X7B7S9 type=write size=2065345 2024-09-22T08:48:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.777+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~BMUJRLZ1XM3A.0 size=1048576 2024-09-22T08:48:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.777+0000 7f7b8ef90780 1 < canceled part key=_multipart_VAO9MXRFGXFY.2~BMUJRLZ1XM3A.1 size=82782 2024-09-22T08:48:48.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.779+0000 7f7b8ef90780 1 < canceled multipart upload key=VAO9MXRFGXFY upload=BMUJRLZ1XM3A tag=01T1EIV6IEMZ type=write size=2179934 2024-09-22T08:48:48.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.780+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=JAZ3YBBQ8CWK type=del size=2079961 2024-09-22T08:48:48.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.781+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~VU99WH30Y20N.0 size=1048407 2024-09-22T08:48:48.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.783+0000 7f7b8ef90780 1 < completed multipart upload key=L3XF68XD23FP upload=VU99WH30Y20N tag=38AG61HHKHJT type=write size=2096983 2024-09-22T08:48:48.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.784+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=0GFKRAGIZ2XV type=del size=3057589 2024-09-22T08:48:48.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.787+0000 7f7b8ef90780 1 < suggested update operation key=Z9CHXCJ02L85 tag=Z61PZZEGXLGZ type=del size=3872637 2024-09-22T08:48:48.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.789+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~EDXD16TQ3T1Z.0 size=673577 2024-09-22T08:48:48.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.789+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=EDXD16TQ3T1Z tag=EPWUHZ2VUOH1 type=write size=1722153 2024-09-22T08:48:48.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.790+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=0N2UG72RRF0M type=del 2024-09-22T08:48:48.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.791+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=70YHMCVBLTR0 type=del size=3845869 2024-09-22T08:48:48.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.793+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~R5EYMBA6E8ZV.0 size=541718 2024-09-22T08:48:48.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.795+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=R5EYMBA6E8ZV tag=NP7R0LZ26KBO type=write size=1590294 2024-09-22T08:48:48.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.797+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~WX4WT689V6GD.0 size=1048576 2024-09-22T08:48:48.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.798+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~WX4WT689V6GD.1 size=245404 2024-09-22T08:48:48.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.798+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=WX4WT689V6GD tag=TMGJ9FHXV93J type=write size=2342556 2024-09-22T08:48:48.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.799+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=LS8ALCMLQ8P5 type=del 2024-09-22T08:48:48.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.802+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.0 size=1048576 2024-09-22T08:48:48.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.802+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.1 size=1048576 2024-09-22T08:48:48.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.803+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.2 size=952976 2024-09-22T08:48:48.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.803+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=OEPEG3HVV6XE tag=5U6P36DBIAGB type=write size=4098704 2024-09-22T08:48:48.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.805+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~GZRPPQHT0CBO.0 size=300187 2024-09-22T08:48:48.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.807+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=GZRPPQHT0CBO tag=NVEB31I0AAED type=write size=1348763 2024-09-22T08:48:48.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.808+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=THPOY3E9A14J type=del size=1185642 2024-09-22T08:48:48.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.809+0000 7f7b8ef90780 -1 < failed to complete operation key=6DC0SVAYR2DB tag=WMZ4HK431B0M type=del size=759796: (22) Invalid argument 2024-09-22T08:48:48.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.811+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.0 size=1048576 2024-09-22T08:48:48.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.812+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.1 size=1048576 2024-09-22T08:48:48.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.813+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.2 size=258489 2024-09-22T08:48:48.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.813+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=3DI6VB0S8RV2 tag=K82SKTAN0RY3 type=write size=3404217 2024-09-22T08:48:48.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.814+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=36ZOGERQ2MPM type=del 2024-09-22T08:48:48.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.815+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=7I9Q8FCT7EEA type=del size=3779009 2024-09-22T08:48:48.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.817+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.0 size=1048576 2024-09-22T08:48:48.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.817+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.1 size=1048576 2024-09-22T08:48:48.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.818+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~9LS282EFD4NC.2 size=5743 2024-09-22T08:48:48.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.821+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=9LS282EFD4NC tag=JU0IINYTM2TQ type=write size=3151471 2024-09-22T08:48:48.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.823+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~06T5GSJ8C9T3.0 size=334492 2024-09-22T08:48:48.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.823+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=06T5GSJ8C9T3 tag=NHKB8L0TRZG1 type=write size=1383068 2024-09-22T08:48:48.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.825+0000 7f7b8ef90780 1 < suggested remove operation key=Z9CHXCJ02L85 tag=G4OV3BIZW5RN type=del 2024-09-22T08:48:48.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.827+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=1WVZWE6JHNO5 type=del size=2426336 2024-09-22T08:48:48.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.828+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~4OZCKVX99DPB.0 size=1048576 2024-09-22T08:48:48.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.829+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~4OZCKVX99DPB.1 size=222837 2024-09-22T08:48:48.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.831+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=4OZCKVX99DPB tag=4MN23W1O2HMK type=write size=2319989 2024-09-22T08:48:48.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.832+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=FN4TMVEC8G99 type=write size=924550 2024-09-22T08:48:48.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.833+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=YNX2CCMMWHDK type=del 2024-09-22T08:48:48.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.834+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=O25UJ4C1MB2P type=write size=871146 2024-09-22T08:48:48.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.835+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~LIFBRF2QZP3U.0 size=789453 2024-09-22T08:48:48.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.838+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=LIFBRF2QZP3U tag=TVDT3VL8LNXV type=write size=1838029 2024-09-22T08:48:48.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.840+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.0 size=1048576 2024-09-22T08:48:48.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.841+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.1 size=1048576 2024-09-22T08:48:48.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.842+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.2 size=380169 2024-09-22T08:48:48.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.842+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=ZQGWGQBEHL10 tag=1UN1B7SIU17I type=write size=3525897 2024-09-22T08:48:48.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.843+0000 7f7b8ef90780 1 < canceled operation key=7ZS8G8H6I957 tag=E6DQ4JQT61VK type=del size=3011798 2024-09-22T08:48:48.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.846+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~A33S57Q2WEHP.0 size=1048576 2024-09-22T08:48:48.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.846+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~A33S57Q2WEHP.1 size=611929 2024-09-22T08:48:48.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.846+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=A33S57Q2WEHP tag=U1G3F20QT5FE type=write size=2709081 2024-09-22T08:48:48.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.848+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~M4FBX8XT0ZB2.0 size=1016769 2024-09-22T08:48:48.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.850+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=M4FBX8XT0ZB2 tag=HFBAS5X7B7S9 type=write size=2065345 2024-09-22T08:48:48.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.851+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=U2663K5ORKBO type=write size=267631 2024-09-22T08:48:48.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.852+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=JAZ3YBBQ8CWK type=del 2024-09-22T08:48:48.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.854+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~Q4BPGDIZZV45.0 size=1048576 2024-09-22T08:48:48.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.855+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~Q4BPGDIZZV45.1 size=122231 2024-09-22T08:48:48.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.855+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=Q4BPGDIZZV45 tag=U574D3YIO0LS type=write size=2219383 2024-09-22T08:48:48.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.856+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=0GFKRAGIZ2XV type=del 2024-09-22T08:48:48.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.858+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=9WY2LDCC4K1X type=del size=3339925 2024-09-22T08:48:48.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.859+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~EDXD16TQ3T1Z.0 size=673577 2024-09-22T08:48:48.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.861+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=EDXD16TQ3T1Z tag=EPWUHZ2VUOH1 type=write size=1722153 2024-09-22T08:48:48.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.864+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.0 size=1048576 2024-09-22T08:48:48.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.865+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.1 size=1048576 2024-09-22T08:48:48.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.866+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.2 size=775790 2024-09-22T08:48:48.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.866+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=DRJGVIX2F6F9 tag=DF2OM821DOPM type=write size=3921518 2024-09-22T08:48:48.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.869+0000 7f7b8ef90780 1 < suggested remove operation key=UQPY2ITDMKGO tag=70YHMCVBLTR0 type=del 2024-09-22T08:48:48.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.870+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=T1KZZD8GVY32 type=del size=507165 2024-09-22T08:48:48.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.871+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~WX4WT689V6GD.0 size=1048576 2024-09-22T08:48:48.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.873+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~WX4WT689V6GD.1 size=245404 2024-09-22T08:48:48.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.877+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=WX4WT689V6GD tag=TMGJ9FHXV93J type=write size=2342556 2024-09-22T08:48:48.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.878+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=D3I2OYJ436GQ type=del size=879089 2024-09-22T08:48:48.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.879+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.0 size=1048576 2024-09-22T08:48:48.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.880+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.1 size=1048576 2024-09-22T08:48:48.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.881+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~OEPEG3HVV6XE.2 size=952976 2024-09-22T08:48:48.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.884+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=OEPEG3HVV6XE tag=5U6P36DBIAGB type=write size=4098704 2024-09-22T08:48:48.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.886+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.0 size=1048576 2024-09-22T08:48:48.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.887+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.1 size=1048576 2024-09-22T08:48:48.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.888+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.2 size=1025751 2024-09-22T08:48:48.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.888+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=IQP31PVREIK7 tag=0LK59C63DHA9 type=write size=4171479 2024-09-22T08:48:48.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.890+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=THPOY3E9A14J type=del 2024-09-22T08:48:48.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.892+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~UN97F298W12J.0 size=1048576 2024-09-22T08:48:48.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.893+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~UN97F298W12J.1 size=604490 2024-09-22T08:48:48.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.893+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=UN97F298W12J tag=32M4VN8N82JP type=write size=2701642 2024-09-22T08:48:48.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.895+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.0 size=1048576 2024-09-22T08:48:48.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.896+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.1 size=1048576 2024-09-22T08:48:48.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.897+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3DI6VB0S8RV2.2 size=258489 2024-09-22T08:48:48.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.899+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=3DI6VB0S8RV2 tag=K82SKTAN0RY3 type=write size=3404217 2024-09-22T08:48:48.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.900+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=QSBBY734NE3Y type=del size=271754 2024-09-22T08:48:48.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.901+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=7I9Q8FCT7EEA type=del 2024-09-22T08:48:48.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.903+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=C5056T936GA2 type=del size=3447969 2024-09-22T08:48:48.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.904+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~06T5GSJ8C9T3.0 size=334492 2024-09-22T08:48:48.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.906+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=06T5GSJ8C9T3 tag=NHKB8L0TRZG1 type=write size=1383068 2024-09-22T08:48:48.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.907+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=2VL0HLJ552JX type=del size=2390284 2024-09-22T08:48:48.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.909+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=1WVZWE6JHNO5 type=del 2024-09-22T08:48:48.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.910+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=F20TPNWD6YSP type=del size=3719153 2024-09-22T08:48:48.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.911+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=FN4TMVEC8G99 type=write size=924550 2024-09-22T08:48:48.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.913+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.0 size=1048576 2024-09-22T08:48:48.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.914+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.1 size=1048576 2024-09-22T08:48:48.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.915+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.2 size=510628 2024-09-22T08:48:48.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.915+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=RWTXR15WQ1K9 tag=KLI8EGV04FX3 type=write size=3656356 2024-09-22T08:48:48.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.917+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=O25UJ4C1MB2P type=write size=871146 2024-09-22T08:48:48.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.919+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~FDE4IBPJ6W5I.0 size=10740 2024-09-22T08:48:48.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.919+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=FDE4IBPJ6W5I tag=TM22JWSVNNS3 type=write size=1059316 2024-09-22T08:48:48.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.920+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.0 size=1048576 2024-09-22T08:48:48.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.921+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.1 size=1048576 2024-09-22T08:48:48.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.922+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~ZQGWGQBEHL10.2 size=380169 2024-09-22T08:48:48.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.925+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=ZQGWGQBEHL10 tag=1UN1B7SIU17I type=write size=3525897 2024-09-22T08:48:48.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.926+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=JDCK08HPZON1 type=write size=113869 2024-09-22T08:48:48.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.927+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~A33S57Q2WEHP.0 size=1048576 2024-09-22T08:48:48.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.928+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~A33S57Q2WEHP.1 size=611929 2024-09-22T08:48:48.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.930+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=A33S57Q2WEHP tag=U1G3F20QT5FE type=write size=2709081 2024-09-22T08:48:48.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.931+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=UXMGUD3TGB1A type=write size=420437 2024-09-22T08:48:48.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.933+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=U2663K5ORKBO type=write size=267631 2024-09-22T08:48:48.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.935+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.0 size=1048576 2024-09-22T08:48:48.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.936+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.1 size=1048576 2024-09-22T08:48:48.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.937+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.2 size=551636 2024-09-22T08:48:48.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.937+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=0N2GMWSS041U tag=X7XZS2WFD690 type=write size=3697364 2024-09-22T08:48:48.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.939+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~Q4BPGDIZZV45.0 size=1048576 2024-09-22T08:48:48.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.940+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~Q4BPGDIZZV45.1 size=122231 2024-09-22T08:48:48.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.942+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=Q4BPGDIZZV45 tag=U574D3YIO0LS type=write size=2219383 2024-09-22T08:48:48.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.944+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.0 size=1048576 2024-09-22T08:48:48.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.945+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.1 size=1048576 2024-09-22T08:48:48.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.946+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.2 size=462303 2024-09-22T08:48:48.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.946+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=K1D18D0VWLOS tag=0TKB2V0883EZ type=write size=3608031 2024-09-22T08:48:48.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.947+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=9WY2LDCC4K1X type=del 2024-09-22T08:48:48.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.948+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=YUPS70ZO9IT7 type=del size=2869742 2024-09-22T08:48:48.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.949+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.0 size=1048576 2024-09-22T08:48:48.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.950+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.1 size=1048576 2024-09-22T08:48:48.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.952+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~DRJGVIX2F6F9.2 size=775790 2024-09-22T08:48:48.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.954+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=DRJGVIX2F6F9 tag=DF2OM821DOPM type=write size=3921518 2024-09-22T08:48:48.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.955+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=M98QWYNEUAZE type=del size=2032217 2024-09-22T08:48:48.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.956+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=T1KZZD8GVY32 type=del 2024-09-22T08:48:48.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.957+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=REWXW6T74T5S type=write size=441053 2024-09-22T08:48:48.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.958+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=D3I2OYJ436GQ type=del 2024-09-22T08:48:48.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.959+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=IPQXG9GQS9LC type=del size=739667 2024-09-22T08:48:48.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.961+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.0 size=1048576 2024-09-22T08:48:48.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.962+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.1 size=1048576 2024-09-22T08:48:48.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.963+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~IQP31PVREIK7.2 size=1025751 2024-09-22T08:48:48.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.965+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=IQP31PVREIK7 tag=0LK59C63DHA9 type=write size=4171479 2024-09-22T08:48:48.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.966+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=OVDIPDCJ86B6 type=write size=204114 2024-09-22T08:48:48.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.967+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~UN97F298W12J.0 size=1048576 2024-09-22T08:48:48.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.968+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~UN97F298W12J.1 size=604490 2024-09-22T08:48:48.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.970+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=UN97F298W12J tag=32M4VN8N82JP type=write size=2701642 2024-09-22T08:48:48.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.971+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=LZTSALX6LOQ4 type=write size=840338 2024-09-22T08:48:48.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.972+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=QSBBY734NE3Y type=del 2024-09-22T08:48:48.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.974+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=D42OAZVERYNA type=del size=2713949 2024-09-22T08:48:48.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.975+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=C5056T936GA2 type=del 2024-09-22T08:48:48.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.977+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~2WO0R3ADTY4I.0 size=1048576 2024-09-22T08:48:48.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.978+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~2WO0R3ADTY4I.1 size=190780 2024-09-22T08:48:48.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.978+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=2WO0R3ADTY4I tag=6IFYB5KIBGGK type=write size=2287932 2024-09-22T08:48:48.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.980+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=2VL0HLJ552JX type=del size=2390284 2024-09-22T08:48:48.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.981+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=FTNL2RF71FNC type=write size=130817 2024-09-22T08:48:48.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.983+0000 7f7b8ef90780 1 < suggested update operation key=YXIZJPACZZFY tag=F20TPNWD6YSP type=del size=3719153 2024-09-22T08:48:48.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.985+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=82SL0YF0NU93 type=del size=2534041 2024-09-22T08:48:48.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.986+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.0 size=1048576 2024-09-22T08:48:48.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.987+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.1 size=1048576 2024-09-22T08:48:48.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.988+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~RWTXR15WQ1K9.2 size=510628 2024-09-22T08:48:48.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.990+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=RWTXR15WQ1K9 tag=KLI8EGV04FX3 type=write size=3656356 2024-09-22T08:48:48.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.994+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~KVIAWUWMH93F.0 size=985464 2024-09-22T08:48:48.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.994+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=KVIAWUWMH93F tag=Z3ESHGV524WZ type=write size=2034040 2024-09-22T08:48:48.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.995+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~FDE4IBPJ6W5I.0 size=10740 2024-09-22T08:48:48.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.997+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=FDE4IBPJ6W5I tag=TM22JWSVNNS3 type=write size=1059316 2024-09-22T08:48:49.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:48.999+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.0 size=1048576 2024-09-22T08:48:49.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.000+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.1 size=1048576 2024-09-22T08:48:49.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.001+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.2 size=215472 2024-09-22T08:48:49.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.001+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=VE796ZGWMX6M tag=9DF8ODX72GD5 type=write size=3361200 2024-09-22T08:48:49.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.002+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=JDCK08HPZON1 type=write size=113869 2024-09-22T08:48:49.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.005+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~1F8HG1ZMSC1U.0 size=252231 2024-09-22T08:48:49.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.005+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=1F8HG1ZMSC1U tag=2UVDVB9EMSYN type=write size=1300807 2024-09-22T08:48:49.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.007+0000 7f7b8ef90780 1 < suggested remove operation key=ORON3U0WY2K5 tag=UXMGUD3TGB1A type=write 2024-09-22T08:48:49.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.008+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=VMB8OZ070VE3 type=del size=1848046 2024-09-22T08:48:49.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.010+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.0 size=1048576 2024-09-22T08:48:49.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.011+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.1 size=1048576 2024-09-22T08:48:49.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.011+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~0N2GMWSS041U.2 size=551636 2024-09-22T08:48:49.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.013+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=0N2GMWSS041U tag=X7XZS2WFD690 type=write size=3697364 2024-09-22T08:48:49.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.014+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=HHJ82Z8H3AHZ type=del size=1995494 2024-09-22T08:48:49.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.016+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.0 size=1048576 2024-09-22T08:48:49.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.017+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.1 size=1048576 2024-09-22T08:48:49.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.018+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~K1D18D0VWLOS.2 size=462303 2024-09-22T08:48:49.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.020+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=K1D18D0VWLOS tag=0TKB2V0883EZ type=write size=3608031 2024-09-22T08:48:49.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.022+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=7KS1OZS9WWQ8 type=del size=3038723 2024-09-22T08:48:49.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.023+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=YUPS70ZO9IT7 type=del 2024-09-22T08:48:49.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.024+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=FNX3BVS432NU type=del size=3009051 2024-09-22T08:48:49.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.026+0000 7f7b8ef90780 1 < canceled operation key=70WNR3KVU0BG tag=M98QWYNEUAZE type=del size=2032217 2024-09-22T08:48:49.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.027+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=M54USRJ6Z8EP type=del size=4044516 2024-09-22T08:48:49.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.030+0000 7f7b8ef90780 1 < suggested update operation key=PODNY4NH4A9W tag=REWXW6T74T5S type=write size=441053 2024-09-22T08:48:49.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.031+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=FIBX81ZFOV5R type=del size=1235953 2024-09-22T08:48:49.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.032+0000 7f7b8ef90780 -1 < failed to complete operation key=YXIZJPACZZFY tag=IPQXG9GQS9LC type=del size=739667: (22) Invalid argument 2024-09-22T08:48:49.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.035+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.0 size=1048576 2024-09-22T08:48:49.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.036+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.1 size=1048576 2024-09-22T08:48:49.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.037+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.2 size=197343 2024-09-22T08:48:49.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.037+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=YDJ2FLSJT1RN tag=5HCMJJC0GWWE type=write size=3343071 2024-09-22T08:48:49.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.038+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=OVDIPDCJ86B6 type=write size=204114 2024-09-22T08:48:49.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.040+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=7RTZ3P1E7AOE type=del size=1666807 2024-09-22T08:48:49.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.041+0000 7f7b8ef90780 1 < canceled operation key=R0N30XP1BXY3 tag=LZTSALX6LOQ4 type=write size=840338 2024-09-22T08:48:49.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.043+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~3Z8TPRQ8NK1V.0 size=962951 2024-09-22T08:48:49.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.043+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=3Z8TPRQ8NK1V tag=C3RGH8EVL059 type=write size=2011527 2024-09-22T08:48:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.045+0000 7f7b8ef90780 -1 < failed to complete operation key=YXIZJPACZZFY tag=D42OAZVERYNA type=del size=2713949: (22) Invalid argument 2024-09-22T08:48:49.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.046+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=ESRAZDRKAZI0 type=write size=22508 2024-09-22T08:48:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.046+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~2WO0R3ADTY4I.0 size=1048576 2024-09-22T08:48:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.046+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~2WO0R3ADTY4I.1 size=190780 2024-09-22T08:48:49.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.049+0000 7f7b8ef90780 1 < canceled multipart upload key=4J4EGI19N123 upload=2WO0R3ADTY4I tag=6IFYB5KIBGGK type=write size=2287932 2024-09-22T08:48:49.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.050+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=HT6H5N38A6UD type=del size=2917311 2024-09-22T08:48:49.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.053+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=FTNL2RF71FNC type=write size=130817 2024-09-22T08:48:49.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.054+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=EENQD2V3PKII type=del size=3821868 2024-09-22T08:48:49.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.055+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=82SL0YF0NU93 type=del 2024-09-22T08:48:49.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.057+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=73K81YY0DPA2 type=del size=3316425 2024-09-22T08:48:49.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.058+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~KVIAWUWMH93F.0 size=985464 2024-09-22T08:48:49.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.060+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=KVIAWUWMH93F tag=Z3ESHGV524WZ type=write size=2034040 2024-09-22T08:48:49.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.062+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~9UHTCO89QBCL.0 size=1048576 2024-09-22T08:48:49.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.063+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~9UHTCO89QBCL.1 size=452575 2024-09-22T08:48:49.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.063+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=9UHTCO89QBCL tag=HCGR1FYMQZ46 type=write size=2549727 2024-09-22T08:48:49.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.063+0000 7f7b8ef90780 1 < canceled part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.0 size=1048576 2024-09-22T08:48:49.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.064+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.1 size=1048576 2024-09-22T08:48:49.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.065+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~VE796ZGWMX6M.2 size=215472 2024-09-22T08:48:49.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.067+0000 7f7b8ef90780 1 < canceled multipart upload key=QH6TK0MJKYUO upload=VE796ZGWMX6M tag=9DF8ODX72GD5 type=write size=3361200 2024-09-22T08:48:49.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.070+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~DJM9JYM7N9XJ.0 size=1048576 2024-09-22T08:48:49.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.071+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~DJM9JYM7N9XJ.1 size=263539 2024-09-22T08:48:49.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.071+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=DJM9JYM7N9XJ tag=Z8CRDNXYQR3D type=write size=2360691 2024-09-22T08:48:49.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.071+0000 7f7b8ef90780 1 < canceled part key=_multipart_YF94C9GVRXQP.2~1F8HG1ZMSC1U.0 size=252231 2024-09-22T08:48:49.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.073+0000 7f7b8ef90780 1 < canceled multipart upload key=YF94C9GVRXQP upload=1F8HG1ZMSC1U tag=2UVDVB9EMSYN type=write size=1300807 2024-09-22T08:48:49.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.075+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~ULUC1P9KJVA2.0 size=1048576 2024-09-22T08:48:49.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.076+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~ULUC1P9KJVA2.1 size=634175 2024-09-22T08:48:49.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.076+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=ULUC1P9KJVA2 tag=YTBK9UHLCK43 type=write size=2731327 2024-09-22T08:48:49.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.078+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=VMB8OZ070VE3 type=del 2024-09-22T08:48:49.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.080+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~UJMGDWMPB8G1.0 size=571782 2024-09-22T08:48:49.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.080+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=UJMGDWMPB8G1 tag=7Q9JAEV9SLUS type=write size=1620358 2024-09-22T08:48:49.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.083+0000 7f7b8ef90780 1 < suggested remove operation key=R0N30XP1BXY3 tag=HHJ82Z8H3AHZ type=del 2024-09-22T08:48:49.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.085+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~YZ0XM51F022Q.0 size=787267 2024-09-22T08:48:49.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.085+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=YZ0XM51F022Q tag=COBROP1XS5G3 type=write size=1835843 2024-09-22T08:48:49.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.087+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=7KS1OZS9WWQ8 type=del size=3038723 2024-09-22T08:48:49.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.088+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=RKAW0880YRQH type=write size=944113 2024-09-22T08:48:49.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.090+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=FNX3BVS432NU type=del 2024-09-22T08:48:49.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.091+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=JBAX59928PJR type=del size=1434601 2024-09-22T08:48:49.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.092+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=M54USRJ6Z8EP type=del 2024-09-22T08:48:49.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.094+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=NTOP67W8IVPO type=del size=3850322 2024-09-22T08:48:49.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.095+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=FIBX81ZFOV5R type=del 2024-09-22T08:48:49.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.096+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=YGXXZK1CUVAH type=del size=3509817 2024-09-22T08:48:49.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.098+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.0 size=1048576 2024-09-22T08:48:49.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.099+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.1 size=1048576 2024-09-22T08:48:49.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.100+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~YDJ2FLSJT1RN.2 size=197343 2024-09-22T08:48:49.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.102+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=YDJ2FLSJT1RN tag=5HCMJJC0GWWE type=write size=3343071 2024-09-22T08:48:49.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.104+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=APJECQITJDLD type=del size=3304393 2024-09-22T08:48:49.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.106+0000 7f7b8ef90780 1 < suggested update operation key=70WNR3KVU0BG tag=7RTZ3P1E7AOE type=del size=1666807 2024-09-22T08:48:49.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.107+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=744B8O5QGPNZ type=del size=1512701 2024-09-22T08:48:49.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.109+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~3Z8TPRQ8NK1V.0 size=962951 2024-09-22T08:48:49.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.111+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=3Z8TPRQ8NK1V tag=C3RGH8EVL059 type=write size=2011527 2024-09-22T08:48:49.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.113+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~6W8FGMQ5KP27.0 size=408523 2024-09-22T08:48:49.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.113+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=6W8FGMQ5KP27 tag=OQJ77BK1CFN7 type=write size=1457099 2024-09-22T08:48:49.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.115+0000 7f7b8ef90780 1 < completed write operation key=L1URDVW43BUG tag=ESRAZDRKAZI0 type=write size=22508 2024-09-22T08:48:49.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.117+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=ZIFSX8EQ13TT type=del size=3379849 2024-09-22T08:48:49.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.118+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=HT6H5N38A6UD type=del 2024-09-22T08:48:49.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.120+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EB09B82WR86I.0 size=1048576 2024-09-22T08:48:49.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.121+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~EB09B82WR86I.1 size=446654 2024-09-22T08:48:49.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.121+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=EB09B82WR86I tag=71KQKB462K2R type=write size=2543806 2024-09-22T08:48:49.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.122+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=EENQD2V3PKII type=del size=3821868: (22) Invalid argument 2024-09-22T08:48:49.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.123+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=UTMGPOHOVH0R type=del size=3272052 2024-09-22T08:48:49.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.124+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=73K81YY0DPA2 type=del 2024-09-22T08:48:49.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.127+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.0 size=1048576 2024-09-22T08:48:49.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.128+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.1 size=1048576 2024-09-22T08:48:49.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.128+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.2 size=207277 2024-09-22T08:48:49.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.128+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=YV4YD5XNFS9K tag=42XXHJL3FRDB type=write size=3353005 2024-09-22T08:48:49.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.130+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~9UHTCO89QBCL.0 size=1048576 2024-09-22T08:48:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.130+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~9UHTCO89QBCL.1 size=452575 2024-09-22T08:48:49.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.131+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=9UHTCO89QBCL tag=HCGR1FYMQZ46 type=write size=2549727 2024-09-22T08:48:49.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.133+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.0 size=1048576 2024-09-22T08:48:49.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.134+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.1 size=1048576 2024-09-22T08:48:49.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.135+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.2 size=556348 2024-09-22T08:48:49.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.135+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=1MLWF51VPYI8 tag=K7EQHDB8YWJT type=write size=3702076 2024-09-22T08:48:49.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.137+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~DJM9JYM7N9XJ.0 size=1048576 2024-09-22T08:48:49.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.138+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~DJM9JYM7N9XJ.1 size=263539 2024-09-22T08:48:49.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.140+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=DJM9JYM7N9XJ tag=Z8CRDNXYQR3D type=write size=2360691 2024-09-22T08:48:49.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.141+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=WOEHHRUAN4R2 type=del size=1773345 2024-09-22T08:48:49.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.141+0000 7f7b8ef90780 1 < canceled part key=_multipart_70WNR3KVU0BG.2~ULUC1P9KJVA2.0 size=1048576 2024-09-22T08:48:49.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.142+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~ULUC1P9KJVA2.1 size=634175 2024-09-22T08:48:49.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.144+0000 7f7b8ef90780 1 < canceled multipart upload key=70WNR3KVU0BG upload=ULUC1P9KJVA2 tag=YTBK9UHLCK43 type=write size=2731327 2024-09-22T08:48:49.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.146+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=K0HVH56T7KUE type=del size=806301 2024-09-22T08:48:49.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.147+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~UJMGDWMPB8G1.0 size=571782 2024-09-22T08:48:49.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.149+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=UJMGDWMPB8G1 tag=7Q9JAEV9SLUS type=write size=1620358 2024-09-22T08:48:49.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.151+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~FLCH8HFYGRVE.0 size=1048576 2024-09-22T08:48:49.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.152+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~FLCH8HFYGRVE.1 size=491879 2024-09-22T08:48:49.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.152+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=FLCH8HFYGRVE tag=C9VUFI1YLL84 type=write size=2589031 2024-09-22T08:48:49.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.153+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~YZ0XM51F022Q.0 size=787267 2024-09-22T08:48:49.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.155+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=YZ0XM51F022Q tag=COBROP1XS5G3 type=write size=1835843 2024-09-22T08:48:49.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.157+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~FZHSD7RXJ2M5.0 size=1048576 2024-09-22T08:48:49.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.158+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~FZHSD7RXJ2M5.1 size=892373 2024-09-22T08:48:49.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.158+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=FZHSD7RXJ2M5 tag=DDV3F7V981F6 type=write size=2989525 2024-09-22T08:48:49.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.159+0000 7f7b8ef90780 1 < completed write operation key=G51KS3NM4VFY tag=RKAW0880YRQH type=write size=944113 2024-09-22T08:48:49.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.161+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=DOS8OR1VTD95 type=write size=96822 2024-09-22T08:48:49.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.163+0000 7f7b8ef90780 1 < suggested remove operation key=L1URDVW43BUG tag=JBAX59928PJR type=del 2024-09-22T08:48:49.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.164+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=ZYGFLNIBVF9R type=del size=2751525 2024-09-22T08:48:49.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.166+0000 7f7b8ef90780 1 < suggested update operation key=7ZS8G8H6I957 tag=NTOP67W8IVPO type=del size=3850322 2024-09-22T08:48:49.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.167+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=H8T0L0FW1IX7 type=del size=250822 2024-09-22T08:48:49.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.170+0000 7f7b8ef90780 1 < suggested update operation key=IEZKK9YIIF33 tag=YGXXZK1CUVAH type=del size=3509817 2024-09-22T08:48:49.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.172+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.0 size=1048576 2024-09-22T08:48:49.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.173+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.1 size=1048576 2024-09-22T08:48:49.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.174+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.2 size=618971 2024-09-22T08:48:49.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.174+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=BG8NJWOZ51UN tag=ODTR9WT19NPI type=write size=3764699 2024-09-22T08:48:49.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.175+0000 7f7b8ef90780 1 < canceled operation key=WDGY8YL16UWI tag=APJECQITJDLD type=del size=3304393 2024-09-22T08:48:49.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.176+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=XQ0J1328I3V5 type=del size=1911558 2024-09-22T08:48:49.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.177+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=744B8O5QGPNZ type=del 2024-09-22T08:48:49.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.180+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~59WPHHJ5J76S.0 size=892262 2024-09-22T08:48:49.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.180+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=59WPHHJ5J76S tag=A39I1BD03KRC type=write size=1940838 2024-09-22T08:48:49.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.181+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~6W8FGMQ5KP27.0 size=408523 2024-09-22T08:48:49.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.183+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=6W8FGMQ5KP27 tag=OQJ77BK1CFN7 type=write size=1457099 2024-09-22T08:48:49.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.184+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=8IQF7F6H85PT type=del size=1513677 2024-09-22T08:48:49.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.185+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=ZIFSX8EQ13TT type=del 2024-09-22T08:48:49.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.188+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~2EVP6L5K7SBN.0 size=1048576 2024-09-22T08:48:49.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.189+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~2EVP6L5K7SBN.1 size=30919 2024-09-22T08:48:49.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.189+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=2EVP6L5K7SBN tag=R8ZT1NT9CTFH type=write size=2128071 2024-09-22T08:48:49.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.190+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EB09B82WR86I.0 size=1048576 2024-09-22T08:48:49.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.191+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~EB09B82WR86I.1 size=446654 2024-09-22T08:48:49.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.193+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=EB09B82WR86I tag=71KQKB462K2R type=write size=2543806 2024-09-22T08:48:49.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.195+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=CBCB6ZMUIX4M type=del size=1151012 2024-09-22T08:48:49.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.197+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=UTMGPOHOVH0R type=del 2024-09-22T08:48:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.198+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=92KOP907ZR6E type=del size=2554582 2024-09-22T08:48:49.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.200+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.0 size=1048576 2024-09-22T08:48:49.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.201+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.1 size=1048576 2024-09-22T08:48:49.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.202+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~YV4YD5XNFS9K.2 size=207277 2024-09-22T08:48:49.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.204+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=YV4YD5XNFS9K tag=42XXHJL3FRDB type=write size=3353005 2024-09-22T08:48:49.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.206+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.0 size=1048576 2024-09-22T08:48:49.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.207+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.1 size=1048576 2024-09-22T08:48:49.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.208+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.2 size=853743 2024-09-22T08:48:49.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.208+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=ABPWIVL2GOC0 tag=HJABPDTRA7AM type=write size=3999471 2024-09-22T08:48:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.209+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.0 size=1048576 2024-09-22T08:48:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.209+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.1 size=1048576 2024-09-22T08:48:49.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.210+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~1MLWF51VPYI8.2 size=556348 2024-09-22T08:48:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.212+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=1MLWF51VPYI8 tag=K7EQHDB8YWJT type=write size=3702076 2024-09-22T08:48:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.214+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=FEJTHW4DBON7 type=del size=2124329 2024-09-22T08:48:49.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.215+0000 7f7b8ef90780 -1 < failed to complete operation key=7ZS8G8H6I957 tag=WOEHHRUAN4R2 type=del size=1773345: (22) Invalid argument 2024-09-22T08:48:49.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.216+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=RIHUGK25MEZD type=del size=1326241 2024-09-22T08:48:49.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.217+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=K0HVH56T7KUE type=del 2024-09-22T08:48:49.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.218+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=14JQ8K3E469C type=del size=3409625 2024-09-22T08:48:49.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.219+0000 7f7b8ef90780 1 < canceled part key=_multipart_O81X7IWXN4VP.2~FLCH8HFYGRVE.0 size=1048576 2024-09-22T08:48:49.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.220+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~FLCH8HFYGRVE.1 size=491879 2024-09-22T08:48:49.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.222+0000 7f7b8ef90780 1 < canceled multipart upload key=O81X7IWXN4VP upload=FLCH8HFYGRVE tag=C9VUFI1YLL84 type=write size=2589031 2024-09-22T08:48:49.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.223+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=LGX2FYFFREHP type=del size=576634 2024-09-22T08:48:49.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.224+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~FZHSD7RXJ2M5.0 size=1048576 2024-09-22T08:48:49.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.225+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~FZHSD7RXJ2M5.1 size=892373 2024-09-22T08:48:49.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.228+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=FZHSD7RXJ2M5 tag=DDV3F7V981F6 type=write size=2989525 2024-09-22T08:48:49.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.230+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=QTREJU3JZ6KA type=del size=3707302 2024-09-22T08:48:49.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.231+0000 7f7b8ef90780 1 < completed write operation key=Z9CHXCJ02L85 tag=DOS8OR1VTD95 type=write size=96822 2024-09-22T08:48:49.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.232+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=1C8UZZXM1B72 type=del size=1651872 2024-09-22T08:48:49.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.235+0000 7f7b8ef90780 1 < suggested remove operation key=7ZS8G8H6I957 tag=ZYGFLNIBVF9R type=del 2024-09-22T08:48:49.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.236+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=1SRPUE4VOGJU type=del size=3016965 2024-09-22T08:48:49.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.237+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=H8T0L0FW1IX7 type=del 2024-09-22T08:48:49.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.238+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=8OB5R6JD55RV type=del size=2234658 2024-09-22T08:48:49.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.238+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.0 size=1048576 2024-09-22T08:48:49.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.239+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.1 size=1048576 2024-09-22T08:48:49.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.239+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~BG8NJWOZ51UN.2 size=618971 2024-09-22T08:48:49.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.241+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=BG8NJWOZ51UN tag=ODTR9WT19NPI type=write size=3764699 2024-09-22T08:48:49.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.243+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~90OYOTL61Z96.0 size=446797 2024-09-22T08:48:49.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.243+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=90OYOTL61Z96 tag=FLYK6VM3F7K7 type=write size=1495373 2024-09-22T08:48:49.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.245+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=XQ0J1328I3V5 type=del 2024-09-22T08:48:49.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.247+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=S0OEQTXBIHLY type=del size=1147623 2024-09-22T08:48:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.248+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~59WPHHJ5J76S.0 size=892262 2024-09-22T08:48:49.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.250+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=59WPHHJ5J76S tag=A39I1BD03KRC type=write size=1940838 2024-09-22T08:48:49.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.252+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=9ET7SMMKF9UU type=write size=796900 2024-09-22T08:48:49.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.253+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=8IQF7F6H85PT type=del size=1513677 2024-09-22T08:48:49.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.255+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~ZIPR5NQWD5F1.0 size=1048576 2024-09-22T08:48:49.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.256+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~ZIPR5NQWD5F1.1 size=366319 2024-09-22T08:48:49.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.256+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=ZIPR5NQWD5F1 tag=LT6W1ZOJITYJ type=write size=2463471 2024-09-22T08:48:49.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.256+0000 7f7b8ef90780 1 < canceled part key=_multipart_ORON3U0WY2K5.2~2EVP6L5K7SBN.0 size=1048576 2024-09-22T08:48:49.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.257+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~2EVP6L5K7SBN.1 size=30919 2024-09-22T08:48:49.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.259+0000 7f7b8ef90780 1 < canceled multipart upload key=ORON3U0WY2K5 upload=2EVP6L5K7SBN tag=R8ZT1NT9CTFH type=write size=2128071 2024-09-22T08:48:49.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.260+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=T5PCSBU5OWDQ type=del size=598044 2024-09-22T08:48:49.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.261+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=CBCB6ZMUIX4M type=del 2024-09-22T08:48:49.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.263+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~0NY3CC0I2S53.0 size=1048576 2024-09-22T08:48:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.264+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~0NY3CC0I2S53.1 size=430464 2024-09-22T08:48:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.264+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=0NY3CC0I2S53 tag=OZAPVVMTAWVJ type=write size=2527616 2024-09-22T08:48:49.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.266+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=92KOP907ZR6E type=del 2024-09-22T08:48:49.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.267+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=AER2GOXE1YQC type=del size=2422869 2024-09-22T08:48:49.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.268+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.0 size=1048576 2024-09-22T08:48:49.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.269+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.1 size=1048576 2024-09-22T08:48:49.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.270+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~ABPWIVL2GOC0.2 size=853743 2024-09-22T08:48:49.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.272+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=ABPWIVL2GOC0 tag=HJABPDTRA7AM type=write size=3999471 2024-09-22T08:48:49.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.273+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=2LK9K99JGLDF type=del size=1346158 2024-09-22T08:48:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.274+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=FEJTHW4DBON7 type=del 2024-09-22T08:48:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.277+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~EOPH6WEW2MZO.0 size=1048576 2024-09-22T08:48:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.278+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~EOPH6WEW2MZO.1 size=255672 2024-09-22T08:48:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.278+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=EOPH6WEW2MZO tag=F3TSXYSPJMT1 type=write size=2352824 2024-09-22T08:48:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.279+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=RIHUGK25MEZD type=del 2024-09-22T08:48:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.280+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=G68D3NQ4CNRT type=del size=3566614 2024-09-22T08:48:49.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.281+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=14JQ8K3E469C type=del 2024-09-22T08:48:49.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.283+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=XNDDPU0PORK1 type=del size=1759537 2024-09-22T08:48:49.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.284+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=LGX2FYFFREHP type=del 2024-09-22T08:48:49.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.285+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=V6XHHMTL1KNH type=del size=1427385 2024-09-22T08:48:49.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.286+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=QTREJU3JZ6KA type=del 2024-09-22T08:48:49.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.287+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=AZYVSWCPFCJS type=del size=2047608 2024-09-22T08:48:49.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.289+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=1C8UZZXM1B72 type=del 2024-09-22T08:48:49.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.290+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=D8M3TUDQQGK1 type=write size=567151 2024-09-22T08:48:49.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.292+0000 7f7b8ef90780 1 < suggested update operation key=YDJLMBL7EQWN tag=1SRPUE4VOGJU type=del size=3016965 2024-09-22T08:48:49.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.293+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=5F60SYX74WJ1 type=del size=3356046 2024-09-22T08:48:49.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.295+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=8OB5R6JD55RV type=del 2024-09-22T08:48:49.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.297+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~15UFFS8MESKG.0 size=834479 2024-09-22T08:48:49.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.297+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=15UFFS8MESKG tag=XKBNBTK04A1C type=write size=1883055 2024-09-22T08:48:49.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.298+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~90OYOTL61Z96.0 size=446797 2024-09-22T08:48:49.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.300+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=90OYOTL61Z96 tag=FLYK6VM3F7K7 type=write size=1495373 2024-09-22T08:48:49.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.302+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=ZRYBAMHYU6ET type=del size=1156349 2024-09-22T08:48:49.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.303+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=S0OEQTXBIHLY type=del 2024-09-22T08:48:49.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.304+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=HMI1M4AA61V8 type=write size=729095 2024-09-22T08:48:49.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.306+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=9ET7SMMKF9UU type=write size=796900 2024-09-22T08:48:49.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.307+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=IJBDUZ9U3V5X type=write size=484235 2024-09-22T08:48:49.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.308+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~ZIPR5NQWD5F1.0 size=1048576 2024-09-22T08:48:49.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.309+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~ZIPR5NQWD5F1.1 size=366319 2024-09-22T08:48:49.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.312+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=ZIPR5NQWD5F1 tag=LT6W1ZOJITYJ type=write size=2463471 2024-09-22T08:48:49.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.314+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~EEUZZ54N84NZ.0 size=126577 2024-09-22T08:48:49.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.314+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=EEUZZ54N84NZ tag=06M7ZQR6D3IZ type=write size=1175153 2024-09-22T08:48:49.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.315+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=T5PCSBU5OWDQ type=del 2024-09-22T08:48:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.317+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=RDM177Q3DC12 type=del size=1473255 2024-09-22T08:48:49.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.318+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~0NY3CC0I2S53.0 size=1048576 2024-09-22T08:48:49.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.319+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~0NY3CC0I2S53.1 size=430464 2024-09-22T08:48:49.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.321+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=0NY3CC0I2S53 tag=OZAPVVMTAWVJ type=write size=2527616 2024-09-22T08:48:49.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.322+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=B7NZC3YWMDHT type=del size=574581 2024-09-22T08:48:49.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.324+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=AER2GOXE1YQC type=del 2024-09-22T08:48:49.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.326+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~FX8YS0JU5IEP.0 size=130641 2024-09-22T08:48:49.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.326+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=FX8YS0JU5IEP tag=U6VMG9NIW7SV type=write size=1179217 2024-09-22T08:48:49.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.327+0000 7f7b8ef90780 1 < canceled operation key=QH6TK0MJKYUO tag=2LK9K99JGLDF type=del size=1346158 2024-09-22T08:48:49.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.330+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.0 size=1048576 2024-09-22T08:48:49.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.331+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.1 size=1048576 2024-09-22T08:48:49.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.332+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.2 size=444231 2024-09-22T08:48:49.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.332+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=TX9S20RXFLWY tag=CSK1RC3V2VIN type=write size=3589959 2024-09-22T08:48:49.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.333+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~EOPH6WEW2MZO.0 size=1048576 2024-09-22T08:48:49.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.334+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~EOPH6WEW2MZO.1 size=255672 2024-09-22T08:48:49.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.336+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=EOPH6WEW2MZO tag=F3TSXYSPJMT1 type=write size=2352824 2024-09-22T08:48:49.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.338+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=0XZ3SIMFCNH1 type=del size=4067375 2024-09-22T08:48:49.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.339+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=G68D3NQ4CNRT type=del 2024-09-22T08:48:49.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.340+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=LBLZPV9WPYS0 type=del size=3488786 2024-09-22T08:48:49.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.341+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=XNDDPU0PORK1 type=del 2024-09-22T08:48:49.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.342+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=B9ZTL263ZXZC type=del size=545513 2024-09-22T08:48:49.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.344+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=V6XHHMTL1KNH type=del 2024-09-22T08:48:49.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.346+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=P4XLPJYJRRSH type=del size=2734353 2024-09-22T08:48:49.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.347+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=AZYVSWCPFCJS type=del 2024-09-22T08:48:49.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.348+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=P8V9U33PL9KB type=del size=3045784 2024-09-22T08:48:49.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.350+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=D8M3TUDQQGK1 type=write size=567151 2024-09-22T08:48:49.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.351+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=EL952483U3CO type=del size=317141 2024-09-22T08:48:49.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.352+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=5F60SYX74WJ1 type=del 2024-09-22T08:48:49.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.353+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=1DXUOHEO31IN type=del size=1257706 2024-09-22T08:48:49.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.354+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~15UFFS8MESKG.0 size=834479 2024-09-22T08:48:49.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.356+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=15UFFS8MESKG tag=XKBNBTK04A1C type=write size=1883055 2024-09-22T08:48:49.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.357+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=5LH6A8B9ZRI0 type=del size=2046967 2024-09-22T08:48:49.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.359+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=ZRYBAMHYU6ET type=del 2024-09-22T08:48:49.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.360+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=8VUG75NNAEXQ type=del size=3597376 2024-09-22T08:48:49.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.361+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=HMI1M4AA61V8 type=write size=729095 2024-09-22T08:48:49.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.362+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=2OS7RC7IYMKH type=del size=641802 2024-09-22T08:48:49.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.364+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=IJBDUZ9U3V5X type=write size=484235 2024-09-22T08:48:49.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.366+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.0 size=1048576 2024-09-22T08:48:49.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.367+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.1 size=1048576 2024-09-22T08:48:49.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.368+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.2 size=888527 2024-09-22T08:48:49.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.368+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=CU1E4B8FWI9Q tag=OJW7UVY2EUBZ type=write size=4034255 2024-09-22T08:48:49.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.368+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~EEUZZ54N84NZ.0 size=126577 2024-09-22T08:48:49.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.370+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=EEUZZ54N84NZ tag=06M7ZQR6D3IZ type=write size=1175153 2024-09-22T08:48:49.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.373+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~YLSEFAAEVCNA.0 size=205235 2024-09-22T08:48:49.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.373+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=YLSEFAAEVCNA tag=4W1706VYI782 type=write size=1253811 2024-09-22T08:48:49.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.374+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=RDM177Q3DC12 type=del 2024-09-22T08:48:49.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.376+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~M87J4RM9MWN1.0 size=416435 2024-09-22T08:48:49.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.376+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=M87J4RM9MWN1 tag=QKR1VAF0TLIA type=write size=1465011 2024-09-22T08:48:49.378 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.377+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=B7NZC3YWMDHT type=del 2024-09-22T08:48:49.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.379+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=BSPP5U2IPUFH type=del size=138028 2024-09-22T08:48:49.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.379+0000 7f7b8ef90780 1 < canceled part key=_multipart_PODNY4NH4A9W.2~FX8YS0JU5IEP.0 size=130641 2024-09-22T08:48:49.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.381+0000 7f7b8ef90780 1 < canceled multipart upload key=PODNY4NH4A9W upload=FX8YS0JU5IEP tag=U6VMG9NIW7SV type=write size=1179217 2024-09-22T08:48:49.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.382+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=OVI27NS32HC5 type=write size=59064 2024-09-22T08:48:49.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.383+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.0 size=1048576 2024-09-22T08:48:49.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.384+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.1 size=1048576 2024-09-22T08:48:49.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.385+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~TX9S20RXFLWY.2 size=444231 2024-09-22T08:48:49.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.387+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=TX9S20RXFLWY tag=CSK1RC3V2VIN type=write size=3589959 2024-09-22T08:48:49.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.389+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=MLHSAGDRAAYG type=del size=1929372 2024-09-22T08:48:49.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.390+0000 7f7b8ef90780 1 < canceled operation key=Y7W0V6YTDFIB tag=0XZ3SIMFCNH1 type=del size=4067375 2024-09-22T08:48:49.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.391+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=MDF7LD0FKAFX type=del size=3114254 2024-09-22T08:48:49.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.392+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=LBLZPV9WPYS0 type=del 2024-09-22T08:48:49.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.395+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~RKNJ33VXBWU4.0 size=113948 2024-09-22T08:48:49.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.395+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=RKNJ33VXBWU4 tag=0X79KPOEKY7P type=write size=1162524 2024-09-22T08:48:49.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.397+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=B9ZTL263ZXZC type=del 2024-09-22T08:48:49.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.400+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~IV51LGHCK2TS.0 size=1046125 2024-09-22T08:48:49.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.400+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=IV51LGHCK2TS tag=55IN492WSA0R type=write size=2094701 2024-09-22T08:48:49.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.402+0000 7f7b8ef90780 1 < suggested remove operation key=YF94C9GVRXQP tag=P4XLPJYJRRSH type=del 2024-09-22T08:48:49.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.403+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=T4ERP82OWY0T type=del size=3642516 2024-09-22T08:48:49.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.405+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=P8V9U33PL9KB type=del 2024-09-22T08:48:49.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.407+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~K2B9VUHKQK9N.0 size=308100 2024-09-22T08:48:49.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.407+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=K2B9VUHKQK9N tag=V4COUBASLKG0 type=write size=1356676 2024-09-22T08:48:49.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.408+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=EL952483U3CO type=del 2024-09-22T08:48:49.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.410+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=UQ69YYPBE6ZO type=del size=3041900 2024-09-22T08:48:49.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.411+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=1DXUOHEO31IN type=del 2024-09-22T08:48:49.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.412+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=R06DZOM308WY type=write size=636682 2024-09-22T08:48:49.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.415+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=5LH6A8B9ZRI0 type=del 2024-09-22T08:48:49.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.417+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~G3BE7TJOBXWM.0 size=1018893 2024-09-22T08:48:49.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.417+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=G3BE7TJOBXWM tag=J5UFEWYLPM6G type=write size=2067469 2024-09-22T08:48:49.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.418+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=8VUG75NNAEXQ type=del 2024-09-22T08:48:49.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.421+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~MW108Q9YPM58.0 size=757760 2024-09-22T08:48:49.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.421+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=MW108Q9YPM58 tag=G66GZBH197X4 type=write size=1806336 2024-09-22T08:48:49.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.422+0000 7f7b8ef90780 1 < canceled operation key=T43DW9JPG1BU tag=2OS7RC7IYMKH type=del size=641802 2024-09-22T08:48:49.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.424+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~WRV4BWZLNVEA.0 size=1048576 2024-09-22T08:48:49.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.425+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~WRV4BWZLNVEA.1 size=506787 2024-09-22T08:48:49.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.425+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=WRV4BWZLNVEA tag=2GB6XJRNMXII type=write size=2603939 2024-09-22T08:48:49.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.427+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.0 size=1048576 2024-09-22T08:48:49.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.428+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.1 size=1048576 2024-09-22T08:48:49.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.429+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~CU1E4B8FWI9Q.2 size=888527 2024-09-22T08:48:49.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.431+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=CU1E4B8FWI9Q tag=OJW7UVY2EUBZ type=write size=4034255 2024-09-22T08:48:49.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.432+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=MIMPKZR059CX type=del size=214702 2024-09-22T08:48:49.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.434+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~YLSEFAAEVCNA.0 size=205235 2024-09-22T08:48:49.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.436+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=YLSEFAAEVCNA tag=4W1706VYI782 type=write size=1253811 2024-09-22T08:48:49.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.437+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=WZNKN94S4WD6 type=del size=3207004 2024-09-22T08:48:49.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.439+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~M87J4RM9MWN1.0 size=416435 2024-09-22T08:48:49.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.441+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=M87J4RM9MWN1 tag=QKR1VAF0TLIA type=write size=1465011 2024-09-22T08:48:49.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.442+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=LD6WZ1WZ9DK4 type=del size=4017358 2024-09-22T08:48:49.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.444+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=BSPP5U2IPUFH type=del 2024-09-22T08:48:49.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.446+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~QSPSKABQR1XC.0 size=960582 2024-09-22T08:48:49.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.446+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=QSPSKABQR1XC tag=ZETPQ8YXJR58 type=write size=2009158 2024-09-22T08:48:49.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.449+0000 7f7b8ef90780 1 < suggested update operation key=6DC0SVAYR2DB tag=OVI27NS32HC5 type=write size=59064 2024-09-22T08:48:49.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.452+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~6BRFGIJN6BK1.0 size=809909 2024-09-22T08:48:49.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.452+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=6BRFGIJN6BK1 tag=SW0AKRK8SQFM type=write size=1858485 2024-09-22T08:48:49.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.453+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=MLHSAGDRAAYG type=del 2024-09-22T08:48:49.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.455+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.0 size=1048576 2024-09-22T08:48:49.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.456+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.1 size=1048576 2024-09-22T08:48:49.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.457+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.2 size=789299 2024-09-22T08:48:49.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.457+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=76FW1ZSBFJ55 tag=U4I5BAE1AYAU type=write size=3935027 2024-09-22T08:48:49.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.460+0000 7f7b8ef90780 1 < suggested remove operation key=F3IHQ6Z9V1DX tag=MDF7LD0FKAFX type=del 2024-09-22T08:48:49.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.461+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=FMM4UOKESZG1 type=del size=2983669 2024-09-22T08:48:49.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.463+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~RKNJ33VXBWU4.0 size=113948 2024-09-22T08:48:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.465+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=RKNJ33VXBWU4 tag=0X79KPOEKY7P type=write size=1162524 2024-09-22T08:48:49.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.469+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~P8S3NNNSTX33.0 size=1048576 2024-09-22T08:48:49.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.470+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~P8S3NNNSTX33.1 size=395330 2024-09-22T08:48:49.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.470+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=P8S3NNNSTX33 tag=4K9GR1NHF1JY type=write size=2492482 2024-09-22T08:48:49.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.471+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~IV51LGHCK2TS.0 size=1046125 2024-09-22T08:48:49.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.473+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=IV51LGHCK2TS tag=55IN492WSA0R type=write size=2094701 2024-09-22T08:48:49.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.476+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~JE5QMHVLRBH3.0 size=1048576 2024-09-22T08:48:49.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.477+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~JE5QMHVLRBH3.1 size=573634 2024-09-22T08:48:49.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.477+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=JE5QMHVLRBH3 tag=6DJA0N505H38 type=write size=2670786 2024-09-22T08:48:49.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.479+0000 7f7b8ef90780 1 < suggested remove operation key=X9TWX0Z54MOO tag=T4ERP82OWY0T type=del 2024-09-22T08:48:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.482+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.0 size=1048576 2024-09-22T08:48:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.483+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.1 size=1048576 2024-09-22T08:48:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.484+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.2 size=682983 2024-09-22T08:48:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.484+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=Y30LTTWSOUWE tag=U9RHCN3CFMAD type=write size=3828711 2024-09-22T08:48:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.484+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~K2B9VUHKQK9N.0 size=308100 2024-09-22T08:48:49.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.486+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=K2B9VUHKQK9N tag=V4COUBASLKG0 type=write size=1356676 2024-09-22T08:48:49.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.488+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=Y6CL2T3CMHJ7 type=del size=1136966 2024-09-22T08:48:49.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.489+0000 7f7b8ef90780 1 < canceled operation key=4ZJ4E4SUA01H tag=UQ69YYPBE6ZO type=del size=3041900 2024-09-22T08:48:49.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.492+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~4ZYLA9C7NCA3.0 size=1048576 2024-09-22T08:48:49.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.493+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~4ZYLA9C7NCA3.1 size=590767 2024-09-22T08:48:49.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.493+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=4ZYLA9C7NCA3 tag=XU9KUPEU30K5 type=write size=2687919 2024-09-22T08:48:49.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.495+0000 7f7b8ef90780 1 < completed write operation key=T43DW9JPG1BU tag=R06DZOM308WY type=write size=636682 2024-09-22T08:48:49.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.497+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.0 size=1048576 2024-09-22T08:48:49.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.498+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.1 size=1048576 2024-09-22T08:48:49.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.499+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.2 size=942913 2024-09-22T08:48:49.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.499+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=MO5QJ5O8JWJP tag=7E4UI57CTO1D type=write size=4088641 2024-09-22T08:48:49.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.500+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~G3BE7TJOBXWM.0 size=1018893 2024-09-22T08:48:49.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.503+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=G3BE7TJOBXWM tag=J5UFEWYLPM6G type=write size=2067469 2024-09-22T08:48:49.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.505+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~3JKGW2CHFO6T.0 size=130227 2024-09-22T08:48:49.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.505+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=3JKGW2CHFO6T tag=FPS3J8FZANQA type=write size=1178803 2024-09-22T08:48:49.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.507+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~MW108Q9YPM58.0 size=757760 2024-09-22T08:48:49.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.509+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=MW108Q9YPM58 tag=G66GZBH197X4 type=write size=1806336 2024-09-22T08:48:49.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.511+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~FKWJD0EI97UQ.0 size=80385 2024-09-22T08:48:49.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.511+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=FKWJD0EI97UQ tag=PBCIEJWBMN31 type=write size=1128961 2024-09-22T08:48:49.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.511+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~WRV4BWZLNVEA.0 size=1048576 2024-09-22T08:48:49.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.512+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~WRV4BWZLNVEA.1 size=506787 2024-09-22T08:48:49.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.514+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=WRV4BWZLNVEA tag=2GB6XJRNMXII type=write size=2603939 2024-09-22T08:48:49.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.516+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=9K7K72LRYQIW type=write size=574072 2024-09-22T08:48:49.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.517+0000 7f7b8ef90780 -1 < failed to complete operation key=X9TWX0Z54MOO tag=MIMPKZR059CX type=del size=214702: (22) Invalid argument 2024-09-22T08:48:49.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.520+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XEK2SSZBNZW7.0 size=302089 2024-09-22T08:48:49.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.520+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=XEK2SSZBNZW7 tag=2VEQ5QTVPDP9 type=write size=1350665 2024-09-22T08:48:49.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.521+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=WZNKN94S4WD6 type=del 2024-09-22T08:48:49.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.524+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~UK1EO8VXJ6I7.0 size=537338 2024-09-22T08:48:49.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.524+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=UK1EO8VXJ6I7 tag=RG3GTJLFD7T2 type=write size=1585914 2024-09-22T08:48:49.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.526+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=LD6WZ1WZ9DK4 type=del 2024-09-22T08:48:49.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.527+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=1WFQ4WBTQC7Q type=del size=848998 2024-09-22T08:48:49.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.528+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~QSPSKABQR1XC.0 size=960582 2024-09-22T08:48:49.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.531+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=QSPSKABQR1XC tag=ZETPQ8YXJR58 type=write size=2009158 2024-09-22T08:48:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.532+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=00PMUM9AET04 type=write size=503227 2024-09-22T08:48:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.534+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~6BRFGIJN6BK1.0 size=809909 2024-09-22T08:48:49.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.537+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=6BRFGIJN6BK1 tag=SW0AKRK8SQFM type=write size=1858485 2024-09-22T08:48:49.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.538+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=20U5MSVWUE1C type=write size=182764 2024-09-22T08:48:49.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.540+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.0 size=1048576 2024-09-22T08:48:49.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.541+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.1 size=1048576 2024-09-22T08:48:49.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.542+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~76FW1ZSBFJ55.2 size=789299 2024-09-22T08:48:49.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.545+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=76FW1ZSBFJ55 tag=U4I5BAE1AYAU type=write size=3935027 2024-09-22T08:48:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.547+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=NENW996941HD type=write size=1031942 2024-09-22T08:48:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.548+0000 7f7b8ef90780 1 < canceled operation key=9DO6M6UQ5A05 tag=FMM4UOKESZG1 type=del size=2983669 2024-09-22T08:48:49.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.550+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=9CFZ7KK2Y23J type=write size=577902 2024-09-22T08:48:49.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.551+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~P8S3NNNSTX33.0 size=1048576 2024-09-22T08:48:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.552+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~P8S3NNNSTX33.1 size=395330 2024-09-22T08:48:49.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.555+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=P8S3NNNSTX33 tag=4K9GR1NHF1JY type=write size=2492482 2024-09-22T08:48:49.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.558+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~LK2FBZ6Q9CQ1.0 size=1046624 2024-09-22T08:48:49.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.558+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=LK2FBZ6Q9CQ1 tag=JVAVLFUGFE6K type=write size=2095200 2024-09-22T08:48:49.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.559+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~JE5QMHVLRBH3.0 size=1048576 2024-09-22T08:48:49.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.561+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~JE5QMHVLRBH3.1 size=573634 2024-09-22T08:48:49.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.563+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=JE5QMHVLRBH3 tag=6DJA0N505H38 type=write size=2670786 2024-09-22T08:48:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.565+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=VJ22NTZ5P96M type=del size=1460004 2024-09-22T08:48:49.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.566+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.0 size=1048576 2024-09-22T08:48:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.567+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.1 size=1048576 2024-09-22T08:48:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.567+0000 7f7b8ef90780 1 < canceled part key=_multipart_X9TWX0Z54MOO.2~Y30LTTWSOUWE.2 size=682983 2024-09-22T08:48:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.569+0000 7f7b8ef90780 1 < canceled multipart upload key=X9TWX0Z54MOO upload=Y30LTTWSOUWE tag=U9RHCN3CFMAD type=write size=3828711 2024-09-22T08:48:49.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.572+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~NJUD1U4LMN7V.0 size=1048576 2024-09-22T08:48:49.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.573+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~NJUD1U4LMN7V.1 size=736888 2024-09-22T08:48:49.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.573+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=NJUD1U4LMN7V tag=G415QFVFZUXI type=write size=2834040 2024-09-22T08:48:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.576+0000 7f7b8ef90780 1 < suggested update operation key=Y7W0V6YTDFIB tag=Y6CL2T3CMHJ7 type=del size=1136966 2024-09-22T08:48:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.578+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~3B5KK001WS8F.0 size=757358 2024-09-22T08:48:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.578+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=3B5KK001WS8F tag=VUI6FB66NQCZ type=write size=1805934 2024-09-22T08:48:49.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.580+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~4ZYLA9C7NCA3.0 size=1048576 2024-09-22T08:48:49.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.581+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~4ZYLA9C7NCA3.1 size=590767 2024-09-22T08:48:49.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.583+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=4ZYLA9C7NCA3 tag=XU9KUPEU30K5 type=write size=2687919 2024-09-22T08:48:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.585+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~4GJ0YHD03FXX.0 size=1048576 2024-09-22T08:48:49.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.586+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~4GJ0YHD03FXX.1 size=580879 2024-09-22T08:48:49.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.586+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=4GJ0YHD03FXX tag=TMIFV30APTN1 type=write size=2678031 2024-09-22T08:48:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.587+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.0 size=1048576 2024-09-22T08:48:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.589+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.1 size=1048576 2024-09-22T08:48:49.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.590+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~MO5QJ5O8JWJP.2 size=942913 2024-09-22T08:48:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.592+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=MO5QJ5O8JWJP tag=7E4UI57CTO1D type=write size=4088641 2024-09-22T08:48:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.593+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=5U8CWT3KOJVN type=del size=99246 2024-09-22T08:48:49.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.596+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~3JKGW2CHFO6T.0 size=130227 2024-09-22T08:48:49.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.598+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=3JKGW2CHFO6T tag=FPS3J8FZANQA type=write size=1178803 2024-09-22T08:48:49.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.599+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=VA4ARPATUMVS type=del size=1811386 2024-09-22T08:48:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.600+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~FKWJD0EI97UQ.0 size=80385 2024-09-22T08:48:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.602+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=FKWJD0EI97UQ tag=PBCIEJWBMN31 type=write size=1128961 2024-09-22T08:48:49.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.604+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=PX4GKN7E5Q52 type=del size=2803892 2024-09-22T08:48:49.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.605+0000 7f7b8ef90780 1 < completed write operation key=IRFUEK82X28U tag=9K7K72LRYQIW type=write size=574072 2024-09-22T08:48:49.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.606+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=ZUK6POQLK399 type=del size=2159770 2024-09-22T08:48:49.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.607+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XEK2SSZBNZW7.0 size=302089 2024-09-22T08:48:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.610+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=XEK2SSZBNZW7 tag=2VEQ5QTVPDP9 type=write size=1350665 2024-09-22T08:48:49.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.612+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.0 size=1048576 2024-09-22T08:48:49.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.613+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.1 size=1048576 2024-09-22T08:48:49.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.614+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.2 size=181339 2024-09-22T08:48:49.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.614+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=YUYA3Z4UZP7O tag=CP5VKKADMYBF type=write size=3327067 2024-09-22T08:48:49.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.615+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~UK1EO8VXJ6I7.0 size=537338 2024-09-22T08:48:49.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.617+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=UK1EO8VXJ6I7 tag=RG3GTJLFD7T2 type=write size=1585914 2024-09-22T08:48:49.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.618+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=SYDU7XQVF2BS type=del size=3830463 2024-09-22T08:48:49.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.620+0000 7f7b8ef90780 1 < canceled operation key=L3XF68XD23FP tag=1WFQ4WBTQC7Q type=del size=848998 2024-09-22T08:48:49.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.621+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=TJ274QGRB8QP type=del size=2132483 2024-09-22T08:48:49.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.622+0000 7f7b8ef90780 1 < completed write operation key=6DC0SVAYR2DB tag=00PMUM9AET04 type=write size=503227 2024-09-22T08:48:49.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.625+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~A3DFWI1HIDZ1.0 size=1048576 2024-09-22T08:48:49.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.626+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~A3DFWI1HIDZ1.1 size=399323 2024-09-22T08:48:49.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.626+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=A3DFWI1HIDZ1 tag=ZL1KEBACH8OH type=write size=2496475 2024-09-22T08:48:49.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.627+0000 7f7b8ef90780 1 < canceled operation key=6DC0SVAYR2DB tag=20U5MSVWUE1C type=write size=182764 2024-09-22T08:48:49.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.628+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=GYCHCSN2W9G7 type=del size=3364273 2024-09-22T08:48:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.630+0000 7f7b8ef90780 1 < completed write operation key=UQPY2ITDMKGO tag=NENW996941HD type=write size=1031942 2024-09-22T08:48:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.631+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=O2D4CPG1DEKZ type=del size=1176520 2024-09-22T08:48:49.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.633+0000 7f7b8ef90780 1 < suggested remove operation key=WDGY8YL16UWI tag=9CFZ7KK2Y23J type=write 2024-09-22T08:48:49.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.635+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=M3R0VUDR1C36 type=del size=2343108 2024-09-22T08:48:49.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.636+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~LK2FBZ6Q9CQ1.0 size=1046624 2024-09-22T08:48:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.638+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=LK2FBZ6Q9CQ1 tag=JVAVLFUGFE6K type=write size=2095200 2024-09-22T08:48:49.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.640+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~5MACT215IINZ.0 size=234726 2024-09-22T08:48:49.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.640+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=5MACT215IINZ tag=1P291QI9Z4VF type=write size=1283302 2024-09-22T08:48:49.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.643+0000 7f7b8ef90780 1 < suggested remove operation key=O81X7IWXN4VP tag=VJ22NTZ5P96M type=del 2024-09-22T08:48:49.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.644+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=9N4W5VW5Q6R5 type=del size=540183 2024-09-22T08:48:49.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.645+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~NJUD1U4LMN7V.0 size=1048576 2024-09-22T08:48:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.646+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~NJUD1U4LMN7V.1 size=736888 2024-09-22T08:48:49.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.648+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=NJUD1U4LMN7V tag=G415QFVFZUXI type=write size=2834040 2024-09-22T08:48:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.649+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=3D16AZ1I15U8 type=del size=846543 2024-09-22T08:48:49.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.651+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~3B5KK001WS8F.0 size=757358 2024-09-22T08:48:49.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.653+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=3B5KK001WS8F tag=VUI6FB66NQCZ type=write size=1805934 2024-09-22T08:48:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.655+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~NCXIXXODASY0.0 size=1048576 2024-09-22T08:48:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.656+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~NCXIXXODASY0.1 size=322656 2024-09-22T08:48:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.656+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=NCXIXXODASY0 tag=QHFOFOS4CD0J type=write size=2419808 2024-09-22T08:48:49.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.658+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~4GJ0YHD03FXX.0 size=1048576 2024-09-22T08:48:49.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.659+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~4GJ0YHD03FXX.1 size=580879 2024-09-22T08:48:49.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.661+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=4GJ0YHD03FXX tag=TMIFV30APTN1 type=write size=2678031 2024-09-22T08:48:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.662+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=L6XKSUN7G5ST type=del size=387540 2024-09-22T08:48:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.663+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=5U8CWT3KOJVN type=del 2024-09-22T08:48:49.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.666+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.0 size=1048576 2024-09-22T08:48:49.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.667+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.1 size=1048576 2024-09-22T08:48:49.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.668+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.2 size=753656 2024-09-22T08:48:49.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.668+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=QOYGXWU3Z4UX tag=LN5SJZGKIOBT type=write size=3899384 2024-09-22T08:48:49.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.669+0000 7f7b8ef90780 1 < completed delete operation key=R0N30XP1BXY3 tag=VA4ARPATUMVS type=del 2024-09-22T08:48:49.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.671+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=DV1WCD9LQJI5 type=del size=1449493 2024-09-22T08:48:49.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.672+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=PX4GKN7E5Q52 type=del 2024-09-22T08:48:49.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.674+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~MS0C7M50DKIQ.0 size=1000679 2024-09-22T08:48:49.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.674+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=MS0C7M50DKIQ tag=HCEBC8E01IH0 type=write size=2049255 2024-09-22T08:48:49.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.676+0000 7f7b8ef90780 -1 < failed to complete operation key=O81X7IWXN4VP tag=ZUK6POQLK399 type=del size=2159770: (22) Invalid argument 2024-09-22T08:48:49.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.678+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~JB58B4TX8RRX.0 size=579071 2024-09-22T08:48:49.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.678+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=JB58B4TX8RRX tag=0FUF71FWGU17 type=write size=1627647 2024-09-22T08:48:49.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.679+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.0 size=1048576 2024-09-22T08:48:49.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.681+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.1 size=1048576 2024-09-22T08:48:49.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.682+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~YUYA3Z4UZP7O.2 size=181339 2024-09-22T08:48:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.684+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=YUYA3Z4UZP7O tag=CP5VKKADMYBF type=write size=3327067 2024-09-22T08:48:49.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.685+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=PH9YUD9VX04T type=del size=3441010 2024-09-22T08:48:49.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.687+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=SYDU7XQVF2BS type=del 2024-09-22T08:48:49.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.688+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=WRZHP330QZYA type=del size=723290 2024-09-22T08:48:49.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.689+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=TJ274QGRB8QP type=del 2024-09-22T08:48:49.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.691+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=3Y0KNFJNW166 type=del size=1467301 2024-09-22T08:48:49.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.692+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~A3DFWI1HIDZ1.0 size=1048576 2024-09-22T08:48:49.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.693+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~A3DFWI1HIDZ1.1 size=399323 2024-09-22T08:48:49.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.695+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=A3DFWI1HIDZ1 tag=ZL1KEBACH8OH type=write size=2496475 2024-09-22T08:48:49.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.696+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=E1RK12G5CIGR type=write size=678924 2024-09-22T08:48:49.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.699+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=GYCHCSN2W9G7 type=del size=3364273 2024-09-22T08:48:49.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.700+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=P00NWE2XEABR type=del size=1596585 2024-09-22T08:48:49.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.703+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=O2D4CPG1DEKZ type=del size=1176520 2024-09-22T08:48:49.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.704+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=N31MEQ7D70FT type=write size=711852 2024-09-22T08:48:49.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.705+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=M3R0VUDR1C36 type=del 2024-09-22T08:48:49.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.707+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=G80TMU7KKERQ type=del size=2267432 2024-09-22T08:48:49.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.707+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~5MACT215IINZ.0 size=234726 2024-09-22T08:48:49.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.709+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=5MACT215IINZ tag=1P291QI9Z4VF type=write size=1283302 2024-09-22T08:48:49.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.710+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=6M6P8Z9UJONI type=del size=2165172 2024-09-22T08:48:49.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.713+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=9N4W5VW5Q6R5 type=del size=540183 2024-09-22T08:48:49.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.715+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=983KIC3TNOOO type=del size=317004 2024-09-22T08:48:49.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.718+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=3D16AZ1I15U8 type=del 2024-09-22T08:48:49.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.721+0000 7f7b8ef90780 1 > prepared part key=_multipart_X9TWX0Z54MOO.2~I28V32GIAERB.0 size=349989 2024-09-22T08:48:49.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.721+0000 7f7b8ef90780 1 > prepared multipart upload key=X9TWX0Z54MOO upload=I28V32GIAERB tag=SO7722UZDXWX type=write size=1398565 2024-09-22T08:48:49.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.723+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~NCXIXXODASY0.0 size=1048576 2024-09-22T08:48:49.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.723+0000 7f7b8ef90780 1 < canceled part key=_multipart_Z9CHXCJ02L85.2~NCXIXXODASY0.1 size=322656 2024-09-22T08:48:49.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.725+0000 7f7b8ef90780 1 < canceled multipart upload key=Z9CHXCJ02L85 upload=NCXIXXODASY0 tag=QHFOFOS4CD0J type=write size=2419808 2024-09-22T08:48:49.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.728+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.0 size=1048576 2024-09-22T08:48:49.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.729+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.1 size=1048576 2024-09-22T08:48:49.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.730+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.2 size=1025296 2024-09-22T08:48:49.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.730+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=B5HLX6Z7M8X3 tag=Y56ZX7K002OQ type=write size=4171024 2024-09-22T08:48:49.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.732+0000 7f7b8ef90780 1 < canceled operation key=Y7W0V6YTDFIB tag=L6XKSUN7G5ST type=del size=387540 2024-09-22T08:48:49.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.733+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=1SE5RFVYIBAR type=write size=183850 2024-09-22T08:48:49.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.734+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.0 size=1048576 2024-09-22T08:48:49.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.736+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.1 size=1048576 2024-09-22T08:48:49.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.736+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~QOYGXWU3Z4UX.2 size=753656 2024-09-22T08:48:49.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.738+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=QOYGXWU3Z4UX tag=LN5SJZGKIOBT type=write size=3899384 2024-09-22T08:48:49.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.741+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.0 size=1048576 2024-09-22T08:48:49.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.742+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.1 size=1048576 2024-09-22T08:48:49.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.742+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.2 size=623608 2024-09-22T08:48:49.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.742+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=76D4709OL6TS tag=BUVDBOD6RIJA type=write size=3769336 2024-09-22T08:48:49.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.744+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=DV1WCD9LQJI5 type=del 2024-09-22T08:48:49.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.746+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~3RWM936PRVH4.0 size=757016 2024-09-22T08:48:49.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.746+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=3RWM936PRVH4 tag=35GGZH9YRQ7O type=write size=1805592 2024-09-22T08:48:49.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.746+0000 7f7b8ef90780 1 < canceled part key=_multipart_7ZS8G8H6I957.2~MS0C7M50DKIQ.0 size=1000679 2024-09-22T08:48:49.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.748+0000 7f7b8ef90780 1 < canceled multipart upload key=7ZS8G8H6I957 upload=MS0C7M50DKIQ tag=HCEBC8E01IH0 type=write size=2049255 2024-09-22T08:48:49.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.749+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=E9G3UL0NSB3W type=write size=429899 2024-09-22T08:48:49.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.751+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~JB58B4TX8RRX.0 size=579071 2024-09-22T08:48:49.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.753+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=JB58B4TX8RRX tag=0FUF71FWGU17 type=write size=1627647 2024-09-22T08:48:49.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.754+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=9VZTFNPUA353 type=del size=2133519 2024-09-22T08:48:49.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.756+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=PH9YUD9VX04T type=del 2024-09-22T08:48:49.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.758+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~E5ARIBAEX2LJ.0 size=1048576 2024-09-22T08:48:49.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.759+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~E5ARIBAEX2LJ.1 size=823192 2024-09-22T08:48:49.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.759+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=E5ARIBAEX2LJ tag=MLE6WVMGHFW4 type=write size=2920344 2024-09-22T08:48:49.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.762+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=WRZHP330QZYA type=del 2024-09-22T08:48:49.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.763+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=Q3A3C9QK0BQW type=del size=1659222 2024-09-22T08:48:49.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.764+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=3Y0KNFJNW166 type=del 2024-09-22T08:48:49.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.765+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=EJ2D9EPYD4N3 type=del size=2006607 2024-09-22T08:48:49.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.767+0000 7f7b8ef90780 1 < completed write operation key=Z9CHXCJ02L85 tag=E1RK12G5CIGR type=write size=678924 2024-09-22T08:48:49.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.768+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=TVA65WB6UXBH type=del size=3012183 2024-09-22T08:48:49.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.770+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=P00NWE2XEABR type=del 2024-09-22T08:48:49.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.772+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~8E3TPFPTYDRE.0 size=1048576 2024-09-22T08:48:49.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.773+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~8E3TPFPTYDRE.1 size=760929 2024-09-22T08:48:49.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.773+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=8E3TPFPTYDRE tag=YRH3RMN9S0E7 type=write size=2858081 2024-09-22T08:48:49.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.776+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=N31MEQ7D70FT type=write 2024-09-22T08:48:49.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.779+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~NRQZ7N61Y4JR.0 size=1048576 2024-09-22T08:48:49.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.780+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~NRQZ7N61Y4JR.1 size=934997 2024-09-22T08:48:49.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.780+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=NRQZ7N61Y4JR tag=9CTWC0CMVJQW type=write size=3032149 2024-09-22T08:48:49.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.781+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=G80TMU7KKERQ type=del 2024-09-22T08:48:49.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.783+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~NFTZ46TE3KWH.0 size=1048576 2024-09-22T08:48:49.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.785+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~NFTZ46TE3KWH.1 size=920519 2024-09-22T08:48:49.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.785+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=NFTZ46TE3KWH tag=C1NXK647UZ8Y type=write size=3017671 2024-09-22T08:48:49.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.786+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=6M6P8Z9UJONI type=del 2024-09-22T08:48:49.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.787+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=RJVK9G0T7KJK type=del size=3206998 2024-09-22T08:48:49.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.789+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=983KIC3TNOOO type=del 2024-09-22T08:48:49.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.790+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=80P73BCST263 type=del size=844246 2024-09-22T08:48:49.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.791+0000 7f7b8ef90780 1 < completed part key=_multipart_X9TWX0Z54MOO.2~I28V32GIAERB.0 size=349989 2024-09-22T08:48:49.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.794+0000 7f7b8ef90780 1 < completed multipart upload key=X9TWX0Z54MOO upload=I28V32GIAERB tag=SO7722UZDXWX type=write size=1398565 2024-09-22T08:48:49.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.795+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=OEP6AGTBSZAV type=write size=212148 2024-09-22T08:48:49.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.796+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.0 size=1048576 2024-09-22T08:48:49.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.797+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.1 size=1048576 2024-09-22T08:48:49.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.798+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~B5HLX6Z7M8X3.2 size=1025296 2024-09-22T08:48:49.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.800+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=B5HLX6Z7M8X3 tag=Y56ZX7K002OQ type=write size=4171024 2024-09-22T08:48:49.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.801+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=A17F2TAQOCBU type=del size=178154 2024-09-22T08:48:49.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.803+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=1SE5RFVYIBAR type=write size=183850 2024-09-22T08:48:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.805+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~S82LMXV6Y0MU.0 size=489688 2024-09-22T08:48:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.805+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=S82LMXV6Y0MU tag=FTR8BLLWI2XK type=write size=1538264 2024-09-22T08:48:49.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.806+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.0 size=1048576 2024-09-22T08:48:49.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.807+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.1 size=1048576 2024-09-22T08:48:49.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.808+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~76D4709OL6TS.2 size=623608 2024-09-22T08:48:49.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.810+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=76D4709OL6TS tag=BUVDBOD6RIJA type=write size=3769336 2024-09-22T08:48:49.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.812+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=T61CGX9X0NUO type=write size=570335 2024-09-22T08:48:49.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.813+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~3RWM936PRVH4.0 size=757016 2024-09-22T08:48:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.815+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=3RWM936PRVH4 tag=35GGZH9YRQ7O type=write size=1805592 2024-09-22T08:48:49.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.816+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=GV1OMU1UFOIG type=del size=285590 2024-09-22T08:48:49.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.817+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=QH6TK0MJKYUO tag=E9G3UL0NSB3W type=write size=429899: (2) No such file or directory 2024-09-22T08:48:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.818+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=6I9PKAFI158Z type=del size=280788 2024-09-22T08:48:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.819+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=9VZTFNPUA353 type=del 2024-09-22T08:48:49.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.820+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=7H7EGYFZ6C7T type=write size=463380 2024-09-22T08:48:49.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.822+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~E5ARIBAEX2LJ.0 size=1048576 2024-09-22T08:48:49.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.823+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~E5ARIBAEX2LJ.1 size=823192 2024-09-22T08:48:49.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.825+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=E5ARIBAEX2LJ tag=MLE6WVMGHFW4 type=write size=2920344 2024-09-22T08:48:49.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.827+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=0JMRVN7CBLLJ type=del size=2006207 2024-09-22T08:48:49.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.828+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=Q3A3C9QK0BQW type=del 2024-09-22T08:48:49.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.831+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~B3PEEB9GBX7C.0 size=333794 2024-09-22T08:48:49.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.831+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=B3PEEB9GBX7C tag=E39OOZXIVPQP type=write size=1382370 2024-09-22T08:48:49.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.832+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=EJ2D9EPYD4N3 type=del 2024-09-22T08:48:49.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.833+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=7VZ70FFPQJOG type=del size=188626 2024-09-22T08:48:49.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.835+0000 7f7b8ef90780 1 < completed delete operation key=4ZJ4E4SUA01H tag=TVA65WB6UXBH type=del 2024-09-22T08:48:49.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.837+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.0 size=1048576 2024-09-22T08:48:49.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.838+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.1 size=1048576 2024-09-22T08:48:49.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.839+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.2 size=854993 2024-09-22T08:48:49.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.839+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=MOSKH1PF0APT tag=0O2RXLHZPN0U type=write size=4000721 2024-09-22T08:48:49.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.842+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~8E3TPFPTYDRE.0 size=1048576 2024-09-22T08:48:49.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.843+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~8E3TPFPTYDRE.1 size=760929 2024-09-22T08:48:49.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.845+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=8E3TPFPTYDRE tag=YRH3RMN9S0E7 type=write size=2858081 2024-09-22T08:48:49.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.846+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=68HATQC08ZTT type=del size=402014 2024-09-22T08:48:49.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.847+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~NRQZ7N61Y4JR.0 size=1048576 2024-09-22T08:48:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.848+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~NRQZ7N61Y4JR.1 size=934997 2024-09-22T08:48:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.850+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=NRQZ7N61Y4JR tag=9CTWC0CMVJQW type=write size=3032149 2024-09-22T08:48:49.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.853+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~TAMBRSAMZBIN.0 size=404701 2024-09-22T08:48:49.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.853+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=TAMBRSAMZBIN tag=TOE1EZS32CC8 type=write size=1453277 2024-09-22T08:48:49.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.853+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~NFTZ46TE3KWH.0 size=1048576 2024-09-22T08:48:49.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.854+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~NFTZ46TE3KWH.1 size=920519 2024-09-22T08:48:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.856+0000 7f7b8ef90780 1 < canceled multipart upload key=4J4EGI19N123 upload=NFTZ46TE3KWH tag=C1NXK647UZ8Y type=write size=3017671 2024-09-22T08:48:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.858+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=L400D1YJJUB8 type=del size=3268356 2024-09-22T08:48:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.859+0000 7f7b8ef90780 1 < canceled operation key=L1URDVW43BUG tag=RJVK9G0T7KJK type=del size=3206998 2024-09-22T08:48:49.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.862+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.0 size=1048576 2024-09-22T08:48:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.863+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.1 size=1048576 2024-09-22T08:48:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.864+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.2 size=1028658 2024-09-22T08:48:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.864+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=BEN73Y67Y59Y tag=G5GS5DU5VHXL type=write size=4174386 2024-09-22T08:48:49.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.865+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=80P73BCST263 type=del 2024-09-22T08:48:49.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.867+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=POKKSKCTCHFH type=del size=3382 2024-09-22T08:48:49.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.868+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=OEP6AGTBSZAV type=write size=212148 2024-09-22T08:48:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.870+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=EQEQF1OVYTYL type=write size=660026 2024-09-22T08:48:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.871+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=A17F2TAQOCBU type=del 2024-09-22T08:48:49.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.873+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=D4C23VRHQQ8Z type=del size=1788914 2024-09-22T08:48:49.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.874+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~S82LMXV6Y0MU.0 size=489688 2024-09-22T08:48:49.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.876+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=S82LMXV6Y0MU tag=FTR8BLLWI2XK type=write size=1538264 2024-09-22T08:48:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.878+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=36XCLGTQ7O3T type=write size=880229 2024-09-22T08:48:49.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.881+0000 7f7b8ef90780 1 < suggested remove operation key=9DO6M6UQ5A05 tag=T61CGX9X0NUO type=write 2024-09-22T08:48:49.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.883+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.0 size=1048576 2024-09-22T08:48:49.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.884+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.1 size=1048576 2024-09-22T08:48:49.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.886+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.2 size=946975 2024-09-22T08:48:49.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.886+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=1LY5T7CO3SWG tag=DZMM01A191VM type=write size=4092703 2024-09-22T08:48:49.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.887+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=GV1OMU1UFOIG type=del 2024-09-22T08:48:49.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.889+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=KRVXKNBZKSSS type=del size=4096796 2024-09-22T08:48:49.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.892+0000 7f7b8ef90780 1 < suggested remove operation key=IEZKK9YIIF33 tag=6I9PKAFI158Z type=del 2024-09-22T08:48:49.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.893+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=OXC038YZAILK type=del size=3589286 2024-09-22T08:48:49.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.894+0000 7f7b8ef90780 1 < completed write operation key=ZM6ITJ2QUIPJ tag=7H7EGYFZ6C7T type=write size=463380 2024-09-22T08:48:49.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.897+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.0 size=1048576 2024-09-22T08:48:49.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.898+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.1 size=1048576 2024-09-22T08:48:49.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.899+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.2 size=250747 2024-09-22T08:48:49.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.899+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=WP8VQ1J0D1C8 tag=72Z2TK1X44YD type=write size=3396475 2024-09-22T08:48:49.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.900+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=0JMRVN7CBLLJ type=del 2024-09-22T08:48:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.903+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.0 size=1048576 2024-09-22T08:48:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.904+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.1 size=1048576 2024-09-22T08:48:49.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.905+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.2 size=668077 2024-09-22T08:48:49.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.905+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=YXNMHGH12ND5 tag=6BIUZO0C1ZPF type=write size=3813805 2024-09-22T08:48:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.906+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~B3PEEB9GBX7C.0 size=333794 2024-09-22T08:48:49.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.909+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=B3PEEB9GBX7C tag=E39OOZXIVPQP type=write size=1382370 2024-09-22T08:48:49.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.910+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=AZP1CS0R277K type=del size=333234 2024-09-22T08:48:49.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.911+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=7VZ70FFPQJOG type=del 2024-09-22T08:48:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.913+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=4E36N0MRJAWU type=write size=465057 2024-09-22T08:48:49.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.914+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.0 size=1048576 2024-09-22T08:48:49.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.914+0000 7f7b8ef90780 1 < canceled part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.1 size=1048576 2024-09-22T08:48:49.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.916+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~MOSKH1PF0APT.2 size=854993 2024-09-22T08:48:49.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.918+0000 7f7b8ef90780 1 < canceled multipart upload key=1U6T2BIZS72V upload=MOSKH1PF0APT tag=0O2RXLHZPN0U type=write size=4000721 2024-09-22T08:48:49.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.920+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~CTG3JZYZBTP4.0 size=668012 2024-09-22T08:48:49.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.920+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=CTG3JZYZBTP4 tag=RDT2XI90TNY9 type=write size=1716588 2024-09-22T08:48:49.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.923+0000 7f7b8ef90780 1 < suggested update operation key=RX3H0G6WHB9L tag=68HATQC08ZTT type=del size=402014 2024-09-22T08:48:49.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.924+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=DGJNWOIB69JL type=del size=444678 2024-09-22T08:48:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.926+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~TAMBRSAMZBIN.0 size=404701 2024-09-22T08:48:49.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.928+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=TAMBRSAMZBIN tag=TOE1EZS32CC8 type=write size=1453277 2024-09-22T08:48:49.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.929+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=9JB9CDP38HB8 type=del size=3682211 2024-09-22T08:48:49.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.930+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=IEZKK9YIIF33 tag=L400D1YJJUB8 type=del size=3268356: (2) No such file or directory 2024-09-22T08:48:49.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.931+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=261DAM5507NO type=del size=3437022 2024-09-22T08:48:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.932+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.0 size=1048576 2024-09-22T08:48:49.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.934+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.1 size=1048576 2024-09-22T08:48:49.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.935+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~BEN73Y67Y59Y.2 size=1028658 2024-09-22T08:48:49.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.937+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=BEN73Y67Y59Y tag=G5GS5DU5VHXL type=write size=4174386 2024-09-22T08:48:49.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.939+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.0 size=1048576 2024-09-22T08:48:49.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.940+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.1 size=1048576 2024-09-22T08:48:49.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.942+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.2 size=494295 2024-09-22T08:48:49.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.942+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=ZP2AIP7T6164 tag=KW7T8GYTDOE4 type=write size=3640023 2024-09-22T08:48:49.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.943+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=POKKSKCTCHFH type=del 2024-09-22T08:48:49.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.945+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~5T49RYSDK839.0 size=859288 2024-09-22T08:48:49.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.945+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=5T49RYSDK839 tag=5OOJ9XLGHLXS type=write size=1907864 2024-09-22T08:48:49.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.946+0000 7f7b8ef90780 1 < canceled operation key=G51KS3NM4VFY tag=EQEQF1OVYTYL type=write size=660026 2024-09-22T08:48:49.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.948+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=7X66SBNLP8MX type=del size=1169979 2024-09-22T08:48:49.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.949+0000 7f7b8ef90780 1 < canceled operation key=UQPY2ITDMKGO tag=D4C23VRHQQ8Z type=del size=1788914 2024-09-22T08:48:49.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.950+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=8NU8YICTCGMF type=del size=3076622 2024-09-22T08:48:49.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.953+0000 7f7b8ef90780 1 < suggested remove operation key=X9TWX0Z54MOO tag=36XCLGTQ7O3T type=write 2024-09-22T08:48:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.955+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~2QLQUAHAM0H4.0 size=1048576 2024-09-22T08:48:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.956+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~2QLQUAHAM0H4.1 size=522238 2024-09-22T08:48:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.956+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=2QLQUAHAM0H4 tag=ASWX8SACJUOK type=write size=2619390 2024-09-22T08:48:49.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.957+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.0 size=1048576 2024-09-22T08:48:49.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.957+0000 7f7b8ef90780 1 < canceled part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.1 size=1048576 2024-09-22T08:48:49.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.958+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~1LY5T7CO3SWG.2 size=946975 2024-09-22T08:48:49.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.960+0000 7f7b8ef90780 1 < canceled multipart upload key=IEZKK9YIIF33 upload=1LY5T7CO3SWG tag=DZMM01A191VM type=write size=4092703 2024-09-22T08:48:49.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.961+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=DRG1MOMBGIO0 type=del size=2001456 2024-09-22T08:48:49.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.962+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=KRVXKNBZKSSS type=del 2024-09-22T08:48:49.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.964+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=6TRSYBY40WM4 type=write size=585947 2024-09-22T08:48:49.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.965+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=OXC038YZAILK type=del 2024-09-22T08:48:49.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.967+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=726SEUD77EQF type=write size=342127 2024-09-22T08:48:49.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.968+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.0 size=1048576 2024-09-22T08:48:49.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.969+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.1 size=1048576 2024-09-22T08:48:49.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.970+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~WP8VQ1J0D1C8.2 size=250747 2024-09-22T08:48:49.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.972+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=WP8VQ1J0D1C8 tag=72Z2TK1X44YD type=write size=3396475 2024-09-22T08:48:49.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.974+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~SQYKY5SQTSS9.0 size=967242 2024-09-22T08:48:49.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.974+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=SQYKY5SQTSS9 tag=5IVDQ130ZKDP type=write size=2015818 2024-09-22T08:48:49.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.975+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.0 size=1048576 2024-09-22T08:48:49.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.976+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.1 size=1048576 2024-09-22T08:48:49.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.976+0000 7f7b8ef90780 1 < canceled part key=_multipart_RX3H0G6WHB9L.2~YXNMHGH12ND5.2 size=668077 2024-09-22T08:48:49.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.978+0000 7f7b8ef90780 1 < canceled multipart upload key=RX3H0G6WHB9L upload=YXNMHGH12ND5 tag=6BIUZO0C1ZPF type=write size=3813805 2024-09-22T08:48:49.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.979+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=011NDWQ4254X type=del size=3294382 2024-09-22T08:48:49.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.982+0000 7f7b8ef90780 1 < suggested update operation key=T43DW9JPG1BU tag=AZP1CS0R277K type=del size=333234 2024-09-22T08:48:49.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.984+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~XSUBOF0PHZ1J.0 size=1048576 2024-09-22T08:48:49.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.985+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~XSUBOF0PHZ1J.1 size=1038002 2024-09-22T08:48:49.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.985+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=XSUBOF0PHZ1J tag=LXIF2ONN0IM4 type=write size=3135154 2024-09-22T08:48:49.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.986+0000 7f7b8ef90780 1 < completed write operation key=4J4EGI19N123 tag=4E36N0MRJAWU type=write size=465057 2024-09-22T08:48:49.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.988+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~QE5B64FFYV7X.0 size=1048576 2024-09-22T08:48:49.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.989+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~QE5B64FFYV7X.1 size=336624 2024-09-22T08:48:49.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.989+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=QE5B64FFYV7X tag=0K6N9QOH1MBF type=write size=2433776 2024-09-22T08:48:49.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.990+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~CTG3JZYZBTP4.0 size=668012 2024-09-22T08:48:49.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.992+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=CTG3JZYZBTP4 tag=RDT2XI90TNY9 type=write size=1716588 2024-09-22T08:48:49.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.993+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=Q30F1VBUS4H4 type=del size=2420853 2024-09-22T08:48:49.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.995+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=DGJNWOIB69JL type=del 2024-09-22T08:48:49.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.996+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=WH0DPXJGQM38 type=write size=825928 2024-09-22T08:48:50.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:49.999+0000 7f7b8ef90780 1 < suggested update operation key=L3XF68XD23FP tag=9JB9CDP38HB8 type=del size=3682211 2024-09-22T08:48:50.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.001+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~R4L2VK4LX467.0 size=667644 2024-09-22T08:48:50.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.001+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=R4L2VK4LX467 tag=RDMF4X0K7NJU type=write size=1716220 2024-09-22T08:48:50.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.002+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=261DAM5507NO type=del 2024-09-22T08:48:50.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.005+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~EJX1C20Z4LEB.0 size=470781 2024-09-22T08:48:50.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.005+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=EJX1C20Z4LEB tag=YT3COBXI0QXK type=write size=1519357 2024-09-22T08:48:50.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.006+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.0 size=1048576 2024-09-22T08:48:50.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.008+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.1 size=1048576 2024-09-22T08:48:50.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.008+0000 7f7b8ef90780 1 < canceled part key=_multipart_YXIZJPACZZFY.2~ZP2AIP7T6164.2 size=494295 2024-09-22T08:48:50.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.010+0000 7f7b8ef90780 1 < canceled multipart upload key=YXIZJPACZZFY upload=ZP2AIP7T6164 tag=KW7T8GYTDOE4 type=write size=3640023 2024-09-22T08:48:50.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.012+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.0 size=1048576 2024-09-22T08:48:50.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.013+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.1 size=1048576 2024-09-22T08:48:50.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.014+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.2 size=185507 2024-09-22T08:48:50.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.014+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=R7GHPRE9MUK2 tag=E5UFEYB7DA1H type=write size=3331235 2024-09-22T08:48:50.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.015+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~5T49RYSDK839.0 size=859288 2024-09-22T08:48:50.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.017+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=5T49RYSDK839 tag=5OOJ9XLGHLXS type=write size=1907864 2024-09-22T08:48:50.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.019+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=WLPH4M35OLXN type=del size=3914893 2024-09-22T08:48:50.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.020+0000 7f7b8ef90780 -1 < failed to complete operation key=T43DW9JPG1BU tag=7X66SBNLP8MX type=del size=1169979: (22) Invalid argument 2024-09-22T08:48:50.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.021+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=AJSX57LWL85Y type=del size=510170 2024-09-22T08:48:50.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.022+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=8NU8YICTCGMF type=del 2024-09-22T08:48:50.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.025+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1F1W0DILUZBO.0 size=1048576 2024-09-22T08:48:50.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.025+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1F1W0DILUZBO.1 size=579531 2024-09-22T08:48:50.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.025+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=1F1W0DILUZBO tag=GA0NCJ350Y9W type=write size=2676683 2024-09-22T08:48:50.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.027+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~2QLQUAHAM0H4.0 size=1048576 2024-09-22T08:48:50.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.028+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~2QLQUAHAM0H4.1 size=522238 2024-09-22T08:48:50.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.030+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=2QLQUAHAM0H4 tag=ASWX8SACJUOK type=write size=2619390 2024-09-22T08:48:50.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.031+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=5BJTT7M1LMKS type=del size=3844512 2024-09-22T08:48:50.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.034+0000 7f7b8ef90780 1 < suggested remove operation key=IEZKK9YIIF33 tag=DRG1MOMBGIO0 type=del 2024-09-22T08:48:50.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.035+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=C9ZMQ6UQ37IT type=del size=1040060 2024-09-22T08:48:50.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.036+0000 7f7b8ef90780 1 < completed write operation key=F3IHQ6Z9V1DX tag=6TRSYBY40WM4 type=write size=585947 2024-09-22T08:48:50.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.037+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=8L76GVO6P7MT type=write size=843831 2024-09-22T08:48:50.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.039+0000 7f7b8ef90780 1 < completed write operation key=PODNY4NH4A9W tag=726SEUD77EQF type=write size=342127 2024-09-22T08:48:50.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.041+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~Z2KCYVMY0UC6.0 size=803334 2024-09-22T08:48:50.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.041+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=Z2KCYVMY0UC6 tag=07TGEALHLX3S type=write size=1851910 2024-09-22T08:48:50.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.042+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~SQYKY5SQTSS9.0 size=967242 2024-09-22T08:48:50.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.044+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=SQYKY5SQTSS9 tag=5IVDQ130ZKDP type=write size=2015818 2024-09-22T08:48:50.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.046+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=S2D5SOSCMBAM type=del size=2613436 2024-09-22T08:48:50.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.047+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=011NDWQ4254X type=del 2024-09-22T08:48:50.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.048+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=2IMOHEHFMEUX type=del size=3988572 2024-09-22T08:48:50.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.050+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~XSUBOF0PHZ1J.0 size=1048576 2024-09-22T08:48:50.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.051+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~XSUBOF0PHZ1J.1 size=1038002 2024-09-22T08:48:50.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.053+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=XSUBOF0PHZ1J tag=LXIF2ONN0IM4 type=write size=3135154 2024-09-22T08:48:50.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.054+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=KSFJL5VIUPZU type=write size=299302 2024-09-22T08:48:50.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.055+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~QE5B64FFYV7X.0 size=1048576 2024-09-22T08:48:50.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.056+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~QE5B64FFYV7X.1 size=336624 2024-09-22T08:48:50.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.059+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=QE5B64FFYV7X tag=0K6N9QOH1MBF type=write size=2433776 2024-09-22T08:48:50.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.060+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=VZMWYXH7CR3T type=del size=3597621 2024-09-22T08:48:50.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.061+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=Q30F1VBUS4H4 type=del 2024-09-22T08:48:50.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.063+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.0 size=1048576 2024-09-22T08:48:50.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.064+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.1 size=1048576 2024-09-22T08:48:50.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.065+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.2 size=40107 2024-09-22T08:48:50.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.065+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=82B6K09W0BOY tag=UUV75EG6PO1G type=write size=3185835 2024-09-22T08:48:50.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.067+0000 7f7b8ef90780 1 < canceled operation key=WDGY8YL16UWI tag=WH0DPXJGQM38 type=write size=825928 2024-09-22T08:48:50.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.068+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=S1RFXT4JA0M8 type=del size=842243 2024-09-22T08:48:50.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.069+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~R4L2VK4LX467.0 size=667644 2024-09-22T08:48:50.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.071+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=R4L2VK4LX467 tag=RDMF4X0K7NJU type=write size=1716220 2024-09-22T08:48:50.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.074+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~YPLPZCF5HFPL.0 size=1048576 2024-09-22T08:48:50.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.075+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~YPLPZCF5HFPL.1 size=1003865 2024-09-22T08:48:50.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.075+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=YPLPZCF5HFPL tag=15GZTL38VSAK type=write size=3101017 2024-09-22T08:48:50.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.076+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~EJX1C20Z4LEB.0 size=470781 2024-09-22T08:48:50.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.079+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=EJX1C20Z4LEB tag=YT3COBXI0QXK type=write size=1519357 2024-09-22T08:48:50.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.080+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=XLWDZO126JRY type=del size=3354022 2024-09-22T08:48:50.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.082+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.0 size=1048576 2024-09-22T08:48:50.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.084+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.1 size=1048576 2024-09-22T08:48:50.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.085+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~R7GHPRE9MUK2.2 size=185507 2024-09-22T08:48:50.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.087+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=R7GHPRE9MUK2 tag=E5UFEYB7DA1H type=write size=3331235 2024-09-22T08:48:50.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.089+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=LH5747QE0M4N type=del size=3375189 2024-09-22T08:48:50.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.090+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=WLPH4M35OLXN type=del 2024-09-22T08:48:50.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.091+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=L760IB22S5XU type=write size=4225 2024-09-22T08:48:50.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.092+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=AJSX57LWL85Y type=del 2024-09-22T08:48:50.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.094+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=STRR5JD6GHDE type=del size=3197287 2024-09-22T08:48:50.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.095+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~1F1W0DILUZBO.0 size=1048576 2024-09-22T08:48:50.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.096+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~1F1W0DILUZBO.1 size=579531 2024-09-22T08:48:50.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.099+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=1F1W0DILUZBO tag=GA0NCJ350Y9W type=write size=2676683 2024-09-22T08:48:50.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.100+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=3E7NIBB75I64 type=del size=2808039 2024-09-22T08:48:50.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.102+0000 7f7b8ef90780 1 < suggested update operation key=1U6T2BIZS72V tag=5BJTT7M1LMKS type=del size=3844512 2024-09-22T08:48:50.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.105+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~ELBT1SFFCNHW.0 size=1048576 2024-09-22T08:48:50.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.106+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~ELBT1SFFCNHW.1 size=371322 2024-09-22T08:48:50.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.106+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=ELBT1SFFCNHW tag=AXZGAYVSVW1Z type=write size=2468474 2024-09-22T08:48:50.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.109+0000 7f7b8ef90780 1 < suggested update operation key=IRFUEK82X28U tag=C9ZMQ6UQ37IT type=del size=1040060 2024-09-22T08:48:50.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.110+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=46NL76M9BLS9 type=del size=2139478 2024-09-22T08:48:50.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.111+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=8L76GVO6P7MT type=write size=843831 2024-09-22T08:48:50.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.114+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.0 size=1048576 2024-09-22T08:48:50.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.115+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.1 size=1048576 2024-09-22T08:48:50.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.116+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.2 size=525964 2024-09-22T08:48:50.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.116+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=V47WFH5YSXNO tag=51E87ST9LQKJ type=write size=3671692 2024-09-22T08:48:50.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.117+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~Z2KCYVMY0UC6.0 size=803334 2024-09-22T08:48:50.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.119+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=Z2KCYVMY0UC6 tag=07TGEALHLX3S type=write size=1851910 2024-09-22T08:48:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.121+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=IT7MIFQCCT2M type=del size=3241500 2024-09-22T08:48:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.122+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=S2D5SOSCMBAM type=del 2024-09-22T08:48:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.123+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=WQQ4MJAR02TI type=write size=183977 2024-09-22T08:48:50.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.125+0000 7f7b8ef90780 1 < completed delete operation key=70WNR3KVU0BG tag=2IMOHEHFMEUX type=del 2024-09-22T08:48:50.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.126+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=5OORH5JJ25ZO type=del size=3153588 2024-09-22T08:48:50.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.128+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=KSFJL5VIUPZU type=write size=299302 2024-09-22T08:48:50.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.130+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.0 size=1048576 2024-09-22T08:48:50.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.131+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.1 size=1048576 2024-09-22T08:48:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.132+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.2 size=208290 2024-09-22T08:48:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.132+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=8240QYN778PN tag=758JGJ11VD11 type=write size=3354018 2024-09-22T08:48:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.134+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=VZMWYXH7CR3T type=del 2024-09-22T08:48:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.136+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.0 size=1048576 2024-09-22T08:48:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.137+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.1 size=1048576 2024-09-22T08:48:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.138+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.2 size=17395 2024-09-22T08:48:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.138+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=2SOWJ1RGKJ9E tag=GGM0L5KFHTJX type=write size=3163123 2024-09-22T08:48:50.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.139+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.0 size=1048576 2024-09-22T08:48:50.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.140+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.1 size=1048576 2024-09-22T08:48:50.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.141+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~82B6K09W0BOY.2 size=40107 2024-09-22T08:48:50.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.144+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=82B6K09W0BOY tag=UUV75EG6PO1G type=write size=3185835 2024-09-22T08:48:50.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.145+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=OC26251DD833 type=del size=48006 2024-09-22T08:48:50.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.146+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=S1RFXT4JA0M8 type=del 2024-09-22T08:48:50.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.148+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=P17RELQ67CQK type=del size=1465273 2024-09-22T08:48:50.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.148+0000 7f7b8ef90780 1 < canceled part key=_multipart_9DO6M6UQ5A05.2~YPLPZCF5HFPL.0 size=1048576 2024-09-22T08:48:50.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.149+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~YPLPZCF5HFPL.1 size=1003865 2024-09-22T08:48:50.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.151+0000 7f7b8ef90780 1 < canceled multipart upload key=9DO6M6UQ5A05 upload=YPLPZCF5HFPL tag=15GZTL38VSAK type=write size=3101017 2024-09-22T08:48:50.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.154+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.0 size=1048576 2024-09-22T08:48:50.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.155+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.1 size=1048576 2024-09-22T08:48:50.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.156+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.2 size=898901 2024-09-22T08:48:50.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.156+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=ZCXUTPWBRL3T tag=NFSNGW2O355B type=write size=4044629 2024-09-22T08:48:50.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.157+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=XLWDZO126JRY type=del 2024-09-22T08:48:50.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.159+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=GH4LNA3KC5P0 type=del size=2975513 2024-09-22T08:48:50.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.160+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=LH5747QE0M4N type=del 2024-09-22T08:48:50.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.163+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~6DO33YIHA8GE.0 size=68204 2024-09-22T08:48:50.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.163+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=6DO33YIHA8GE tag=TOOUFM9JY33K type=write size=1116780 2024-09-22T08:48:50.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.164+0000 7f7b8ef90780 1 < completed write operation key=Y7W0V6YTDFIB tag=L760IB22S5XU type=write size=4225 2024-09-22T08:48:50.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.166+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=V9A9I223A0VE type=del size=3642495 2024-09-22T08:48:50.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.167+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=STRR5JD6GHDE type=del 2024-09-22T08:48:50.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.168+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=WBSX13QU2WYF type=del size=4165679 2024-09-22T08:48:50.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.170+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=3E7NIBB75I64 type=del 2024-09-22T08:48:50.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.171+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=1DLN4GXHJEQH type=del size=2651378 2024-09-22T08:48:50.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.172+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~ELBT1SFFCNHW.0 size=1048576 2024-09-22T08:48:50.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.173+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~ELBT1SFFCNHW.1 size=371322 2024-09-22T08:48:50.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.175+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=ELBT1SFFCNHW tag=AXZGAYVSVW1Z type=write size=2468474 2024-09-22T08:48:50.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.176+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=E2F03DOKBZSR type=del size=2533280 2024-09-22T08:48:50.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.179+0000 7f7b8ef90780 1 < suggested remove operation key=WDGY8YL16UWI tag=46NL76M9BLS9 type=del 2024-09-22T08:48:50.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.180+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=09MGRU5OC8TL type=del size=1950851 2024-09-22T08:48:50.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.182+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.0 size=1048576 2024-09-22T08:48:50.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.183+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.1 size=1048576 2024-09-22T08:48:50.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.184+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~V47WFH5YSXNO.2 size=525964 2024-09-22T08:48:50.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.186+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=V47WFH5YSXNO tag=51E87ST9LQKJ type=write size=3671692 2024-09-22T08:48:50.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.188+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=AW7T9EP79X1G type=del size=3284753 2024-09-22T08:48:50.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.189+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=IT7MIFQCCT2M type=del 2024-09-22T08:48:50.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.191+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=RV8LCS48RJGB type=write size=303741 2024-09-22T08:48:50.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.192+0000 7f7b8ef90780 1 < completed write operation key=70WNR3KVU0BG tag=WQQ4MJAR02TI type=write size=183977 2024-09-22T08:48:50.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.194+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=OSVYOHENHJD2 type=write size=579286 2024-09-22T08:48:50.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.195+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=5OORH5JJ25ZO type=del 2024-09-22T08:48:50.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.196+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=K7153NY3ZWMT type=del size=1252289 2024-09-22T08:48:50.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.197+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.0 size=1048576 2024-09-22T08:48:50.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.198+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.1 size=1048576 2024-09-22T08:48:50.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.198+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~8240QYN778PN.2 size=208290 2024-09-22T08:48:50.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.201+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=8240QYN778PN tag=758JGJ11VD11 type=write size=3354018 2024-09-22T08:48:50.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.202+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=SWW8637LO1XN type=del size=2898744 2024-09-22T08:48:50.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.203+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.0 size=1048576 2024-09-22T08:48:50.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.204+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.1 size=1048576 2024-09-22T08:48:50.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.205+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~2SOWJ1RGKJ9E.2 size=17395 2024-09-22T08:48:50.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.208+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=2SOWJ1RGKJ9E tag=GGM0L5KFHTJX type=write size=3163123 2024-09-22T08:48:50.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.210+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.0 size=1048576 2024-09-22T08:48:50.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.211+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.1 size=1048576 2024-09-22T08:48:50.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.212+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.2 size=316434 2024-09-22T08:48:50.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.212+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=RX1P0QG5MVOD tag=U8VMNZWNCD1H type=write size=3462162 2024-09-22T08:48:50.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.215+0000 7f7b8ef90780 1 < suggested update operation key=ZM6ITJ2QUIPJ tag=OC26251DD833 type=del size=48006 2024-09-22T08:48:50.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.216+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=RCB1CJLDXCP2 type=write size=113332 2024-09-22T08:48:50.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.218+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=P17RELQ67CQK type=del 2024-09-22T08:48:50.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.221+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~OUZOUV2DJCFJ.0 size=1048576 2024-09-22T08:48:50.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.222+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~OUZOUV2DJCFJ.1 size=296903 2024-09-22T08:48:50.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.222+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=OUZOUV2DJCFJ tag=N8E7RY56G2HH type=write size=2394055 2024-09-22T08:48:50.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.223+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.0 size=1048576 2024-09-22T08:48:50.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.224+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.1 size=1048576 2024-09-22T08:48:50.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.225+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~ZCXUTPWBRL3T.2 size=898901 2024-09-22T08:48:50.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.227+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=ZCXUTPWBRL3T tag=NFSNGW2O355B type=write size=4044629 2024-09-22T08:48:50.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.228+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=4OH62HY2PHZK type=del size=2767699 2024-09-22T08:48:50.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.229+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=GH4LNA3KC5P0 type=del 2024-09-22T08:48:50.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.231+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=3LHV0B1X4FKY type=del size=3229119 2024-09-22T08:48:50.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.232+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~6DO33YIHA8GE.0 size=68204 2024-09-22T08:48:50.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.234+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=6DO33YIHA8GE tag=TOOUFM9JY33K type=write size=1116780 2024-09-22T08:48:50.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.237+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~LF34ZVE46562.0 size=1048576 2024-09-22T08:48:50.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.238+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~LF34ZVE46562.1 size=107397 2024-09-22T08:48:50.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.238+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=LF34ZVE46562 tag=V71Z5L2MVNOA type=write size=2204549 2024-09-22T08:48:50.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.239+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=V9A9I223A0VE type=del 2024-09-22T08:48:50.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.240+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=W19S3X8H1GS4 type=del size=3623652 2024-09-22T08:48:50.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.241+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=WBSX13QU2WYF type=del 2024-09-22T08:48:50.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.243+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=W052CAIVP9NP type=del size=1832459 2024-09-22T08:48:50.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.244+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=1DLN4GXHJEQH type=del 2024-09-22T08:48:50.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.245+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=SMAYQER0PHF0 type=del size=208393 2024-09-22T08:48:50.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.247+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=E2F03DOKBZSR type=del 2024-09-22T08:48:50.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.249+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=AEPS3HV15T4R type=del size=2505285 2024-09-22T08:48:50.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.250+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=09MGRU5OC8TL type=del 2024-09-22T08:48:50.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.252+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~3SR52BANC4XG.0 size=130194 2024-09-22T08:48:50.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.252+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=3SR52BANC4XG tag=OBY2Y0TFIKN7 type=write size=1178770 2024-09-22T08:48:50.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.255+0000 7f7b8ef90780 1 < suggested remove operation key=ZM6ITJ2QUIPJ tag=AW7T9EP79X1G type=del 2024-09-22T08:48:50.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.256+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=WFB77KQ18YPC type=del size=3088583 2024-09-22T08:48:50.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.257+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=RV8LCS48RJGB type=write size=303741 2024-09-22T08:48:50.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.258+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=JFRDY9JI68L5 type=write size=741262 2024-09-22T08:48:50.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.260+0000 7f7b8ef90780 -1 < failed to complete operation key=ZM6ITJ2QUIPJ tag=OSVYOHENHJD2 type=write size=579286: (22) Invalid argument 2024-09-22T08:48:50.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.262+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~9B1MMNVMTPVV.0 size=727559 2024-09-22T08:48:50.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.262+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=9B1MMNVMTPVV tag=WS0631K3JVJ2 type=write size=1776135 2024-09-22T08:48:50.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.264+0000 7f7b8ef90780 1 < suggested remove operation key=YXIZJPACZZFY tag=K7153NY3ZWMT type=del 2024-09-22T08:48:50.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.266+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=NYQCLHT7JK7K type=del size=2774715 2024-09-22T08:48:50.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.267+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=SWW8637LO1XN type=del 2024-09-22T08:48:50.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.268+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=T5DIOJO3SCDG type=del size=2096747 2024-09-22T08:48:50.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.270+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.0 size=1048576 2024-09-22T08:48:50.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.271+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.1 size=1048576 2024-09-22T08:48:50.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.272+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~RX1P0QG5MVOD.2 size=316434 2024-09-22T08:48:50.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.274+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=RX1P0QG5MVOD tag=U8VMNZWNCD1H type=write size=3462162 2024-09-22T08:48:50.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.275+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=JITAZ9OCYGVW type=del size=1199409 2024-09-22T08:48:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.276+0000 7f7b8ef90780 1 < completed write operation key=O81X7IWXN4VP tag=RCB1CJLDXCP2 type=write size=113332 2024-09-22T08:48:50.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.277+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=MHSWAVR2F43Q type=del size=2079374 2024-09-22T08:48:50.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.279+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~OUZOUV2DJCFJ.0 size=1048576 2024-09-22T08:48:50.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.280+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~OUZOUV2DJCFJ.1 size=296903 2024-09-22T08:48:50.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.282+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=OUZOUV2DJCFJ tag=N8E7RY56G2HH type=write size=2394055 2024-09-22T08:48:50.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.283+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=VOL5VWF35TR5 type=del size=502360 2024-09-22T08:48:50.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.284+0000 7f7b8ef90780 1 < canceled operation key=QQKJ4URBRF16 tag=4OH62HY2PHZK type=del size=2767699 2024-09-22T08:48:50.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.285+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=BEUYC8LTJN6J type=del size=656560 2024-09-22T08:48:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.287+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=3LHV0B1X4FKY type=del 2024-09-22T08:48:50.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.289+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~IZ8N96L0C14K.0 size=386548 2024-09-22T08:48:50.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.289+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=IZ8N96L0C14K tag=OJCNVMEOO3FE type=write size=1435124 2024-09-22T08:48:50.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.290+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~LF34ZVE46562.0 size=1048576 2024-09-22T08:48:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.291+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~LF34ZVE46562.1 size=107397 2024-09-22T08:48:50.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.293+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=LF34ZVE46562 tag=V71Z5L2MVNOA type=write size=2204549 2024-09-22T08:48:50.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.294+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=QO95778DFW0W type=del size=1555558 2024-09-22T08:48:50.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.297+0000 7f7b8ef90780 1 < suggested update operation key=GBNPVRO0JPF7 tag=W19S3X8H1GS4 type=del size=3623652 2024-09-22T08:48:50.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.298+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=1D9V046J0623 type=del size=4027131 2024-09-22T08:48:50.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.299+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=W052CAIVP9NP type=del 2024-09-22T08:48:50.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.301+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~HMFM2K479YMR.0 size=1048576 2024-09-22T08:48:50.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.302+0000 7f7b8ef90780 1 > prepared part key=_multipart_L3XF68XD23FP.2~HMFM2K479YMR.1 size=356490 2024-09-22T08:48:50.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.302+0000 7f7b8ef90780 1 > prepared multipart upload key=L3XF68XD23FP upload=HMFM2K479YMR tag=K82G0JQ9EI7J type=write size=2453642 2024-09-22T08:48:50.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.304+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=SMAYQER0PHF0 type=del 2024-09-22T08:48:50.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.306+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~T8UPMX1FYJ2K.0 size=1048576 2024-09-22T08:48:50.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.307+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~T8UPMX1FYJ2K.1 size=301960 2024-09-22T08:48:50.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.307+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=T8UPMX1FYJ2K tag=HZ26ZANHCIYD type=write size=2399112 2024-09-22T08:48:50.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.308+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=AEPS3HV15T4R type=del 2024-09-22T08:48:50.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.309+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=NXMKTL0UICS2 type=del size=1008050 2024-09-22T08:48:50.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.311+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~3SR52BANC4XG.0 size=130194 2024-09-22T08:48:50.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.313+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=3SR52BANC4XG tag=OBY2Y0TFIKN7 type=write size=1178770 2024-09-22T08:48:50.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.314+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=Q2PS2QWIXDLP type=del size=2369157 2024-09-22T08:48:50.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.315+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=WFB77KQ18YPC type=del 2024-09-22T08:48:50.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.317+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=GLM7DH9E6AMJ type=write size=760595 2024-09-22T08:48:50.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.318+0000 7f7b8ef90780 1 < completed write operation key=Z9CHXCJ02L85 tag=JFRDY9JI68L5 type=write size=741262 2024-09-22T08:48:50.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.319+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=FNTOZPKWD5KL type=del size=856302 2024-09-22T08:48:50.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.321+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~9B1MMNVMTPVV.0 size=727559 2024-09-22T08:48:50.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.323+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=9B1MMNVMTPVV tag=WS0631K3JVJ2 type=write size=1776135 2024-09-22T08:48:50.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.324+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=MFZIUH5VSQC3 type=del size=1294273 2024-09-22T08:48:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.327+0000 7f7b8ef90780 1 < suggested update operation key=QH6TK0MJKYUO tag=NYQCLHT7JK7K type=del size=2774715 2024-09-22T08:48:50.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.330+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~GOSCNWBTEC93.0 size=1048576 2024-09-22T08:48:50.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.331+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~GOSCNWBTEC93.1 size=60139 2024-09-22T08:48:50.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.331+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=GOSCNWBTEC93 tag=8NKBLQQXY912 type=write size=2157291 2024-09-22T08:48:50.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.332+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=T5DIOJO3SCDG type=del 2024-09-22T08:48:50.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.334+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.0 size=1048576 2024-09-22T08:48:50.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.335+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.1 size=1048576 2024-09-22T08:48:50.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.336+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.2 size=235465 2024-09-22T08:48:50.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.336+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=O8NXUDDWHR1B tag=GTS3COO9GD0Z type=write size=3381193 2024-09-22T08:48:50.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.338+0000 7f7b8ef90780 -1 < failed to complete operation key=GBNPVRO0JPF7 tag=JITAZ9OCYGVW type=del size=1199409: (22) Invalid argument 2024-09-22T08:48:50.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.339+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=XZQFVS5IZ02P type=write size=370414 2024-09-22T08:48:50.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.340+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=MHSWAVR2F43Q type=del 2024-09-22T08:48:50.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.342+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=W58K96R2RUQJ type=del size=3560767 2024-09-22T08:48:50.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.343+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=VOL5VWF35TR5 type=del 2024-09-22T08:48:50.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.345+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~0WPQXHY1E2E7.0 size=586733 2024-09-22T08:48:50.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.345+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=0WPQXHY1E2E7 tag=M0ONRJTMBF56 type=write size=1635309 2024-09-22T08:48:50.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.347+0000 7f7b8ef90780 1 < canceled operation key=Z9CHXCJ02L85 tag=BEUYC8LTJN6J type=del size=656560 2024-09-22T08:48:50.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.348+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=PSK2Z22CH63K type=del size=227146 2024-09-22T08:48:50.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.349+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~IZ8N96L0C14K.0 size=386548 2024-09-22T08:48:50.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.351+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=IZ8N96L0C14K tag=OJCNVMEOO3FE type=write size=1435124 2024-09-22T08:48:50.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.352+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=T1ZM24RRUX6I type=del size=1380252 2024-09-22T08:48:50.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.354+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=QO95778DFW0W type=del size=1555558 2024-09-22T08:48:50.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.355+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=C292J5UZ2EOU type=del size=67699 2024-09-22T08:48:50.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.357+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=1D9V046J0623 type=del 2024-09-22T08:48:50.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.358+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=61F2QY15LRC9 type=del size=3482587 2024-09-22T08:48:50.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.360+0000 7f7b8ef90780 1 < completed part key=_multipart_L3XF68XD23FP.2~HMFM2K479YMR.0 size=1048576 2024-09-22T08:48:50.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.360+0000 7f7b8ef90780 1 < canceled part key=_multipart_L3XF68XD23FP.2~HMFM2K479YMR.1 size=356490 2024-09-22T08:48:50.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.361+0000 7f7b8ef90780 1 < canceled multipart upload key=L3XF68XD23FP upload=HMFM2K479YMR tag=K82G0JQ9EI7J type=write size=2453642 2024-09-22T08:48:50.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.364+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.0 size=1048576 2024-09-22T08:48:50.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.365+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.1 size=1048576 2024-09-22T08:48:50.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.366+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.2 size=215879 2024-09-22T08:48:50.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.366+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=6H3K8774NJHG tag=YR1G85G0WM0F type=write size=3361607 2024-09-22T08:48:50.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.367+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~T8UPMX1FYJ2K.0 size=1048576 2024-09-22T08:48:50.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.368+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~T8UPMX1FYJ2K.1 size=301960 2024-09-22T08:48:50.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.371+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=T8UPMX1FYJ2K tag=HZ26ZANHCIYD type=write size=2399112 2024-09-22T08:48:50.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.373+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.0 size=1048576 2024-09-22T08:48:50.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.374+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.1 size=1048576 2024-09-22T08:48:50.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.375+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.2 size=448294 2024-09-22T08:48:50.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.375+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=GHWNDQUNO2TR tag=D6Y0H1GF41SL type=write size=3594022 2024-09-22T08:48:50.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.376+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=NXMKTL0UICS2 type=del 2024-09-22T08:48:50.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.378+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=CREU4K83W0AZ type=del size=2077179 2024-09-22T08:48:50.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.380+0000 7f7b8ef90780 1 < suggested remove operation key=L1URDVW43BUG tag=Q2PS2QWIXDLP type=del 2024-09-22T08:48:50.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.382+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~LE6YQYMRPBY8.0 size=183555 2024-09-22T08:48:50.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.382+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=LE6YQYMRPBY8 tag=P1DINVFN2D89 type=write size=1232131 2024-09-22T08:48:50.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.384+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=GLM7DH9E6AMJ type=write size=760595 2024-09-22T08:48:50.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.385+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=6K3YMPD3RMTJ type=del size=3495133 2024-09-22T08:48:50.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.386+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=FNTOZPKWD5KL type=del 2024-09-22T08:48:50.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.387+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=OAPTIAXNEP1H type=write size=403465 2024-09-22T08:48:50.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.389+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=MFZIUH5VSQC3 type=del 2024-09-22T08:48:50.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.390+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=W89CD5D3O7E9 type=del size=3665128 2024-09-22T08:48:50.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.391+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~GOSCNWBTEC93.0 size=1048576 2024-09-22T08:48:50.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.392+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~GOSCNWBTEC93.1 size=60139 2024-09-22T08:48:50.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.394+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=GOSCNWBTEC93 tag=8NKBLQQXY912 type=write size=2157291 2024-09-22T08:48:50.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.396+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=OX1M8AJ7XQW0 type=del size=3881795 2024-09-22T08:48:50.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.397+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.0 size=1048576 2024-09-22T08:48:50.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.398+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.1 size=1048576 2024-09-22T08:48:50.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.399+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~O8NXUDDWHR1B.2 size=235465 2024-09-22T08:48:50.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.401+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=O8NXUDDWHR1B tag=GTS3COO9GD0Z type=write size=3381193 2024-09-22T08:48:50.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.403+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~74EJK308QVMY.0 size=955014 2024-09-22T08:48:50.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.403+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=74EJK308QVMY tag=ENJW4EGE32MK type=write size=2003590 2024-09-22T08:48:50.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.405+0000 7f7b8ef90780 1 < completed write operation key=QQKJ4URBRF16 tag=XZQFVS5IZ02P type=write size=370414 2024-09-22T08:48:50.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.407+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0CU30AQZ4P32.0 size=543047 2024-09-22T08:48:50.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.407+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=0CU30AQZ4P32 tag=IPNX7BO4OCO1 type=write size=1591623 2024-09-22T08:48:50.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.408+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=W58K96R2RUQJ type=del 2024-09-22T08:48:50.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.410+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~0IR8YIYD37BJ.0 size=1048576 2024-09-22T08:48:50.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.411+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~0IR8YIYD37BJ.1 size=303402 2024-09-22T08:48:50.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.411+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=0IR8YIYD37BJ tag=OU4KVCTC4JH5 type=write size=2400554 2024-09-22T08:48:50.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.413+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~0WPQXHY1E2E7.0 size=586733 2024-09-22T08:48:50.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.415+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=0WPQXHY1E2E7 tag=M0ONRJTMBF56 type=write size=1635309 2024-09-22T08:48:50.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.416+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=3DVQ84HOIG9W type=del size=2513583 2024-09-22T08:48:50.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.417+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=PSK2Z22CH63K type=del 2024-09-22T08:48:50.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.420+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.0 size=1048576 2024-09-22T08:48:50.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.421+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.1 size=1048576 2024-09-22T08:48:50.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.422+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.2 size=641324 2024-09-22T08:48:50.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.422+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=RRJ04OQZLZJR tag=L6FNXC2NCU58 type=write size=3787052 2024-09-22T08:48:50.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.423+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=T1ZM24RRUX6I type=del 2024-09-22T08:48:50.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.425+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.0 size=1048576 2024-09-22T08:48:50.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.426+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.1 size=1048576 2024-09-22T08:48:50.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.427+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.2 size=71261 2024-09-22T08:48:50.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.427+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=1U5G0QVIWQCA tag=MA8CJL5HOB8R type=write size=3216989 2024-09-22T08:48:50.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.429+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=C292J5UZ2EOU type=del 2024-09-22T08:48:50.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.430+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=XTV5FUSOM8TC type=del size=1698969 2024-09-22T08:48:50.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.431+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=61F2QY15LRC9 type=del 2024-09-22T08:48:50.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.433+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=J2O5AI9U3C8G type=del size=1659742 2024-09-22T08:48:50.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.434+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.0 size=1048576 2024-09-22T08:48:50.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.435+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.1 size=1048576 2024-09-22T08:48:50.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.436+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~6H3K8774NJHG.2 size=215879 2024-09-22T08:48:50.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.438+0000 7f7b8ef90780 1 < completed multipart upload key=UQPY2ITDMKGO upload=6H3K8774NJHG tag=YR1G85G0WM0F type=write size=3361607 2024-09-22T08:48:50.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.441+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~GDHZMZ9VNXOX.0 size=1048576 2024-09-22T08:48:50.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.442+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~GDHZMZ9VNXOX.1 size=308353 2024-09-22T08:48:50.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.442+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=GDHZMZ9VNXOX tag=ET1TOP9AUXNF type=write size=2405505 2024-09-22T08:48:50.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.443+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.0 size=1048576 2024-09-22T08:48:50.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.444+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.1 size=1048576 2024-09-22T08:48:50.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.444+0000 7f7b8ef90780 1 < canceled part key=_multipart_GBNPVRO0JPF7.2~GHWNDQUNO2TR.2 size=448294 2024-09-22T08:48:50.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.448+0000 7f7b8ef90780 1 < canceled multipart upload key=GBNPVRO0JPF7 upload=GHWNDQUNO2TR tag=D6Y0H1GF41SL type=write size=3594022 2024-09-22T08:48:50.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.450+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.0 size=1048576 2024-09-22T08:48:50.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.452+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.1 size=1048576 2024-09-22T08:48:50.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.453+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.2 size=10841 2024-09-22T08:48:50.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.453+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=U68Z2EX9Q7OI tag=OOMZRZZZ25LT type=write size=3156569 2024-09-22T08:48:50.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.454+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=CREU4K83W0AZ type=del 2024-09-22T08:48:50.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.455+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=RBLEPTLG8633 type=del size=1784993 2024-09-22T08:48:50.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.457+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~LE6YQYMRPBY8.0 size=183555 2024-09-22T08:48:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.459+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=LE6YQYMRPBY8 tag=P1DINVFN2D89 type=write size=1232131 2024-09-22T08:48:50.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.460+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=72XK3CZU5626 type=write size=575178 2024-09-22T08:48:50.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.463+0000 7f7b8ef90780 1 < suggested remove operation key=L1URDVW43BUG tag=6K3YMPD3RMTJ type=del 2024-09-22T08:48:50.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.464+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=A10JEIKGBP9J type=del size=3253795 2024-09-22T08:48:50.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.466+0000 7f7b8ef90780 1 < completed write operation key=9DO6M6UQ5A05 tag=OAPTIAXNEP1H type=write size=403465 2024-09-22T08:48:50.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.468+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~WCP7XLXD4O73.0 size=385292 2024-09-22T08:48:50.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.468+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=WCP7XLXD4O73 tag=KUJ30N7XKWPQ type=write size=1433868 2024-09-22T08:48:50.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.470+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=W89CD5D3O7E9 type=del 2024-09-22T08:48:50.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.471+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=SM83ANAHRI2V type=del size=879858 2024-09-22T08:48:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.472+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=OX1M8AJ7XQW0 type=del 2024-09-22T08:48:50.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.473+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=A2DEHW00IFPB type=del size=3977283 2024-09-22T08:48:50.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.475+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~74EJK308QVMY.0 size=955014 2024-09-22T08:48:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.477+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=74EJK308QVMY tag=ENJW4EGE32MK type=write size=2003590 2024-09-22T08:48:50.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.478+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=8T3R61G2FT67 type=del size=1678000 2024-09-22T08:48:50.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.479+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0CU30AQZ4P32.0 size=543047 2024-09-22T08:48:50.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.481+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=0CU30AQZ4P32 tag=IPNX7BO4OCO1 type=write size=1591623 2024-09-22T08:48:50.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.483+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=2A0P0BNY6WIG type=del size=3183505 2024-09-22T08:48:50.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.484+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~0IR8YIYD37BJ.0 size=1048576 2024-09-22T08:48:50.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.485+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~0IR8YIYD37BJ.1 size=303402 2024-09-22T08:48:50.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.487+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=0IR8YIYD37BJ tag=OU4KVCTC4JH5 type=write size=2400554 2024-09-22T08:48:50.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.488+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=MMS43FLLWUZU type=del size=3296946 2024-09-22T08:48:50.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.490+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=3DVQ84HOIG9W type=del 2024-09-22T08:48:50.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.491+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=K00OFGQB8QXB type=del size=2870649 2024-09-22T08:48:50.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.492+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.0 size=1048576 2024-09-22T08:48:50.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.493+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.1 size=1048576 2024-09-22T08:48:50.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.494+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~RRJ04OQZLZJR.2 size=641324 2024-09-22T08:48:50.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.496+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=RRJ04OQZLZJR tag=L6FNXC2NCU58 type=write size=3787052 2024-09-22T08:48:50.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.497+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=9W9Y0DB4M80W type=del size=1911741 2024-09-22T08:48:50.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.499+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.0 size=1048576 2024-09-22T08:48:50.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.499+0000 7f7b8ef90780 1 < canceled part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.1 size=1048576 2024-09-22T08:48:50.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.500+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~1U5G0QVIWQCA.2 size=71261 2024-09-22T08:48:50.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.502+0000 7f7b8ef90780 1 < canceled multipart upload key=ZM6ITJ2QUIPJ upload=1U5G0QVIWQCA tag=MA8CJL5HOB8R type=write size=3216989 2024-09-22T08:48:50.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.503+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=HJPFKGOELWG7 type=del size=2510836 2024-09-22T08:48:50.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.504+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=XTV5FUSOM8TC type=del 2024-09-22T08:48:50.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.507+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~YEFEJ736X8D1.0 size=325385 2024-09-22T08:48:50.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.507+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=YEFEJ736X8D1 tag=5516MUXD1XQ6 type=write size=1373961 2024-09-22T08:48:50.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.508+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=J2O5AI9U3C8G type=del 2024-09-22T08:48:50.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.509+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=4WA81RRG79OP type=del size=3126960 2024-09-22T08:48:50.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.511+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~GDHZMZ9VNXOX.0 size=1048576 2024-09-22T08:48:50.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.512+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~GDHZMZ9VNXOX.1 size=308353 2024-09-22T08:48:50.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.514+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=GDHZMZ9VNXOX tag=ET1TOP9AUXNF type=write size=2405505 2024-09-22T08:48:50.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.515+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=ZVXIQNR7L0QJ type=del size=2645590 2024-09-22T08:48:50.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.516+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.0 size=1048576 2024-09-22T08:48:50.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.517+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.1 size=1048576 2024-09-22T08:48:50.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.519+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~U68Z2EX9Q7OI.2 size=10841 2024-09-22T08:48:50.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.521+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=U68Z2EX9Q7OI tag=OOMZRZZZ25LT type=write size=3156569 2024-09-22T08:48:50.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.523+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~TOU6QO4BND63.0 size=1048576 2024-09-22T08:48:50.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.524+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~TOU6QO4BND63.1 size=899224 2024-09-22T08:48:50.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.524+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=TOU6QO4BND63 tag=Y6IFQRC4FPU7 type=write size=2996376 2024-09-22T08:48:50.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.525+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=RBLEPTLG8633 type=del 2024-09-22T08:48:50.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.527+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=5JTIBQOI7WTD type=del size=2202913 2024-09-22T08:48:50.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.528+0000 7f7b8ef90780 1 < canceled operation key=7ZS8G8H6I957 tag=72XK3CZU5626 type=write size=575178 2024-09-22T08:48:50.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.530+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~M87Q0K3JA9M3.0 size=1029821 2024-09-22T08:48:50.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.530+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=M87Q0K3JA9M3 tag=3XP6P1G6MC24 type=write size=2078397 2024-09-22T08:48:50.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.531+0000 7f7b8ef90780 1 < canceled operation key=Y7W0V6YTDFIB tag=A10JEIKGBP9J type=del size=3253795 2024-09-22T08:48:50.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.532+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=YLCUE4JN2691 type=del size=3946237 2024-09-22T08:48:50.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.533+0000 7f7b8ef90780 1 < canceled part key=_multipart_QH6TK0MJKYUO.2~WCP7XLXD4O73.0 size=385292 2024-09-22T08:48:50.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.535+0000 7f7b8ef90780 1 < canceled multipart upload key=QH6TK0MJKYUO upload=WCP7XLXD4O73 tag=KUJ30N7XKWPQ type=write size=1433868 2024-09-22T08:48:50.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.536+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=V544PID3XVHH type=del size=2046181 2024-09-22T08:48:50.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.538+0000 7f7b8ef90780 1 < suggested remove operation key=ORON3U0WY2K5 tag=SM83ANAHRI2V type=del 2024-09-22T08:48:50.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.540+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=OGAB38REO922 type=del size=4107102 2024-09-22T08:48:50.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.541+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=A2DEHW00IFPB type=del 2024-09-22T08:48:50.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.542+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=ZLVFSKM9P98K type=write size=377874 2024-09-22T08:48:50.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.545+0000 7f7b8ef90780 1 < suggested remove operation key=7ZS8G8H6I957 tag=8T3R61G2FT67 type=del 2024-09-22T08:48:50.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.546+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=R93MMM9AJ4FE type=write size=471401 2024-09-22T08:48:50.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.549+0000 7f7b8ef90780 1 < suggested remove operation key=4ZJ4E4SUA01H tag=2A0P0BNY6WIG type=del 2024-09-22T08:48:50.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.550+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=L6J8LZ0AJFZM type=del size=950030 2024-09-22T08:48:50.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.551+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=MMS43FLLWUZU type=del 2024-09-22T08:48:50.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.553+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=W0KABBKESKQD type=del size=3926863 2024-09-22T08:48:50.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.554+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=K00OFGQB8QXB type=del 2024-09-22T08:48:50.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.557+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.0 size=1048576 2024-09-22T08:48:50.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.558+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.1 size=1048576 2024-09-22T08:48:50.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.559+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.2 size=642440 2024-09-22T08:48:50.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.559+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=KRWVSR0Y8SHS tag=24UI3UV8DRXV type=write size=3788168 2024-09-22T08:48:50.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.560+0000 7f7b8ef90780 -1 < failed to complete operation key=7ZS8G8H6I957 tag=9W9Y0DB4M80W type=del size=1911741: (22) Invalid argument 2024-09-22T08:48:50.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.563+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~YV4SRSM9N12X.0 size=1048576 2024-09-22T08:48:50.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.564+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~YV4SRSM9N12X.1 size=443104 2024-09-22T08:48:50.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.564+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=YV4SRSM9N12X tag=VZQHJS5DKIGU type=write size=2540256 2024-09-22T08:48:50.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.567+0000 7f7b8ef90780 1 < suggested update operation key=GBNPVRO0JPF7 tag=HJPFKGOELWG7 type=del size=2510836 2024-09-22T08:48:50.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.570+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=TGSHBEUFQ92T type=write size=395939 2024-09-22T08:48:50.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.571+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~YEFEJ736X8D1.0 size=325385 2024-09-22T08:48:50.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.573+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=YEFEJ736X8D1 tag=5516MUXD1XQ6 type=write size=1373961 2024-09-22T08:48:50.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.576+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~OTBQ96BRJ0NZ.0 size=1048576 2024-09-22T08:48:50.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.577+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~OTBQ96BRJ0NZ.1 size=528932 2024-09-22T08:48:50.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.577+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=OTBQ96BRJ0NZ tag=MZKOZ2MSKWF7 type=write size=2626084 2024-09-22T08:48:50.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.578+0000 7f7b8ef90780 -1 < failed to complete operation key=GBNPVRO0JPF7 tag=4WA81RRG79OP type=del size=3126960: (22) Invalid argument 2024-09-22T08:48:50.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.581+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~IECS6HE1F6HX.0 size=123052 2024-09-22T08:48:50.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.581+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=IECS6HE1F6HX tag=0JESV51ET1BE type=write size=1171628 2024-09-22T08:48:50.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.582+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=ZVXIQNR7L0QJ type=del 2024-09-22T08:48:50.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.585+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~9H2DED3BDA2B.0 size=637518 2024-09-22T08:48:50.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.585+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=9H2DED3BDA2B tag=OHV51CDOZO3E type=write size=1686094 2024-09-22T08:48:50.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.586+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~TOU6QO4BND63.0 size=1048576 2024-09-22T08:48:50.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.586+0000 7f7b8ef90780 1 < canceled part key=_multipart_4ZJ4E4SUA01H.2~TOU6QO4BND63.1 size=899224 2024-09-22T08:48:50.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.589+0000 7f7b8ef90780 1 < canceled multipart upload key=4ZJ4E4SUA01H upload=TOU6QO4BND63 tag=Y6IFQRC4FPU7 type=write size=2996376 2024-09-22T08:48:50.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.590+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=C44FC4DP9Y2M type=write size=807124 2024-09-22T08:48:50.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.592+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=5JTIBQOI7WTD type=del 2024-09-22T08:48:50.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.593+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=63SOG58UZEUQ type=del size=462786 2024-09-22T08:48:50.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.595+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~M87Q0K3JA9M3.0 size=1029821 2024-09-22T08:48:50.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.597+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=M87Q0K3JA9M3 tag=3XP6P1G6MC24 type=write size=2078397 2024-09-22T08:48:50.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.600+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~NKKO20NBPA7Q.0 size=746317 2024-09-22T08:48:50.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.600+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=NKKO20NBPA7Q tag=LKH0HM6QG3JK type=write size=1794893 2024-09-22T08:48:50.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.602+0000 7f7b8ef90780 1 < suggested remove operation key=1U6T2BIZS72V tag=YLCUE4JN2691 type=del 2024-09-22T08:48:50.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.603+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=XQ073Z0YOZX2 type=del size=2164336 2024-09-22T08:48:50.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.605+0000 7f7b8ef90780 1 < completed delete operation key=QH6TK0MJKYUO tag=V544PID3XVHH type=del 2024-09-22T08:48:50.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.607+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.0 size=1048576 2024-09-22T08:48:50.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.608+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.1 size=1048576 2024-09-22T08:48:50.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.609+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.2 size=333846 2024-09-22T08:48:50.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.609+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=8AQ5DB1QVYTP tag=NQUZ4TJLLZ8X type=write size=3479574 2024-09-22T08:48:50.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.610+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=OGAB38REO922 type=del 2024-09-22T08:48:50.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.612+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=DVALO4ALR3JR type=del size=1654732 2024-09-22T08:48:50.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.613+0000 7f7b8ef90780 1 < completed write operation key=R0N30XP1BXY3 tag=ZLVFSKM9P98K type=write size=377874 2024-09-22T08:48:50.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.615+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=LXO7RTBFBBMZ type=del size=2735577 2024-09-22T08:48:50.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.616+0000 7f7b8ef90780 1 < completed write operation key=YF94C9GVRXQP tag=R93MMM9AJ4FE type=write size=471401 2024-09-22T08:48:50.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.618+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.0 size=1048576 2024-09-22T08:48:50.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.619+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.1 size=1048576 2024-09-22T08:48:50.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.620+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.2 size=292397 2024-09-22T08:48:50.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.620+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=Y27UOZ0WJ04X tag=RUK5OT20FBSL type=write size=3438125 2024-09-22T08:48:50.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.622+0000 7f7b8ef90780 1 < canceled operation key=ORON3U0WY2K5 tag=L6J8LZ0AJFZM type=del size=950030 2024-09-22T08:48:50.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.624+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.0 size=1048576 2024-09-22T08:48:50.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.625+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.1 size=1048576 2024-09-22T08:48:50.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.626+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.2 size=33349 2024-09-22T08:48:50.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.626+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=N18LOU0ZOYJ6 tag=T1KFUJ9F1E3Z type=write size=3179077 2024-09-22T08:48:50.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.627+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=W0KABBKESKQD type=del size=3926863 2024-09-22T08:48:50.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.629+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~0Z23RETZ2B1L.0 size=470383 2024-09-22T08:48:50.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.629+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=0Z23RETZ2B1L tag=MPWWWK8HKOSL type=write size=1518959 2024-09-22T08:48:50.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.630+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.0 size=1048576 2024-09-22T08:48:50.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.631+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.1 size=1048576 2024-09-22T08:48:50.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.632+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~KRWVSR0Y8SHS.2 size=642440 2024-09-22T08:48:50.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.634+0000 7f7b8ef90780 1 < completed multipart upload key=L1URDVW43BUG upload=KRWVSR0Y8SHS tag=24UI3UV8DRXV type=write size=3788168 2024-09-22T08:48:50.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.635+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=Y054YG705VIT type=del size=972390 2024-09-22T08:48:50.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.637+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~YV4SRSM9N12X.0 size=1048576 2024-09-22T08:48:50.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.638+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~YV4SRSM9N12X.1 size=443104 2024-09-22T08:48:50.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.640+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=YV4SRSM9N12X tag=VZQHJS5DKIGU type=write size=2540256 2024-09-22T08:48:50.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.642+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.0 size=1048576 2024-09-22T08:48:50.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.1 size=1048576 2024-09-22T08:48:50.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.644+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.2 size=315930 2024-09-22T08:48:50.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.644+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=OXDTQDB9OSQN tag=GZM1J0XOLQJX type=write size=3461658 2024-09-22T08:48:50.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.646+0000 7f7b8ef90780 1 < suggested update operation key=4J4EGI19N123 tag=TGSHBEUFQ92T type=write size=395939 2024-09-22T08:48:50.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.647+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=8G5G2V8035M3 type=del size=3793649 2024-09-22T08:48:50.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.648+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~OTBQ96BRJ0NZ.0 size=1048576 2024-09-22T08:48:50.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.649+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~OTBQ96BRJ0NZ.1 size=528932 2024-09-22T08:48:50.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.651+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=OTBQ96BRJ0NZ tag=MZKOZ2MSKWF7 type=write size=2626084 2024-09-22T08:48:50.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.652+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=UGVXVK5R332D type=write size=235805 2024-09-22T08:48:50.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.653+0000 7f7b8ef90780 1 < canceled part key=_multipart_4J4EGI19N123.2~IECS6HE1F6HX.0 size=123052 2024-09-22T08:48:50.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.654+0000 7f7b8ef90780 1 < canceled multipart upload key=4J4EGI19N123 upload=IECS6HE1F6HX tag=0JESV51ET1BE type=write size=1171628 2024-09-22T08:48:50.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.656+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=ZOAW3M7O3MKC type=del size=2321543 2024-09-22T08:48:50.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.657+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~9H2DED3BDA2B.0 size=637518 2024-09-22T08:48:50.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.659+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=9H2DED3BDA2B tag=OHV51CDOZO3E type=write size=1686094 2024-09-22T08:48:50.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.661+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~A9Q90AXS048P.0 size=768327 2024-09-22T08:48:50.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.661+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=A9Q90AXS048P tag=R5APY8L1WCQZ type=write size=1816903 2024-09-22T08:48:50.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.664+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=C44FC4DP9Y2M type=write 2024-09-22T08:48:50.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.666+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~SW2IARHFIFIV.0 size=1048576 2024-09-22T08:48:50.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.667+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~SW2IARHFIFIV.1 size=426761 2024-09-22T08:48:50.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.667+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=SW2IARHFIFIV tag=ZNW3279MGGRP type=write size=2523913 2024-09-22T08:48:50.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.668+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=63SOG58UZEUQ type=del 2024-09-22T08:48:50.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.670+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~LDH9U0HOQ766.0 size=972173 2024-09-22T08:48:50.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.670+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=LDH9U0HOQ766 tag=EK51OK5QDGPM type=write size=2020749 2024-09-22T08:48:50.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.672+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~NKKO20NBPA7Q.0 size=746317 2024-09-22T08:48:50.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.674+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=NKKO20NBPA7Q tag=LKH0HM6QG3JK type=write size=1794893 2024-09-22T08:48:50.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.676+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~U1XE9ZA9DY24.0 size=402192 2024-09-22T08:48:50.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.676+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=U1XE9ZA9DY24 tag=2D9KUG9X67ZR type=write size=1450768 2024-09-22T08:48:50.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.677+0000 7f7b8ef90780 1 < canceled operation key=Y7W0V6YTDFIB tag=XQ073Z0YOZX2 type=del size=2164336 2024-09-22T08:48:50.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.680+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~OCBS91WS8IVG.0 size=483805 2024-09-22T08:48:50.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.680+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=OCBS91WS8IVG tag=NGM6DPYMZ9L0 type=write size=1532381 2024-09-22T08:48:50.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.681+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.0 size=1048576 2024-09-22T08:48:50.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.682+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.1 size=1048576 2024-09-22T08:48:50.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.683+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~8AQ5DB1QVYTP.2 size=333846 2024-09-22T08:48:50.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.685+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=8AQ5DB1QVYTP tag=NQUZ4TJLLZ8X type=write size=3479574 2024-09-22T08:48:50.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.689+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~25NJTWORDT1D.0 size=1048576 2024-09-22T08:48:50.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.690+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~25NJTWORDT1D.1 size=1046231 2024-09-22T08:48:50.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.690+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=25NJTWORDT1D tag=JBJA1QNCIAB4 type=write size=3143383 2024-09-22T08:48:50.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.693+0000 7f7b8ef90780 1 < suggested remove operation key=QQKJ4URBRF16 tag=DVALO4ALR3JR type=del 2024-09-22T08:48:50.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.694+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=UEG8RAWVIXCU type=del size=886140 2024-09-22T08:48:50.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.696+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=LXO7RTBFBBMZ type=del 2024-09-22T08:48:50.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.697+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=6CF3D718IRLW type=write size=559715 2024-09-22T08:48:50.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.698+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.0 size=1048576 2024-09-22T08:48:50.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.699+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.1 size=1048576 2024-09-22T08:48:50.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.700+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~Y27UOZ0WJ04X.2 size=292397 2024-09-22T08:48:50.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.702+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=Y27UOZ0WJ04X tag=RUK5OT20FBSL type=write size=3438125 2024-09-22T08:48:50.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.704+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=2YH29FY2EFV2 type=del size=1886733 2024-09-22T08:48:50.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.705+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.0 size=1048576 2024-09-22T08:48:50.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.706+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.1 size=1048576 2024-09-22T08:48:50.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.707+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~N18LOU0ZOYJ6.2 size=33349 2024-09-22T08:48:50.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.709+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=N18LOU0ZOYJ6 tag=T1KFUJ9F1E3Z type=write size=3179077 2024-09-22T08:48:50.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.711+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~KLKN2KVIOR4K.0 size=1048576 2024-09-22T08:48:50.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.712+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~KLKN2KVIOR4K.1 size=564955 2024-09-22T08:48:50.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.712+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=KLKN2KVIOR4K tag=6SUD9JW4V0P7 type=write size=2662107 2024-09-22T08:48:50.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.714+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~0Z23RETZ2B1L.0 size=470383 2024-09-22T08:48:50.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.716+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=0Z23RETZ2B1L tag=MPWWWK8HKOSL type=write size=1518959 2024-09-22T08:48:50.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.717+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=7NOWNX11K8FO type=write size=588906 2024-09-22T08:48:50.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.719+0000 7f7b8ef90780 1 < suggested update operation key=IRFUEK82X28U tag=Y054YG705VIT type=del size=972390 2024-09-22T08:48:50.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.721+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~9HMPC3B97UK3.0 size=845194 2024-09-22T08:48:50.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.721+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=9HMPC3B97UK3 tag=1J05KT3MM4W7 type=write size=1893770 2024-09-22T08:48:50.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.723+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.0 size=1048576 2024-09-22T08:48:50.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.724+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.1 size=1048576 2024-09-22T08:48:50.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.725+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~OXDTQDB9OSQN.2 size=315930 2024-09-22T08:48:50.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.727+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=OXDTQDB9OSQN tag=GZM1J0XOLQJX type=write size=3461658 2024-09-22T08:48:50.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.729+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~Q45BFXILLZLD.0 size=851997 2024-09-22T08:48:50.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.729+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=Q45BFXILLZLD tag=09CEEYLY2G3B type=write size=1900573 2024-09-22T08:48:50.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.730+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=8G5G2V8035M3 type=del 2024-09-22T08:48:50.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.732+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=A04PJVYF5YXL type=del size=2530503 2024-09-22T08:48:50.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.734+0000 7f7b8ef90780 1 < suggested update operation key=R0N30XP1BXY3 tag=UGVXVK5R332D type=write size=235805 2024-09-22T08:48:50.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.735+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=RECTBZC2NQIM type=del size=1149321 2024-09-22T08:48:50.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.737+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=ZOAW3M7O3MKC type=del 2024-09-22T08:48:50.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.738+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=JPLVSEVHQOTC type=del size=1070096 2024-09-22T08:48:50.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.739+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~A9Q90AXS048P.0 size=768327 2024-09-22T08:48:50.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.741+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=A9Q90AXS048P tag=R5APY8L1WCQZ type=write size=1816903 2024-09-22T08:48:50.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.742+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=1G3FD9J1QZ1W type=del size=1540633 2024-09-22T08:48:50.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.743+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~SW2IARHFIFIV.0 size=1048576 2024-09-22T08:48:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.744+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~SW2IARHFIFIV.1 size=426761 2024-09-22T08:48:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.746+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=SW2IARHFIFIV tag=ZNW3279MGGRP type=write size=2523913 2024-09-22T08:48:50.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.747+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=CAXK687V95SM type=del size=2073312 2024-09-22T08:48:50.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.749+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~LDH9U0HOQ766.0 size=972173 2024-09-22T08:48:50.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.751+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=LDH9U0HOQ766 tag=EK51OK5QDGPM type=write size=2020749 2024-09-22T08:48:50.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.752+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=5EWLEDGBV0KV type=del size=2122793 2024-09-22T08:48:50.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.753+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~U1XE9ZA9DY24.0 size=402192 2024-09-22T08:48:50.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.755+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=U1XE9ZA9DY24 tag=2D9KUG9X67ZR type=write size=1450768 2024-09-22T08:48:50.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.757+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=62KJNEEO230D type=del size=1388385 2024-09-22T08:48:50.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.758+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~OCBS91WS8IVG.0 size=483805 2024-09-22T08:48:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.760+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=OCBS91WS8IVG tag=NGM6DPYMZ9L0 type=write size=1532381 2024-09-22T08:48:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.761+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=0P6KYDSCSO7U type=del size=3162094 2024-09-22T08:48:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.762+0000 7f7b8ef90780 1 < canceled part key=_multipart_UQPY2ITDMKGO.2~25NJTWORDT1D.0 size=1048576 2024-09-22T08:48:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.763+0000 7f7b8ef90780 1 < completed part key=_multipart_UQPY2ITDMKGO.2~25NJTWORDT1D.1 size=1046231 2024-09-22T08:48:50.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.765+0000 7f7b8ef90780 1 < canceled multipart upload key=UQPY2ITDMKGO upload=25NJTWORDT1D tag=JBJA1QNCIAB4 type=write size=3143383 2024-09-22T08:48:50.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.766+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=850RF4EAA91A type=del size=3741250 2024-09-22T08:48:50.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.769+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=UEG8RAWVIXCU type=del 2024-09-22T08:48:50.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.770+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=HC2CG7TVA43E type=del size=1707971 2024-09-22T08:48:50.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.771+0000 7f7b8ef90780 1 < completed write operation key=6DC0SVAYR2DB tag=6CF3D718IRLW type=write size=559715 2024-09-22T08:48:50.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.773+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=M70AJ80A6TF3 type=del size=2919628 2024-09-22T08:48:50.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.774+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=2YH29FY2EFV2 type=del 2024-09-22T08:48:50.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.775+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=L4GP5N9N0NPQ type=write size=234684 2024-09-22T08:48:50.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.777+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~KLKN2KVIOR4K.0 size=1048576 2024-09-22T08:48:50.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.778+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~KLKN2KVIOR4K.1 size=564955 2024-09-22T08:48:50.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.780+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=KLKN2KVIOR4K tag=6SUD9JW4V0P7 type=write size=2662107 2024-09-22T08:48:50.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.781+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=0MM7N86XBWH6 type=del size=798906 2024-09-22T08:48:50.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.783+0000 7f7b8ef90780 1 < canceled operation key=6DC0SVAYR2DB tag=7NOWNX11K8FO type=write size=588906 2024-09-22T08:48:50.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.784+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=SHHESHFFPIDV type=del size=1553685 2024-09-22T08:48:50.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.785+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~9HMPC3B97UK3.0 size=845194 2024-09-22T08:48:50.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.787+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=9HMPC3B97UK3 tag=1J05KT3MM4W7 type=write size=1893770 2024-09-22T08:48:50.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.789+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=DSRKK9W16CSX type=del size=2561355 2024-09-22T08:48:50.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.790+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~Q45BFXILLZLD.0 size=851997 2024-09-22T08:48:50.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.792+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=Q45BFXILLZLD tag=09CEEYLY2G3B type=write size=1900573 2024-09-22T08:48:50.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.793+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=NCG7JM6PI95B type=del size=3200302 2024-09-22T08:48:50.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.794+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=A04PJVYF5YXL type=del 2024-09-22T08:48:50.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.797+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.0 size=1048576 2024-09-22T08:48:50.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.798+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.1 size=1048576 2024-09-22T08:48:50.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.799+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.2 size=203072 2024-09-22T08:48:50.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.799+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=1WDL135CE1BS tag=MDYH24NAGNXA type=write size=3348800 2024-09-22T08:48:50.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.800+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=RECTBZC2NQIM type=del 2024-09-22T08:48:50.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.801+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=8F1RSYJA2SES type=write size=46095 2024-09-22T08:48:50.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.803+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=JPLVSEVHQOTC type=del 2024-09-22T08:48:50.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.804+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=KOM0CARC2HX0 type=write size=401824 2024-09-22T08:48:50.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.807+0000 7f7b8ef90780 1 < canceled operation key=YXIZJPACZZFY tag=1G3FD9J1QZ1W type=del size=1540633 2024-09-22T08:48:50.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.809+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~32FV0BFLBBPQ.0 size=1048576 2024-09-22T08:48:50.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.810+0000 7f7b8ef90780 1 > prepared part key=_multipart_7ZS8G8H6I957.2~32FV0BFLBBPQ.1 size=402734 2024-09-22T08:48:50.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.810+0000 7f7b8ef90780 1 > prepared multipart upload key=7ZS8G8H6I957 upload=32FV0BFLBBPQ tag=STV0ESPY2G9R type=write size=2499886 2024-09-22T08:48:50.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.811+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=CAXK687V95SM type=del 2024-09-22T08:48:50.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.813+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=7O4796Q1ZOLS type=del size=2730297 2024-09-22T08:48:50.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.816+0000 7f7b8ef90780 1 < suggested remove operation key=VAO9MXRFGXFY tag=5EWLEDGBV0KV type=del 2024-09-22T08:48:50.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.817+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=3AWSK9ISGVYQ type=del size=3834269 2024-09-22T08:48:50.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.819+0000 7f7b8ef90780 1 < suggested remove operation key=YDJLMBL7EQWN tag=62KJNEEO230D type=del 2024-09-22T08:48:50.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.822+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~HT87PU8A3VBX.0 size=840011 2024-09-22T08:48:50.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.822+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=HT87PU8A3VBX tag=KBZ2K6D63BU6 type=write size=1888587 2024-09-22T08:48:50.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.823+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=0P6KYDSCSO7U type=del 2024-09-22T08:48:50.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.825+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.0 size=1048576 2024-09-22T08:48:50.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.826+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.1 size=1048576 2024-09-22T08:48:50.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.827+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.2 size=972524 2024-09-22T08:48:50.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.827+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=TAI2O40VDORS tag=TPUXIZGR1H69 type=write size=4118252 2024-09-22T08:48:50.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.829+0000 7f7b8ef90780 1 < canceled operation key=IEZKK9YIIF33 tag=850RF4EAA91A type=del size=3741250 2024-09-22T08:48:50.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.831+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~TK0C4W9LO0Y4.0 size=1048576 2024-09-22T08:48:50.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.832+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~TK0C4W9LO0Y4.1 size=774302 2024-09-22T08:48:50.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.832+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=TK0C4W9LO0Y4 tag=B5LUKADWZBHJ type=write size=2871454 2024-09-22T08:48:50.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.833+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=HC2CG7TVA43E type=del 2024-09-22T08:48:50.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.835+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=N4GMRI6UUF66 type=write size=408290 2024-09-22T08:48:50.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.836+0000 7f7b8ef90780 1 < completed delete operation key=ORON3U0WY2K5 tag=M70AJ80A6TF3 type=del 2024-09-22T08:48:50.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.837+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=Y5OV0RESUPO7 type=write size=309752 2024-09-22T08:48:50.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.839+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=L4GP5N9N0NPQ type=write size=234684 2024-09-22T08:48:50.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.840+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=UTFIRRH1U7V0 type=del size=2011180 2024-09-22T08:48:50.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.842+0000 7f7b8ef90780 1 < suggested remove operation key=O81X7IWXN4VP tag=0MM7N86XBWH6 type=del 2024-09-22T08:48:50.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.844+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=0IVZ8JWO0D71 type=write size=465391 2024-09-22T08:48:50.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.846+0000 7f7b8ef90780 1 < suggested remove operation key=IRFUEK82X28U tag=SHHESHFFPIDV type=del 2024-09-22T08:48:50.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.848+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=AOZMEU72N15E type=del size=2278347 2024-09-22T08:48:50.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.849+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=DSRKK9W16CSX type=del 2024-09-22T08:48:50.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.850+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=A7VZ9G4A9HMW type=del size=2946418 2024-09-22T08:48:50.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.852+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=NCG7JM6PI95B type=del 2024-09-22T08:48:50.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.853+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=2L2YSZG8JMXF type=del size=1610749 2024-09-22T08:48:50.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.854+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.0 size=1048576 2024-09-22T08:48:50.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.855+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.1 size=1048576 2024-09-22T08:48:50.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.856+0000 7f7b8ef90780 1 < completed part key=_multipart_F3IHQ6Z9V1DX.2~1WDL135CE1BS.2 size=203072 2024-09-22T08:48:50.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.858+0000 7f7b8ef90780 1 < completed multipart upload key=F3IHQ6Z9V1DX upload=1WDL135CE1BS tag=MDYH24NAGNXA type=write size=3348800 2024-09-22T08:48:50.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.859+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=LULZLCIXXCER type=del size=597954 2024-09-22T08:48:50.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.861+0000 7f7b8ef90780 1 < completed write operation key=PODNY4NH4A9W tag=8F1RSYJA2SES type=write size=46095 2024-09-22T08:48:50.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.863+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0CSCC1UK2BGJ.0 size=1048576 2024-09-22T08:48:50.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.864+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~0CSCC1UK2BGJ.1 size=8205 2024-09-22T08:48:50.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.864+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=0CSCC1UK2BGJ tag=ZF8WCTYLOCSQ type=write size=2105357 2024-09-22T08:48:50.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.865+0000 7f7b8ef90780 1 < completed write operation key=ORON3U0WY2K5 tag=KOM0CARC2HX0 type=write size=401824 2024-09-22T08:48:50.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.866+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=WHX2IVBVMK02 type=write size=886818 2024-09-22T08:48:50.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.868+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~32FV0BFLBBPQ.0 size=1048576 2024-09-22T08:48:50.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.869+0000 7f7b8ef90780 1 < completed part key=_multipart_7ZS8G8H6I957.2~32FV0BFLBBPQ.1 size=402734 2024-09-22T08:48:50.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.871+0000 7f7b8ef90780 1 < completed multipart upload key=7ZS8G8H6I957 upload=32FV0BFLBBPQ tag=STV0ESPY2G9R type=write size=2499886 2024-09-22T08:48:50.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.872+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=GRDV7NHU63MM type=del size=2874676 2024-09-22T08:48:50.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.873+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=7O4796Q1ZOLS type=del 2024-09-22T08:48:50.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.875+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=A9AYAN0NQ5VG type=write size=812600 2024-09-22T08:48:50.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.876+0000 7f7b8ef90780 1 < completed delete operation key=F3IHQ6Z9V1DX tag=3AWSK9ISGVYQ type=del 2024-09-22T08:48:50.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.878+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~DVDJUA3FE13K.0 size=1048576 2024-09-22T08:48:50.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.879+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~DVDJUA3FE13K.1 size=741399 2024-09-22T08:48:50.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.879+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=DVDJUA3FE13K tag=JHR0C3KUTUKK type=write size=2838551 2024-09-22T08:48:50.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.880+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~HT87PU8A3VBX.0 size=840011 2024-09-22T08:48:50.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.883+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=HT87PU8A3VBX tag=KBZ2K6D63BU6 type=write size=1888587 2024-09-22T08:48:50.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.884+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=7T1EW2I9W4FI type=del size=3187694 2024-09-22T08:48:50.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.885+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.0 size=1048576 2024-09-22T08:48:50.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.886+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.1 size=1048576 2024-09-22T08:48:50.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.887+0000 7f7b8ef90780 1 < completed part key=_multipart_PODNY4NH4A9W.2~TAI2O40VDORS.2 size=972524 2024-09-22T08:48:50.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.889+0000 7f7b8ef90780 1 < completed multipart upload key=PODNY4NH4A9W upload=TAI2O40VDORS tag=TPUXIZGR1H69 type=write size=4118252 2024-09-22T08:48:50.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.890+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=55HIFJBX35PL type=del size=890245 2024-09-22T08:48:50.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.892+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~TK0C4W9LO0Y4.0 size=1048576 2024-09-22T08:48:50.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.893+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~TK0C4W9LO0Y4.1 size=774302 2024-09-22T08:48:50.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.895+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=TK0C4W9LO0Y4 tag=B5LUKADWZBHJ type=write size=2871454 2024-09-22T08:48:50.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.897+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TFN9MC3JJG47.0 size=54168 2024-09-22T08:48:50.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.897+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=TFN9MC3JJG47 tag=DXRIDH9QVEYT type=write size=1102744 2024-09-22T08:48:50.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.900+0000 7f7b8ef90780 1 < suggested update operation key=70WNR3KVU0BG tag=N4GMRI6UUF66 type=write size=408290 2024-09-22T08:48:50.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.901+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=OQ003VCRSCOI type=del size=1733264 2024-09-22T08:48:50.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.903+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=Y5OV0RESUPO7 type=write size=309752 2024-09-22T08:48:50.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.905+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.0 size=1048576 2024-09-22T08:48:50.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.906+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.1 size=1048576 2024-09-22T08:48:50.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.907+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.2 size=86666 2024-09-22T08:48:50.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.907+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=S1PKBUK3LP85 tag=9EMO5C15PN4H type=write size=3232394 2024-09-22T08:48:50.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.909+0000 7f7b8ef90780 1 < suggested remove operation key=YDJLMBL7EQWN tag=UTFIRRH1U7V0 type=del 2024-09-22T08:48:50.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.911+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=L8J6NGWMS6NR type=del size=3195511 2024-09-22T08:48:50.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.912+0000 7f7b8ef90780 -1 < failed to complete operation key=70WNR3KVU0BG tag=0IVZ8JWO0D71 type=write size=465391: (22) Invalid argument 2024-09-22T08:48:50.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.914+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~X8ZQ47EHPNXP.0 size=258358 2024-09-22T08:48:50.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.914+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=X8ZQ47EHPNXP tag=8G5IPBYOBSDT type=write size=1306934 2024-09-22T08:48:50.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.916+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=AOZMEU72N15E type=del 2024-09-22T08:48:50.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.917+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=T14BZ5KNZ29T type=del size=293445 2024-09-22T08:48:50.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.918+0000 7f7b8ef90780 1 < completed delete operation key=IRFUEK82X28U tag=A7VZ9G4A9HMW type=del 2024-09-22T08:48:50.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.921+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.0 size=1048576 2024-09-22T08:48:50.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.922+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.1 size=1048576 2024-09-22T08:48:50.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.923+0000 7f7b8ef90780 1 > prepared part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.2 size=981150 2024-09-22T08:48:50.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.923+0000 7f7b8ef90780 1 > prepared multipart upload key=O81X7IWXN4VP upload=OK0K3VSHX90A tag=VCK4VTAK9E81 type=write size=4126878 2024-09-22T08:48:50.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.924+0000 7f7b8ef90780 1 < completed delete operation key=YF94C9GVRXQP tag=2L2YSZG8JMXF type=del 2024-09-22T08:48:50.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.925+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=YORXCFOKF7PL type=write size=778904 2024-09-22T08:48:50.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.928+0000 7f7b8ef90780 1 < canceled operation key=X9TWX0Z54MOO tag=LULZLCIXXCER type=del size=597954 2024-09-22T08:48:50.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.929+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=T8U8U25RCTP0 type=write size=391969 2024-09-22T08:48:50.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.930+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0CSCC1UK2BGJ.0 size=1048576 2024-09-22T08:48:50.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.931+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~0CSCC1UK2BGJ.1 size=8205 2024-09-22T08:48:50.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.933+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=0CSCC1UK2BGJ tag=ZF8WCTYLOCSQ type=write size=2105357 2024-09-22T08:48:50.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.935+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=YKAZAD5PJMAG type=del size=860618 2024-09-22T08:48:50.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.936+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=WHX2IVBVMK02 type=write size=886818 2024-09-22T08:48:50.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.938+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.0 size=1048576 2024-09-22T08:48:50.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.939+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.1 size=1048576 2024-09-22T08:48:50.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.940+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.2 size=275639 2024-09-22T08:48:50.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.940+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=TEC4V4BTGC6E tag=WQ5IBQRQ0JDO type=write size=3421367 2024-09-22T08:48:50.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.942+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=GRDV7NHU63MM type=del 2024-09-22T08:48:50.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.943+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=TE2ON5ZPDV2O type=del size=3249860 2024-09-22T08:48:50.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.945+0000 7f7b8ef90780 1 < canceled operation key=GBNPVRO0JPF7 tag=A9AYAN0NQ5VG type=write size=812600 2024-09-22T08:48:50.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.946+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=ILEPMZPLLFQU type=write size=637321 2024-09-22T08:48:50.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.948+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~DVDJUA3FE13K.0 size=1048576 2024-09-22T08:48:50.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.949+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~DVDJUA3FE13K.1 size=741399 2024-09-22T08:48:50.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.952+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=DVDJUA3FE13K tag=JHR0C3KUTUKK type=write size=2838551 2024-09-22T08:48:50.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.953+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=142JHJ79IGOJ type=del size=334322 2024-09-22T08:48:50.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.955+0000 7f7b8ef90780 1 < canceled operation key=9DO6M6UQ5A05 tag=7T1EW2I9W4FI type=del size=3187694 2024-09-22T08:48:50.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.957+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~0WGEVJ9B3Q2Z.0 size=1048576 2024-09-22T08:48:50.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.958+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~0WGEVJ9B3Q2Z.1 size=582794 2024-09-22T08:48:50.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.958+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=0WGEVJ9B3Q2Z tag=28O0ANF78RKA type=write size=2679946 2024-09-22T08:48:50.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.960+0000 7f7b8ef90780 -1 < failed to complete operation key=YDJLMBL7EQWN tag=55HIFJBX35PL type=del size=890245: (22) Invalid argument 2024-09-22T08:48:50.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.963+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~JR0D8R2O2DGX.0 size=137481 2024-09-22T08:48:50.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.963+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=JR0D8R2O2DGX tag=HH4IMEKGP1GC type=write size=1186057 2024-09-22T08:48:50.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.964+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~TFN9MC3JJG47.0 size=54168 2024-09-22T08:48:50.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.966+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=TFN9MC3JJG47 tag=DXRIDH9QVEYT type=write size=1102744 2024-09-22T08:48:50.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.967+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=C8484XQT0DOB type=del size=1574705 2024-09-22T08:48:50.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.968+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=OQ003VCRSCOI type=del 2024-09-22T08:48:50.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.970+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~0MNFP2S7QS6J.0 size=1048576 2024-09-22T08:48:50.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.971+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~0MNFP2S7QS6J.1 size=873538 2024-09-22T08:48:50.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.971+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=0MNFP2S7QS6J tag=SJ1NB3IUYQO5 type=write size=2970690 2024-09-22T08:48:50.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.973+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.0 size=1048576 2024-09-22T08:48:50.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.974+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.1 size=1048576 2024-09-22T08:48:50.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.975+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~S1PKBUK3LP85.2 size=86666 2024-09-22T08:48:50.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.977+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=S1PKBUK3LP85 tag=9EMO5C15PN4H type=write size=3232394 2024-09-22T08:48:50.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.978+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=T5IZ5J16YLIG type=del size=691348 2024-09-22T08:48:50.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.979+0000 7f7b8ef90780 1 < completed delete operation key=Y7W0V6YTDFIB tag=L8J6NGWMS6NR type=del 2024-09-22T08:48:50.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.981+0000 7f7b8ef90780 1 > prepared part key=_multipart_PODNY4NH4A9W.2~7EFC67R07YI8.0 size=84030 2024-09-22T08:48:50.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.981+0000 7f7b8ef90780 1 > prepared multipart upload key=PODNY4NH4A9W upload=7EFC67R07YI8 tag=R2YSC08OCRIJ type=write size=1132606 2024-09-22T08:48:50.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.983+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~X8ZQ47EHPNXP.0 size=258358 2024-09-22T08:48:50.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.985+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=X8ZQ47EHPNXP tag=8G5IPBYOBSDT type=write size=1306934 2024-09-22T08:48:50.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.986+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=4COK29C2Q4L4 type=write size=580239 2024-09-22T08:48:50.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.987+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=T14BZ5KNZ29T type=del 2024-09-22T08:48:50.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.988+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=85RQFGHG7C25 type=del size=382295 2024-09-22T08:48:50.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.990+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.0 size=1048576 2024-09-22T08:48:50.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.991+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.1 size=1048576 2024-09-22T08:48:50.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.992+0000 7f7b8ef90780 1 < completed part key=_multipart_O81X7IWXN4VP.2~OK0K3VSHX90A.2 size=981150 2024-09-22T08:48:50.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.994+0000 7f7b8ef90780 1 < completed multipart upload key=O81X7IWXN4VP upload=OK0K3VSHX90A tag=VCK4VTAK9E81 type=write size=4126878 2024-09-22T08:48:50.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.995+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=QIARM3I5MXQ3 type=del size=986061 2024-09-22T08:48:50.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.996+0000 7f7b8ef90780 1 < completed write operation key=6DC0SVAYR2DB tag=YORXCFOKF7PL type=write size=778904 2024-09-22T08:48:50.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.997+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=HO32V5WFPAZB type=write size=393153 2024-09-22T08:48:51.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:50.999+0000 7f7b8ef90780 1 < completed write operation key=YXIZJPACZZFY tag=T8U8U25RCTP0 type=write size=391969 2024-09-22T08:48:51.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.000+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=O93OSGC1SILB type=del size=2381077 2024-09-22T08:48:51.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.001+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=YKAZAD5PJMAG type=del 2024-09-22T08:48:51.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.002+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=ULH5CJXZ6TSA type=del size=1705832 2024-09-22T08:48:51.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.003+0000 7f7b8ef90780 1 < canceled part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.0 size=1048576 2024-09-22T08:48:51.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.004+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.1 size=1048576 2024-09-22T08:48:51.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.004+0000 7f7b8ef90780 1 < canceled part key=_multipart_WDGY8YL16UWI.2~TEC4V4BTGC6E.2 size=275639 2024-09-22T08:48:51.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.006+0000 7f7b8ef90780 1 < canceled multipart upload key=WDGY8YL16UWI upload=TEC4V4BTGC6E tag=WQ5IBQRQ0JDO type=write size=3421367 2024-09-22T08:48:51.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.008+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~2CGKPVMVKA7Q.0 size=1048576 2024-09-22T08:48:51.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.009+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~2CGKPVMVKA7Q.1 size=564155 2024-09-22T08:48:51.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.009+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=2CGKPVMVKA7Q tag=PHER32ERDIV6 type=write size=2661307 2024-09-22T08:48:51.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.012+0000 7f7b8ef90780 1 < suggested remove operation key=ORON3U0WY2K5 tag=TE2ON5ZPDV2O type=del 2024-09-22T08:48:51.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.013+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=9AAZGQ237LR6 type=write size=870614 2024-09-22T08:48:51.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.015+0000 7f7b8ef90780 -1 < failed to complete operation key=ORON3U0WY2K5 tag=ILEPMZPLLFQU type=write size=637321: (22) Invalid argument 2024-09-22T08:48:51.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.018+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~FUYH29O7LEMI.0 size=957864 2024-09-22T08:48:51.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.018+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=FUYH29O7LEMI tag=H34HJWQRX4LP type=write size=2006440 2024-09-22T08:48:51.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.019+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=142JHJ79IGOJ type=del 2024-09-22T08:48:51.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.021+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.0 size=1048576 2024-09-22T08:48:51.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.023+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.1 size=1048576 2024-09-22T08:48:51.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.024+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.2 size=1035873 2024-09-22T08:48:51.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.024+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=EPAKGWBVWI8J tag=YZANL897IXZV type=write size=4181601 2024-09-22T08:48:51.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.025+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~0WGEVJ9B3Q2Z.0 size=1048576 2024-09-22T08:48:51.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.026+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~0WGEVJ9B3Q2Z.1 size=582794 2024-09-22T08:48:51.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.028+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=0WGEVJ9B3Q2Z tag=28O0ANF78RKA type=write size=2679946 2024-09-22T08:48:51.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.031+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.0 size=1048576 2024-09-22T08:48:51.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.033+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.1 size=1048576 2024-09-22T08:48:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.034+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.2 size=1016121 2024-09-22T08:48:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.034+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=7JMQ43EWMGWC tag=E1COYPWK7U03 type=write size=4161849 2024-09-22T08:48:51.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.035+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~JR0D8R2O2DGX.0 size=137481 2024-09-22T08:48:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.037+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=JR0D8R2O2DGX tag=HH4IMEKGP1GC type=write size=1186057 2024-09-22T08:48:51.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.040+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~SAHZ7ISRPEBK.0 size=781088 2024-09-22T08:48:51.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.040+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=SAHZ7ISRPEBK tag=7TX3N0YL6Z85 type=write size=1829664 2024-09-22T08:48:51.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.041+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=C8484XQT0DOB type=del 2024-09-22T08:48:51.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.043+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=WW5GD8ZH89D8 type=del size=306067 2024-09-22T08:48:51.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.043+0000 7f7b8ef90780 1 < canceled part key=_multipart_G51KS3NM4VFY.2~0MNFP2S7QS6J.0 size=1048576 2024-09-22T08:48:51.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.044+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~0MNFP2S7QS6J.1 size=873538 2024-09-22T08:48:51.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.046+0000 7f7b8ef90780 1 < canceled multipart upload key=G51KS3NM4VFY upload=0MNFP2S7QS6J tag=SJ1NB3IUYQO5 type=write size=2970690 2024-09-22T08:48:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.048+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=0A258OS8AWCQ type=del size=3673922 2024-09-22T08:48:51.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.049+0000 7f7b8ef90780 1 < canceled operation key=ZM6ITJ2QUIPJ tag=T5IZ5J16YLIG type=del size=691348 2024-09-22T08:48:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.053+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~6C8051Q5F1HB.0 size=316431 2024-09-22T08:48:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.053+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=6C8051Q5F1HB tag=CJPIN3FO0HHQ type=write size=1365007 2024-09-22T08:48:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.053+0000 7f7b8ef90780 1 < canceled part key=_multipart_PODNY4NH4A9W.2~7EFC67R07YI8.0 size=84030 2024-09-22T08:48:51.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.055+0000 7f7b8ef90780 1 < canceled multipart upload key=PODNY4NH4A9W upload=7EFC67R07YI8 tag=R2YSC08OCRIJ type=write size=1132606 2024-09-22T08:48:51.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.057+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=SHILGA4DRUZ9 type=del size=23379 2024-09-22T08:48:51.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.058+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=4COK29C2Q4L4 type=write size=580239 2024-09-22T08:48:51.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.061+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~G0I5PH3AZHBQ.0 size=44671 2024-09-22T08:48:51.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.061+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=G0I5PH3AZHBQ tag=KLIX1LFHRGRY type=write size=1093247 2024-09-22T08:48:51.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.064+0000 7f7b8ef90780 1 < suggested update operation key=4ZJ4E4SUA01H tag=85RQFGHG7C25 type=del size=382295 2024-09-22T08:48:51.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.065+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=BED5AEOIWEYN type=del size=1294120 2024-09-22T08:48:51.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.066+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=QIARM3I5MXQ3 type=del 2024-09-22T08:48:51.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.067+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=GY89JP2EHCEY type=del size=1221686 2024-09-22T08:48:51.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.069+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=HO32V5WFPAZB type=write size=393153 2024-09-22T08:48:51.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.070+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=HF2TVIDB9049 type=del size=1426772 2024-09-22T08:48:51.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.071+0000 7f7b8ef90780 1 < canceled operation key=IRFUEK82X28U tag=O93OSGC1SILB type=del size=2381077 2024-09-22T08:48:51.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.074+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~B264KMP9QNH5.0 size=1048576 2024-09-22T08:48:51.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.075+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~B264KMP9QNH5.1 size=1043702 2024-09-22T08:48:51.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.075+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=B264KMP9QNH5 tag=X4GY3AJEA3D6 type=write size=3140854 2024-09-22T08:48:51.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.075+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=ORON3U0WY2K5 tag=ULH5CJXZ6TSA type=del size=1705832: (2) No such file or directory 2024-09-22T08:48:51.078 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.078+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~C7X9FZ5JOELF.0 size=55661 2024-09-22T08:48:51.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.078+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=C7X9FZ5JOELF tag=Z81V2UIZ1MR3 type=write size=1104237 2024-09-22T08:48:51.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.079+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~2CGKPVMVKA7Q.0 size=1048576 2024-09-22T08:48:51.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.080+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~2CGKPVMVKA7Q.1 size=564155 2024-09-22T08:48:51.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.082+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=2CGKPVMVKA7Q tag=PHER32ERDIV6 type=write size=2661307 2024-09-22T08:48:51.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.083+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=OTJZ95OZPUH0 type=del size=254396 2024-09-22T08:48:51.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.085+0000 7f7b8ef90780 1 < completed write operation key=R0N30XP1BXY3 tag=9AAZGQ237LR6 type=write size=870614 2024-09-22T08:48:51.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.087+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.0 size=1048576 2024-09-22T08:48:51.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.088+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.1 size=1048576 2024-09-22T08:48:51.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.089+0000 7f7b8ef90780 1 > prepared part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.2 size=457969 2024-09-22T08:48:51.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.089+0000 7f7b8ef90780 1 > prepared multipart upload key=R0N30XP1BXY3 upload=B0IWKYQOVYOF tag=WHEH3P36LM2A type=write size=3603697 2024-09-22T08:48:51.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.091+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~FUYH29O7LEMI.0 size=957864 2024-09-22T08:48:51.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.093+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=FUYH29O7LEMI tag=H34HJWQRX4LP type=write size=2006440 2024-09-22T08:48:51.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.095+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~SWJ6F25D2HJ0.0 size=736806 2024-09-22T08:48:51.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.095+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=SWJ6F25D2HJ0 tag=9T2IN31JAA1I type=write size=1785382 2024-09-22T08:48:51.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.097+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.0 size=1048576 2024-09-22T08:48:51.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.098+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.1 size=1048576 2024-09-22T08:48:51.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.099+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~EPAKGWBVWI8J.2 size=1035873 2024-09-22T08:48:51.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.101+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=EPAKGWBVWI8J tag=YZANL897IXZV type=write size=4181601 2024-09-22T08:48:51.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.102+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=0QTZYYJNQSRH type=del size=1321098 2024-09-22T08:48:51.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.104+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.0 size=1048576 2024-09-22T08:48:51.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.105+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.1 size=1048576 2024-09-22T08:48:51.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.106+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~7JMQ43EWMGWC.2 size=1016121 2024-09-22T08:48:51.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.108+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=7JMQ43EWMGWC tag=E1COYPWK7U03 type=write size=4161849 2024-09-22T08:48:51.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.109+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=TD7ZZ6X9AU19 type=write size=676957 2024-09-22T08:48:51.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.110+0000 7f7b8ef90780 1 < completed part key=_multipart_IRFUEK82X28U.2~SAHZ7ISRPEBK.0 size=781088 2024-09-22T08:48:51.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.112+0000 7f7b8ef90780 1 < completed multipart upload key=IRFUEK82X28U upload=SAHZ7ISRPEBK tag=7TX3N0YL6Z85 type=write size=1829664 2024-09-22T08:48:51.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.114+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=S12XPDJEE01H type=del size=561954 2024-09-22T08:48:51.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.115+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=WW5GD8ZH89D8 type=del 2024-09-22T08:48:51.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.116+0000 7f7b8ef90780 1 > prepared operation key=Y7W0V6YTDFIB tag=1EZPR6YRA4T6 type=del size=460112 2024-09-22T08:48:51.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.119+0000 7f7b8ef90780 1 < suggested update operation key=T43DW9JPG1BU tag=0A258OS8AWCQ type=del size=3673922 2024-09-22T08:48:51.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.120+0000 7f7b8ef90780 1 > prepared operation key=QH6TK0MJKYUO tag=ST61WXKIX5JS type=del size=1643641 2024-09-22T08:48:51.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.121+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~6C8051Q5F1HB.0 size=316431 2024-09-22T08:48:51.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.124+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=6C8051Q5F1HB tag=CJPIN3FO0HHQ type=write size=1365007 2024-09-22T08:48:51.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.125+0000 7f7b8ef90780 1 > prepared operation key=1U6T2BIZS72V tag=8BLRBTDUQ9E9 type=del size=845819 2024-09-22T08:48:51.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.126+0000 7f7b8ef90780 1 < completed delete operation key=4J4EGI19N123 tag=SHILGA4DRUZ9 type=del 2024-09-22T08:48:51.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.127+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=SZ3RGRPXRGMB type=del size=2574270 2024-09-22T08:48:51.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.129+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~G0I5PH3AZHBQ.0 size=44671 2024-09-22T08:48:51.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.131+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=G0I5PH3AZHBQ tag=KLIX1LFHRGRY type=write size=1093247 2024-09-22T08:48:51.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.132+0000 7f7b8ef90780 1 > prepared operation key=4J4EGI19N123 tag=XGPCLBIWRED2 type=del size=3597783 2024-09-22T08:48:51.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.133+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=BED5AEOIWEYN type=del 2024-09-22T08:48:51.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.135+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=5NEHQ33RE6Q2 type=write size=461090 2024-09-22T08:48:51.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.136+0000 7f7b8ef90780 1 < canceled operation key=PODNY4NH4A9W tag=GY89JP2EHCEY type=del size=1221686 2024-09-22T08:48:51.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.137+0000 7f7b8ef90780 1 > prepared operation key=ORON3U0WY2K5 tag=XZUREV88OZ4K type=del size=1281798 2024-09-22T08:48:51.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.140+0000 7f7b8ef90780 1 < suggested remove operation key=IRFUEK82X28U tag=HF2TVIDB9049 type=del 2024-09-22T08:48:51.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.141+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=CGZFY1GAOZF8 type=del size=2961238 2024-09-22T08:48:51.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.143+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~B264KMP9QNH5.0 size=1048576 2024-09-22T08:48:51.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.144+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~B264KMP9QNH5.1 size=1043702 2024-09-22T08:48:51.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.146+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=B264KMP9QNH5 tag=X4GY3AJEA3D6 type=write size=3140854 2024-09-22T08:48:51.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.148+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=KUX62G2DOGIA type=write size=80231 2024-09-22T08:48:51.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.150+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~C7X9FZ5JOELF.0 size=55661 2024-09-22T08:48:51.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.152+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=C7X9FZ5JOELF tag=Z81V2UIZ1MR3 type=write size=1104237 2024-09-22T08:48:51.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.154+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=31E0JR9ML1ZG type=del size=262704 2024-09-22T08:48:51.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.155+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=OTJZ95OZPUH0 type=del 2024-09-22T08:48:51.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.158+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~1XB3WW2RK31Q.0 size=1048576 2024-09-22T08:48:51.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.159+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~1XB3WW2RK31Q.1 size=494289 2024-09-22T08:48:51.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.159+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=1XB3WW2RK31Q tag=QU6KQQH8MW72 type=write size=2591441 2024-09-22T08:48:51.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.160+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.0 size=1048576 2024-09-22T08:48:51.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.161+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.1 size=1048576 2024-09-22T08:48:51.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.163+0000 7f7b8ef90780 1 < completed part key=_multipart_R0N30XP1BXY3.2~B0IWKYQOVYOF.2 size=457969 2024-09-22T08:48:51.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.165+0000 7f7b8ef90780 1 < completed multipart upload key=R0N30XP1BXY3 upload=B0IWKYQOVYOF tag=WHEH3P36LM2A type=write size=3603697 2024-09-22T08:48:51.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.168+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.0 size=1048576 2024-09-22T08:48:51.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.169+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.1 size=1048576 2024-09-22T08:48:51.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.171+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.2 size=262217 2024-09-22T08:48:51.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.171+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=H1MSU5MYML2D tag=301EPUCFTSEM type=write size=3407945 2024-09-22T08:48:51.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.172+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~SWJ6F25D2HJ0.0 size=736806 2024-09-22T08:48:51.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.175+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=SWJ6F25D2HJ0 tag=9T2IN31JAA1I type=write size=1785382 2024-09-22T08:48:51.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.176+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=RUS7FVZF3AI6 type=del size=444992 2024-09-22T08:48:51.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.179+0000 7f7b8ef90780 1 < completed delete operation key=1U6T2BIZS72V tag=0QTZYYJNQSRH type=del 2024-09-22T08:48:51.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.181+0000 7f7b8ef90780 1 > prepared part key=_multipart_T43DW9JPG1BU.2~RZFHJVXJS3R4.0 size=738813 2024-09-22T08:48:51.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.181+0000 7f7b8ef90780 1 > prepared multipart upload key=T43DW9JPG1BU upload=RZFHJVXJS3R4 tag=O34PEJT63N7K type=write size=1787389 2024-09-22T08:48:51.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.184+0000 7f7b8ef90780 1 < suggested remove operation key=R0N30XP1BXY3 tag=TD7ZZ6X9AU19 type=write 2024-09-22T08:48:51.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.185+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=NKWO2PBMTPIR type=del size=269829 2024-09-22T08:48:51.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.188+0000 7f7b8ef90780 1 < suggested update operation key=YF94C9GVRXQP tag=S12XPDJEE01H type=del size=561954 2024-09-22T08:48:51.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.190+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.0 size=1048576 2024-09-22T08:48:51.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.191+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.1 size=1048576 2024-09-22T08:48:51.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.192+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.2 size=53415 2024-09-22T08:48:51.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.192+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=9WB2DE1CSG51 tag=VUZZ7RDT8WX3 type=write size=3199143 2024-09-22T08:48:51.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.194+0000 7f7b8ef90780 1 < suggested remove operation key=Y7W0V6YTDFIB tag=1EZPR6YRA4T6 type=del 2024-09-22T08:48:51.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.196+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.0 size=1048576 2024-09-22T08:48:51.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.198+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.1 size=1048576 2024-09-22T08:48:51.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.198+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.2 size=995076 2024-09-22T08:48:51.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.198+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=QR7MF31NUMSR tag=ENDJ27MWDQLU type=write size=4140804 2024-09-22T08:48:51.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.201+0000 7f7b8ef90780 1 < suggested remove operation key=QH6TK0MJKYUO tag=ST61WXKIX5JS type=del 2024-09-22T08:48:51.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.202+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=MC1W4BWW7RKP type=del size=2426244 2024-09-22T08:48:51.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.204+0000 7f7b8ef90780 1 < suggested remove operation key=1U6T2BIZS72V tag=8BLRBTDUQ9E9 type=del 2024-09-22T08:48:51.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.206+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=EJ91N75EQ5C7 type=del size=1965840 2024-09-22T08:48:51.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.207+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=SZ3RGRPXRGMB type=del 2024-09-22T08:48:51.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.209+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~K624LTGX7RA8.0 size=1048576 2024-09-22T08:48:51.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.210+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~K624LTGX7RA8.1 size=824181 2024-09-22T08:48:51.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.210+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=K624LTGX7RA8 tag=I0EVKV8GACZR type=write size=2921333 2024-09-22T08:48:51.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.212+0000 7f7b8ef90780 1 < suggested remove operation key=4J4EGI19N123 tag=XGPCLBIWRED2 type=del 2024-09-22T08:48:51.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.214+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=JWKHXV2VYLJM type=del size=3878600 2024-09-22T08:48:51.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.215+0000 7f7b8ef90780 1 < completed write operation key=VAO9MXRFGXFY tag=5NEHQ33RE6Q2 type=write size=461090 2024-09-22T08:48:51.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.217+0000 7f7b8ef90780 1 > prepared part key=_multipart_YF94C9GVRXQP.2~FEILEHVR2RQ9.0 size=1008824 2024-09-22T08:48:51.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.217+0000 7f7b8ef90780 1 > prepared multipart upload key=YF94C9GVRXQP upload=FEILEHVR2RQ9 tag=PJ3MEERUXQ2A type=write size=2057400 2024-09-22T08:48:51.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.220+0000 7f7b8ef90780 1 < suggested update operation key=ORON3U0WY2K5 tag=XZUREV88OZ4K type=del size=1281798 2024-09-22T08:48:51.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.221+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=FALQIW71003I type=del size=3300324 2024-09-22T08:48:51.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.222+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=CGZFY1GAOZF8 type=del 2024-09-22T08:48:51.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.224+0000 7f7b8ef90780 1 > prepared operation key=O81X7IWXN4VP tag=0HI8MNGU6YOU type=del size=3722904 2024-09-22T08:48:51.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.225+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=KUX62G2DOGIA type=write size=80231 2024-09-22T08:48:51.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.228+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~NWWTKFJ29P5B.0 size=209599 2024-09-22T08:48:51.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.228+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=NWWTKFJ29P5B tag=YX0AP351R0ES type=write size=1258175 2024-09-22T08:48:51.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.229+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=31E0JR9ML1ZG type=del size=262704: (22) Invalid argument 2024-09-22T08:48:51.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.230+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=ODGDR5117GFH type=write size=660064 2024-09-22T08:48:51.233 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.232+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~1XB3WW2RK31Q.0 size=1048576 2024-09-22T08:48:51.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.233+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~1XB3WW2RK31Q.1 size=494289 2024-09-22T08:48:51.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.235+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=1XB3WW2RK31Q tag=QU6KQQH8MW72 type=write size=2591441 2024-09-22T08:48:51.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.237+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.0 size=1048576 2024-09-22T08:48:51.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.238+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.1 size=1048576 2024-09-22T08:48:51.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.239+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.2 size=664533 2024-09-22T08:48:51.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.239+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=GMZ3SP60M9LW tag=9MXN6OML36D2 type=write size=3810261 2024-09-22T08:48:51.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.241+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.0 size=1048576 2024-09-22T08:48:51.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.242+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.1 size=1048576 2024-09-22T08:48:51.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.243+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~H1MSU5MYML2D.2 size=262217 2024-09-22T08:48:51.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.245+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=H1MSU5MYML2D tag=301EPUCFTSEM type=write size=3407945 2024-09-22T08:48:51.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.246+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=W257O8R09FZQ type=del size=1556768 2024-09-22T08:48:51.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.247+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=RUS7FVZF3AI6 type=del size=444992: (22) Invalid argument 2024-09-22T08:48:51.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.248+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=SGRXDHYAHI2G type=del size=1694724 2024-09-22T08:48:51.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.250+0000 7f7b8ef90780 1 < completed part key=_multipart_T43DW9JPG1BU.2~RZFHJVXJS3R4.0 size=738813 2024-09-22T08:48:51.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.252+0000 7f7b8ef90780 1 < completed multipart upload key=T43DW9JPG1BU upload=RZFHJVXJS3R4 tag=O34PEJT63N7K type=write size=1787389 2024-09-22T08:48:51.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.254+0000 7f7b8ef90780 1 > prepared part key=_multipart_WDGY8YL16UWI.2~HHREYML6HU4T.0 size=99003 2024-09-22T08:48:51.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.254+0000 7f7b8ef90780 1 > prepared multipart upload key=WDGY8YL16UWI upload=HHREYML6HU4T tag=69L5U6LA8V30 type=write size=1147579 2024-09-22T08:48:51.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.255+0000 7f7b8ef90780 1 < completed delete operation key=Z9CHXCJ02L85 tag=NKWO2PBMTPIR type=del 2024-09-22T08:48:51.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.257+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=GQUMGE97EJYP type=del size=3814459 2024-09-22T08:48:51.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.257+0000 7f7b8ef90780 1 < canceled part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.0 size=1048576 2024-09-22T08:48:51.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.258+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.1 size=1048576 2024-09-22T08:48:51.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.259+0000 7f7b8ef90780 1 < completed part key=_multipart_L1URDVW43BUG.2~9WB2DE1CSG51.2 size=53415 2024-09-22T08:48:51.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.261+0000 7f7b8ef90780 1 < canceled multipart upload key=L1URDVW43BUG upload=9WB2DE1CSG51 tag=VUZZ7RDT8WX3 type=write size=3199143 2024-09-22T08:48:51.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.263+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.0 size=1048576 2024-09-22T08:48:51.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.264+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.1 size=1048576 2024-09-22T08:48:51.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.265+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.2 size=748325 2024-09-22T08:48:51.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.265+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=53REMUVS2KOD tag=S2NMSNTE3I6B type=write size=3894053 2024-09-22T08:48:51.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.266+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.0 size=1048576 2024-09-22T08:48:51.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.267+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.1 size=1048576 2024-09-22T08:48:51.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.268+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~QR7MF31NUMSR.2 size=995076 2024-09-22T08:48:51.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.271+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=QR7MF31NUMSR tag=ENDJ27MWDQLU type=write size=4140804 2024-09-22T08:48:51.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.272+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=D4SCFSK8F6KQ type=del size=167928 2024-09-22T08:48:51.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.273+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=MC1W4BWW7RKP type=del 2024-09-22T08:48:51.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.274+0000 7f7b8ef90780 1 > prepared operation key=QQKJ4URBRF16 tag=J6Y7U499XP2V type=del size=2288876 2024-09-22T08:48:51.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.276+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=EJ91N75EQ5C7 type=del 2024-09-22T08:48:51.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.277+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=HRB61HRFXQGC type=del size=4163387 2024-09-22T08:48:51.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.278+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~K624LTGX7RA8.0 size=1048576 2024-09-22T08:48:51.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.279+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~K624LTGX7RA8.1 size=824181 2024-09-22T08:48:51.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.282+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=K624LTGX7RA8 tag=I0EVKV8GACZR type=write size=2921333 2024-09-22T08:48:51.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.283+0000 7f7b8ef90780 1 > prepared operation key=R0N30XP1BXY3 tag=R5IC1XLQRFH8 type=del size=2829834 2024-09-22T08:48:51.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.285+0000 7f7b8ef90780 1 < suggested remove operation key=R0N30XP1BXY3 tag=JWKHXV2VYLJM type=del 2024-09-22T08:48:51.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.287+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=2CWP7652H7QP type=del size=3452079 2024-09-22T08:48:51.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.288+0000 7f7b8ef90780 1 < completed part key=_multipart_YF94C9GVRXQP.2~FEILEHVR2RQ9.0 size=1008824 2024-09-22T08:48:51.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.290+0000 7f7b8ef90780 1 < completed multipart upload key=YF94C9GVRXQP upload=FEILEHVR2RQ9 tag=PJ3MEERUXQ2A type=write size=2057400 2024-09-22T08:48:51.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.291+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=AIA29T79TGAS type=del size=202958 2024-09-22T08:48:51.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.293+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=FALQIW71003I type=del 2024-09-22T08:48:51.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.295+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.0 size=1048576 2024-09-22T08:48:51.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.297+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.1 size=1048576 2024-09-22T08:48:51.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.298+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.2 size=891622 2024-09-22T08:48:51.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.298+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=5LQS6XJQU1ME tag=8Y4WNYUKGUW7 type=write size=4037350 2024-09-22T08:48:51.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.299+0000 7f7b8ef90780 1 < completed delete operation key=O81X7IWXN4VP tag=0HI8MNGU6YOU type=del 2024-09-22T08:48:51.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.301+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~FCQ73XRAA0OO.0 size=375771 2024-09-22T08:48:51.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.301+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=FCQ73XRAA0OO tag=CJE1NOMKH0LN type=write size=1424347 2024-09-22T08:48:51.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.303+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~NWWTKFJ29P5B.0 size=209599 2024-09-22T08:48:51.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.305+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=NWWTKFJ29P5B tag=YX0AP351R0ES type=write size=1258175 2024-09-22T08:48:51.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.306+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=UDUX1I428LTN type=write size=853287 2024-09-22T08:48:51.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.307+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=ODGDR5117GFH type=write size=660064 2024-09-22T08:48:51.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.309+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~YXUZ1UR79GCG.0 size=710328 2024-09-22T08:48:51.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.309+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=YXUZ1UR79GCG tag=LRWX4DFH02HZ type=write size=1758904 2024-09-22T08:48:51.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.311+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.0 size=1048576 2024-09-22T08:48:51.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.312+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.1 size=1048576 2024-09-22T08:48:51.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.313+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~GMZ3SP60M9LW.2 size=664533 2024-09-22T08:48:51.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.315+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=GMZ3SP60M9LW tag=9MXN6OML36D2 type=write size=3810261 2024-09-22T08:48:51.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.316+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=F19CXQWUM5II type=del size=2664878 2024-09-22T08:48:51.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.318+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=W257O8R09FZQ type=del size=1556768: (22) Invalid argument 2024-09-22T08:48:51.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.320+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~NR489Z26245X.0 size=454466 2024-09-22T08:48:51.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.320+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=NR489Z26245X tag=OWHGU3JSTZKG type=write size=1503042 2024-09-22T08:48:51.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.321+0000 7f7b8ef90780 1 < canceled operation key=G51KS3NM4VFY tag=SGRXDHYAHI2G type=del size=1694724 2024-09-22T08:48:51.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.322+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=ZB2GE498SEG7 type=del size=2386431 2024-09-22T08:48:51.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.324+0000 7f7b8ef90780 1 < completed part key=_multipart_WDGY8YL16UWI.2~HHREYML6HU4T.0 size=99003 2024-09-22T08:48:51.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.326+0000 7f7b8ef90780 1 < completed multipart upload key=WDGY8YL16UWI upload=HHREYML6HU4T tag=69L5U6LA8V30 type=write size=1147579 2024-09-22T08:48:51.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.327+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=S40YF8YKA6PY type=del size=982867 2024-09-22T08:48:51.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.328+0000 7f7b8ef90780 1 < completed delete operation key=UQPY2ITDMKGO tag=GQUMGE97EJYP type=del 2024-09-22T08:48:51.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.331+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.0 size=1048576 2024-09-22T08:48:51.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.332+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.1 size=1048576 2024-09-22T08:48:51.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.332+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.2 size=726431 2024-09-22T08:48:51.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.332+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=NCQF03VQCP16 tag=ASMZOS7RMYUC type=write size=3872159 2024-09-22T08:48:51.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.334+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.0 size=1048576 2024-09-22T08:48:51.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.335+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.1 size=1048576 2024-09-22T08:48:51.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.336+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~53REMUVS2KOD.2 size=748325 2024-09-22T08:48:51.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.338+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=53REMUVS2KOD tag=S2NMSNTE3I6B type=write size=3894053 2024-09-22T08:48:51.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.339+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=FQHI6E1C3YYR type=del size=734902 2024-09-22T08:48:51.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.340+0000 7f7b8ef90780 1 < canceled operation key=VAO9MXRFGXFY tag=D4SCFSK8F6KQ type=del size=167928 2024-09-22T08:48:51.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.341+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=4S0DBZEOW9VC type=del size=1286573 2024-09-22T08:48:51.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.342+0000 7f7b8ef90780 1 < completed delete operation key=QQKJ4URBRF16 tag=J6Y7U499XP2V type=del 2024-09-22T08:48:51.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.344+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=R04192OW3OVI type=del size=1919018 2024-09-22T08:48:51.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.345+0000 7f7b8ef90780 -1 < failed to complete operation key=R0N30XP1BXY3 tag=HRB61HRFXQGC type=del size=4163387: (22) Invalid argument 2024-09-22T08:48:51.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.346+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=I07TAWNH696R type=write size=217565 2024-09-22T08:48:51.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.346+0000 7f7b8ef90780 -1 < no bi entry to suggest for operation key=R0N30XP1BXY3 tag=R5IC1XLQRFH8 type=del size=2829834: (2) No such file or directory 2024-09-22T08:48:51.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.349+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~316BQ7FHKFUQ.0 size=1048576 2024-09-22T08:48:51.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.350+0000 7f7b8ef90780 1 > prepared part key=_multipart_4ZJ4E4SUA01H.2~316BQ7FHKFUQ.1 size=548238 2024-09-22T08:48:51.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.350+0000 7f7b8ef90780 1 > prepared multipart upload key=4ZJ4E4SUA01H upload=316BQ7FHKFUQ tag=M9Q5X2NFJKQX type=write size=2645390 2024-09-22T08:48:51.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.351+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=2CWP7652H7QP type=del 2024-09-22T08:48:51.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.352+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=GE92ZYIDTPKP type=del size=398924 2024-09-22T08:48:51.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.353+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=AIA29T79TGAS type=del 2024-09-22T08:48:51.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.355+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=N0CFBDEBRD7O type=write size=892853 2024-09-22T08:48:51.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.356+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.0 size=1048576 2024-09-22T08:48:51.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.357+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.1 size=1048576 2024-09-22T08:48:51.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.358+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~5LQS6XJQU1ME.2 size=891622 2024-09-22T08:48:51.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.360+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=5LQS6XJQU1ME tag=8Y4WNYUKGUW7 type=write size=4037350 2024-09-22T08:48:51.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.361+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=L63HHPHRHNAC type=del size=105927 2024-09-22T08:48:51.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.362+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~FCQ73XRAA0OO.0 size=375771 2024-09-22T08:48:51.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.364+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=FCQ73XRAA0OO tag=CJE1NOMKH0LN type=write size=1424347 2024-09-22T08:48:51.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.366+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=T8A76XLX5AE0 type=del size=3395382 2024-09-22T08:48:51.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.367+0000 7f7b8ef90780 1 < canceled operation key=4ZJ4E4SUA01H tag=UDUX1I428LTN type=write size=853287 2024-09-22T08:48:51.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.368+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=92KX0FN3CRNG type=del size=3968353 2024-09-22T08:48:51.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.369+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~YXUZ1UR79GCG.0 size=710328 2024-09-22T08:48:51.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.372+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=YXUZ1UR79GCG tag=LRWX4DFH02HZ type=write size=1758904 2024-09-22T08:48:51.375 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.374+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~1EAB0U46ENCE.0 size=1048576 2024-09-22T08:48:51.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.375+0000 7f7b8ef90780 1 > prepared part key=_multipart_RX3H0G6WHB9L.2~1EAB0U46ENCE.1 size=161524 2024-09-22T08:48:51.376 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.375+0000 7f7b8ef90780 1 > prepared multipart upload key=RX3H0G6WHB9L upload=1EAB0U46ENCE tag=1Q3VQJO81CTO type=write size=2258676 2024-09-22T08:48:51.378 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.377+0000 7f7b8ef90780 1 < canceled operation key=Z9CHXCJ02L85 tag=F19CXQWUM5II type=del size=2664878 2024-09-22T08:48:51.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.378+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=IS60D2M4CI8G type=del size=872450 2024-09-22T08:48:51.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.379+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~NR489Z26245X.0 size=454466 2024-09-22T08:48:51.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.382+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=NR489Z26245X tag=OWHGU3JSTZKG type=write size=1503042 2024-09-22T08:48:51.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.383+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=74ONIRDYP2I7 type=del size=350893 2024-09-22T08:48:51.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.384+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=ZB2GE498SEG7 type=del 2024-09-22T08:48:51.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.387+0000 7f7b8ef90780 1 > prepared part key=_multipart_VAO9MXRFGXFY.2~YR1L5W92CXGH.0 size=395607 2024-09-22T08:48:51.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.387+0000 7f7b8ef90780 1 > prepared multipart upload key=VAO9MXRFGXFY upload=YR1L5W92CXGH tag=OJ9LU5Q82NH6 type=write size=1444183 2024-09-22T08:48:51.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.388+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=S40YF8YKA6PY type=del 2024-09-22T08:48:51.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.391+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.0 size=1048576 2024-09-22T08:48:51.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.392+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.1 size=1048576 2024-09-22T08:48:51.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.393+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.2 size=559755 2024-09-22T08:48:51.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.393+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=XWUCN08Y2SNO tag=D89M4WLZTP6C type=write size=3705483 2024-09-22T08:48:51.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.394+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.0 size=1048576 2024-09-22T08:48:51.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.395+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.1 size=1048576 2024-09-22T08:48:51.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.397+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~NCQF03VQCP16.2 size=726431 2024-09-22T08:48:51.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.399+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=NCQF03VQCP16 tag=ASMZOS7RMYUC type=write size=3872159 2024-09-22T08:48:51.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.400+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=BY0AKC0RPUEW type=write size=42620 2024-09-22T08:48:51.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.402+0000 7f7b8ef90780 1 < completed delete operation key=PODNY4NH4A9W tag=FQHI6E1C3YYR type=del 2024-09-22T08:48:51.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.403+0000 7f7b8ef90780 1 > prepared operation key=WDGY8YL16UWI tag=FZ8QEFEE851I type=del size=3778185 2024-09-22T08:48:51.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.404+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=4S0DBZEOW9VC type=del 2024-09-22T08:48:51.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.406+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=NKU2U7W3YF7G type=del size=3422238 2024-09-22T08:48:51.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.407+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=R04192OW3OVI type=del 2024-09-22T08:48:51.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.409+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~GMB7AZ1PXA6O.0 size=1048576 2024-09-22T08:48:51.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.410+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~GMB7AZ1PXA6O.1 size=524531 2024-09-22T08:48:51.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.411+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=GMB7AZ1PXA6O tag=3RUQAISDJIDW type=write size=2621683 2024-09-22T08:48:51.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.412+0000 7f7b8ef90780 1 < completed write operation key=PODNY4NH4A9W tag=I07TAWNH696R type=write size=217565 2024-09-22T08:48:51.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.414+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~NXIJN84DIAJ3.0 size=1048576 2024-09-22T08:48:51.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.416+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~NXIJN84DIAJ3.1 size=259623 2024-09-22T08:48:51.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.416+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=NXIJN84DIAJ3 tag=S10I99CFLAYN type=write size=2356775 2024-09-22T08:48:51.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.418+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~316BQ7FHKFUQ.0 size=1048576 2024-09-22T08:48:51.420 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.419+0000 7f7b8ef90780 1 < completed part key=_multipart_4ZJ4E4SUA01H.2~316BQ7FHKFUQ.1 size=548238 2024-09-22T08:48:51.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.421+0000 7f7b8ef90780 1 < completed multipart upload key=4ZJ4E4SUA01H upload=316BQ7FHKFUQ tag=M9Q5X2NFJKQX type=write size=2645390 2024-09-22T08:48:51.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.423+0000 7f7b8ef90780 1 > prepared part key=_multipart_QQKJ4URBRF16.2~RNNY2L03JLN7.0 size=405488 2024-09-22T08:48:51.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.423+0000 7f7b8ef90780 1 > prepared multipart upload key=QQKJ4URBRF16 upload=RNNY2L03JLN7 tag=B52CCZF8KP1K type=write size=1454064 2024-09-22T08:48:51.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.426+0000 7f7b8ef90780 1 < suggested update operation key=Z9CHXCJ02L85 tag=GE92ZYIDTPKP type=del size=398924 2024-09-22T08:48:51.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.427+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=9DVPOA50BE1G type=del size=2964174 2024-09-22T08:48:51.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.428+0000 7f7b8ef90780 1 < completed write operation key=GBNPVRO0JPF7 tag=N0CFBDEBRD7O type=write size=892853 2024-09-22T08:48:51.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.430+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~ZANNK79TP4JS.0 size=1048576 2024-09-22T08:48:51.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.431+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~ZANNK79TP4JS.1 size=630313 2024-09-22T08:48:51.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.431+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=ZANNK79TP4JS tag=3S51Q77N97GW type=write size=2727465 2024-09-22T08:48:51.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.433+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=L63HHPHRHNAC type=del 2024-09-22T08:48:51.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.434+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=8DL0C1GPT5KZ type=del size=1407890 2024-09-22T08:48:51.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.435+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=T8A76XLX5AE0 type=del size=3395382: (22) Invalid argument 2024-09-22T08:48:51.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.438+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~U8X0Q6GSW0CM.0 size=349171 2024-09-22T08:48:51.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.438+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=U8X0Q6GSW0CM tag=A3WVBL2TEJLM type=write size=1397747 2024-09-22T08:48:51.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.439+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=92KX0FN3CRNG type=del 2024-09-22T08:48:51.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.440+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=C1RNO2NE43BY type=write size=346255 2024-09-22T08:48:51.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.441+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~1EAB0U46ENCE.0 size=1048576 2024-09-22T08:48:51.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.443+0000 7f7b8ef90780 1 < completed part key=_multipart_RX3H0G6WHB9L.2~1EAB0U46ENCE.1 size=161524 2024-09-22T08:48:51.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.445+0000 7f7b8ef90780 1 < completed multipart upload key=RX3H0G6WHB9L upload=1EAB0U46ENCE tag=1Q3VQJO81CTO type=write size=2258676 2024-09-22T08:48:51.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.446+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=3TY6DNPJ0AX7 type=del size=3514318 2024-09-22T08:48:51.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.447+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=IS60D2M4CI8G type=del 2024-09-22T08:48:51.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.448+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=Q1JIHK6W75HI type=del size=3712526 2024-09-22T08:48:51.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.450+0000 7f7b8ef90780 -1 < failed to complete operation key=Z9CHXCJ02L85 tag=74ONIRDYP2I7 type=del size=350893: (22) Invalid argument 2024-09-22T08:48:51.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.451+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=YWX6S3UZPPBM type=del size=3138299 2024-09-22T08:48:51.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.452+0000 7f7b8ef90780 1 < completed part key=_multipart_VAO9MXRFGXFY.2~YR1L5W92CXGH.0 size=395607 2024-09-22T08:48:51.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.454+0000 7f7b8ef90780 1 < completed multipart upload key=VAO9MXRFGXFY upload=YR1L5W92CXGH tag=OJ9LU5Q82NH6 type=write size=1444183 2024-09-22T08:48:51.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.456+0000 7f7b8ef90780 1 > prepared operation key=IRFUEK82X28U tag=PYATIXGOIFDH type=write size=896286 2024-09-22T08:48:51.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.457+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.0 size=1048576 2024-09-22T08:48:51.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.458+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.1 size=1048576 2024-09-22T08:48:51.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.458+0000 7f7b8ef90780 1 < canceled part key=_multipart_Y7W0V6YTDFIB.2~XWUCN08Y2SNO.2 size=559755 2024-09-22T08:48:51.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.460+0000 7f7b8ef90780 1 < canceled multipart upload key=Y7W0V6YTDFIB upload=XWUCN08Y2SNO tag=D89M4WLZTP6C type=write size=3705483 2024-09-22T08:48:51.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.461+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=F072HXPTRJ4F type=del size=3243760 2024-09-22T08:48:51.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.462+0000 7f7b8ef90780 1 < completed write operation key=YDJLMBL7EQWN tag=BY0AKC0RPUEW type=write size=42620 2024-09-22T08:48:51.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.464+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=OT98R2PYDHDE type=del size=2042827 2024-09-22T08:48:51.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.465+0000 7f7b8ef90780 1 < completed delete operation key=WDGY8YL16UWI tag=FZ8QEFEE851I type=del 2024-09-22T08:48:51.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.466+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=FDU2D5PG3074 type=del size=4002899 2024-09-22T08:48:51.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.467+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=NKU2U7W3YF7G type=del 2024-09-22T08:48:51.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.469+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=Y8F7KPG9BP10 type=del size=3955774 2024-09-22T08:48:51.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.470+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~GMB7AZ1PXA6O.0 size=1048576 2024-09-22T08:48:51.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.471+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~GMB7AZ1PXA6O.1 size=524531 2024-09-22T08:48:51.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.473+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=GMB7AZ1PXA6O tag=3RUQAISDJIDW type=write size=2621683 2024-09-22T08:48:51.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.474+0000 7f7b8ef90780 1 > prepared operation key=PODNY4NH4A9W tag=H0LD7EVVEFDW type=del size=1147253 2024-09-22T08:48:51.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.475+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~NXIJN84DIAJ3.0 size=1048576 2024-09-22T08:48:51.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.476+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~NXIJN84DIAJ3.1 size=259623 2024-09-22T08:48:51.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.478+0000 7f7b8ef90780 1 < completed multipart upload key=6DC0SVAYR2DB upload=NXIJN84DIAJ3 tag=S10I99CFLAYN type=write size=2356775 2024-09-22T08:48:51.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.480+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.0 size=1048576 2024-09-22T08:48:51.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.481+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.1 size=1048576 2024-09-22T08:48:51.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.482+0000 7f7b8ef90780 1 > prepared part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.2 size=153726 2024-09-22T08:48:51.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.482+0000 7f7b8ef90780 1 > prepared multipart upload key=6DC0SVAYR2DB upload=9V830R46VXU4 tag=CJK464NMI7KE type=write size=3299454 2024-09-22T08:48:51.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.484+0000 7f7b8ef90780 1 < completed part key=_multipart_QQKJ4URBRF16.2~RNNY2L03JLN7.0 size=405488 2024-09-22T08:48:51.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.486+0000 7f7b8ef90780 1 < completed multipart upload key=QQKJ4URBRF16 upload=RNNY2L03JLN7 tag=B52CCZF8KP1K type=write size=1454064 2024-09-22T08:48:51.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.488+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~ZD0FNVKOV9YM.0 size=276337 2024-09-22T08:48:51.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.488+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=ZD0FNVKOV9YM tag=V95YVBFAQDEZ type=write size=1324913 2024-09-22T08:48:51.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.489+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=9DVPOA50BE1G type=del 2024-09-22T08:48:51.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.491+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=I49THU37HKES type=del size=3593500 2024-09-22T08:48:51.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.492+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~ZANNK79TP4JS.0 size=1048576 2024-09-22T08:48:51.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.493+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~ZANNK79TP4JS.1 size=630313 2024-09-22T08:48:51.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.495+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=ZANNK79TP4JS tag=3S51Q77N97GW type=write size=2727465 2024-09-22T08:48:51.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.498+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.0 size=1048576 2024-09-22T08:48:51.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.499+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.1 size=1048576 2024-09-22T08:48:51.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.500+0000 7f7b8ef90780 1 > prepared part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.2 size=434704 2024-09-22T08:48:51.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.500+0000 7f7b8ef90780 1 > prepared multipart upload key=Z9CHXCJ02L85 upload=XGOJ57ZNS8OU tag=JRXVN11E13H3 type=write size=3580432 2024-09-22T08:48:51.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.502+0000 7f7b8ef90780 1 < suggested update operation key=IRFUEK82X28U tag=8DL0C1GPT5KZ type=del size=1407890 2024-09-22T08:48:51.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.504+0000 7f7b8ef90780 1 > prepared operation key=T43DW9JPG1BU tag=IVVWV0PUPDG7 type=del size=130608 2024-09-22T08:48:51.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.505+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~U8X0Q6GSW0CM.0 size=349171 2024-09-22T08:48:51.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.508+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=U8X0Q6GSW0CM tag=A3WVBL2TEJLM type=write size=1397747 2024-09-22T08:48:51.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.510+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~YOA1ZEYT7SK9.0 size=1048576 2024-09-22T08:48:51.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.511+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~YOA1ZEYT7SK9.1 size=279275 2024-09-22T08:48:51.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.511+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=YOA1ZEYT7SK9 tag=IWPCTFR2PDNU type=write size=2376427 2024-09-22T08:48:51.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.513+0000 7f7b8ef90780 1 < completed write operation key=IEZKK9YIIF33 tag=C1RNO2NE43BY type=write size=346255 2024-09-22T08:48:51.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.514+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=SFGFSJV4E00T type=del size=1835469 2024-09-22T08:48:51.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.515+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=3TY6DNPJ0AX7 type=del 2024-09-22T08:48:51.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.518+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~FL1H11BLS478.0 size=1048576 2024-09-22T08:48:51.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.519+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~FL1H11BLS478.1 size=10152 2024-09-22T08:48:51.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.519+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=FL1H11BLS478 tag=7NBN14YB8VR9 type=write size=2107304 2024-09-22T08:48:51.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.521+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=Q1JIHK6W75HI type=del 2024-09-22T08:48:51.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.522+0000 7f7b8ef90780 1 > prepared operation key=L1URDVW43BUG tag=9IF00JGAO2Z8 type=write size=607565 2024-09-22T08:48:51.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.523+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=YWX6S3UZPPBM type=del 2024-09-22T08:48:51.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.526+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~N2V1KD6ISCWS.0 size=1048576 2024-09-22T08:48:51.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.527+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~N2V1KD6ISCWS.1 size=455070 2024-09-22T08:48:51.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.527+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=N2V1KD6ISCWS tag=5ZN0AB4BDT8C type=write size=2552222 2024-09-22T08:48:51.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.528+0000 7f7b8ef90780 -1 < failed to complete operation key=IRFUEK82X28U tag=PYATIXGOIFDH type=write size=896286: (22) Invalid argument 2024-09-22T08:48:51.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.529+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=ZS1MTD3LZ4LB type=del size=3426691 2024-09-22T08:48:51.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.532+0000 7f7b8ef90780 1 < suggested remove operation key=RX3H0G6WHB9L tag=F072HXPTRJ4F type=del 2024-09-22T08:48:51.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.533+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=E3SBXUVTJAAY type=write size=315443 2024-09-22T08:48:51.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.535+0000 7f7b8ef90780 1 < completed delete operation key=X9TWX0Z54MOO tag=OT98R2PYDHDE type=del 2024-09-22T08:48:51.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.538+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=2X33QW8258FY type=del size=636963 2024-09-22T08:48:51.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.539+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=FDU2D5PG3074 type=del 2024-09-22T08:48:51.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.540+0000 7f7b8ef90780 1 > prepared operation key=UQPY2ITDMKGO tag=0TBO082ZT4AY type=del size=270655 2024-09-22T08:48:51.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.541+0000 7f7b8ef90780 1 < completed delete operation key=VAO9MXRFGXFY tag=Y8F7KPG9BP10 type=del 2024-09-22T08:48:51.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.544+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~82CSO6Y77QNU.0 size=1048576 2024-09-22T08:48:51.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.545+0000 7f7b8ef90780 1 > prepared part key=_multipart_IEZKK9YIIF33.2~82CSO6Y77QNU.1 size=485368 2024-09-22T08:48:51.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.545+0000 7f7b8ef90780 1 > prepared multipart upload key=IEZKK9YIIF33 upload=82CSO6Y77QNU tag=NGHGQ125MOQK type=write size=2582520 2024-09-22T08:48:51.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.547+0000 7f7b8ef90780 1 < suggested remove operation key=PODNY4NH4A9W tag=H0LD7EVVEFDW type=del 2024-09-22T08:48:51.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.550+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~M71D86Q7OB7A.0 size=1048576 2024-09-22T08:48:51.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.551+0000 7f7b8ef90780 1 > prepared part key=_multipart_G51KS3NM4VFY.2~M71D86Q7OB7A.1 size=493613 2024-09-22T08:48:51.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.551+0000 7f7b8ef90780 1 > prepared multipart upload key=G51KS3NM4VFY upload=M71D86Q7OB7A tag=1H6U9TMPEJ41 type=write size=2590765 2024-09-22T08:48:51.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.552+0000 7f7b8ef90780 1 < completed part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.0 size=1048576 2024-09-22T08:48:51.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.552+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.1 size=1048576 2024-09-22T08:48:51.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.552+0000 7f7b8ef90780 1 < canceled part key=_multipart_6DC0SVAYR2DB.2~9V830R46VXU4.2 size=153726 2024-09-22T08:48:51.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.554+0000 7f7b8ef90780 1 < canceled multipart upload key=6DC0SVAYR2DB upload=9V830R46VXU4 tag=CJK464NMI7KE type=write size=3299454 2024-09-22T08:48:51.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.556+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~UWBC5C4J2YF6.0 size=773830 2024-09-22T08:48:51.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.556+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=UWBC5C4J2YF6 tag=JIQYP3PY8O74 type=write size=1822406 2024-09-22T08:48:51.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.558+0000 7f7b8ef90780 1 < completed part key=_multipart_ORON3U0WY2K5.2~ZD0FNVKOV9YM.0 size=276337 2024-09-22T08:48:51.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.560+0000 7f7b8ef90780 1 < completed multipart upload key=ORON3U0WY2K5 upload=ZD0FNVKOV9YM tag=V95YVBFAQDEZ type=write size=1324913 2024-09-22T08:48:51.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.561+0000 7f7b8ef90780 1 > prepared operation key=L3XF68XD23FP tag=Z3XDJ7LE589W type=del size=1920060 2024-09-22T08:48:51.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.562+0000 7f7b8ef90780 1 < completed delete operation key=L1URDVW43BUG tag=I49THU37HKES type=del 2024-09-22T08:48:51.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.563+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=GEF2GJ5IMW8O type=del size=2769941 2024-09-22T08:48:51.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.564+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.0 size=1048576 2024-09-22T08:48:51.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.565+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.1 size=1048576 2024-09-22T08:48:51.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.566+0000 7f7b8ef90780 1 < completed part key=_multipart_Z9CHXCJ02L85.2~XGOJ57ZNS8OU.2 size=434704 2024-09-22T08:48:51.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.568+0000 7f7b8ef90780 1 < completed multipart upload key=Z9CHXCJ02L85 upload=XGOJ57ZNS8OU tag=JRXVN11E13H3 type=write size=3580432 2024-09-22T08:48:51.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.570+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~XUKMPYP30V3I.0 size=457154 2024-09-22T08:48:51.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.570+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=XUKMPYP30V3I tag=2D4RA8JM07E0 type=write size=1505730 2024-09-22T08:48:51.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.572+0000 7f7b8ef90780 1 < completed delete operation key=T43DW9JPG1BU tag=IVVWV0PUPDG7 type=del 2024-09-22T08:48:51.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.573+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=WAOKJ2XZC97K type=del size=1381409 2024-09-22T08:48:51.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.574+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~YOA1ZEYT7SK9.0 size=1048576 2024-09-22T08:48:51.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.575+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~YOA1ZEYT7SK9.1 size=279275 2024-09-22T08:48:51.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.577+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=YOA1ZEYT7SK9 tag=IWPCTFR2PDNU type=write size=2376427 2024-09-22T08:48:51.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.578+0000 7f7b8ef90780 1 > prepared operation key=YDJLMBL7EQWN tag=T1XFDE129O2P type=del size=921694 2024-09-22T08:48:51.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.581+0000 7f7b8ef90780 1 < suggested update operation key=UQPY2ITDMKGO tag=SFGFSJV4E00T type=del size=1835469 2024-09-22T08:48:51.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.582+0000 7f7b8ef90780 1 > prepared operation key=IEZKK9YIIF33 tag=B0DS8HG91RP1 type=del size=3357249 2024-09-22T08:48:51.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.583+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~FL1H11BLS478.0 size=1048576 2024-09-22T08:48:51.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.584+0000 7f7b8ef90780 1 < completed part key=_multipart_ZM6ITJ2QUIPJ.2~FL1H11BLS478.1 size=10152 2024-09-22T08:48:51.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.586+0000 7f7b8ef90780 1 < completed multipart upload key=ZM6ITJ2QUIPJ upload=FL1H11BLS478 tag=7NBN14YB8VR9 type=write size=2107304 2024-09-22T08:48:51.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.587+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=HB87P0NHGL5R type=del size=3989271 2024-09-22T08:48:51.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.589+0000 7f7b8ef90780 1 < suggested update operation key=L1URDVW43BUG tag=9IF00JGAO2Z8 type=write size=607565 2024-09-22T08:48:51.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.592+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.0 size=1048576 2024-09-22T08:48:51.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.592+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.1 size=1048576 2024-09-22T08:48:51.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.593+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.2 size=150101 2024-09-22T08:48:51.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.593+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=HC3AOJSHO504 tag=J23AP15JPG1I type=write size=3295829 2024-09-22T08:48:51.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.595+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~N2V1KD6ISCWS.0 size=1048576 2024-09-22T08:48:51.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.596+0000 7f7b8ef90780 1 < completed part key=_multipart_YXIZJPACZZFY.2~N2V1KD6ISCWS.1 size=455070 2024-09-22T08:48:51.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.598+0000 7f7b8ef90780 1 < completed multipart upload key=YXIZJPACZZFY upload=N2V1KD6ISCWS tag=5ZN0AB4BDT8C type=write size=2552222 2024-09-22T08:48:51.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.599+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=33ZVB1ABEH7Y type=del size=955029 2024-09-22T08:48:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.600+0000 7f7b8ef90780 1 < completed delete operation key=7ZS8G8H6I957 tag=ZS1MTD3LZ4LB type=del 2024-09-22T08:48:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.602+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=JYBHSAFGZK2Z type=write size=360128 2024-09-22T08:48:51.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.604+0000 7f7b8ef90780 1 < suggested remove operation key=Z9CHXCJ02L85 tag=E3SBXUVTJAAY type=write 2024-09-22T08:48:51.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.606+0000 7f7b8ef90780 1 > prepared part key=_multipart_QH6TK0MJKYUO.2~FMAD4DVW5BV3.0 size=156355 2024-09-22T08:48:51.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.606+0000 7f7b8ef90780 1 > prepared multipart upload key=QH6TK0MJKYUO upload=FMAD4DVW5BV3 tag=2P9TG7H6246M type=write size=1204931 2024-09-22T08:48:51.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.608+0000 7f7b8ef90780 1 < completed delete operation key=RX3H0G6WHB9L tag=2X33QW8258FY type=del 2024-09-22T08:48:51.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.609+0000 7f7b8ef90780 1 > prepared operation key=GBNPVRO0JPF7 tag=ZC6QSIBKV7SN type=del size=3730293 2024-09-22T08:48:51.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.610+0000 7f7b8ef90780 -1 < failed to complete operation key=UQPY2ITDMKGO tag=0TBO082ZT4AY type=del size=270655: (22) Invalid argument 2024-09-22T08:48:51.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.613+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~RQDLJK151QBT.0 size=852206 2024-09-22T08:48:51.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.613+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=RQDLJK151QBT tag=E6V0PA42AJCB type=write size=1900782 2024-09-22T08:48:51.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.614+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~82CSO6Y77QNU.0 size=1048576 2024-09-22T08:48:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.615+0000 7f7b8ef90780 1 < completed part key=_multipart_IEZKK9YIIF33.2~82CSO6Y77QNU.1 size=485368 2024-09-22T08:48:51.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.617+0000 7f7b8ef90780 1 < completed multipart upload key=IEZKK9YIIF33 upload=82CSO6Y77QNU tag=NGHGQ125MOQK type=write size=2582520 2024-09-22T08:48:51.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.619+0000 7f7b8ef90780 1 > prepared operation key=4ZJ4E4SUA01H tag=F4Z4X5T5YLD9 type=del size=2266399 2024-09-22T08:48:51.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.620+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~M71D86Q7OB7A.0 size=1048576 2024-09-22T08:48:51.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.621+0000 7f7b8ef90780 1 < completed part key=_multipart_G51KS3NM4VFY.2~M71D86Q7OB7A.1 size=493613 2024-09-22T08:48:51.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.623+0000 7f7b8ef90780 1 < completed multipart upload key=G51KS3NM4VFY upload=M71D86Q7OB7A tag=1H6U9TMPEJ41 type=write size=2590765 2024-09-22T08:48:51.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.625+0000 7f7b8ef90780 1 > prepared operation key=9DO6M6UQ5A05 tag=A20MDF917TAJ type=del size=4182852 2024-09-22T08:48:51.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.626+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~UWBC5C4J2YF6.0 size=773830 2024-09-22T08:48:51.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.628+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=UWBC5C4J2YF6 tag=JIQYP3PY8O74 type=write size=1822406 2024-09-22T08:48:51.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.629+0000 7f7b8ef90780 1 > prepared operation key=ZM6ITJ2QUIPJ tag=P4G5CDKGEAFQ type=write size=433524 2024-09-22T08:48:51.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.630+0000 7f7b8ef90780 1 < completed delete operation key=L3XF68XD23FP tag=Z3XDJ7LE589W type=del 2024-09-22T08:48:51.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.632+0000 7f7b8ef90780 1 > prepared operation key=X9TWX0Z54MOO tag=Q4T5O2J8B3DE type=write size=749672 2024-09-22T08:48:51.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.634+0000 7f7b8ef90780 1 < suggested update operation key=4ZJ4E4SUA01H tag=GEF2GJ5IMW8O type=del size=2769941 2024-09-22T08:48:51.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.636+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~48DKX726ZBET.0 size=1048576 2024-09-22T08:48:51.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.637+0000 7f7b8ef90780 1 > prepared part key=_multipart_70WNR3KVU0BG.2~48DKX726ZBET.1 size=251998 2024-09-22T08:48:51.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.637+0000 7f7b8ef90780 1 > prepared multipart upload key=70WNR3KVU0BG upload=48DKX726ZBET tag=SKU1MKF26FSJ type=write size=2349150 2024-09-22T08:48:51.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.638+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~XUKMPYP30V3I.0 size=457154 2024-09-22T08:48:51.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.641+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=XUKMPYP30V3I tag=2D4RA8JM07E0 type=write size=1505730 2024-09-22T08:48:51.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.643+0000 7f7b8ef90780 1 > prepared part key=_multipart_YDJLMBL7EQWN.2~6PYXKV560BVL.0 size=504357 2024-09-22T08:48:51.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.643+0000 7f7b8ef90780 1 > prepared multipart upload key=YDJLMBL7EQWN upload=6PYXKV560BVL tag=VK1YN7MMZFEF type=write size=1552933 2024-09-22T08:48:51.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.645+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=WAOKJ2XZC97K type=del 2024-09-22T08:48:51.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.647+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.0 size=1048576 2024-09-22T08:48:51.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.648+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.1 size=1048576 2024-09-22T08:48:51.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.649+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.2 size=624189 2024-09-22T08:48:51.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.649+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=669Z19D2KIQM tag=FFDN2L0RZMYD type=write size=3769917 2024-09-22T08:48:51.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.650+0000 7f7b8ef90780 1 < completed delete operation key=YDJLMBL7EQWN tag=T1XFDE129O2P type=del 2024-09-22T08:48:51.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.654+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.0 size=1048576 2024-09-22T08:48:51.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.655+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.1 size=1048576 2024-09-22T08:48:51.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.656+0000 7f7b8ef90780 1 > prepared part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.2 size=175112 2024-09-22T08:48:51.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.656+0000 7f7b8ef90780 1 > prepared multipart upload key=1U6T2BIZS72V upload=0WE6X5ZNES5Q tag=8QAIRCYR55UR type=write size=3320840 2024-09-22T08:48:51.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.657+0000 7f7b8ef90780 1 < completed delete operation key=IEZKK9YIIF33 tag=B0DS8HG91RP1 type=del 2024-09-22T08:48:51.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.659+0000 7f7b8ef90780 1 > prepared operation key=6DC0SVAYR2DB tag=6EDBLQ8CGSN2 type=del size=72637 2024-09-22T08:48:51.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.660+0000 7f7b8ef90780 1 < completed delete operation key=ZM6ITJ2QUIPJ tag=HB87P0NHGL5R type=del 2024-09-22T08:48:51.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.662+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~147PLVS7U0HK.0 size=1048576 2024-09-22T08:48:51.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.663+0000 7f7b8ef90780 1 > prepared part key=_multipart_4J4EGI19N123.2~147PLVS7U0HK.1 size=147154 2024-09-22T08:48:51.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.663+0000 7f7b8ef90780 1 > prepared multipart upload key=4J4EGI19N123 upload=147PLVS7U0HK tag=XJKTLSHCV7EP type=write size=2244306 2024-09-22T08:48:51.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.664+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.0 size=1048576 2024-09-22T08:48:51.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.665+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.1 size=1048576 2024-09-22T08:48:51.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.665+0000 7f7b8ef90780 1 < canceled part key=_multipart_1U6T2BIZS72V.2~HC3AOJSHO504.2 size=150101 2024-09-22T08:48:51.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.667+0000 7f7b8ef90780 1 < canceled multipart upload key=1U6T2BIZS72V upload=HC3AOJSHO504 tag=J23AP15JPG1I type=write size=3295829 2024-09-22T08:48:51.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.669+0000 7f7b8ef90780 1 > prepared operation key=RX3H0G6WHB9L tag=T7L5R7RBULPQ type=write size=814762 2024-09-22T08:48:51.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.670+0000 7f7b8ef90780 1 < completed delete operation key=G51KS3NM4VFY tag=33ZVB1ABEH7Y type=del 2024-09-22T08:48:51.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.672+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~LDHYN8L43O6Z.0 size=1048576 2024-09-22T08:48:51.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.673+0000 7f7b8ef90780 1 > prepared part key=_multipart_GBNPVRO0JPF7.2~LDHYN8L43O6Z.1 size=291347 2024-09-22T08:48:51.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.673+0000 7f7b8ef90780 1 > prepared multipart upload key=GBNPVRO0JPF7 upload=LDHYN8L43O6Z tag=L6RK9UCUOVJB type=write size=2388499 2024-09-22T08:48:51.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.675+0000 7f7b8ef90780 1 < suggested remove operation key=VAO9MXRFGXFY tag=JYBHSAFGZK2Z type=write 2024-09-22T08:48:51.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.677+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=9YNPV2ABRCWT type=del size=2951419 2024-09-22T08:48:51.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.678+0000 7f7b8ef90780 1 < completed part key=_multipart_QH6TK0MJKYUO.2~FMAD4DVW5BV3.0 size=156355 2024-09-22T08:48:51.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.680+0000 7f7b8ef90780 1 < completed multipart upload key=QH6TK0MJKYUO upload=FMAD4DVW5BV3 tag=2P9TG7H6246M type=write size=1204931 2024-09-22T08:48:51.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.682+0000 7f7b8ef90780 1 > prepared part key=_multipart_9DO6M6UQ5A05.2~UU61NHW11PV9.0 size=270816 2024-09-22T08:48:51.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.682+0000 7f7b8ef90780 1 > prepared multipart upload key=9DO6M6UQ5A05 upload=UU61NHW11PV9 tag=OKAS1UILCKAY type=write size=1319392 2024-09-22T08:48:51.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.683+0000 7f7b8ef90780 1 < completed delete operation key=GBNPVRO0JPF7 tag=ZC6QSIBKV7SN type=del 2024-09-22T08:48:51.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.686+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~Q63JBR5KVCQZ.0 size=1048576 2024-09-22T08:48:51.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.686+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~Q63JBR5KVCQZ.1 size=1048576 2024-09-22T08:48:51.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.687+0000 7f7b8ef90780 1 > prepared part key=_multipart_ORON3U0WY2K5.2~Q63JBR5KVCQZ.2 size=510494 2024-09-22T08:48:51.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.687+0000 7f7b8ef90780 1 > prepared multipart upload key=ORON3U0WY2K5 upload=Q63JBR5KVCQZ tag=Y4VFGHBTUFYQ type=write size=3656222 2024-09-22T08:48:51.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.689+0000 7f7b8ef90780 1 < completed part key=_multipart_Y7W0V6YTDFIB.2~RQDLJK151QBT.0 size=852206 2024-09-22T08:48:51.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.691+0000 7f7b8ef90780 1 < completed multipart upload key=Y7W0V6YTDFIB upload=RQDLJK151QBT tag=E6V0PA42AJCB type=write size=1900782 2024-09-22T08:48:51.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.692+0000 7f7b8ef90780 1 > prepared operation key=G51KS3NM4VFY tag=04R894HD2E9Y type=del size=3457006 2024-09-22T08:48:51.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.693+0000 7f7b8ef90780 -1 < failed to complete operation key=4ZJ4E4SUA01H tag=F4Z4X5T5YLD9 type=del size=2266399: (22) Invalid argument 2024-09-22T08:48:51.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.695+0000 7f7b8ef90780 1 > prepared part key=_multipart_UQPY2ITDMKGO.2~6OZPVMUNN2YR.0 size=865639 2024-09-22T08:48:51.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.695+0000 7f7b8ef90780 1 > prepared multipart upload key=UQPY2ITDMKGO upload=6OZPVMUNN2YR tag=2F1673XB51AU type=write size=1914215 2024-09-22T08:48:51.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.697+0000 7f7b8ef90780 1 < completed delete operation key=9DO6M6UQ5A05 tag=A20MDF917TAJ type=del 2024-09-22T08:48:51.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.699+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~UABDSV6P3FD9.0 size=1048576 2024-09-22T08:48:51.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.700+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~UABDSV6P3FD9.1 size=1048576 2024-09-22T08:48:51.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.701+0000 7f7b8ef90780 1 > prepared part key=_multipart_IRFUEK82X28U.2~UABDSV6P3FD9.2 size=116905 2024-09-22T08:48:51.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.701+0000 7f7b8ef90780 1 > prepared multipart upload key=IRFUEK82X28U upload=UABDSV6P3FD9 tag=Z85B74O5ORAB type=write size=3262633 2024-09-22T08:48:51.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.704+0000 7f7b8ef90780 1 < suggested update operation key=ZM6ITJ2QUIPJ tag=P4G5CDKGEAFQ type=write size=433524 2024-09-22T08:48:51.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.705+0000 7f7b8ef90780 1 > prepared operation key=YXIZJPACZZFY tag=90CZ0PRO6VIX type=write size=661008 2024-09-22T08:48:51.707 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.706+0000 7f7b8ef90780 1 < completed write operation key=X9TWX0Z54MOO tag=Q4T5O2J8B3DE type=write size=749672 2024-09-22T08:48:51.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.708+0000 7f7b8ef90780 1 > prepared operation key=7ZS8G8H6I957 tag=0X1LZ21JB9YV type=del size=4113037 2024-09-22T08:48:51.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.709+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~48DKX726ZBET.0 size=1048576 2024-09-22T08:48:51.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.710+0000 7f7b8ef90780 1 < completed part key=_multipart_70WNR3KVU0BG.2~48DKX726ZBET.1 size=251998 2024-09-22T08:48:51.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.712+0000 7f7b8ef90780 1 < completed multipart upload key=70WNR3KVU0BG upload=48DKX726ZBET tag=SKU1MKF26FSJ type=write size=2349150 2024-09-22T08:48:51.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.713+0000 7f7b8ef90780 1 > prepared operation key=70WNR3KVU0BG tag=ICXVZT9NRKUS type=del size=937114 2024-09-22T08:48:51.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.715+0000 7f7b8ef90780 1 < completed part key=_multipart_YDJLMBL7EQWN.2~6PYXKV560BVL.0 size=504357 2024-09-22T08:48:51.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.717+0000 7f7b8ef90780 1 < completed multipart upload key=YDJLMBL7EQWN upload=6PYXKV560BVL tag=VK1YN7MMZFEF type=write size=1552933 2024-09-22T08:48:51.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.719+0000 7f7b8ef90780 1 > prepared part key=_multipart_YXIZJPACZZFY.2~8YTZSJ5R4TMX.0 size=607403 2024-09-22T08:48:51.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.719+0000 7f7b8ef90780 1 > prepared multipart upload key=YXIZJPACZZFY upload=8YTZSJ5R4TMX tag=35NJXPVBL1NZ type=write size=1655979 2024-09-22T08:48:51.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.721+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.0 size=1048576 2024-09-22T08:48:51.723 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.722+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.1 size=1048576 2024-09-22T08:48:51.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.723+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~669Z19D2KIQM.2 size=624189 2024-09-22T08:48:51.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.725+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=669Z19D2KIQM tag=FFDN2L0RZMYD type=write size=3769917 2024-09-22T08:48:51.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.726+0000 7f7b8ef90780 1 > prepared operation key=F3IHQ6Z9V1DX tag=F1HSTO0CUD3U type=del size=2153774 2024-09-22T08:48:51.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.727+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.0 size=1048576 2024-09-22T08:48:51.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.729+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.1 size=1048576 2024-09-22T08:48:51.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.730+0000 7f7b8ef90780 1 < completed part key=_multipart_1U6T2BIZS72V.2~0WE6X5ZNES5Q.2 size=175112 2024-09-22T08:48:51.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.732+0000 7f7b8ef90780 1 < completed multipart upload key=1U6T2BIZS72V upload=0WE6X5ZNES5Q tag=8QAIRCYR55UR type=write size=3320840 2024-09-22T08:48:51.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.733+0000 7f7b8ef90780 1 > prepared operation key=YF94C9GVRXQP tag=TQP48UHZTLGA type=del size=548325 2024-09-22T08:48:51.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.734+0000 7f7b8ef90780 1 < completed delete operation key=6DC0SVAYR2DB tag=6EDBLQ8CGSN2 type=del 2024-09-22T08:48:51.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.736+0000 7f7b8ef90780 1 > prepared operation key=VAO9MXRFGXFY tag=LYK7J33DJPLP type=del size=1817613 2024-09-22T08:48:51.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.737+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~147PLVS7U0HK.0 size=1048576 2024-09-22T08:48:51.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.738+0000 7f7b8ef90780 1 < completed part key=_multipart_4J4EGI19N123.2~147PLVS7U0HK.1 size=147154 2024-09-22T08:48:51.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.740+0000 7f7b8ef90780 1 < completed multipart upload key=4J4EGI19N123 upload=147PLVS7U0HK tag=XJKTLSHCV7EP type=write size=2244306 2024-09-22T08:48:51.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.743+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~8JE6D33ZH0P4.0 size=1048576 2024-09-22T08:48:51.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.744+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~8JE6D33ZH0P4.1 size=1048576 2024-09-22T08:48:51.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.745+0000 7f7b8ef90780 1 > prepared part key=_multipart_Y7W0V6YTDFIB.2~8JE6D33ZH0P4.2 size=517851 2024-09-22T08:48:51.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.745+0000 7f7b8ef90780 1 > prepared multipart upload key=Y7W0V6YTDFIB upload=8JE6D33ZH0P4 tag=HGDY7QQ3ADRZ type=write size=3663579 2024-09-22T08:48:51.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.746+0000 7f7b8ef90780 1 < completed write operation key=RX3H0G6WHB9L tag=T7L5R7RBULPQ type=write size=814762 2024-09-22T08:48:51.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.749+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~IVVA7R3NX5GS.0 size=1048576 2024-09-22T08:48:51.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.750+0000 7f7b8ef90780 1 > prepared part key=_multipart_F3IHQ6Z9V1DX.2~IVVA7R3NX5GS.1 size=1005714 2024-09-22T08:48:51.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.750+0000 7f7b8ef90780 1 > prepared multipart upload key=F3IHQ6Z9V1DX upload=IVVA7R3NX5GS tag=WRMDUTNSF7ZB type=write size=3102866 2024-09-22T08:48:51.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.751+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~LDHYN8L43O6Z.0 size=1048576 2024-09-22T08:48:51.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.752+0000 7f7b8ef90780 1 < completed part key=_multipart_GBNPVRO0JPF7.2~LDHYN8L43O6Z.1 size=291347 2024-09-22T08:48:51.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.754+0000 7f7b8ef90780 1 < completed multipart upload key=GBNPVRO0JPF7 upload=LDHYN8L43O6Z tag=L6RK9UCUOVJB type=write size=2388499 2024-09-22T08:48:51.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.757+0000 7f7b8ef90780 1 > prepared part key=_multipart_ZM6ITJ2QUIPJ.2~2BCVSND5SGEX.0 size=739948 2024-09-22T08:48:51.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.757+0000 7f7b8ef90780 1 > prepared multipart upload key=ZM6ITJ2QUIPJ upload=2BCVSND5SGEX tag=1B3MC26E738P type=write size=1788524 2024-09-22T08:48:51.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.758+0000 7f7b8ef90780 1 < completed delete operation key=YXIZJPACZZFY tag=9YNPV2ABRCWT type=del 2024-09-22T08:48:51.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.760+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~QQZQSD92E1IX.0 size=1048576 2024-09-22T08:48:51.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.761+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~QQZQSD92E1IX.1 size=1048576 2024-09-22T08:48:51.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.762+0000 7f7b8ef90780 1 > prepared part key=_multipart_L1URDVW43BUG.2~QQZQSD92E1IX.2 size=825268 2024-09-22T08:48:51.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.762+0000 7f7b8ef90780 1 > prepared multipart upload key=L1URDVW43BUG upload=QQZQSD92E1IX tag=XPKZAYX33XAJ type=write size=3970996 2024-09-22T08:48:51.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.764+0000 7f7b8ef90780 1 < completed part key=_multipart_9DO6M6UQ5A05.2~UU61NHW11PV9.0 size=270816 2024-09-22T08:48:51.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.766+0000 7f7b8ef90780 1 < completed multipart upload key=9DO6M6UQ5A05 upload=UU61NHW11PV9 tag=OKAS1UILCKAY type=write size=1319392 2024-09-22T08:48:51.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:48:51.767+0000 7f7b8ef90780 1 > prepared operation key=Z9CHXCJ02L85 tag=F4Y0H2QY2RJO type=del size=3536309 2024-09-22T08:48:51.768 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] cls_rgw_stats.simulate (9517 ms) 2024-09-22T08:48:51.768 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 1 test from cls_rgw_stats (9517 ms total) 2024-09-22T08:48:51.768 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:48:51.768 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:48:52.259 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 1 test from 1 test suite ran. (11932 ms total) 2024-09-22T08:48:52.259 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 1 test. 2024-09-22T08:48:52.262 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:48:52.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:48:52.344 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-22T08:48:52.345 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-22T08:48:52.345 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-22T08:48:52.429 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:48:52.429 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-22T08:48:52.430 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:48:54.295 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 31 tests from CmpOmap 2024-09-22T08:48:54.295 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-22T08:48:54.311 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-22T08:48:54.312 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-22T08:48:54.315 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-22T08:48:54.315 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-22T08:48:54.318 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-22T08:48:54.318 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-22T08:48:54.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-22T08:48:54.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-22T08:48:54.328 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-22T08:48:54.328 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-22T08:48:54.334 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-22T08:48:54.334 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-22T08:48:54.338 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-22T08:48:54.338 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-22T08:48:54.342 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-22T08:48:54.342 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-22T08:48:54.345 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-22T08:48:54.345 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-22T08:48:54.349 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-22T08:48:54.350 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-22T08:48:54.350 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-22T08:48:54.350 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-22T08:48:54.351 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-22T08:48:54.351 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-22T08:48:54.358 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-22T08:48:54.358 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-22T08:48:54.364 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-22T08:48:54.364 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-22T08:48:54.372 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (8 ms) 2024-09-22T08:48:54.372 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-22T08:48:54.379 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-22T08:48:54.380 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-22T08:48:54.387 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-22T08:48:54.387 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-22T08:48:54.396 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-22T08:48:54.396 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-22T08:48:54.399 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-22T08:48:54.399 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-22T08:48:54.401 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-22T08:48:54.402 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-22T08:48:54.402 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-22T08:48:54.403 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-22T08:48:54.403 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-22T08:48:54.403 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-22T08:48:54.410 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-22T08:48:54.410 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-22T08:48:54.416 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-22T08:48:54.416 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-22T08:48:54.425 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-22T08:48:54.425 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-22T08:48:54.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-22T08:48:54.434 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-22T08:48:54.436 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-22T08:48:54.436 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-22T08:48:54.439 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-22T08:48:54.439 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-22T08:48:54.440 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-22T08:48:54.440 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-22T08:48:54.440 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-22T08:48:54.440 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-22T08:48:54.448 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-22T08:48:54.448 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 31 tests from CmpOmap (153 ms total) 2024-09-22T08:48:54.448 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:48:54.448 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:48:55.296 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 31 tests from 1 test suite ran. (2867 ms total) 2024-09-22T08:48:55.296 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 31 tests. 2024-09-22T08:48:55.300 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:48:55.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:48:55.345 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-22T08:48:55.346 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-22T08:48:55.346 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-22T08:48:55.394 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:48:55.394 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:48:55.394 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:48:55.394 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-22T08:48:55.394 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-22T08:48:58.356 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2962 ms) 2024-09-22T08:48:58.356 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-22T08:49:01.396 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3041 ms) 2024-09-22T08:49:01.396 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-22T08:49:04.407 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.Reserve (3010 ms) 2024-09-22T08:49:04.407 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-22T08:49:07.455 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3049 ms) 2024-09-22T08:49:07.455 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-22T08:49:10.461 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.Commit (3006 ms) 2024-09-22T08:49:10.461 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-22T08:49:13.473 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.Stats (3011 ms) 2024-09-22T08:49:13.473 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-22T08:49:17.509 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4036 ms) 2024-09-22T08:49:17.509 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-22T08:49:20.542 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.Abort (3033 ms) 2024-09-22T08:49:20.542 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-22T08:49:23.596 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.ReserveError (3055 ms) 2024-09-22T08:49:23.596 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-22T08:49:26.609 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.CommitError (3012 ms) 2024-09-22T08:49:26.609 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-22T08:49:29.620 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.AbortError (3011 ms) 2024-09-22T08:49:29.620 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-22T08:49:32.641 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3022 ms) 2024-09-22T08:49:32.642 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-22T08:49:35.694 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3052 ms) 2024-09-22T08:49:35.694 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-22T08:49:38.703 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3010 ms) 2024-09-22T08:49:38.703 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-22T08:49:41.730 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3027 ms) 2024-09-22T08:49:41.731 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-22T08:49:44.770 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3040 ms) 2024-09-22T08:49:44.770 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-22T08:49:47.808 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3038 ms) 2024-09-22T08:49:47.808 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-22T08:49:50.843 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.Cleanup (3035 ms) 2024-09-22T08:49:50.844 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-22T08:50:01.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10273 ms) 2024-09-22T08:50:01.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-22T08:50:04.146 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3030 ms) 2024-09-22T08:50:04.147 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-22T08:50:17.224 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13077 ms) 2024-09-22T08:50:17.224 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-22T08:50:21.264 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4041 ms) 2024-09-22T08:50:21.264 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-22T08:50:27.314 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6050 ms) 2024-09-22T08:50:27.314 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5084 ms) 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from TestCls2PCQueue (97005 ms total) 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 24 tests from 1 test suite ran. (97005 ms total) 2024-09-22T08:50:32.399 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 24 tests. 2024-09-22T08:50:32.402 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:50:32.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:50:32.448 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-22T08:50:32.449 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-22T08:50:32.450 DEBUG:teuthology.orchestra.run.smithi039:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-22T08:50:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:50:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:50:32.506 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:50:32.507 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:50:34.426 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from ClsAccount 2024-09-22T08:50:34.426 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsAccount.add 2024-09-22T08:50:34.448 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-22T08:50:34.449 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsAccount.get 2024-09-22T08:50:34.453 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-22T08:50:34.453 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsAccount.rm 2024-09-22T08:50:34.478 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsAccount.rm (25 ms) 2024-09-22T08:50:34.478 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] ClsAccount.list 2024-09-22T08:50:34.496 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] ClsAccount.list (17 ms) 2024-09-22T08:50:34.496 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from ClsAccount (70 ms total) 2024-09-22T08:50:34.496 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:50:34.496 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:50:35.445 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 4 tests from 1 test suite ran. (2939 ms total) 2024-09-22T08:50:35.446 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 4 tests. 2024-09-22T08:50:35.449 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:50:35.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:50:35.497 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-22T08:50:35.499 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-22T08:50:35.499 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-22T08:50:35.555 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:50:35.556 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:50:35.556 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-22T08:50:35.556 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:50:37.462 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 6 tests from rgw_gc_log 2024-09-22T08:50:37.463 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-22T08:50:37.476 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.init_existing_queue (14 ms) 2024-09-22T08:50:37.476 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-22T08:50:37.480 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-22T08:50:37.480 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-22T08:50:37.483 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2024-09-22T08:50:37.483 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-22T08:50:37.485 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-22T08:50:37.485 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-22T08:50:37.488 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-22T08:50:37.488 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-22T08:50:37.490 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-22T08:50:37.490 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 6 tests from rgw_gc_log (28 ms total) 2024-09-22T08:50:37.490 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:50:37.490 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:50:38.460 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 6 tests from 1 test suite ran. (2905 ms total) 2024-09-22T08:50:38.460 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 6 tests. 2024-09-22T08:50:38.464 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:50:38.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:50:38.510 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-22T08:50:38.511 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-22T08:50:38.511 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:Running main() from gmock_main.cc 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from TestRGWObj 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestRGWObj.underscore 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.572 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i= 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i= 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i= 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.573 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.574 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.575 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.576 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.577 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.578 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i= 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i= 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i= 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.579 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.580 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.581 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.582 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.583 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.584 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i=v1 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i=v1 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns= i=v1 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.585 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.586 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.587 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.588 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.589 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.590 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: _obj[v1] 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: _obj ns=ns i=v1 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.591 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.592 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.593 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.594 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.595 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_obj", 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i= 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.596 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i= 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i= 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.597 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.598 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.599 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.600 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.601 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i= 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.602 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i= 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i= 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.603 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.604 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.605 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.606 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.607 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i=v1 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i=v1 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.608 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns= i=v1 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.609 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.610 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.611 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.613 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.614 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.615 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:parsed: obj[v1] 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:stripped: obj ns=ns i=v1 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.616 INFO:tasks.workunit.client.0.smithi039.stdout: "obj1": { 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.617 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "obj2": { 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.618 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3": { 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.619 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "obj3-2": { 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.620 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "obj", 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "v1", 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.621 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.622 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.623 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker_myobj", 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.624 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.625 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.626 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.627 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker_myobj", 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.628 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.629 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.630 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.631 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.632 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.633 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.634 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.635 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.636 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.637 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.638 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.639 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.641 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.643 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.644 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.646 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.648 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.649 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.651 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.653 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.655 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj", 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.656 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.658 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj", 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.660 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.661 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.663 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.664 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.665 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.666 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.667 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.668 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.669 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.670 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.671 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.672 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.673 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.674 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.675 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.676 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.677 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.678 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.679 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.680 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.681 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.682 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.683 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.684 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.685 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.686 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.687 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj_", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.688 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.689 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.690 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.691 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj_", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.692 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.693 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.694 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.695 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.696 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.697 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.698 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.699 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.700 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.701 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.702 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.703 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.704 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.705 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.706 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.707 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.708 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.709 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.710 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.711 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": "default-placement.data", 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "test", 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.712 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": "", 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": "" 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.713 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "obj": { 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.714 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.715 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.716 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.717 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker_myobj", 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.718 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.719 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker_myobj 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker_myobj", 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.720 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker_myobj 2024-09-22T08:50:38.721 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.722 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns_myobj 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.723 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns_myobj", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.724 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.725 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.726 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst_myobj", 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.727 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.728 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.729 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.730 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst_myobj", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.731 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "myobj", 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.732 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.733 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker___myobj 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj", 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.734 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.735 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker___myobj 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.736 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.737 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns__myobj 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj", 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.738 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-22T08:50:38.739 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.740 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.741 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj" 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.742 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:50:38.743 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.744 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj", 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.745 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.746 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj_", 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.747 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker___myobj_ 2024-09-22T08:50:38.748 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker___myobj_", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.749 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker___myobj_ 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.750 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.751 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.752 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns__myobj_", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.753 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "", 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.754 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.755 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__:inst__myobj_", 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "marker__myobj_" 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.756 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.757 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "" 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj": { 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.758 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj": { 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.759 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "raw_obj2": { 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "pool": ".data-pool", 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "loc": "" 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "new_obj2": { 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket": { 2024-09-22T08:50:38.760 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "ebtest", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "marker": "marker", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_id": "bucket-id", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "tenant": "", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "explicit_placement": { 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "data_pool": ".data-pool", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "data_extra_pool": "", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "index_pool": ".index-pool" 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "key": { 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "name": "_myobj_", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "instance": "inst", 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: "ns": "ns" 2024-09-22T08:50:38.761 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-22T08:50:38.762 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 4 tests. 2024-09-22T08:50:38.762 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:50:38.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:50:38.805 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-22T08:50:38.806 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-22T08:50:38.806 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-22T08:50:38.923 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:50:38.923 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:50:38.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.971+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:38.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:38.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 realm 2024-09-22T08:50:38.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.973+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:38.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.974+0000 7fb88753d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:50:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.974+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.975+0000 7fb88753d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:50:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.975+0000 7fb88753d800 20 searching for the correct realm 2024-09-22T08:50:38.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:38.980+0000 7fb883a2b640 0 -- 172.21.15.39:0/70670089 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb87802a070 msgr2=0x7fb878044430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:50:39.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.192+0000 7fb882a29640 0 -- 172.21.15.39:0/70670089 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb87c0943f0 msgr2=0x7fb87c094870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:50:39.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:50:39.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:50:39.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:50:39.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:50:39.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:50:39.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:50:39.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.405+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 zone default found 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 4 Realm: () 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 zonegroup default 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.406+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.407+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.407+0000 7fb88753d800 20 started sync module instance, tier type = 2024-09-22T08:50:39.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.407+0000 7fb88753d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=0 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=1 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=2 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=3 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=4 2024-09-22T08:50:39.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=5 2024-09-22T08:50:39.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.417+0000 7fb88753d800 20 add_watcher() i=6 2024-09-22T08:50:39.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.418+0000 7fb88753d800 20 add_watcher() i=7 2024-09-22T08:50:39.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.418+0000 7fb88753d800 2 all 8 watchers are set, enabling cache 2024-09-22T08:50:39.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.420+0000 7fb739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.420+0000 7fb88753d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.420+0000 7fb88753d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.420+0000 7fb88753d800 5 note: GC not initialized 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb738fe1640 20 reqs_thread_entry: start 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb88753d800 20 init_complete bucket index max shards: 1 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb88753d800 20 Filter name: none 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb6b27fc640 20 reqs_thread_entry: start 2024-09-22T08:50:39.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb88753d800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.421+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache get: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= : miss 2024-09-22T08:50:39.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 20 rados->read ofs=0 len=0 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= info.flags=0x0 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 adding default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= to cache LRU end 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache get: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= : hit (negative entry) 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.422+0000 7fb88753d800 10 cache get: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= : hit (negative entry) 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb88753d800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:50:39.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb88753d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-22T08:50:39.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889409 cookie 94518169206720 notifier 5258 bl.length()=697 2024-09-22T08:50:39.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-22T08:50:39.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.424+0000 7fb766ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-22T08:50:39.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:50:39.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb88753d800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:50:39.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb88753d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-22T08:50:39.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889408 cookie 94518169202528 notifier 5258 bl.length()=194 2024-09-22T08:50:39.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-22T08:50:39.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.427+0000 7fb766ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-22T08:50:39.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb88753d800 10 cache put: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= info.flags=0x7 2024-09-22T08:50:39.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb88753d800 10 moving default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= to cache LRU end 2024-09-22T08:50:39.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb88753d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:YBQvcCacqmYNkRAOai3IOBsGSlY=, ofs0, ns] 2024-09-22T08:50:39.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb7667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889412 cookie 94518169195088 notifier 5258 bl.length()=203 2024-09-22T08:50:39.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb7667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= info.flags=0x7 2024-09-22T08:50:39.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.432+0000 7fb7667fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YBQvcCacqmYNkRAOai3IOBsGSlY= to cache LRU end 2024-09-22T08:50:39.434 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "user_id": "ceph-test-librgw-file", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "display_name": "librgw test user", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "email": "librgw@example.com", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "suspended": 0, 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "max_buckets": 1000, 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "subusers": [], 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "keys": [ 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: { 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "user": "ceph-test-librgw-file", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "access_key": "YBQvcCacqmYNkRAOai3IOBsGSlY=", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "secret_key": "X3E8hQAYspp+DjgQMmJ/aENvSLAZGVNIH975R3AK9Mt+DK058n2vhQ==", 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "active": true, 2024-09-22T08:50:39.435 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:50:39.423510Z" 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: ], 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "swift_keys": [], 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "caps": [], 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "default_placement": "", 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "default_storage_class": "", 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "placement_tags": [], 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_quota": { 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:39.436 INFO:tasks.workunit.client.0.smithi039.stdout: "user_quota": { 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "temp_url_keys": [], 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "type": "rgw", 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "mfa_ids": [], 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "account_id": "", 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "path": "/", 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:50:39.423493Z", 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "tags": [], 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: "group_ids": [] 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:50:39.437 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:50:39.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.434+0000 7fb739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:50:39.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.437+0000 7fb88753d800 20 remove_watcher() i=0 2024-09-22T08:50:39.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.437+0000 7fb88753d800 2 removed watcher, disabling cache 2024-09-22T08:50:39.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.438+0000 7fb88753d800 20 remove_watcher() i=1 2024-09-22T08:50:39.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.439+0000 7fb88753d800 20 remove_watcher() i=2 2024-09-22T08:50:39.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.441+0000 7fb88753d800 20 remove_watcher() i=3 2024-09-22T08:50:39.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.442+0000 7fb88753d800 20 remove_watcher() i=4 2024-09-22T08:50:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.443+0000 7fb88753d800 20 remove_watcher() i=5 2024-09-22T08:50:39.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.444+0000 7fb88753d800 20 remove_watcher() i=6 2024-09-22T08:50:39.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:39.445+0000 7fb88753d800 20 remove_watcher() i=7 2024-09-22T08:50:39.457 INFO:tasks.workunit.client.0.smithi039.stdout:phase 1.1 2024-09-22T08:50:39.479 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:50:39.479 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:50:39.480 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:50:39.480 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:50:39.491 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:50:39.491 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:50:39.799 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (319 ms) 2024-09-22T08:50:39.799 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:50:39.800 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-22T08:50:39.800 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:50:39.800 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:50:39.800 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:50:39.811 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-22T08:50:39.816 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/f1 2024-09-22T08:50:39.819 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/f2 2024-09-22T08:50:39.822 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/f1 2024-09-22T08:50:39.825 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-22T08:50:39.829 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-22T08:50:39.832 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-22T08:50:39.835 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-22T08:50:39.840 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-22T08:50:39.843 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-22T08:50:39.846 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-22T08:50:39.849 INFO:tasks.workunit.client.0.smithi039.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-22T08:50:39.852 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_HIER1 (52 ms) 2024-09-22T08:50:39.852 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:50:39.949 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_DIRS1 (97 ms) 2024-09-22T08:50:39.950 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:50:39.950 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:50:39.950 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:50:39.967 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-09-22T08:50:39.967 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:50:40.009 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (42 ms) 2024-09-22T08:50:40.009 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:50:40.009 INFO:tasks.workunit.client.0.smithi039.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-22T08:50:40.016 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-22T08:50:40.016 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:50:40.016 INFO:tasks.workunit.client.0.smithi039.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-22T08:50:40.023 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:50:40.024 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:50:40.025 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:50:40.027 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:50:40.027 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:50:40.027 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:50:40.028 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:50:40.028 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:50:40.030 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:50:40.030 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:50:40.030 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:50:40.031 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:50:40.031 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:50:40.032 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:50:40.032 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-22T08:50:40.033 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:50:40.213 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:50:40.214 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:50:40.215 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:50:40.220 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:50:40.221 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:50:40.224 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:50:40.225 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:50:40.227 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:50:40.228 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:50:40.228 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:50:40.229 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:50:40.229 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:50:40.230 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:50:40.231 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:50:40.232 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:50:40.232 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:50:40.233 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:50:40.234 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:50:40.234 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:50:40.234 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:50:40.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:40.231+0000 7f149ae2f8c0 -1 shutting down 2024-09-22T08:50:40.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:50:40.232+0000 7f1374b6e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63429, si_uid : 1000, si_addr0x3e80000f7c5, si_status0 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (29512 ms) 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW (30265 ms total) 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 24 tests from 1 test suite ran. (30265 ms total) 2024-09-22T08:51:09.745 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 24 tests. 2024-09-22T08:51:09.751 INFO:tasks.workunit.client.0.smithi039.stdout:phase 1.2 2024-09-22T08:51:09.776 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:51:09.776 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:51:09.776 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:51:09.776 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:51:09.785 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:09.785 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:10.381 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (605 ms) 2024-09-22T08:51:10.381 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:51:10.382 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:51:10.383 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:51:10.384 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:51:10.385 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:51:10.386 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:51:10.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:51:10.380+0000 7fb710f238c0 -1 shutting down 2024-09-22T08:51:10.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:51:10.381+0000 7fb5e851a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64048, si_uid : 1000, si_addr0x3e80000fa30, si_status0 2024-09-22T08:51:40.579 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30197 ms) 2024-09-22T08:51:40.580 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW (30803 ms total) 2024-09-22T08:51:40.580 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:51:40.580 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:51:40.580 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 24 tests from 1 test suite ran. (30803 ms total) 2024-09-22T08:51:40.580 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 24 tests. 2024-09-22T08:51:40.586 INFO:tasks.workunit.client.0.smithi039.stdout:phase 1.3 2024-09-22T08:51:40.611 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-22T08:51:40.611 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:51:40.611 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW 2024-09-22T08:51:40.611 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:51:40.622 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:51:40.622 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:51:41.221 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (609 ms) 2024-09-22T08:51:41.221 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-22T08:51:41.222 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-22T08:51:41.222 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:51:41.222 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-22T08:51:41.222 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-22T08:51:41.227 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-22T08:51:41.228 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETUP_DIRS1 (65 ms) 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SETATTR 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-22T08:51:41.293 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_0 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:51:41.294 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:scanning objects in /bdirs1/dir_2 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_0 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_0/sfile_0 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:51:41.295 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_0/sfile_1 2024-09-22T08:51:41.296 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:51:41.296 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_1 2024-09-22T08:51:41.297 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_1/sfile_0 2024-09-22T08:51:41.298 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:51:41.298 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_1/sfile_1 2024-09-22T08:51:41.300 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:51:41.300 INFO:tasks.workunit.client.0.smithi039.stdout:read back objects in /bdirs1/dir_2 2024-09-22T08:51:41.300 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_2/sfile_0 2024-09-22T08:51:41.301 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-22T08:51:41.301 INFO:tasks.workunit.client.0.smithi039.stdout:reading 0,256 dir_2/sfile_1 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:51:41.303 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_0 type: DIR refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_0 type: FILE refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sdir_1 type: DIR refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:release sfile_1 type: FILE refs: 2 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-22T08:51:41.304 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.HIER1 2024-09-22T08:51:41.309 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-22T08:51:41.309 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-22T08:51:41.312 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-22T08:51:41.314 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-22T08:51:41.316 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:51:41.316 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-22T08:51:41.317 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-22T08:51:41.317 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-22T08:51:41.318 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:51:41.318 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-22T08:51:41.319 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot/foo (foo): DIR 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:/nfsroot (nfsroot): DIR 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.HIER1 (18 ms) 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:51:41.321 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:51:41.319+0000 7f1737d228c0 -1 shutting down 2024-09-22T08:51:41.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:51:41.321+0000 7f160fb9b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64667, si_uid : 1000, si_addr0x3e80000fc9b, si_status0 2024-09-22T08:52:11.634 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30313 ms) 2024-09-22T08:52:11.634 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 24 tests from LibRGW (31022 ms total) 2024-09-22T08:52:11.635 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:52:11.635 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:52:11.635 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 24 tests from 1 test suite ran. (31022 ms total) 2024-09-22T08:52:11.635 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 24 tests. 2024-09-22T08:52:11.640 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2.1 2024-09-22T08:52:11.666 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:52:11.666 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:52:11.666 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:52:11.666 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:52:11.676 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:52:11.676 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:52:11.859 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (194 ms) 2024-09-22T08:52:11.860 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:52:11.860 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:52:11.860 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:52:11.870 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-22T08:52:11.870 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:52:11.870 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:52:11.870 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:52:11.879 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave0 2024-09-22T08:52:11.888 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave1 2024-09-22T08:52:11.897 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave2 2024-09-22T08:52:11.906 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave3 2024-09-22T08:52:11.914 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave4 2024-09-22T08:52:11.923 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave5 2024-09-22T08:52:11.933 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave6 2024-09-22T08:52:11.941 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave7 2024-09-22T08:52:11.949 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave8 2024-09-22T08:52:11.959 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave9 2024-09-22T08:52:11.959 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (88 ms) 2024-09-22T08:52:11.959 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:52:12.135 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (176 ms) 2024-09-22T08:52:12.135 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:52:12.135 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:52:12.135 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:52:12.135 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:52:12.136 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:52:12.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:52:12.132+0000 7f995332b8c0 -1 shutting down 2024-09-22T08:52:12.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:52:12.134+0000 7f982b2a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65286, si_uid : 1000, si_addr0x3e80000ff06, si_status0 2024-09-22T08:52:42.050 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (29916 ms) 2024-09-22T08:52:42.050 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from LibRGW (30385 ms total) 2024-09-22T08:52:42.051 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:52:42.051 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:52:42.051 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 9 tests from 1 test suite ran. (30385 ms total) 2024-09-22T08:52:42.051 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 9 tests. 2024-09-22T08:52:42.056 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2.2 2024-09-22T08:52:42.082 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-22T08:52:42.083 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:52:42.083 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from LibRGW 2024-09-22T08:52:42.083 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:52:42.092 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:52:42.092 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (602 ms) 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:52:42.685 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:52:42.706 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (20 ms) 2024-09-22T08:52:42.706 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-22T08:52:42.715 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave0 2024-09-22T08:52:42.725 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave1 2024-09-22T08:52:42.734 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave2 2024-09-22T08:52:42.744 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave3 2024-09-22T08:52:42.753 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave4 2024-09-22T08:52:42.762 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave5 2024-09-22T08:52:42.772 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave6 2024-09-22T08:52:42.781 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave7 2024-09-22T08:52:42.789 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave8 2024-09-22T08:52:42.798 INFO:tasks.workunit.client.0.smithi039.stdout:created: sorrydave9 2024-09-22T08:52:42.798 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (93 ms) 2024-09-22T08:52:42.798 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-22T08:52:42.978 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (180 ms) 2024-09-22T08:52:42.978 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:52:42.977+0000 7f24f09758c0 -1 shutting down 2024-09-22T08:52:42.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:52:42.978+0000 7f23ca6b4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65905, si_uid : 1000, si_addr0x3e800010171, si_status0 2024-09-22T08:53:12.777 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (29798 ms) 2024-09-22T08:53:12.777 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 9 tests from LibRGW (30695 ms total) 2024-09-22T08:53:12.777 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:53:12.778 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:53:12.778 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 9 tests from 1 test suite ran. (30695 ms total) 2024-09-22T08:53:12.778 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 9 tests. 2024-09-22T08:53:12.783 INFO:tasks.workunit.client.0.smithi039.stdout:phase 3.1 2024-09-22T08:53:13.115 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:53:13.115 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:53:13.115 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:53:13.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:53:13.124 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:53:13.125 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:53:13.709 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (594 ms) 2024-09-22T08:53:13.710 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:53:13.710 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:53:13.710 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:53:13.720 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-22T08:53:13.720 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:53:13.723 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-22T08:53:13.723 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:53:13.725 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:53:13.725 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:53:13.792 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LARGE1 (66 ms) 2024-09-22T08:53:13.792 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LARGE2 (45 ms) 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:53:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:53:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:53:13.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:53:13.835+0000 7fc7145af8c0 -1 shutting down 2024-09-22T08:53:13.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:53:13.837+0000 7fc5ee2ee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66525, si_uid : 1000, si_addr0x3e8000103dd, si_status0 2024-09-22T08:53:44.013 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30177 ms) 2024-09-22T08:53:44.013 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 13 tests from LibRGW (30898 ms total) 2024-09-22T08:53:44.014 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:53:44.014 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:53:44.014 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 13 tests from 1 test suite ran. (30898 ms total) 2024-09-22T08:53:44.014 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 13 tests. 2024-09-22T08:53:44.021 INFO:tasks.workunit.client.0.smithi039.stdout:phase 3.2 2024-09-22T08:53:44.351 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-22T08:53:44.351 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:53:44.351 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 13 tests from LibRGW 2024-09-22T08:53:44.351 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:53:44.359 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:53:44.360 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:53:45.150 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (798 ms) 2024-09-22T08:53:45.150 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:53:45.150 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:53:45.151 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:53:45.151 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:53:45.151 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:53:45.156 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-22T08:53:45.156 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:53:45.160 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-22T08:53:45.160 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LARGE1 2024-09-22T08:53:45.234 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LARGE1 (74 ms) 2024-09-22T08:53:45.235 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LARGE2 2024-09-22T08:53:45.235 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-22T08:53:45.235 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:53:45.235 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:53:45.235 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:53:45.239 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-22T08:53:45.240 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:53:45.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:53:45.256+0000 7f17d99338c0 -1 shutting down 2024-09-22T08:53:45.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:53:45.257+0000 7f16b1901640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67145, si_uid : 1000, si_addr0x3e800010649, si_status0 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (29954 ms) 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 13 tests from LibRGW (30859 ms total) 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 13 tests from 1 test suite ran. (30859 ms total) 2024-09-22T08:54:15.211 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 13 tests. 2024-09-22T08:54:15.218 INFO:tasks.workunit.client.0.smithi039.stdout:phase 4.1 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:read i1: 64001 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:read s1: blunderbuss 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:54:15.244 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:54:15.256 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:54:15.256 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:54:15.851 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (607 ms) 2024-09-22T08:54:15.851 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:54:15.851 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:54:15.852 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:54:15.869 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-22T08:54:15.869 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_0 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_1 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_2 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_3 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_4 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_5 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_6 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_7 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_8 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_9 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_10 2024-09-22T08:54:16.324 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_11 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_12 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_13 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_14 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_15 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_16 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_17 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_18 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_19 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_20 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_21 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_22 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_23 2024-09-22T08:54:16.325 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_24 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_25 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_26 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_27 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_28 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_29 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_30 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_31 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_32 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_33 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_34 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_35 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_36 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_37 2024-09-22T08:54:16.326 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_38 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_39 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_40 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_41 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_42 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_43 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_44 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_45 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_46 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_47 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_48 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_49 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_50 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_51 2024-09-22T08:54:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_52 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_53 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_54 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_55 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_56 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_57 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_58 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_59 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_60 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_61 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_62 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_63 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_64 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_65 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_66 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_67 2024-09-22T08:54:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_68 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_69 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_70 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_71 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_72 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_73 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_74 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_75 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_76 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_77 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_78 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_79 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_80 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_81 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_82 2024-09-22T08:54:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_83 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_84 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_85 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_86 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_87 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_88 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_89 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_90 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_91 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_92 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_93 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_94 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_95 2024-09-22T08:54:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_96 2024-09-22T08:54:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_97 2024-09-22T08:54:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_98 2024-09-22T08:54:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:created: dmarker:f_99 2024-09-22T08:54:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (454 ms) 2024-09-22T08:54:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:54:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:54:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:54:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:54:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:54:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:54:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:54:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:54:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:54:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:54:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:54:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:54:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:54:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:54:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:54:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:54:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:54:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:54:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:54:16.347 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:54:16.348 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:54:16.348 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:54:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:54:16.329+0000 7fdd25d2b8c0 -1 shutting down 2024-09-22T08:54:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:54:16.330+0000 7fdbfdd2e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67764, si_uid : 1000, si_addr0x3e8000108b4, si_status0 2024-09-22T08:54:45.975 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (29645 ms) 2024-09-22T08:54:45.975 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from LibRGW (30732 ms total) 2024-09-22T08:54:45.975 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:54:45.975 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:54:45.976 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 11 tests from 1 test suite ran. (30732 ms total) 2024-09-22T08:54:45.976 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 11 tests. 2024-09-22T08:54:45.982 INFO:tasks.workunit.client.0.smithi039.stdout:phase 4.2 2024-09-22T08:54:46.007 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-22T08:54:46.007 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:54:46.007 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from LibRGW 2024-09-22T08:54:46.008 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.TVAR 2024-09-22T08:54:46.008 INFO:tasks.workunit.client.0.smithi039.stdout:read i1: 64001 2024-09-22T08:54:46.008 INFO:tasks.workunit.client.0.smithi039.stdout:read s1: blunderbuss 2024-09-22T08:54:46.008 INFO:tasks.workunit.client.0.smithi039.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-22T08:54:46.008 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:54:46.016 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:54:46.016 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:54:46.411 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-22T08:54:46.411 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:54:46.411 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:54:46.412 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-22T08:54:46.422 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-09-22T08:54:46.422 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-22T08:54:46.422 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-22T08:54:46.423 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-22T08:54:46.423 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-22T08:54:46.423 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-22T08:54:46.426 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-22T08:54:46.427 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-22T08:54:46.428 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-22T08:54:46.429 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-22T08:54:46.430 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-22T08:54:46.431 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-22T08:54:46.432 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:54:46.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:54:46.425+0000 7f9b0bebc8c0 -1 shutting down 2024-09-22T08:54:46.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:54:46.426+0000 7f99e5bf9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68383, si_uid : 1000, si_addr0x3e800010b1f, si_status0 2024-09-22T08:55:16.650 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30224 ms) 2024-09-22T08:55:16.650 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 11 tests from LibRGW (30642 ms total) 2024-09-22T08:55:16.650 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:55:16.650 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:55:16.650 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 11 tests from 1 test suite ran. (30642 ms total) 2024-09-22T08:55:16.651 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 11 tests. 2024-09-22T08:55:16.656 INFO:tasks.workunit.client.0.smithi039.stdout:phase 5.1 2024-09-22T08:55:16.691 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:55:16.691 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:55:16.692 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:55:16.692 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:55:16.702 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:16.702 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:17.095 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-22T08:55:17.095 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:55:17.095 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:55:17.096 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:55:17.106 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-22T08:55:17.106 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:55:17.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-22T08:55:17.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:55:17.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:55:17.110 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:55:17.111 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-22T08:55:17.111 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:55:17.111 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:55:17.111 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:55:17.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.PUT_OBJECT (3 ms) 2024-09-22T08:55:17.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:55:17.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-22T08:55:17.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:55:17.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:55:17.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:55:17.117 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:55:17.118 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:55:17.119 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:55:17.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:55:17.116+0000 7f7681b278c0 -1 shutting down 2024-09-22T08:55:17.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:55:17.117+0000 7f7559abd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69002, si_uid : 1000, si_addr0x3e800010d8a, si_status0 2024-09-22T08:55:47.465 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30348 ms) 2024-09-22T08:55:47.466 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from LibRGW (30774 ms total) 2024-09-22T08:55:47.466 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:55:47.466 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:55:47.466 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 19 tests from 1 test suite ran. (30774 ms total) 2024-09-22T08:55:47.466 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 19 tests. 2024-09-22T08:55:47.472 INFO:tasks.workunit.client.0.smithi039.stdout:phase 5.2 2024-09-22T08:55:47.505 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-22T08:55:47.506 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:55:47.506 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from LibRGW 2024-09-22T08:55:47.506 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:55:47.513 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:55:47.513 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:55:48.108 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (603 ms) 2024-09-22T08:55:48.108 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:55:48.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:55:48.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-22T08:55:48.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-22T08:55:48.109 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-22T08:55:48.115 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.WRITEV 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READV 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-22T08:55:48.116 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-22T08:55:48.119 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-22T08:55:48.119 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:55:48.137 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:55:48.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:55:48.135+0000 7fe78191f8c0 -1 shutting down 2024-09-22T08:55:48.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:55:48.136+0000 7fe658e27640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69621, si_uid : 1000, si_addr0x3e800010ff5, si_status0 2024-09-22T08:56:18.180 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30043 ms) 2024-09-22T08:56:18.181 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 19 tests from LibRGW (30675 ms total) 2024-09-22T08:56:18.181 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:56:18.181 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:56:18.181 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 19 tests from 1 test suite ran. (30675 ms total) 2024-09-22T08:56:18.181 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 19 tests. 2024-09-22T08:56:18.187 INFO:tasks.workunit.client.0.smithi039.stdout:phase 6.1 2024-09-22T08:56:18.213 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-22T08:56:18.213 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment set-up. 2024-09-22T08:56:18.213 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 10 tests from LibRGW 2024-09-22T08:56:18.213 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.INIT 2024-09-22T08:56:18.220 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:56:18.221 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:56:18.611 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-22T08:56:18.612 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.MOUNT 2024-09-22T08:56:18.612 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-22T08:56:18.612 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-22T08:56:18.631 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CREATE_BUCKETS (19 ms) 2024-09-22T08:56:18.631 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-22T08:56:18.638 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (7 ms) 2024-09-22T08:56:18.639 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-22T08:56:18.654 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.TOPDIR_RENAME (16 ms) 2024-09-22T08:56:18.654 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-22T08:56:18.677 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SUBDIR_RENAME (23 ms) 2024-09-22T08:56:18.678 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (20 ms) 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-22T08:56:18.698 INFO:tasks.workunit.client.0.smithi039.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-22T08:56:18.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:18.697+0000 7fc8df83a8c0 -1 shutting down 2024-09-22T08:56:18.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:18.698+0000 7fc7b9577640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70240, si_uid : 1000, si_addr0x3e800011260, si_status0 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:[ OK ] LibRGW.SHUTDOWN (30260 ms) 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] 10 tests from LibRGW (30745 ms total) 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:[----------] Global test environment tear-down 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:[==========] 10 tests from 1 test suite ran. (30745 ms total) 2024-09-22T08:56:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:[ PASSED ] 10 tests. 2024-09-22T08:56:48.965 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:56:48.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:56:49.010 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-22T08:56:49.012 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-22T08:56:49.012 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-22T08:56:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -z ']' 2024-09-22T08:56:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:56:49.049 INFO:tasks.workunit.client.0.smithi039.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:56:49.049 INFO:tasks.workunit.client.0.smithi039.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:56:49.049 INFO:tasks.workunit.client.0.smithi039.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:56:49.049 INFO:tasks.workunit.client.0.smithi039.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-22T08:56:49.087 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T08:56:49.087 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T08:56:49.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.126+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.128+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.128+0000 7fce35baf800 20 realm 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.128+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.129+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.129+0000 7fce35baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.129+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.129+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.129+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.130+0000 7fce35baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:49.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.130+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.130+0000 7fce35baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T08:56:49.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.130+0000 7fce35baf800 20 searching for the correct realm 2024-09-22T08:56:49.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.131+0000 7fce33699640 0 -- 172.21.15.39:0/3959066585 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fce2c06b930 msgr2=0x7fce2c06a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T08:56:49.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.336+0000 7fce33699640 0 -- 172.21.15.39:0/3959066585 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7fce2c074b20 msgr2=0x7fce2c0744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T08:56:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T08:56:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T08:56:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.546+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T08:56:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 zone default found 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 4 Realm: () 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 zonegroup default 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.547+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.548+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.548+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.548+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.548+0000 7fce35baf800 20 started sync module instance, tier type = 2024-09-22T08:56:49.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.548+0000 7fce35baf800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.558+0000 7fce35baf800 20 add_watcher() i=0 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.558+0000 7fce35baf800 20 add_watcher() i=1 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.558+0000 7fce35baf800 20 add_watcher() i=2 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 20 add_watcher() i=3 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 20 add_watcher() i=4 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 20 add_watcher() i=5 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 20 add_watcher() i=6 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 20 add_watcher() i=7 2024-09-22T08:56:49.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.559+0000 7fce35baf800 2 all 8 watchers are set, enabling cache 2024-09-22T08:56:49.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.561+0000 7fcce97ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:49.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T08:56:49.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T08:56:49.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 5 note: GC not initialized 2024-09-22T08:56:49.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fcc63fff640 20 reqs_thread_entry: start 2024-09-22T08:56:49.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 20 init_complete bucket index max shards: 1 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 20 Filter name: none 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fcc61ffb640 20 reqs_thread_entry: start 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.562+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:56:49.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-22T08:56:49.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 20 rados->read ofs=0 len=0 2024-09-22T08:56:49.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.563+0000 7fce35baf800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.564+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.564+0000 7fce35baf800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.564+0000 7fce35baf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.565+0000 7fcd16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889421 cookie 94005401912624 notifier 5787 bl.length()=677 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.565+0000 7fcd16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-22T08:56:49.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.565+0000 7fcd16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-22T08:56:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:56:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fce35baf800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:56:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fce35baf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-22T08:56:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fcd16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889462 cookie 94005401899824 notifier 5787 bl.length()=187 2024-09-22T08:56:49.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fcd16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-22T08:56:49.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.568+0000 7fcd16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-22T08:56:49.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fce35baf800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:56:49.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fce35baf800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:56:49.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fce35baf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-22T08:56:49.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fcd16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889463 cookie 94005401899824 notifier 5787 bl.length()=197 2024-09-22T08:56:49.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fcd16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-22T08:56:49.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.571+0000 7fcd16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "user_id": "ceph-test-maven", 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "display_name": "maven test user", 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "email": "sigv4@example.com", 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "suspended": 0, 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "max_buckets": 1000, 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "subusers": [], 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "keys": [ 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: { 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "user": "ceph-test-maven", 2024-09-22T08:56:49.575 INFO:tasks.workunit.client.0.smithi039.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "active": true, 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:56:49.565429Z" 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: ], 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "swift_keys": [], 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "caps": [], 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "default_placement": "", 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "default_storage_class": "", 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "placement_tags": [], 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_quota": { 2024-09-22T08:56:49.576 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "user_quota": { 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "temp_url_keys": [], 2024-09-22T08:56:49.577 INFO:tasks.workunit.client.0.smithi039.stdout: "type": "rgw", 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "mfa_ids": [], 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "account_id": "", 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "path": "/", 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:56:49.565412Z", 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "tags": [], 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: "group_ids": [] 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:56:49.578 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T08:56:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.574+0000 7fcce97ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T08:56:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.576+0000 7fce35baf800 20 remove_watcher() i=0 2024-09-22T08:56:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.576+0000 7fce35baf800 2 removed watcher, disabling cache 2024-09-22T08:56:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.578+0000 7fce35baf800 20 remove_watcher() i=1 2024-09-22T08:56:49.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.579+0000 7fce35baf800 20 remove_watcher() i=2 2024-09-22T08:56:49.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.580+0000 7fce35baf800 20 remove_watcher() i=3 2024-09-22T08:56:49.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.581+0000 7fce35baf800 20 remove_watcher() i=4 2024-09-22T08:56:49.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.582+0000 7fce35baf800 20 remove_watcher() i=5 2024-09-22T08:56:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.583+0000 7fce35baf800 20 remove_watcher() i=6 2024-09-22T08:56:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T08:56:49.584+0000 7fce35baf800 20 remove_watcher() i=7 2024-09-22T08:56:49.598 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -z ']' 2024-09-22T08:56:49.598 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-22T08:56:49.598 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-22T08:56:49.599 INFO:tasks.workunit.client.0.smithi039.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi039.front.sepia.ceph.com:443 2024-09-22T08:56:49.599 INFO:tasks.workunit.client.0.smithi039.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi039.front.sepia.ceph.com:443 2024-09-22T08:56:49.599 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-22T08:56:49.600 INFO:tasks.workunit.client.0.smithi039.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-22T08:56:49.600 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./mvnw clean package 2024-09-22T08:56:49.608 INFO:tasks.workunit.client.0.smithi039.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:56:51.180 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Scanning for projects... 2024-09-22T08:56:51.322 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-22T08:56:51.407 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 63 kB/s) 2024-09-22T08:56:51.420 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-22T08:56:51.463 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-09-22T08:56:51.476 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-22T08:56:51.498 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.3 MB/s) 2024-09-22T08:56:51.529 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:51.529 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:56:51.529 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:56:51.530 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] from pom.xml 2024-09-22T08:56:51.530 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:56:51.533 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-22T08:56:51.549 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-22T08:56:51.555 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-22T08:56:51.571 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-22T08:56:51.575 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-22T08:56:51.592 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-22T08:56:51.601 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-22T08:56:51.618 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-22T08:56:51.631 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-22T08:56:51.648 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-22T08:56:51.657 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-22T08:56:51.673 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-22T08:56:51.677 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-22T08:56:51.692 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-22T08:56:51.695 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-22T08:56:51.712 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-22T08:56:51.717 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-22T08:56:51.733 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-22T08:56:51.740 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-22T08:56:51.756 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-22T08:56:51.763 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-22T08:56:51.779 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-22T08:56:51.787 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-22T08:56:51.804 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-22T08:56:51.813 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-22T08:56:51.828 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-22T08:56:51.832 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-22T08:56:51.847 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-22T08:56:51.852 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-22T08:56:51.869 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-22T08:56:51.874 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-22T08:56:51.890 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-22T08:56:51.898 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-22T08:56:51.913 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-22T08:56:51.918 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-22T08:56:51.934 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-22T08:56:51.944 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-22T08:56:51.959 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-22T08:56:51.963 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-22T08:56:51.978 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-22T08:56:51.982 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-22T08:56:51.997 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-22T08:56:52.002 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-22T08:56:52.017 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-22T08:56:52.024 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-22T08:56:52.039 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-22T08:56:52.057 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-22T08:56:52.073 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-22T08:56:52.076 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-22T08:56:52.091 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-22T08:56:52.097 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-22T08:56:52.113 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-22T08:56:52.124 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-22T08:56:52.139 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-22T08:56:52.142 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-22T08:56:52.158 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-22T08:56:52.161 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-22T08:56:52.177 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-22T08:56:52.183 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-22T08:56:52.199 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-22T08:56:52.205 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-22T08:56:52.221 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-22T08:56:52.267 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-22T08:56:52.267 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-22T08:56:52.267 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-22T08:56:52.267 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-22T08:56:52.268 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-22T08:56:52.283 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-22T08:56:52.287 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-22T08:56:52.303 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-22T08:56:52.308 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-22T08:56:52.322 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-22T08:56:52.325 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-22T08:56:52.340 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-22T08:56:52.342 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-22T08:56:52.357 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-22T08:56:52.361 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-22T08:56:52.377 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-22T08:56:52.382 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-22T08:56:52.398 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-22T08:56:52.403 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-22T08:56:52.419 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-22T08:56:52.424 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-22T08:56:52.440 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-09-22T08:56:52.444 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-22T08:56:52.460 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-22T08:56:52.464 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-22T08:56:52.479 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-22T08:56:52.484 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-22T08:56:52.500 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-22T08:56:52.503 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-22T08:56:52.519 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-22T08:56:52.524 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-22T08:56:52.539 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-22T08:56:52.544 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-22T08:56:52.559 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-22T08:56:52.563 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-22T08:56:52.578 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-22T08:56:52.583 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-22T08:56:52.598 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-22T08:56:52.604 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-22T08:56:52.619 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-22T08:56:52.621 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-22T08:56:52.637 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-22T08:56:52.641 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-22T08:56:52.656 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-22T08:56:52.659 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-22T08:56:52.674 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-22T08:56:52.677 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-22T08:56:52.692 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.2 MB/s) 2024-09-22T08:56:52.696 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-22T08:56:52.711 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-22T08:56:52.715 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-22T08:56:52.730 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-22T08:56:52.732 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-22T08:56:52.747 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-22T08:56:52.752 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-22T08:56:52.768 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-22T08:56:52.770 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-22T08:56:52.787 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-22T08:56:52.793 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-22T08:56:52.807 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-22T08:56:52.811 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-22T08:56:52.825 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-22T08:56:52.827 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-22T08:56:52.843 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-22T08:56:52.847 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-22T08:56:52.862 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-22T08:56:52.865 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-22T08:56:52.880 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-22T08:56:52.882 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-22T08:56:52.899 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-22T08:56:52.904 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-22T08:56:52.919 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-22T08:56:52.921 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-22T08:56:52.936 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-22T08:56:52.939 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-22T08:56:52.954 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-22T08:56:52.956 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-22T08:56:52.971 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-22T08:56:52.973 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-22T08:56:52.987 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-22T08:56:52.989 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-22T08:56:53.004 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-22T08:56:53.006 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-22T08:56:53.020 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-22T08:56:53.023 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-22T08:56:53.038 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-22T08:56:53.040 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-22T08:56:53.055 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-22T08:56:53.057 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-22T08:56:53.072 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-22T08:56:53.074 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-22T08:56:53.089 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-22T08:56:53.093 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-22T08:56:53.107 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-22T08:56:53.110 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-22T08:56:53.125 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-22T08:56:53.127 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-22T08:56:53.141 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-22T08:56:53.143 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-22T08:56:53.158 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-22T08:56:53.160 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-22T08:56:53.175 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-22T08:56:53.177 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-22T08:56:53.192 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-22T08:56:53.209 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-22T08:56:53.295 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 38 MB/s) 2024-09-22T08:56:53.297 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-22T08:56:53.297 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-22T08:56:53.297 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-22T08:56:53.297 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-22T08:56:53.298 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-22T08:56:53.315 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-22T08:56:53.315 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-22T08:56:53.329 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-22T08:56:53.329 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-22T08:56:53.346 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/71 kB Progress (2): 2.8/16 kB | 1.4/71 kB Progress (3): 2.8/16 kB | 1.4/71 kB | 1.4/49 kB Progress (3): 4.1/16 kB | 1.4/71 kB | 1.4/49 kB Progress (3): 4.1/16 kB | 2.8/71 kB | 1.4/49 kB Progress (3): 5.5/16 kB | 2.8/71 kB | 1.4/49 kB Progress (3): 5.5/16 kB | 2.8/71 kB | 2.8/49 kB Progress (3): 6.9/16 kB | 2.8/71 kB | 2.8/49 kB Progress (3): 6.9/16 kB | 4.1/71 kB | 2.8/49 kB Progress (3): 8.3/16 kB | 4.1/71 kB | 2.8/49 kB Progress (3): 8.3/16 kB | 4.1/71 kB | 4.1/49 kB Progress (3): 9.7/16 kB | 4.1/71 kB | 4.1/49 kB Progress (3): 9.7/16 kB | 5.5/71 kB | 4.1/49 kB Progress (3): 11/16 kB | 5.5/71 kB | 4.1/49 kB Progress (3): 11/16 kB | 6.9/71 kB | 4.1/49 kB Progress (3): 12/16 kB | 6.9/71 kB | 4.1/49 kB Progress (3): 12/16 kB | 6.9/71 kB | 5.5/49 kB Progress (3): 12/16 kB | 8.3/71 kB | 5.5/49 kB Progress (3): 14/16 kB | 8.3/71 kB | 5.5/49 kB Progress (3): 14/16 kB | 8.3/71 kB | 6.9/49 kB Progress (4): 14/16 kB | 8.3/71 kB | 6.9/49 kB | 16/782 kB Progress (4): 14/16 kB | 9.7/71 kB | 6.9/49 kB | 16/782 kB Progress (4): 15/16 kB | 9.7/71 kB | 6.9/49 kB | 16/782 kB Progress (4): 15/16 kB | 9.7/71 kB | 8.3/49 kB | 16/782 kB Progress (4): 16 kB | 9.7/71 kB | 8.3/49 kB | 16/782 kB Progress (4): 16 kB | 11/71 kB | 8.3/49 kB | 16/782 kB Progress (4): 16 kB | 11/71 kB | 9.7/49 kB | 16/782 kB Progress (4): 16 kB | 12/71 kB | 9.7/49 kB | 16/782 kB Progress (4): 16 kB | 12/71 kB | 9.7/49 kB | 33/782 kB Progress (5): 16 kB | 12/71 kB | 9.7/49 kB | 33/782 kB | 16/98 kB Progress (5): 16 kB | 14/71 kB | 9.7/49 kB | 33/782 kB | 16/98 kB Progress (5): 16 kB | 14/71 kB | 11/49 kB | 33/782 kB | 16/98 kB Progress (5): 16 kB | 15/71 kB | 11/49 kB | 33/782 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-22T08:56:53.347 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 16/71 kB | 11/49 kB | 33/782 kB | 16/98 kB Progress (4): 16/71 kB | 12/49 kB | 33/782 kB | 16/98 kB Progress (4): 16/71 kB | 12/49 kB | 49/782 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-22T08:56:53.357 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 16/71 kB | 14/49 kB | 49/782 kB | 16/98 kB Progress (4): 16/71 kB | 15/49 kB | 49/782 kB | 16/98 kB Progress (4): 16/71 kB | 15/49 kB | 63/782 kB | 16/98 kB Progress (4): 16/71 kB | 17/49 kB | 63/782 kB | 16/98 kB Progress (4): 16/71 kB | 18/49 kB | 63/782 kB | 16/98 kB Progress (4): 16/71 kB | 19/49 kB | 63/782 kB | 16/98 kB Progress (4): 16/71 kB | 19/49 kB | 79/782 kB | 16/98 kB Progress (4): 16/71 kB | 21/49 kB | 79/782 kB | 16/98 kB Progress (4): 16/71 kB | 22/49 kB | 79/782 kB | 16/98 kB Progress (4): 16/71 kB | 22/49 kB | 96/782 kB | 16/98 kB Progress (4): 16/71 kB | 23/49 kB | 96/782 kB | 16/98 kB Progress (4): 16/71 kB | 25/49 kB | 96/782 kB | 16/98 kB Progress (4): 16/71 kB | 25/49 kB | 112/782 kB | 16/98 kB Progress (4): 16/71 kB | 26/49 kB | 112/782 kB | 16/98 kB Progress (4): 16/71 kB | 28/49 kB | 112/782 kB | 16/98 kB Progress (4): 16/71 kB | 28/49 kB | 129/782 kB | 16/98 kB Progress (4): 16/71 kB | 29/49 kB | 129/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 129/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 145/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 161/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 178/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 194/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 210/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 227/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 243/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 260/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 276/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 292/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 309/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 325/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 341/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 358/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 374/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 391/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 407/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 423/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 440/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 456/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 473/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 489/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 505/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 522/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 538/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 554/782 kB | 16/98 kB Progress (4): 16/71 kB | 30/49 kB | 571/782 kB | 16/98 kB Progress (4): 16/71 kB | 32/49 kB | 571/782 kB | 16/98 kB Progress (4): 16/71 kB | 32/49 kB | 587/782 kB | 16/98 kB Progress (4): 16/71 kB | 33/49 kB | 587/782 kB | 16/98 kB Progress (4): 16/71 kB | 34/49 kB | 587/782 kB | 16/98 kB Progress (4): 32/71 kB | 34/49 kB | 587/782 kB | 16/98 kB Progress (4): 32/71 kB | 34/49 kB | 604/782 kB | 16/98 kB Progress (4): 32/71 kB | 36/49 kB | 604/782 kB | 16/98 kB Progress (4): 32/71 kB | 37/49 kB | 604/782 kB | 16/98 kB Progress (4): 32/71 kB | 37/49 kB | 620/782 kB | 16/98 kB Progress (4): 32/71 kB | 39/49 kB | 620/782 kB | 16/98 kB Progress (4): 32/71 kB | 39/49 kB | 636/782 kB | 16/98 kB Progress (4): 32/71 kB | 40/49 kB | 636/782 kB | 16/98 kB Progress (4): 32/71 kB | 40/49 kB | 653/782 kB | 16/98 kB Progress (4): 32/71 kB | 41/49 kB | 653/782 kB | 16/98 kB Progress (4): 32/71 kB | 41/49 kB | 669/782 kB | 16/98 kB Progress (4): 32/71 kB | 43/49 kB | 669/782 kB | 16/98 kB Progress (4): 32/71 kB | 44/49 kB | 669/782 kB | 16/98 kB Progress (4): 32/71 kB | 44/49 kB | 686/782 kB | 16/98 kB Progress (4): 32/71 kB | 46/49 kB | 686/782 kB | 16/98 kB Progress (4): 32/71 kB | 46/49 kB | 686/782 kB | 33/98 kB Progress (4): 32/71 kB | 47/49 kB | 686/782 kB | 33/98 kB Progress (4): 32/71 kB | 47/49 kB | 702/782 kB | 33/98 kB Progress (4): 32/71 kB | 48/49 kB | 702/782 kB | 33/98 kB Progress (4): 32/71 kB | 49 kB | 702/782 kB | 33/98 kB Progress (4): 32/71 kB | 49 kB | 718/782 kB | 33/98 kB Progress (4): 32/71 kB | 49 kB | 735/782 kB | 33/98 kB Progress (4): 32/71 kB | 49 kB | 751/782 kB | 33/98 kB Progress (4): 32/71 kB | 49 kB | 767/782 kB | 33/98 kB Progress (4): 49/71 kB | 49 kB | 767/782 kB | 33/98 kB Progress (4): 49/71 kB | 49 kB | 782 kB | 33/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 821 kB/s) 2024-09-22T08:56:53.357 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-22T08:56:53.358 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 13 MB/s) 2024-09-22T08:56:53.358 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-22T08:56:53.361 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 49/71 kB | 49/98 kB Progress (3): 49/71 kB | 49/98 kB | 1.4/11 kB Progress (3): 49/71 kB | 49/98 kB | 2.8/11 kB Progress (3): 49/71 kB | 49/98 kB | 4.1/11 kB Progress (3): 49/71 kB | 49/98 kB | 5.5/11 kB Progress (3): 49/71 kB | 49/98 kB | 6.9/11 kB Progress (3): 49/71 kB | 49/98 kB | 8.3/11 kB Progress (3): 49/71 kB | 49/98 kB | 9.7/11 kB Progress (3): 49/71 kB | 49/98 kB | 11/11 kB Progress (3): 49/71 kB | 49/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 180 kB/s) 2024-09-22T08:56:53.361 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-22T08:56:53.367 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 65/71 kB | 49/98 kB Progress (2): 71 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 993 kB/s) 2024-09-22T08:56:53.367 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-22T08:56:53.371 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-22T08:56:53.371 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-22T08:56:53.375 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 49/205 kB | 16/30 kB Progress (2): 66/205 kB | 16/30 kB Progress (2): 82/205 kB | 16/30 kB Progress (2): 82/205 kB | 30 kB Progress (2): 98/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 397 kB/s) 2024-09-22T08:56:53.375 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 115/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-22T08:56:53.378 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 131/205 kB Progress (2): 131/205 kB | 1.4/81 kB Progress (2): 147/205 kB | 1.4/81 kB Progress (2): 147/205 kB | 2.8/81 kB Progress (2): 147/205 kB | 4.1/81 kB Progress (2): 147/205 kB | 5.5/81 kB Progress (2): 147/205 kB | 6.9/81 kB Progress (2): 147/205 kB | 8.3/81 kB Progress (2): 147/205 kB | 9.7/81 kB Progress (2): 164/205 kB | 9.7/81 kB Progress (2): 180/205 kB | 9.7/81 kB Progress (2): 180/205 kB | 11/81 kB Progress (2): 180/205 kB | 12/81 kB Progress (2): 180/205 kB | 14/81 kB Progress (2): 180/205 kB | 15/81 kB Progress (2): 197/205 kB | 15/81 kB Progress (2): 197/205 kB | 16/81 kB Progress (2): 205 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.6 MB/s) 2024-09-22T08:56:53.378 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-22T08:56:53.386 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 16/81 kB | 16/798 kB Progress (2): 16/81 kB | 33/798 kB Progress (3): 16/81 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-22T08:56:53.386 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-22T08:56:53.394 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 16/81 kB | 49/798 kB Progress (2): 32/81 kB | 49/798 kB Progress (2): 32/81 kB | 66/798 kB Progress (2): 49/81 kB | 66/798 kB Progress (3): 49/81 kB | 66/798 kB | 16/182 kB Progress (3): 65/81 kB | 66/798 kB | 16/182 kB Progress (3): 65/81 kB | 66/798 kB | 33/182 kB Progress (4): 65/81 kB | 66/798 kB | 33/182 kB | 16/151 kB Progress (4): 81 kB | 66/798 kB | 33/182 kB | 16/151 kB Progress (4): 81 kB | 66/798 kB | 33/182 kB | 33/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 855 kB/s) 2024-09-22T08:56:53.394 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 66/798 kB | 33/182 kB | 49/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-22T08:56:53.397 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 66/798 kB | 49/182 kB | 49/151 kB Progress (3): 66/798 kB | 49/182 kB | 66/151 kB Progress (3): 66/798 kB | 49/182 kB | 82/151 kB Progress (3): 66/798 kB | 66/182 kB | 82/151 kB Progress (3): 66/798 kB | 66/182 kB | 98/151 kB Progress (3): 66/798 kB | 66/182 kB | 115/151 kB Progress (3): 82/798 kB | 66/182 kB | 115/151 kB Progress (3): 82/798 kB | 66/182 kB | 131/151 kB Progress (3): 82/798 kB | 66/182 kB | 147/151 kB Progress (3): 98/798 kB | 66/182 kB | 147/151 kB Progress (3): 98/798 kB | 66/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.5 MB/s) 2024-09-22T08:56:53.397 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-22T08:56:53.401 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 115/798 kB | 66/182 kB Progress (2): 131/798 kB | 66/182 kB Progress (2): 147/798 kB | 66/182 kB Progress (2): 164/798 kB | 66/182 kB Progress (3): 164/798 kB | 66/182 kB | 16/27 kB Progress (3): 164/798 kB | 66/182 kB | 27 kB Progress (3): 180/798 kB | 66/182 kB | 27 kB Progress (3): 180/798 kB | 82/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 268 kB/s) 2024-09-22T08:56:53.402 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-22T08:56:53.408 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 180/798 kB | 98/182 kB Progress (2): 180/798 kB | 115/182 kB Progress (2): 180/798 kB | 131/182 kB Progress (2): 180/798 kB | 147/182 kB Progress (2): 180/798 kB | 164/182 kB Progress (2): 197/798 kB | 164/182 kB Progress (2): 197/798 kB | 180/182 kB Progress (2): 197/798 kB | 182 kB Progress (2): 213/798 kB | 182 kB Progress (3): 213/798 kB | 182 kB | 16/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-22T08:56:53.408 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 229/798 kB | 16/30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-22T08:56:53.408 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 229/798 kB | 30 kB Progress (2): 246/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 276 kB/s) 2024-09-22T08:56:53.409 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-22T08:56:53.417 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 262/798 kB Progress (1): 279/798 kB Progress (1): 295/798 kB Progress (1): 311/798 kB Progress (1): 328/798 kB Progress (1): 344/798 kB Progress (2): 344/798 kB | 16/385 kB Progress (2): 360/798 kB | 16/385 kB Progress (2): 360/798 kB | 33/385 kB Progress (2): 377/798 kB | 33/385 kB Progress (2): 377/798 kB | 49/385 kB Progress (2): 393/798 kB | 49/385 kB Progress (2): 393/798 kB | 66/385 kB Progress (2): 410/798 kB | 66/385 kB Progress (2): 410/798 kB | 82/385 kB Progress (2): 410/798 kB | 98/385 kB Progress (2): 426/798 kB | 98/385 kB Progress (2): 442/798 kB | 98/385 kB Progress (2): 442/798 kB | 115/385 kB Progress (2): 442/798 kB | 131/385 kB Progress (2): 442/798 kB | 147/385 kB Progress (2): 442/798 kB | 164/385 kB Progress (2): 442/798 kB | 180/385 kB Progress (3): 442/798 kB | 180/385 kB | 13 kB Progress (3): 442/798 kB | 197/385 kB | 13 kB Progress (3): 442/798 kB | 213/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 112 kB/s) 2024-09-22T08:56:53.417 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-22T08:56:53.422 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 442/798 kB | 229/385 kB Progress (2): 442/798 kB | 246/385 kB Progress (2): 442/798 kB | 256/385 kB Progress (2): 442/798 kB | 272/385 kB Progress (2): 442/798 kB | 289/385 kB Progress (2): 442/798 kB | 305/385 kB Progress (2): 459/798 kB | 305/385 kB Progress (2): 459/798 kB | 321/385 kB Progress (2): 475/798 kB | 321/385 kB Progress (2): 492/798 kB | 321/385 kB Progress (2): 492/798 kB | 338/385 kB Progress (2): 508/798 kB | 338/385 kB Progress (2): 508/798 kB | 354/385 kB Progress (2): 508/798 kB | 370/385 kB Progress (2): 524/798 kB | 370/385 kB Progress (2): 524/798 kB | 385 kB Progress (2): 541/798 kB | 385 kB Progress (2): 557/798 kB | 385 kB Progress (2): 573/798 kB | 385 kB Progress (2): 585/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-22T08:56:53.422 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-22T08:56:53.427 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 601/798 kB Progress (2): 601/798 kB | 16/780 kB Progress (2): 617/798 kB | 16/780 kB Progress (2): 617/798 kB | 33/780 kB Progress (2): 634/798 kB | 33/780 kB Progress (3): 634/798 kB | 33/780 kB | 16/75 kB Progress (3): 634/798 kB | 49/780 kB | 16/75 kB Progress (3): 650/798 kB | 49/780 kB | 16/75 kB Progress (3): 650/798 kB | 62/780 kB | 16/75 kB Progress (3): 650/798 kB | 62/780 kB | 33/75 kB Progress (3): 667/798 kB | 62/780 kB | 33/75 kB Progress (3): 667/798 kB | 79/780 kB | 33/75 kB Progress (3): 683/798 kB | 79/780 kB | 33/75 kB Progress (3): 683/798 kB | 95/780 kB | 33/75 kB Progress (3): 699/798 kB | 95/780 kB | 33/75 kB Progress (3): 699/798 kB | 95/780 kB | 49/75 kB Progress (3): 716/798 kB | 95/780 kB | 49/75 kB Progress (3): 716/798 kB | 111/780 kB | 49/75 kB Progress (3): 732/798 kB | 111/780 kB | 49/75 kB Progress (3): 732/798 kB | 128/780 kB | 49/75 kB Progress (3): 749/798 kB | 128/780 kB | 49/75 kB Progress (3): 749/798 kB | 128/780 kB | 66/75 kB Progress (3): 749/798 kB | 144/780 kB | 66/75 kB Progress (3): 749/798 kB | 144/780 kB | 75 kB Progress (3): 765/798 kB | 144/780 kB | 75 kB Progress (3): 765/798 kB | 161/780 kB | 75 kB Progress (3): 781/798 kB | 161/780 kB | 75 kB Progress (3): 781/798 kB | 177/780 kB | 75 kB Progress (3): 798/798 kB | 177/780 kB | 75 kB Progress (3): 798 kB | 177/780 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 587 kB/s) 2024-09-22T08:56:53.427 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-22T08:56:53.427 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 798 kB | 193/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.2 MB/s) 2024-09-22T08:56:53.427 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-22T08:56:53.444 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 210/780 kB Progress (1): 226/780 kB Progress (1): 243/780 kB Progress (2): 243/780 kB | 16/329 kB Progress (2): 243/780 kB | 33/329 kB Progress (2): 243/780 kB | 49/329 kB Progress (2): 243/780 kB | 64/329 kB Progress (2): 259/780 kB | 64/329 kB Progress (2): 259/780 kB | 80/329 kB Progress (2): 275/780 kB | 80/329 kB Progress (2): 292/780 kB | 80/329 kB Progress (2): 292/780 kB | 97/329 kB Progress (2): 308/780 kB | 97/329 kB Progress (2): 324/780 kB | 97/329 kB Progress (2): 341/780 kB | 97/329 kB Progress (2): 357/780 kB | 97/329 kB Progress (3): 357/780 kB | 97/329 kB | 16/501 kB Progress (3): 374/780 kB | 97/329 kB | 16/501 kB Progress (3): 374/780 kB | 97/329 kB | 33/501 kB Progress (3): 390/780 kB | 97/329 kB | 33/501 kB Progress (3): 406/780 kB | 97/329 kB | 33/501 kB Progress (3): 406/780 kB | 97/329 kB | 49/501 kB Progress (3): 423/780 kB | 97/329 kB | 49/501 kB Progress (3): 423/780 kB | 97/329 kB | 63/501 kB Progress (3): 439/780 kB | 97/329 kB | 63/501 kB Progress (3): 456/780 kB | 97/329 kB | 63/501 kB Progress (3): 456/780 kB | 97/329 kB | 79/501 kB Progress (3): 472/780 kB | 97/329 kB | 79/501 kB Progress (3): 472/780 kB | 97/329 kB | 96/501 kB Progress (3): 488/780 kB | 97/329 kB | 96/501 kB Progress (3): 488/780 kB | 97/329 kB | 104/501 kB Progress (3): 505/780 kB | 97/329 kB | 104/501 kB Progress (3): 521/780 kB | 97/329 kB | 104/501 kB Progress (3): 521/780 kB | 97/329 kB | 120/501 kB Progress (3): 537/780 kB | 97/329 kB | 120/501 kB Progress (3): 537/780 kB | 97/329 kB | 128/501 kB Progress (3): 554/780 kB | 97/329 kB | 128/501 kB Progress (3): 554/780 kB | 97/329 kB | 145/501 kB Progress (3): 570/780 kB | 97/329 kB | 145/501 kB Progress (3): 587/780 kB | 97/329 kB | 145/501 kB Progress (3): 587/780 kB | 97/329 kB | 161/501 kB Progress (3): 603/780 kB | 97/329 kB | 161/501 kB Progress (3): 603/780 kB | 97/329 kB | 178/501 kB Progress (3): 603/780 kB | 97/329 kB | 182/501 kB Progress (3): 619/780 kB | 97/329 kB | 182/501 kB Progress (4): 619/780 kB | 97/329 kB | 182/501 kB | 16/41 kB Progress (4): 619/780 kB | 97/329 kB | 194/501 kB | 16/41 kB Progress (4): 636/780 kB | 97/329 kB | 194/501 kB | 16/41 kB Progress (4): 636/780 kB | 97/329 kB | 198/501 kB | 16/41 kB Progress (4): 636/780 kB | 97/329 kB | 198/501 kB | 33/41 kB Progress (5): 636/780 kB | 97/329 kB | 198/501 kB | 33/41 kB | 16/354 kB Progress (5): 652/780 kB | 97/329 kB | 198/501 kB | 33/41 kB | 16/354 kB Progress (5): 652/780 kB | 97/329 kB | 198/501 kB | 41 kB | 16/354 kB Progress (5): 652/780 kB | 113/329 kB | 198/501 kB | 41 kB | 16/354 kB Progress (5): 652/780 kB | 113/329 kB | 198/501 kB | 41 kB | 33/354 kB Progress (5): 652/780 kB | 129/329 kB | 198/501 kB | 41 kB | 33/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 286 kB/s) 2024-09-22T08:56:53.444 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 652/780 kB | 129/329 kB | 214/501 kB | 33/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-22T08:56:53.464 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 652/780 kB | 129/329 kB | 214/501 kB | 49/354 kB Progress (4): 652/780 kB | 146/329 kB | 214/501 kB | 49/354 kB Progress (4): 652/780 kB | 146/329 kB | 231/501 kB | 49/354 kB Progress (4): 652/780 kB | 146/329 kB | 231/501 kB | 66/354 kB Progress (4): 669/780 kB | 146/329 kB | 231/501 kB | 66/354 kB Progress (4): 669/780 kB | 146/329 kB | 247/501 kB | 66/354 kB Progress (4): 669/780 kB | 146/329 kB | 247/501 kB | 82/354 kB Progress (4): 669/780 kB | 162/329 kB | 247/501 kB | 82/354 kB Progress (4): 669/780 kB | 162/329 kB | 260/501 kB | 82/354 kB Progress (4): 685/780 kB | 162/329 kB | 260/501 kB | 82/354 kB Progress (4): 685/780 kB | 162/329 kB | 260/501 kB | 98/354 kB Progress (4): 685/780 kB | 162/329 kB | 276/501 kB | 98/354 kB Progress (4): 701/780 kB | 162/329 kB | 276/501 kB | 98/354 kB Progress (4): 701/780 kB | 162/329 kB | 276/501 kB | 115/354 kB Progress (4): 701/780 kB | 162/329 kB | 292/501 kB | 115/354 kB Progress (4): 718/780 kB | 162/329 kB | 292/501 kB | 115/354 kB Progress (4): 718/780 kB | 179/329 kB | 292/501 kB | 115/354 kB Progress (4): 718/780 kB | 179/329 kB | 292/501 kB | 131/354 kB Progress (4): 718/780 kB | 179/329 kB | 309/501 kB | 131/354 kB Progress (4): 734/780 kB | 179/329 kB | 309/501 kB | 131/354 kB Progress (4): 734/780 kB | 195/329 kB | 309/501 kB | 131/354 kB Progress (4): 734/780 kB | 195/329 kB | 309/501 kB | 147/354 kB Progress (4): 734/780 kB | 195/329 kB | 325/501 kB | 147/354 kB Progress (4): 734/780 kB | 195/329 kB | 325/501 kB | 164/354 kB Progress (4): 734/780 kB | 195/329 kB | 325/501 kB | 180/354 kB Progress (4): 734/780 kB | 195/329 kB | 341/501 kB | 180/354 kB Progress (4): 734/780 kB | 195/329 kB | 341/501 kB | 197/354 kB Progress (4): 734/780 kB | 195/329 kB | 358/501 kB | 197/354 kB Progress (4): 734/780 kB | 195/329 kB | 358/501 kB | 213/354 kB Progress (4): 734/780 kB | 195/329 kB | 374/501 kB | 213/354 kB Progress (4): 734/780 kB | 195/329 kB | 374/501 kB | 229/354 kB Progress (4): 734/780 kB | 195/329 kB | 391/501 kB | 229/354 kB Progress (4): 734/780 kB | 195/329 kB | 391/501 kB | 246/354 kB Progress (4): 734/780 kB | 195/329 kB | 407/501 kB | 246/354 kB Progress (4): 734/780 kB | 195/329 kB | 407/501 kB | 256/354 kB Progress (4): 734/780 kB | 195/329 kB | 423/501 kB | 256/354 kB Progress (4): 734/780 kB | 195/329 kB | 423/501 kB | 272/354 kB Progress (4): 734/780 kB | 195/329 kB | 440/501 kB | 272/354 kB Progress (4): 734/780 kB | 195/329 kB | 440/501 kB | 289/354 kB Progress (4): 734/780 kB | 195/329 kB | 456/501 kB | 289/354 kB Progress (4): 734/780 kB | 195/329 kB | 456/501 kB | 305/354 kB Progress (4): 734/780 kB | 211/329 kB | 456/501 kB | 305/354 kB Progress (4): 734/780 kB | 211/329 kB | 473/501 kB | 305/354 kB Progress (4): 750/780 kB | 211/329 kB | 473/501 kB | 305/354 kB Progress (4): 750/780 kB | 211/329 kB | 473/501 kB | 321/354 kB Progress (4): 750/780 kB | 211/329 kB | 489/501 kB | 321/354 kB Progress (4): 750/780 kB | 228/329 kB | 489/501 kB | 321/354 kB Progress (4): 750/780 kB | 228/329 kB | 501 kB | 321/354 kB Progress (4): 767/780 kB | 228/329 kB | 501 kB | 321/354 kB Progress (4): 767/780 kB | 228/329 kB | 501 kB | 338/354 kB Progress (4): 767/780 kB | 244/329 kB | 501 kB | 338/354 kB Progress (4): 780 kB | 244/329 kB | 501 kB | 338/354 kB Progress (4): 780 kB | 244/329 kB | 501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.1 MB/s) 2024-09-22T08:56:53.464 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 780 kB | 260/329 kB | 354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 780 kB | 260/329 kB | 354 kB | 6.4 kB Progress (4): 780 kB | 277/329 kB | 354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 293/329 kB | 354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 310/329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-22T08:56:53.465 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-22T08:56:53.466 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 326/329 kB Progress (1): 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-22T08:56:53.466 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-22T08:56:53.479 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 80 kB/s) 2024-09-22T08:56:53.480 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-22T08:56:53.480 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 33/106 kB Progress (2): 33/106 kB | 16/211 kB Progress (2): 49/106 kB | 16/211 kB Progress (3): 49/106 kB | 16/211 kB | 16/586 kB Progress (4): 49/106 kB | 16/211 kB | 16/586 kB | 6.8 kB Progress (4): 66/106 kB | 16/211 kB | 16/586 kB | 6.8 kB Progress (4): 66/106 kB | 33/211 kB | 16/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-22T08:56:53.480 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 82/106 kB | 33/211 kB | 16/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-22T08:56:53.480 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 82/106 kB | 33/211 kB | 33/586 kB Progress (3): 82/106 kB | 49/211 kB | 33/586 kB Progress (3): 98/106 kB | 49/211 kB | 33/586 kB Progress (3): 106 kB | 49/211 kB | 33/586 kB Progress (3): 106 kB | 66/211 kB | 33/586 kB Progress (3): 106 kB | 66/211 kB | 49/586 kB Progress (3): 106 kB | 82/211 kB | 49/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 590 kB/s) 2024-09-22T08:56:53.480 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-22T08:56:53.482 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 82/211 kB | 66/586 kB Progress (2): 98/211 kB | 66/586 kB Progress (2): 115/211 kB | 66/586 kB Progress (2): 115/211 kB | 82/586 kB Progress (2): 131/211 kB | 82/586 kB Progress (2): 147/211 kB | 82/586 kB Progress (2): 164/211 kB | 82/586 kB Progress (2): 180/211 kB | 82/586 kB Progress (2): 180/211 kB | 98/586 kB Progress (2): 197/211 kB | 98/586 kB Progress (2): 197/211 kB | 115/586 kB Progress (2): 211 kB | 115/586 kB Progress (2): 211 kB | 131/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-22T08:56:53.482 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-22T08:56:53.495 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (2): 246/586 kB | 16/245 kB Progress (2): 256/586 kB | 16/245 kB Progress (2): 256/586 kB | 33/245 kB Progress (3): 256/586 kB | 33/245 kB | 16/205 kB Progress (3): 256/586 kB | 49/245 kB | 16/205 kB Progress (3): 256/586 kB | 49/245 kB | 33/205 kB Progress (3): 272/586 kB | 49/245 kB | 33/205 kB Progress (3): 272/586 kB | 66/245 kB | 33/205 kB Progress (3): 272/586 kB | 66/245 kB | 49/205 kB Progress (4): 272/586 kB | 66/245 kB | 49/205 kB | 15 kB Progress (4): 289/586 kB | 66/245 kB | 49/205 kB | 15 kB Progress (4): 289/586 kB | 82/245 kB | 49/205 kB | 15 kB Progress (4): 289/586 kB | 82/245 kB | 66/205 kB | 15 kB Progress (4): 305/586 kB | 82/245 kB | 66/205 kB | 15 kB Progress (4): 305/586 kB | 98/245 kB | 66/205 kB | 15 kB Progress (4): 305/586 kB | 98/245 kB | 81/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 78 kB/s) 2024-09-22T08:56:53.495 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 321/586 kB | 98/245 kB | 81/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-22T08:56:53.498 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 321/586 kB | 115/245 kB | 81/205 kB Progress (3): 321/586 kB | 115/245 kB | 98/205 kB Progress (3): 338/586 kB | 115/245 kB | 98/205 kB Progress (3): 338/586 kB | 131/245 kB | 98/205 kB Progress (3): 338/586 kB | 131/245 kB | 114/205 kB Progress (3): 354/586 kB | 131/245 kB | 114/205 kB Progress (3): 354/586 kB | 147/245 kB | 114/205 kB Progress (3): 354/586 kB | 147/245 kB | 130/205 kB Progress (3): 370/586 kB | 147/245 kB | 130/205 kB Progress (3): 370/586 kB | 164/245 kB | 130/205 kB Progress (3): 370/586 kB | 164/245 kB | 147/205 kB Progress (3): 387/586 kB | 164/245 kB | 147/205 kB Progress (4): 387/586 kB | 164/245 kB | 147/205 kB | 16/16 kB Progress (4): 387/586 kB | 164/245 kB | 147/205 kB | 16 kB Progress (4): 387/586 kB | 180/245 kB | 147/205 kB | 16 kB Progress (4): 403/586 kB | 180/245 kB | 147/205 kB | 16 kB Progress (4): 403/586 kB | 197/245 kB | 147/205 kB | 16 kB Progress (4): 420/586 kB | 197/245 kB | 147/205 kB | 16 kB Progress (4): 420/586 kB | 197/245 kB | 163/205 kB | 16 kB Progress (4): 420/586 kB | 213/245 kB | 163/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 83 kB/s) 2024-09-22T08:56:53.498 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 436/586 kB | 213/245 kB | 163/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-22T08:56:53.499 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 436/586 kB | 213/245 kB | 180/205 kB Progress (3): 436/586 kB | 229/245 kB | 180/205 kB Progress (3): 452/586 kB | 229/245 kB | 180/205 kB Progress (3): 452/586 kB | 229/245 kB | 196/205 kB Progress (3): 452/586 kB | 245 kB | 196/205 kB Progress (3): 452/586 kB | 245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-22T08:56:53.499 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-22T08:56:53.499 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-22T08:56:53.499 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-22T08:56:53.505 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-09-22T08:56:53.506 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-22T08:56:53.510 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 30 kB/s) 2024-09-22T08:56:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 106 kB/s) 2024-09-22T08:56:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 113 kB/s) 2024-09-22T08:56:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 81 kB/s) 2024-09-22T08:56:53.524 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 817 kB/s) 2024-09-22T08:56:53.551 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:53.551 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-22T08:56:53.559 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-22T08:56:53.574 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-22T08:56:53.577 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-22T08:56:53.592 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-22T08:56:53.595 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-22T08:56:53.610 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-22T08:56:53.615 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-22T08:56:53.630 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-22T08:56:53.636 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-22T08:56:53.652 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 64/153 kB Progress (1): 80/153 kB Progress (1): 97/153 kB Progress (1): 113/153 kB Progress (1): 129/153 kB Progress (1): 146/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.6 MB/s) 2024-09-22T08:56:53.653 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-22T08:56:53.670 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 79/215 kB Progress (1): 95/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 177/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-22T08:56:53.718 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:53.718 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:56:53.721 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-22T08:56:53.735 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-22T08:56:53.737 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-22T08:56:53.752 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-22T08:56:53.755 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-22T08:56:53.769 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-22T08:56:53.771 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-22T08:56:53.785 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-22T08:56:53.789 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-22T08:56:53.802 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:56:53.804 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-22T08:56:53.818 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-22T08:56:53.820 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-22T08:56:53.834 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-22T08:56:53.836 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-22T08:56:53.850 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-22T08:56:53.851 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-22T08:56:53.865 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-22T08:56:53.867 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-22T08:56:53.881 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-22T08:56:53.882 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-22T08:56:53.897 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-22T08:56:53.898 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-22T08:56:53.913 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-22T08:56:53.915 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-22T08:56:53.929 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-22T08:56:53.932 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-22T08:56:53.946 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-22T08:56:53.952 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-22T08:56:53.966 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-22T08:56:53.969 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-22T08:56:53.984 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-22T08:56:53.989 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-22T08:56:54.003 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-22T08:56:54.009 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-22T08:56:54.025 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-22T08:56:54.052 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/269 kB Progress (3): 2.5 kB | 16/269 kB | 8.5 kB Progress (4): 2.5 kB | 16/269 kB | 8.5 kB | 16/41 kB Progress (5): 2.5 kB | 16/269 kB | 8.5 kB | 16/41 kB | 16/55 kB Progress (5): 2.5 kB | 33/269 kB | 8.5 kB | 16/41 kB | 16/55 kB Progress (5): 2.5 kB | 33/269 kB | 8.5 kB | 33/41 kB | 16/55 kB Progress (5): 2.5 kB | 33/269 kB | 8.5 kB | 33/41 kB | 33/55 kB Progress (5): 2.5 kB | 49/269 kB | 8.5 kB | 33/41 kB | 33/55 kB Progress (5): 2.5 kB | 49/269 kB | 8.5 kB | 41 kB | 33/55 kB Progress (5): 2.5 kB | 63/269 kB | 8.5 kB | 41 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 92 kB/s) 2024-09-22T08:56:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 314 kB/s) 2024-09-22T08:56:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-22T08:56:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 63/269 kB | 41 kB | 49/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-22T08:56:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 79/269 kB | 41 kB | 49/55 kB Progress (3): 79/269 kB | 41 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.5 MB/s) 2024-09-22T08:56:54.053 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 96/269 kB | 55 kB Progress (2): 108/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.0 MB/s) 2024-09-22T08:56:54.054 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 124/269 kB Progress (1): 128/269 kB Progress (1): 145/269 kB Progress (1): 161/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 210/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 9.0 MB/s) 2024-09-22T08:56:54.074 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 63/587 kB Progress (2): 63/587 kB | 16/327 kB Progress (2): 79/587 kB | 16/327 kB Progress (2): 95/587 kB | 16/327 kB Progress (2): 95/587 kB | 33/327 kB Progress (2): 112/587 kB | 33/327 kB Progress (2): 112/587 kB | 49/327 kB Progress (2): 128/587 kB | 49/327 kB Progress (2): 145/587 kB | 49/327 kB Progress (2): 145/587 kB | 66/327 kB Progress (2): 161/587 kB | 66/327 kB Progress (2): 177/587 kB | 66/327 kB Progress (2): 177/587 kB | 82/327 kB Progress (2): 194/587 kB | 82/327 kB Progress (2): 194/587 kB | 98/327 kB Progress (2): 210/587 kB | 98/327 kB Progress (2): 227/587 kB | 98/327 kB Progress (2): 227/587 kB | 115/327 kB Progress (2): 243/587 kB | 115/327 kB Progress (2): 259/587 kB | 115/327 kB Progress (2): 259/587 kB | 131/327 kB Progress (2): 276/587 kB | 131/327 kB Progress (2): 276/587 kB | 147/327 kB Progress (2): 292/587 kB | 147/327 kB Progress (2): 308/587 kB | 147/327 kB Progress (2): 308/587 kB | 164/327 kB Progress (2): 325/587 kB | 164/327 kB Progress (2): 325/587 kB | 180/327 kB Progress (2): 341/587 kB | 180/327 kB Progress (2): 358/587 kB | 180/327 kB Progress (2): 358/587 kB | 197/327 kB Progress (2): 374/587 kB | 197/327 kB Progress (2): 374/587 kB | 213/327 kB Progress (2): 390/587 kB | 213/327 kB Progress (2): 407/587 kB | 213/327 kB Progress (2): 407/587 kB | 229/327 kB Progress (2): 423/587 kB | 229/327 kB Progress (2): 440/587 kB | 229/327 kB Progress (2): 440/587 kB | 246/327 kB Progress (2): 456/587 kB | 246/327 kB Progress (2): 456/587 kB | 256/327 kB Progress (2): 472/587 kB | 256/327 kB Progress (2): 472/587 kB | 272/327 kB Progress (2): 489/587 kB | 272/327 kB Progress (2): 505/587 kB | 272/327 kB Progress (2): 505/587 kB | 289/327 kB Progress (2): 521/587 kB | 289/327 kB Progress (2): 538/587 kB | 289/327 kB Progress (2): 538/587 kB | 305/327 kB Progress (2): 554/587 kB | 305/327 kB Progress (2): 554/587 kB | 321/327 kB Progress (2): 571/587 kB | 321/327 kB Progress (2): 571/587 kB | 327 kB Progress (2): 587/587 kB | 327 kB Progress (2): 587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 12 MB/s) 2024-09-22T08:56:54.074 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 6.8 MB/s) 2024-09-22T08:56:54.110 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:56:54.110 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:54.111 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:56:54.115 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-22T08:56:54.130 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-22T08:56:54.132 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-22T08:56:54.146 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-22T08:56:54.148 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-22T08:56:54.162 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-22T08:56:54.165 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-22T08:56:54.179 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-22T08:56:54.183 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-22T08:56:54.198 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-22T08:56:54.200 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-22T08:56:54.215 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-22T08:56:54.216 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-22T08:56:54.231 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-22T08:56:54.235 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-22T08:56:54.250 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-22T08:56:54.252 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-22T08:56:54.266 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-22T08:56:54.269 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-22T08:56:54.283 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-22T08:56:54.285 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-22T08:56:54.299 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-22T08:56:54.302 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-22T08:56:54.316 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-22T08:56:54.318 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-22T08:56:54.333 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-22T08:56:54.335 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-22T08:56:54.349 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-22T08:56:54.350 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-22T08:56:54.364 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 645 kB/s) 2024-09-22T08:56:54.365 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-22T08:56:54.379 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 206 kB/s) 2024-09-22T08:56:54.381 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-22T08:56:54.395 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-22T08:56:54.398 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-22T08:56:54.412 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-22T08:56:54.414 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-22T08:56:54.428 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-22T08:56:54.430 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-22T08:56:54.443 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-22T08:56:54.445 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-22T08:56:54.459 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-22T08:56:54.461 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-22T08:56:54.476 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-22T08:56:54.477 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-22T08:56:54.492 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-22T08:56:54.498 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-22T08:56:54.512 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-22T08:56:54.512 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-22T08:56:54.513 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-22T08:56:54.513 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-22T08:56:54.513 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-22T08:56:54.513 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-22T08:56:54.528 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/122 kB Progress (4): 4.2 kB | 16/55 kB | 16/122 kB | 16/334 kB Progress (4): 4.2 kB | 33/55 kB | 16/122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-22T08:56:54.528 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-22T08:56:54.528 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 33/55 kB | 16/122 kB | 16/334 kB | 16/27 kB Progress (4): 33/55 kB | 33/122 kB | 16/334 kB | 16/27 kB Progress (4): 33/55 kB | 33/122 kB | 33/334 kB | 16/27 kB Progress (4): 49/55 kB | 33/122 kB | 33/334 kB | 16/27 kB Progress (4): 49/55 kB | 33/122 kB | 33/334 kB | 27 kB Progress (4): 55 kB | 33/122 kB | 33/334 kB | 27 kB Progress (4): 55 kB | 49/122 kB | 33/334 kB | 27 kB Progress (4): 55 kB | 49/122 kB | 49/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-22T08:56:54.529 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-22T08:56:54.529 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 55 kB | 49/122 kB | 62/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-22T08:56:54.529 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 66/122 kB | 62/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-22T08:56:54.530 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 66/122 kB | 79/334 kB Progress (2): 82/122 kB | 79/334 kB Progress (2): 82/122 kB | 95/334 kB Progress (2): 98/122 kB | 95/334 kB Progress (2): 98/122 kB | 111/334 kB Progress (2): 115/122 kB | 111/334 kB Progress (2): 122 kB | 111/334 kB Progress (2): 122 kB | 128/334 kB Progress (2): 122 kB | 144/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-22T08:56:54.532 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 161/334 kB Progress (1): 177/334 kB Progress (1): 193/334 kB Progress (1): 210/334 kB Progress (1): 226/334 kB Progress (1): 242/334 kB Progress (1): 259/334 kB Progress (1): 275/334 kB Progress (1): 292/334 kB Progress (1): 308/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-22T08:56:54.542 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/23 kB Progress (3): 4.7 kB | 16/23 kB | 16/267 kB Progress (3): 4.7 kB | 23 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-22T08:56:54.542 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 23 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-22T08:56:54.545 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-22T08:56:54.602 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-22T08:56:54.605 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-22T08:56:55.317 INFO:tasks.workunit.client.0.smithi039.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:56:55.317 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:55.317 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:56:55.321 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:56:55.321 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:55.321 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:56:55.328 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-22T08:56:55.329 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-22T08:56:55.519 INFO:tasks.workunit.client.0.smithi039.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-22T08:56:55.519 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:55.519 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:56:55.526 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-22T08:56:55.541 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-22T08:56:55.546 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-22T08:56:55.561 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-22T08:56:55.564 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-22T08:56:55.579 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-22T08:56:55.583 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-22T08:56:55.598 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-22T08:56:55.601 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-22T08:56:55.616 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-22T08:56:55.620 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-22T08:56:55.635 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-22T08:56:55.638 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-22T08:56:55.653 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-22T08:56:55.655 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-22T08:56:55.669 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-22T08:56:55.670 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-22T08:56:55.684 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-22T08:56:55.687 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-22T08:56:55.700 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-22T08:56:55.703 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-22T08:56:55.717 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-22T08:56:55.721 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-22T08:56:55.735 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-22T08:56:55.737 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-22T08:56:55.751 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-22T08:56:55.753 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-22T08:56:55.767 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-22T08:56:55.769 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-22T08:56:55.783 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-22T08:56:55.785 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-22T08:56:55.799 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-22T08:56:55.801 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-22T08:56:55.814 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-22T08:56:55.817 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-22T08:56:55.831 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 620 kB/s) 2024-09-22T08:56:55.834 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-22T08:56:55.848 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-22T08:56:55.851 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-22T08:56:55.865 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-22T08:56:55.868 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-22T08:56:55.882 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-22T08:56:55.883 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-22T08:56:55.897 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-22T08:56:55.898 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-22T08:56:55.912 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-22T08:56:55.914 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-22T08:56:55.927 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-22T08:56:55.929 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-22T08:56:55.943 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-22T08:56:55.945 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-22T08:56:55.959 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-22T08:56:55.960 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-22T08:56:55.974 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-22T08:56:55.975 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-22T08:56:55.989 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-22T08:56:55.991 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-22T08:56:56.005 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-22T08:56:56.007 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-22T08:56:56.020 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-22T08:56:56.024 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-22T08:56:56.038 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-22T08:56:56.041 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-22T08:56:56.055 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-22T08:56:56.057 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-22T08:56:56.071 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-22T08:56:56.074 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-22T08:56:56.088 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-22T08:56:56.090 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-22T08:56:56.104 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-22T08:56:56.106 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-22T08:56:56.119 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-22T08:56:56.121 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-22T08:56:56.136 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-22T08:56:56.138 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-22T08:56:56.153 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-22T08:56:56.155 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-22T08:56:56.168 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-22T08:56:56.171 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-22T08:56:56.185 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-22T08:56:56.186 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-22T08:56:56.200 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-22T08:56:56.202 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-22T08:56:56.215 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-22T08:56:56.217 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-22T08:56:56.231 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-22T08:56:56.234 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-22T08:56:56.248 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-22T08:56:56.250 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-22T08:56:56.264 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-22T08:56:56.266 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-22T08:56:56.281 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-22T08:56:56.283 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-22T08:56:56.298 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-22T08:56:56.299 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-22T08:56:56.313 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-22T08:56:56.315 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-22T08:56:56.329 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-22T08:56:56.332 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-22T08:56:56.345 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-22T08:56:56.347 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-22T08:56:56.360 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-22T08:56:56.362 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-22T08:56:56.376 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-22T08:56:56.377 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-22T08:56:56.391 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-22T08:56:56.393 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-22T08:56:56.407 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-22T08:56:56.409 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-22T08:56:56.424 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-22T08:56:56.426 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-22T08:56:56.440 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-22T08:56:56.446 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-22T08:56:56.457 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-22T08:56:56.460 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-22T08:56:56.474 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-22T08:56:56.477 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-22T08:56:56.491 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-22T08:56:56.492 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-22T08:56:56.506 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-22T08:56:56.508 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-22T08:56:56.522 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-22T08:56:56.524 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-22T08:56:56.538 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-22T08:56:56.542 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-22T08:56:56.562 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-22T08:56:56.562 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-22T08:56:56.562 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-22T08:56:56.562 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-22T08:56:56.562 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-22T08:56:56.563 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 16/118 kB Progress (3): 49/171 kB | 16/118 kB | 14 kB Progress (3): 66/171 kB | 16/118 kB | 14 kB Progress (3): 66/171 kB | 33/118 kB | 14 kB Progress (4): 66/171 kB | 33/118 kB | 14 kB | 8.2 kB Progress (4): 82/171 kB | 33/118 kB | 14 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 82/171 kB | 33/118 kB | 8.2 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 82/171 kB | 49/118 kB | 8.2 kB | 16/26 kB Progress (4): 82/171 kB | 49/118 kB | 8.2 kB | 26 kB Progress (4): 98/171 kB | 49/118 kB | 8.2 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 98/171 kB | 66/118 kB | 26 kB Progress (3): 115/171 kB | 66/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 115/171 kB | 82/118 kB Progress (2): 131/171 kB | 82/118 kB Progress (2): 131/171 kB | 98/118 kB Progress (2): 147/171 kB | 98/118 kB Progress (2): 164/171 kB | 98/118 kB Progress (2): 164/171 kB | 115/118 kB Progress (2): 171 kB | 115/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-22T08:56:56.580 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-22T08:56:56.595 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (2): 33/146 kB | 16/61 kB Progress (2): 49/146 kB | 16/61 kB Progress (3): 49/146 kB | 16/61 kB | 16/136 kB Progress (3): 49/146 kB | 33/61 kB | 16/136 kB Progress (3): 63/146 kB | 33/61 kB | 16/136 kB Progress (3): 63/146 kB | 33/61 kB | 33/136 kB Progress (3): 80/146 kB | 33/61 kB | 33/136 kB Progress (3): 80/146 kB | 49/61 kB | 33/136 kB Progress (3): 80/146 kB | 49/61 kB | 49/136 kB Progress (3): 80/146 kB | 61 kB | 49/136 kB Progress (3): 96/146 kB | 61 kB | 49/136 kB Progress (3): 96/146 kB | 61 kB | 62/136 kB Progress (3): 112/146 kB | 61 kB | 62/136 kB Progress (4): 112/146 kB | 61 kB | 62/136 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-22T08:56:56.595 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-22T08:56:56.595 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 112/146 kB | 62/136 kB | 16/501 kB | 16/58 kB Progress (4): 112/146 kB | 78/136 kB | 16/501 kB | 16/58 kB Progress (4): 129/146 kB | 78/136 kB | 16/501 kB | 16/58 kB Progress (4): 129/146 kB | 78/136 kB | 33/501 kB | 16/58 kB Progress (4): 129/146 kB | 78/136 kB | 33/501 kB | 33/58 kB Progress (4): 145/146 kB | 78/136 kB | 33/501 kB | 33/58 kB Progress (4): 145/146 kB | 94/136 kB | 33/501 kB | 33/58 kB Progress (4): 146 kB | 94/136 kB | 33/501 kB | 33/58 kB Progress (4): 146 kB | 94/136 kB | 33/501 kB | 49/58 kB Progress (4): 146 kB | 94/136 kB | 49/501 kB | 49/58 kB Progress (4): 146 kB | 94/136 kB | 49/501 kB | 58 kB Progress (4): 146 kB | 111/136 kB | 49/501 kB | 58 kB Progress (4): 146 kB | 111/136 kB | 63/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-22T08:56:56.595 INFO:tasks.workunit.client.0.smithi039.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-22T08:56:56.595 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-22T08:56:56.596 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 127/136 kB | 63/501 kB Progress (2): 127/136 kB | 80/501 kB Progress (2): 136 kB | 80/501 kB Progress (2): 136 kB | 96/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-22T08:56:56.601 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 113/501 kB Progress (1): 129/501 kB Progress (1): 145/501 kB Progress (1): 162/501 kB Progress (1): 178/501 kB Progress (1): 194/501 kB Progress (1): 211/501 kB Progress (1): 227/501 kB Progress (1): 244/501 kB Progress (1): 260/501 kB Progress (1): 276/501 kB Progress (1): 293/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 342/501 kB Progress (1): 358/501 kB Progress (1): 375/501 kB Progress (1): 391/501 kB Progress (1): 407/501 kB Progress (1): 424/501 kB Progress (1): 440/501 kB Progress (1): 457/501 kB Progress (1): 473/501 kB Progress (1): 489/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-22T08:56:56.609 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-22T08:56:56.645 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 29 MB/s) 2024-09-22T08:56:56.718 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:56.718 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-22T08:56:56.721 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-22T08:56:56.736 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-22T08:56:56.738 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-22T08:56:56.753 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-22T08:56:56.755 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-22T08:56:56.770 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-22T08:56:56.773 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-22T08:56:56.788 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-22T08:56:56.791 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-22T08:56:56.806 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-22T08:56:56.809 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-22T08:56:56.823 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-22T08:56:56.826 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-22T08:56:56.841 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-22T08:56:56.844 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-22T08:56:56.859 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-22T08:56:56.862 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-22T08:56:56.877 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-22T08:56:56.882 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-22T08:56:56.897 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-22T08:56:56.900 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-22T08:56:56.914 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-22T08:56:56.917 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-22T08:56:56.932 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-22T08:56:56.934 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-22T08:56:56.949 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-22T08:56:56.956 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-22T08:56:56.971 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-22T08:56:56.971 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-22T08:56:56.972 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-22T08:56:56.973 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-22T08:56:56.973 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-22T08:56:56.973 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-22T08:56:56.988 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/58 kB Progress (3): 16/79 kB | 16/58 kB | 0/1.0 MB Progress (3): 33/79 kB | 16/58 kB | 0/1.0 MB Progress (4): 33/79 kB | 16/58 kB | 0/1.0 MB | 16/211 kB Progress (4): 33/79 kB | 16/58 kB | 0/1.0 MB | 16/211 kB Progress (4): 49/79 kB | 16/58 kB | 0/1.0 MB | 16/211 kB Progress (4): 49/79 kB | 16/58 kB | 0/1.0 MB | 33/211 kB Progress (5): 49/79 kB | 16/58 kB | 0/1.0 MB | 33/211 kB | 16/26 kB Progress (5): 49/79 kB | 16/58 kB | 0/1.0 MB | 33/211 kB | 16/26 kB Progress (5): 49/79 kB | 33/58 kB | 0/1.0 MB | 33/211 kB | 16/26 kB Progress (5): 66/79 kB | 33/58 kB | 0/1.0 MB | 33/211 kB | 16/26 kB Progress (5): 66/79 kB | 33/58 kB | 0/1.0 MB | 33/211 kB | 26 kB Progress (5): 66/79 kB | 33/58 kB | 0/1.0 MB | 49/211 kB | 26 kB Progress (5): 66/79 kB | 33/58 kB | 0.1/1.0 MB | 49/211 kB | 26 kB Progress (5): 79 kB | 33/58 kB | 0.1/1.0 MB | 49/211 kB | 26 kB Progress (5): 79 kB | 33/58 kB | 0.1/1.0 MB | 63/211 kB | 26 kB Progress (5): 79 kB | 49/58 kB | 0.1/1.0 MB | 63/211 kB | 26 kB Progress (5): 79 kB | 49/58 kB | 0.1/1.0 MB | 63/211 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-22T08:56:56.988 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 79 kB | 49/58 kB | 0.1/1.0 MB | 80/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-22T08:56:56.988 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 80/211 kB Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 80/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-22T08:56:56.989 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-22T08:56:56.990 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 58 kB | 0.1/1.0 MB | 96/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 96/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 112/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 112/211 kB Progress (3): 58 kB | 0.1/1.0 MB | 129/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-22T08:56:56.991 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 0.1/1.0 MB | 145/211 kB Progress (2): 0.1/1.0 MB | 145/211 kB Progress (2): 0.1/1.0 MB | 162/211 kB Progress (2): 0.2/1.0 MB | 162/211 kB Progress (2): 0.2/1.0 MB | 178/211 kB Progress (2): 0.2/1.0 MB | 178/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 211/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-22T08:56:57.004 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (3): 1.0/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 33/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 1.0 MB | 66/116 kB | 49/267 kB Progress (3): 1.0 MB | 82/116 kB | 49/267 kB Progress (3): 1.0 MB | 82/116 kB | 65/267 kB Progress (3): 1.0 MB | 98/116 kB | 65/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 32 MB/s) 2024-09-22T08:56:57.004 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 98/116 kB | 82/267 kB Progress (2): 115/116 kB | 82/267 kB Progress (2): 116 kB | 82/267 kB Progress (2): 116 kB | 98/267 kB Progress (2): 116 kB | 114/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-22T08:56:57.008 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 254/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-22T08:56:57.204 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-22T08:56:57.239 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:56:57.240 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:56:57.240 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:56:57.241 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Total time: 6.093 s 2024-09-22T08:56:57.241 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Finished at: 2024-09-22T08:56:57Z 2024-09-22T08:56:57.241 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:56:57.265 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-22T08:56:57.275 INFO:tasks.workunit.client.0.smithi039.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-22T08:56:58.333 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Scanning for projects... 2024-09-22T08:56:58.411 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.411 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-22T08:56:58.411 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Building jcksum 1.0 2024-09-22T08:56:58.411 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] from pom.xml 2024-09-22T08:56:58.411 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-22T08:56:58.663 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.663 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-22T08:56:58.754 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-22T08:56:58.755 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.755 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-22T08:56:58.846 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:56:58.846 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.846 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-22T08:56:58.848 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-22T08:56:58.848 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.848 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-22T08:56:58.853 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-22T08:56:58.853 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:58.854 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-22T08:56:59.047 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-22T08:56:59.247 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-22T08:56:59.453 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-22T08:56:59.462 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-22T08:56:59.479 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-22T08:56:59.485 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-22T08:56:59.502 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-22T08:56:59.506 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-22T08:56:59.523 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-22T08:56:59.526 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-22T08:56:59.542 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-22T08:56:59.546 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-22T08:56:59.562 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-22T08:56:59.565 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-22T08:56:59.581 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-22T08:56:59.588 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-22T08:56:59.611 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-22T08:56:59.613 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-22T08:56:59.613 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-22T08:56:59.613 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-22T08:56:59.614 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-22T08:56:59.614 INFO:tasks.workunit.client.0.smithi039.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-22T08:56:59.652 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 62/169 kB Progress (1): 78/169 kB Progress (1): 94/169 kB Progress (1): 111/169 kB Progress (1): 127/169 kB Progress (1): 144/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.2 MB/s) 2024-09-22T08:56:59.667 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 2.8/18 kB Progress (3): 4.1/7.7 kB | 2.8/18 kB | 1.4/103 kB Progress (3): 4.1/7.7 kB | 4.1/18 kB | 1.4/103 kB Progress (3): 5.5/7.7 kB | 4.1/18 kB | 1.4/103 kB Progress (3): 5.5/7.7 kB | 5.5/18 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 5.5/18 kB | 1.4/103 kB | 1.4/189 kB Progress (4): 5.5/7.7 kB | 6.9/18 kB | 1.4/103 kB | 1.4/189 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 1.4/103 kB | 1.4/189 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 2.8/103 kB | 1.4/189 kB Progress (4): 7.7 kB | 6.9/18 kB | 2.8/103 kB | 1.4/189 kB Progress (4): 7.7 kB | 8.3/18 kB | 2.8/103 kB | 1.4/189 kB Progress (4): 7.7 kB | 8.3/18 kB | 2.8/103 kB | 2.8/189 kB Progress (4): 7.7 kB | 9.7/18 kB | 2.8/103 kB | 2.8/189 kB Progress (4): 7.7 kB | 9.7/18 kB | 4.1/103 kB | 2.8/189 kB Progress (4): 7.7 kB | 11/18 kB | 4.1/103 kB | 2.8/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-22T08:56:59.679 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (3): 12/18 kB | 4.1/103 kB | 2.8/189 kB Progress (3): 12/18 kB | 4.1/103 kB | 4.1/189 kB Progress (3): 14/18 kB | 4.1/103 kB | 4.1/189 kB Progress (3): 14/18 kB | 5.5/103 kB | 4.1/189 kB Progress (3): 15/18 kB | 5.5/103 kB | 4.1/189 kB Progress (3): 15/18 kB | 5.5/103 kB | 5.5/189 kB Progress (3): 17/18 kB | 5.5/103 kB | 5.5/189 kB Progress (3): 17/18 kB | 6.9/103 kB | 5.5/189 kB Progress (3): 18 kB | 6.9/103 kB | 5.5/189 kB Progress (3): 18 kB | 6.9/103 kB | 6.9/189 kB Progress (3): 18 kB | 8.3/103 kB | 6.9/189 kB Progress (3): 18 kB | 8.3/103 kB | 8.3/189 kB Progress (3): 18 kB | 9.7/103 kB | 8.3/189 kB Progress (3): 18 kB | 9.7/103 kB | 9.7/189 kB Progress (3): 18 kB | 11/103 kB | 9.7/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 298 kB/s) 2024-09-22T08:56:59.698 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (2): 11/103 kB | 11/189 kB Progress (2): 12/103 kB | 11/189 kB Progress (2): 12/103 kB | 12/189 kB Progress (2): 14/103 kB | 12/189 kB Progress (2): 14/103 kB | 14/189 kB Progress (2): 15/103 kB | 14/189 kB Progress (2): 15/103 kB | 15/189 kB Progress (2): 16/103 kB | 15/189 kB Progress (2): 16/103 kB | 16/189 kB Progress (2): 17/103 kB | 16/189 kB Progress (2): 17/103 kB | 18/189 kB Progress (2): 19/103 kB | 18/189 kB Progress (2): 19/103 kB | 19/189 kB Progress (2): 20/103 kB | 19/189 kB Progress (2): 20/103 kB | 21/189 kB Progress (2): 21/103 kB | 21/189 kB Progress (2): 21/103 kB | 22/189 kB Progress (2): 23/103 kB | 22/189 kB Progress (2): 23/103 kB | 23/189 kB Progress (2): 24/103 kB | 23/189 kB Progress (2): 24/103 kB | 25/189 kB Progress (2): 25/103 kB | 25/189 kB Progress (2): 25/103 kB | 26/189 kB Progress (2): 27/103 kB | 26/189 kB Progress (2): 27/103 kB | 27/189 kB Progress (2): 28/103 kB | 27/189 kB Progress (2): 28/103 kB | 29/189 kB Progress (2): 30/103 kB | 29/189 kB Progress (2): 30/103 kB | 30/189 kB Progress (2): 31/103 kB | 30/189 kB Progress (2): 31/103 kB | 32/189 kB Progress (2): 32/103 kB | 32/189 kB Progress (2): 32/103 kB | 33/189 kB Progress (2): 34/103 kB | 33/189 kB Progress (2): 34/103 kB | 34/189 kB Progress (2): 35/103 kB | 34/189 kB Progress (2): 35/103 kB | 36/189 kB Progress (2): 36/103 kB | 36/189 kB Progress (2): 36/103 kB | 37/189 kB Progress (2): 38/103 kB | 37/189 kB Progress (2): 38/103 kB | 38/189 kB Progress (2): 39/103 kB | 38/189 kB Progress (2): 39/103 kB | 40/189 kB Progress (2): 41/103 kB | 40/189 kB Progress (2): 41/103 kB | 41/189 kB Progress (2): 42/103 kB | 41/189 kB Progress (2): 42/103 kB | 43/189 kB Progress (2): 43/103 kB | 43/189 kB Progress (2): 43/103 kB | 44/189 kB Progress (2): 45/103 kB | 44/189 kB Progress (2): 45/103 kB | 45/189 kB Progress (2): 46/103 kB | 45/189 kB Progress (2): 46/103 kB | 47/189 kB Progress (2): 48/103 kB | 47/189 kB Progress (2): 48/103 kB | 48/189 kB Progress (2): 49/103 kB | 48/189 kB Progress (2): 49/103 kB | 49/189 kB Progress (2): 50/103 kB | 49/189 kB Progress (2): 50/103 kB | 51/189 kB Progress (2): 52/103 kB | 51/189 kB Progress (2): 52/103 kB | 52/189 kB Progress (2): 53/103 kB | 52/189 kB Progress (2): 53/103 kB | 53/189 kB Progress (2): 54/103 kB | 53/189 kB Progress (2): 54/103 kB | 55/189 kB Progress (2): 56/103 kB | 55/189 kB Progress (2): 56/103 kB | 56/189 kB Progress (2): 57/103 kB | 56/189 kB Progress (2): 57/103 kB | 57/189 kB Progress (2): 59/103 kB | 57/189 kB Progress (2): 59/103 kB | 59/189 kB Progress (2): 60/103 kB | 59/189 kB Progress (2): 60/103 kB | 60/189 kB Progress (2): 61/103 kB | 60/189 kB Progress (2): 61/103 kB | 62/189 kB Progress (2): 62/103 kB | 62/189 kB Progress (2): 62/103 kB | 63/189 kB Progress (2): 62/103 kB | 79/189 kB Progress (2): 79/103 kB | 79/189 kB Progress (2): 79/103 kB | 96/189 kB Progress (2): 79/103 kB | 112/189 kB Progress (2): 79/103 kB | 128/189 kB Progress (2): 95/103 kB | 128/189 kB Progress (2): 103 kB | 128/189 kB Progress (2): 103 kB | 145/189 kB Progress (2): 103 kB | 161/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-22T08:56:59.699 INFO:tasks.workunit.client.0.smithi039.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-22T08:56:59.714 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:56:59.714 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:56:59.714 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] T E S T S 2024-09-22T08:56:59.714 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------- 2024-09-22T08:57:00.154 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-22T08:57:00.283 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjects.java: starting test run: 2024-09-22T08:57:00.283 INFO:tasks.workunit.client.0.smithi039.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-22T08:57:00.284 INFO:tasks.workunit.client.0.smithi039.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-22T08:57:00.284 INFO:tasks.workunit.client.0.smithi039.stdout: EndpointUrl=https://smithi039.front.sepia.ceph.com:443 2024-09-22T08:57:00.284 INFO:tasks.workunit.client.0.smithi039.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-22T08:57:00.380 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Environment Variables Read 2024-09-22T08:57:00.683 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: S3 Client Initialized 2024-09-22T08:57:00.683 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.683 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.683 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generating File 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: File Generated 2024-09-22T08:57:00.684 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Generated Big Files 2024-09-22T08:57:01.081 INFO:tasks.workunit.client.0.smithi039.stdout:HeadBucketResponse() 2024-09-22T08:57:01.082 INFO:tasks.workunit.client.0.smithi039.stdout:sheik is ready 2024-09-22T08:57:01.082 INFO:tasks.workunit.client.0.smithi039.stdout:DEBUG: Test Bucket Created 2024-09-22T08:57:01.181 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-22T08:57:01.382 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-22T08:57:01.482 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-22T08:57:01.682 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-22T08:57:01.782 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-22T08:57:01.983 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-22T08:57:02.183 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-22T08:57:02.283 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-22T08:57:02.784 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-22T08:57:03.284 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-22T08:57:06.590 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-22T08:57:10.195 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-22T08:57:48.890 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-0b 2024-09-22T08:57:48.891 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-8b 2024-09-22T08:57:48.893 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-200b 2024-09-22T08:57:48.894 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-21983b 2024-09-22T08:57:48.895 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-5519b 2024-09-22T08:57:48.896 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-204329b 2024-09-22T08:57:48.898 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-256k 2024-09-22T08:57:48.899 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-1m 2024-09-22T08:57:48.901 INFO:tasks.workunit.client.0.smithi039.stdout:arg: file-1038757b 2024-09-22T08:57:48.941 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-0b 2024-09-22T08:57:49.040 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.141 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-8b 2024-09-22T08:57:49.141 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.241 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-200b 2024-09-22T08:57:49.241 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.341 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-21983b 2024-09-22T08:57:49.428 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.441 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-5519b 2024-09-22T08:57:49.541 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.642 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-204329b 2024-09-22T08:57:49.742 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:49.842 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-256k 2024-09-22T08:57:49.942 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:50.042 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-1m 2024-09-22T08:57:50.442 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:50.643 INFO:tasks.workunit.client.0.smithi039.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-22T08:57:51.043 INFO:tasks.workunit.client.0.smithi039.stdout:PutObjectResponse 2024-09-22T08:57:51.244 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-22T08:57:54.246 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-22T08:57:58.951 INFO:tasks.workunit.client.0.smithi039.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-22T08:58:44.687 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.5 s -- in io.ceph.jcksum.PutObjects 2024-09-22T08:58:44.698 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:58:44.699 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Results: 2024-09-22T08:58:44.699 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:58:44.699 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-22T08:58:44.699 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] 2024-09-22T08:58:44.701 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:58:44.701 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] BUILD SUCCESS 2024-09-22T08:58:44.701 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:58:44.702 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Total time: 01:46 min 2024-09-22T08:58:44.702 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] Finished at: 2024-09-22T08:58:44Z 2024-09-22T08:58:44.702 INFO:tasks.workunit.client.0.smithi039.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-22T08:58:44.714 INFO:tasks.workunit.client.0.smithi039.stderr:+ exit 2024-09-22T08:58:44.714 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T08:58:44.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T08:58:44.794 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-22T08:58:44.794 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T08:58:45.169 DEBUG:teuthology.parallel:result is None 2024-09-22T08:58:45.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:58:45.209 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:58:45.209 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:58:45.281 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T08:58:45.281 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T08:58:45.292 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:58:45.292 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T08:58:45.292 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:58:45.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T08:58:45.351 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T08:58:45.351 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T08:58:45.422 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T08:58:45.422 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T08:58:45.491 INFO:tasks.workunit:timeout=3h 2024-09-22T08:58:45.492 INFO:tasks.workunit:cleanup=True 2024-09-22T08:58:45.492 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T08:58:45.563 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T08:59:47.908 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 93% (11846/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T08:59:48.830 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T08:59:48.830 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.830 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T08:59:48.830 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T08:59:48.831 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T08:59:48.836 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T08:59:48.905 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T08:59:48.908 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:59:48.908 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T08:59:48.958 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T08:59:49.008 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T08:59:49.049 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T08:59:49.051 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:59:49.051 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T08:59:49.090 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T08:59:49.094 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T08:59:49.094 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T08:59:49.164 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-22T08:59:49.165 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-22T08:59:49.165 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-22T08:59:49.240 INFO:tasks.workunit.client.0.smithi039.stdout:INFO: fully qualified domain name: smithi039.front.sepia.ceph.com 2024-09-22T08:59:49.240 INFO:tasks.workunit.client.0.smithi039.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-22T08:59:49.240 INFO:tasks.workunit.client.0.smithi039.stdout:== TESTING VERSIONED BUCKET == 2024-09-22T08:59:51.867 INFO:tasks.workunit.client.0.smithi039.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T08:59:52.050 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting pip 2024-09-22T08:59:52.056 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T08:59:52.103 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: pip 2024-09-22T08:59:52.103 INFO:tasks.workunit.client.0.smithi039.stdout: Attempting uninstall: pip 2024-09-22T08:59:52.103 INFO:tasks.workunit.client.0.smithi039.stdout: Found existing installation: pip 21.3.1 2024-09-22T08:59:52.269 INFO:tasks.workunit.client.0.smithi039.stdout: Uninstalling pip-21.3.1: 2024-09-22T08:59:52.274 INFO:tasks.workunit.client.0.smithi039.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T08:59:53.047 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed pip-24.2 2024-09-22T08:59:53.907 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting boto3 2024-09-22T08:59:53.908 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T08:59:54.472 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T08:59:54.473 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T08:59:54.523 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T08:59:54.525 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T08:59:54.579 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T08:59:54.580 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T08:59:54.630 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:59:54.631 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T08:59:54.709 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:59:54.710 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T08:59:54.868 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T08:59:54.870 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T08:59:54.874 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T08:59:54.876 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T08:59:54.885 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T08:59:54.886 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T08:59:54.887 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T08:59:54.889 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T08:59:54.890 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T08:59:54.967 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T08:59:55.973 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T08:59:56.214 INFO:tasks.workunit.client.0.smithi039.stdout:INFO: creating user 2024-09-22T08:59:56.739 INFO:tasks.workunit.client.0.smithi039.stdout:{ 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "user_id": "testid", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "display_name": "M. Tester", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "email": "tester@ceph.com", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "suspended": 0, 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "max_buckets": 1000, 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "subusers": [], 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "keys": [ 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: { 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "user": "testid", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "access_key": "0555b35654ad1656d804", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-22T08:59:56.740 INFO:tasks.workunit.client.0.smithi039.stdout: "active": true, 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:59:56.730121Z" 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: } 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: ], 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "swift_keys": [], 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "caps": [], 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "default_placement": "", 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "default_storage_class": "", 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "placement_tags": [], 2024-09-22T08:59:56.741 INFO:tasks.workunit.client.0.smithi039.stdout: "bucket_quota": { 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "user_quota": { 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "enabled": false, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "check_on_raw": false, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size": -1, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_size_kb": 0, 2024-09-22T08:59:56.742 INFO:tasks.workunit.client.0.smithi039.stdout: "max_objects": -1 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: }, 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "temp_url_keys": [], 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "type": "rgw", 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "mfa_ids": [], 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "account_id": "", 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "path": "/", 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "create_date": "2024-09-22T08:59:56.730108Z", 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "tags": [], 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: "group_ids": [] 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout:} 2024-09-22T08:59:56.743 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-09-22T09:00:06.353 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:06.353 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:06.403 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:06.403 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:06.451 INFO:tasks.workunit.client.0.smithi039.stderr:5+0 records in 2024-09-22T09:00:06.452 INFO:tasks.workunit.client.0.smithi039.stderr:5+0 records out 2024-09-22T09:00:06.452 INFO:tasks.workunit.client.0.smithi039.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.014175 s, 370 MB/s 2024-09-22T09:00:06.455 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:06.455 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:06.536 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:06.536 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:07.616 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:07.616 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:08.697 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:08.697 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:09.779 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:09.779 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:10.862 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:10.862 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:11.941 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:11.942 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:13.032 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:13.032 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:14.109 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:14.110 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:15.186 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:15.186 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:16.267 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:16.267 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:17.350 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:17.350 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:18.439 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:18.439 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:19.529 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:19.529 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:20.598 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:00:20.598 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:bucket nams is reupload-bkt-113084 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:endpoint is https://smithi039.front.sepia.ceph.com:443 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:start UploadId=2~B704qfTAgI5ZwwpMYa77fvenEXPibe6 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:phase 1 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:phase 1 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 2} 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.680 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:phase 2 uploaded part {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1} 2024-09-22T09:00:20.681 INFO:tasks.workunit.client.0.smithi039.stdout:aborting multipart upload, parts=[{'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 1}, {'ETag': '"170b3ebb440954062476af576a30e3ef"', 'PartNumber': 2}] 2024-09-22T09:00:22.301 INFO:tasks.workunit.client.0.smithi039.stdout:radosgw-admin bucket radoslist: 2024-09-22T09:00:22.362 INFO:tasks.workunit.client.0.smithi039.stdout:rados ls: 2024-09-22T09:00:22.371 INFO:tasks.workunit.client.0.smithi039.stdout:== PASSED == 2024-09-22T09:00:22.372 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T09:00:22.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T09:00:22.453 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-22T09:00:22.453 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T09:00:22.874 DEBUG:teuthology.parallel:result is None 2024-09-22T09:00:22.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:00:22.914 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:00:22.914 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:00:22.985 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:00:22.985 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-22T09:00:22.998 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-22T09:00:22.998 INFO:tasks.ragweed:Downloading ragweed... 2024-09-22T09:00:22.998 INFO:tasks.ragweed:Using branch 'wip-skoduri-cloud-restore' for ragweed 2024-09-22T09:00:22.998 DEBUG:teuthology.orchestra.run.smithi039:> git clone -b wip-skoduri-cloud-restore https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T09:00:23.054 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T09:00:23.082 INFO:teuthology.orchestra.run.smithi039.stderr:fatal: Remote branch wip-skoduri-cloud-restore not found in upstream origin 2024-09-22T09:00:23.083 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-22T09:00:23.084 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-22T09:00:23.084 DEBUG:teuthology.orchestra.run.smithi039:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T09:00:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-22T09:00:23.326 INFO:tasks.ragweed:Creating rgw users... 2024-09-22T09:00:23.327 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-22T09:00:23.327 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key RHDJLLZGKIPJFOYKIUEK --secret VAcQiGt2oLwnUOJRDcj21Cxix4aTmoHGkVG/eH1B+o/VsjCxg9Oleg== --email ragweed.client.0+test@test.test --system false 2024-09-22T09:00:23.434 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:00:23.434 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:00:23.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.672+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 realm 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:23.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.674+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:23.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.675+0000 7f2365416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:00:23.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.675+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:23.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.676+0000 7f2365416800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:00:23.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.676+0000 7f2365416800 20 searching for the correct realm 2024-09-22T09:00:23.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.678+0000 7f23613e8640 0 -- 172.21.15.39:0/2684276975 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f23480b9280 msgr2=0x7f23480ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:00:23.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:23.883+0000 7f23583e6640 0 -- 172.21.15.39:0/2684276975 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f235c04a440 msgr2=0x7f235c04a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:00:24.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:00:24.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.089+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 zone default found 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 4 Realm: () 2024-09-22T09:00:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 zonegroup default 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.090+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 started sync module instance, tier type = 2024-09-22T09:00:24.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.091+0000 7f2365416800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=0 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=1 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=2 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=3 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=4 2024-09-22T09:00:24.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=5 2024-09-22T09:00:24.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.103+0000 7f2365416800 20 add_watcher() i=6 2024-09-22T09:00:24.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.104+0000 7f2365416800 20 add_watcher() i=7 2024-09-22T09:00:24.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.104+0000 7f2365416800 2 all 8 watchers are set, enabling cache 2024-09-22T09:00:24.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f22177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:00:24.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f2365416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:00:24.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f2365416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f2365416800 5 note: GC not initialized 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f22167e4640 20 reqs_thread_entry: start 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.106+0000 7f2365416800 20 init_complete bucket index max shards: 1 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 20 Filter name: none 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f220ffff640 20 reqs_thread_entry: start 2024-09-22T09:00:24.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.107+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 cache get: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK : miss 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK info.flags=0x0 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 adding default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK to cache LRU end 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 cache get: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK : hit (negative entry) 2024-09-22T09:00:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.108+0000 7f2365416800 10 cache get: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK : hit (negative entry) 2024-09-22T09:00:24.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.109+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.109+0000 7f2365416800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.109+0000 7f2365416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.110+0000 7f2237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791317 cookie 94582564425744 notifier 5910 bl.length()=675 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.110+0000 7f2237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.110+0000 7f2237fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2365416800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2365416800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T09:00:24.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791352 cookie 94582564419392 notifier 5910 bl.length()=202 2024-09-22T09:00:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-22T09:00:24.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.113+0000 7f2237fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2365416800 10 cache put: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK info.flags=0x7 2024-09-22T09:00:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2365416800 10 moving default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK to cache LRU end 2024-09-22T09:00:24.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2365416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:RHDJLLZGKIPJFOYKIUEK, ofs0, ns] 2024-09-22T09:00:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791318 cookie 94582564425744 notifier 5910 bl.length()=190 2024-09-22T09:00:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK info.flags=0x7 2024-09-22T09:00:24.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.116+0000 7f2237fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RHDJLLZGKIPJFOYKIUEK to cache LRU end 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "ragweed.client.0", 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "ragweed.client.0", 2024-09-22T09:00:24.120 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "RHDJLLZGKIPJFOYKIUEK", 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "VAcQiGt2oLwnUOJRDcj21Cxix4aTmoHGkVG/eH1B+o/VsjCxg9Oleg==", 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:00:24.110164Z" 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:00:24.121 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:00:24.122 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:00:24.110154Z", 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.119+0000 7f22177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:00:24.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.121+0000 7f2365416800 20 remove_watcher() i=0 2024-09-22T09:00:24.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.121+0000 7f2365416800 2 removed watcher, disabling cache 2024-09-22T09:00:24.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.122+0000 7f2365416800 20 remove_watcher() i=1 2024-09-22T09:00:24.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.124+0000 7f2365416800 20 remove_watcher() i=2 2024-09-22T09:00:24.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.125+0000 7f2365416800 20 remove_watcher() i=3 2024-09-22T09:00:24.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.126+0000 7f2365416800 20 remove_watcher() i=4 2024-09-22T09:00:24.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.127+0000 7f2365416800 20 remove_watcher() i=5 2024-09-22T09:00:24.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.129+0000 7f2365416800 20 remove_watcher() i=6 2024-09-22T09:00:24.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.130+0000 7f2365416800 20 remove_watcher() i=7 2024-09-22T09:00:24.145 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-22T09:00:24.145 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key EBKISFXQZJDLVVSKJBOX --secret FRoENYtty8LSHtNSEygBQ3IdZLhW01ictH8+WtzBekkCN65kCJ7A0g== --email sysuser.client.0+test@test.test --system true 2024-09-22T09:00:24.216 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:00:24.216 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:00:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.251+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.252+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.252+0000 7f7e46540800 20 realm 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.252+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.253+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.253+0000 7f7e46540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.253+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.253+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.253+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.254+0000 7f7e46540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:00:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.254+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.254+0000 7f7e46540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:00:24.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.254+0000 7f7e46540800 20 searching for the correct realm 2024-09-22T09:00:24.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.256+0000 7f7e42ac1640 0 -- 172.21.15.39:0/2121116062 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f7e2c06b020 msgr2=0x7f7e2c0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:00:24.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.462+0000 7f7e3bfff640 0 -- 172.21.15.39:0/2121116062 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f7e3c069950 msgr2=0x7f7e3c06aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:00:24.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.669+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.670+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.670+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.670+0000 7f7e46540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:00:24.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.670+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 zone default found 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 4 Realm: () 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 zonegroup default 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.671+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.672+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.672+0000 7f7e46540800 20 started sync module instance, tier type = 2024-09-22T09:00:24.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.672+0000 7f7e46540800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:00:24.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=0 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=1 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=2 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=3 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=4 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=5 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.682+0000 7f7e46540800 20 add_watcher() i=6 2024-09-22T09:00:24.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.683+0000 7f7e46540800 20 add_watcher() i=7 2024-09-22T09:00:24.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.683+0000 7f7e46540800 2 all 8 watchers are set, enabling cache 2024-09-22T09:00:24.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.685+0000 7f7cf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:00:24.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:00:24.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:00:24.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 5 note: GC not initialized 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7c737fe640 20 reqs_thread_entry: start 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 20 init_complete bucket index max shards: 1 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 20 Filter name: none 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7c717fa640 20 reqs_thread_entry: start 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T09:00:24.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.686+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache get: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX : miss 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 20 rados->read ofs=0 len=0 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX info.flags=0x0 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 adding default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX to cache LRU end 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache get: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX : hit (negative entry) 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.687+0000 7f7e46540800 10 cache get: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX : hit (negative entry) 2024-09-22T09:00:24.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T09:00:24.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7e46540800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T09:00:24.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7e46540800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T09:00:24.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7d25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791353 cookie 94385314001312 notifier 5606 bl.length()=675 2024-09-22T09:00:24.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7d25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-22T09:00:24.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.689+0000 7f7d25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T09:00:24.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T09:00:24.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7e46540800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7e46540800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T09:00:24.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7d25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94385314006288 notifier 5606 bl.length()=202 2024-09-22T09:00:24.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7d25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-22T09:00:24.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.692+0000 7f7d25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-22T09:00:24.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7e46540800 10 cache put: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX info.flags=0x7 2024-09-22T09:00:24.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7e46540800 10 moving default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX to cache LRU end 2024-09-22T09:00:24.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7e46540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:EBKISFXQZJDLVVSKJBOX, ofs0, ns] 2024-09-22T09:00:24.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7d25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94385314003952 notifier 5606 bl.length()=190 2024-09-22T09:00:24.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7d25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX info.flags=0x7 2024-09-22T09:00:24.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.695+0000 7f7d25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EBKISFXQZJDLVVSKJBOX to cache LRU end 2024-09-22T09:00:24.698 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "sysuser.client.0", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "sysuser.client.0", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "EBKISFXQZJDLVVSKJBOX", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "FRoENYtty8LSHtNSEygBQ3IdZLhW01ictH8+WtzBekkCN65kCJ7A0g==", 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:00:24.699 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:00:24.689376Z" 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "system": true, 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:00:24.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:00:24.701 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:00:24.689363Z", 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.697+0000 7f7cf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.700+0000 7f7e46540800 20 remove_watcher() i=0 2024-09-22T09:00:24.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.700+0000 7f7e46540800 2 removed watcher, disabling cache 2024-09-22T09:00:24.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.701+0000 7f7e46540800 20 remove_watcher() i=1 2024-09-22T09:00:24.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.702+0000 7f7e46540800 20 remove_watcher() i=2 2024-09-22T09:00:24.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.704+0000 7f7e46540800 20 remove_watcher() i=3 2024-09-22T09:00:24.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.705+0000 7f7e46540800 20 remove_watcher() i=4 2024-09-22T09:00:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.706+0000 7f7e46540800 20 remove_watcher() i=5 2024-09-22T09:00:24.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.707+0000 7f7e46540800 20 remove_watcher() i=6 2024-09-22T09:00:24.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:00:24.708+0000 7f7e46540800 20 remove_watcher() i=7 2024-09-22T09:00:24.722 INFO:tasks.ragweed:Configuring ragweed... 2024-09-22T09:00:24.722 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:00:24.722 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-22T09:00:24.752 INFO:tasks.ragweed:Configuring boto... 2024-09-22T09:00:24.753 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:00:24.753 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-22T09:00:24.822 DEBUG:teuthology.orchestra.run.smithi039:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-22T09:00:25.019 INFO:teuthology.orchestra.run.smithi039.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-22T09:00:25.196 INFO:teuthology.orchestra.run.smithi039.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-22T09:00:25.810 INFO:teuthology.orchestra.run.smithi039.stdout:py installdeps: -rrequirements.txt 2024-09-22T09:00:32.073 INFO:teuthology.orchestra.run.smithi039.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-22T09:00:35.536 INFO:teuthology.orchestra.run.smithi039.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.1,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d80080ffcc8234d4c53b2fdde1e96514852f9c3feb30a433d65c8ad48471624f,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-22T09:00:35.536 INFO:teuthology.orchestra.run.smithi039.stdout:py run-test-pre: PYTHONHASHSEED='695857847' 2024-09-22T09:00:35.537 INFO:teuthology.orchestra.run.smithi039.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-22T09:00:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:============================= test session starts ============================== 2024-09-22T09:00:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-22T09:00:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T09:00:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T09:00:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:configfile: pytest.ini 2024-09-22T09:00:35.833 INFO:teuthology.orchestra.run.smithi039.stdout:collecting ... collected 9 items 2024-09-22T09:00:35.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:00:41.515 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-22T09:00:48.291 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-22T09:00:52.798 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-22T09:00:59.329 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-22T09:01:05.781 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-22T09:01:20.893 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-22T09:01:33.527 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-22T09:01:48.126 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-22T09:02:16.526 INFO:teuthology.orchestra.run.smithi039.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-22T09:02:16.526 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:02:16.526 INFO:teuthology.orchestra.run.smithi039.stdout:=============================== warnings summary =============================== 2024-09-22T09:02:16.526 INFO:teuthology.orchestra.run.smithi039.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T09:02:16.527 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T09:02:16.527 INFO:teuthology.orchestra.run.smithi039.stdout: import imp 2024-09-22T09:02:16.527 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:02:16.527 INFO:teuthology.orchestra.run.smithi039.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T09:02:16.527 INFO:teuthology.orchestra.run.smithi039.stdout:=================== 9 passed, 1 warning in 100.79s (0:01:40) =================== 2024-09-22T09:02:16.558 INFO:teuthology.orchestra.run.smithi039.stdout:___________________________________ summary ____________________________________ 2024-09-22T09:02:16.558 INFO:teuthology.orchestra.run.smithi039.stdout: py: commands succeeded 2024-09-22T09:02:16.558 INFO:teuthology.orchestra.run.smithi039.stdout: congratulations :) 2024-09-22T09:02:16.575 INFO:tasks.ragweed:Cleaning up boto... 2024-09-22T09:02:16.576 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-22T09:02:16.606 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-22T09:02:16.704 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:02:16.704 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:02:16.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.739+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 realm 2024-09-22T09:02:16.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:02:16.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.741+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.742+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:02:16.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.742+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.743+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:02:16.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.743+0000 7f510c640800 20 searching for the correct realm 2024-09-22T09:02:16.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.744+0000 7f5109929640 0 -- 172.21.15.39:0/2133159473 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f50fc080040 msgr2=0x7f50fc06ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:02:16.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.748+0000 7f5109929640 0 -- 172.21.15.39:0/2133159473 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f4fd4087c90 msgr2=0x7f4fd408a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.953+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:02:16.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 zone default found 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 4 Realm: () 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 zonegroup default 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.954+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.955+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.955+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:16.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.955+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:16.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.955+0000 7f510c640800 20 started sync module instance, tier type = 2024-09-22T09:02:16.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.955+0000 7f510c640800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:02:16.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=0 2024-09-22T09:02:16.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=1 2024-09-22T09:02:16.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=2 2024-09-22T09:02:16.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=3 2024-09-22T09:02:16.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=4 2024-09-22T09:02:16.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=5 2024-09-22T09:02:16.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.965+0000 7f510c640800 20 add_watcher() i=6 2024-09-22T09:02:16.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.966+0000 7f510c640800 20 add_watcher() i=7 2024-09-22T09:02:16.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.966+0000 7f510c640800 2 all 8 watchers are set, enabling cache 2024-09-22T09:02:16.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.968+0000 7f4fc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:02:16.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.968+0000 7f510c640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:02:16.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:16.968+0000 7f510c640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f4f3b7fe640 20 reqs_thread_entry: start 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f510c640800 20 init_complete bucket index max shards: 1 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f510c640800 20 Filter name: none 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f4f397fa640 20 reqs_thread_entry: start 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f510c640800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-22T09:02:17.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.006+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 : miss 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.007+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=426 2024-09-22T09:02:17.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 info.flags=0x17 2024-09-22T09:02:17.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 to cache LRU end 2024-09-22T09:02:17.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.008+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55734a298e48 s->prefetch_data=0 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.009+0000 7f510c640800 10 manifest: total_size = 13111 2024-09-22T09:02:17.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.009+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10655230930588105984 2024-09-22T09:02:17.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.009+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55734a298e48 s->prefetch_data=0 2024-09-22T09:02:17.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.009+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a298e48 2024-09-22T09:02:17.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.009+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.011+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.012+0000 7f510c640800 10 manifest: total_size = 7674 2024-09-22T09:02:17.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.012+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12057714567205484375 2024-09-22T09:02:17.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.012+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.012+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.012+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.013+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-22T09:02:17.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 10 manifest: total_size = 7501 2024-09-22T09:02:17.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15817756982865091770 2024-09-22T09:02:17.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.015+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.016+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-22T09:02:17.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.018+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.019+0000 7f510c640800 10 manifest: total_size = 4903 2024-09-22T09:02:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.019+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.4836500444874245916 2024-09-22T09:02:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.019+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.019+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.019+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.020+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-22T09:02:17.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.021+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.022+0000 7f510c640800 10 manifest: total_size = 7538 2024-09-22T09:02:17.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.022+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.8171837882866815909 2024-09-22T09:02:17.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.022+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.022+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.022+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.023+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-22T09:02:17.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 10 manifest: total_size = 5237 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.2488190568028578682 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 20 get_obj_state: octx=0x557349fdf1a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.025+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.026+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-22T09:02:17.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.028+0000 7f510c640800 20 get_obj_state: octx=0x55734a222390 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f510c640800 10 manifest: total_size = 5173 2024-09-22T09:02:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16516588441296439782 2024-09-22T09:02:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f510c640800 20 get_obj_state: octx=0x55734a222390 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.029+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-22T09:02:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 10 manifest: total_size = 7817 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12671793548001204866 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55734a223ef8 s->prefetch_data=0 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223ef8 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.031+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.032+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-22T09:02:17.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.034+0000 7f510c640800 20 get_obj_state: octx=0x55734a223450 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55734a223e98 s->prefetch_data=0 2024-09-22T09:02:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.035+0000 7f510c640800 10 manifest: total_size = 5409 2024-09-22T09:02:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.035+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16137688342614440365 2024-09-22T09:02:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.035+0000 7f510c640800 20 get_obj_state: octx=0x55734a223450 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55734a223e98 s->prefetch_data=0 2024-09-22T09:02:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.035+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a223e98 2024-09-22T09:02:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.035+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.4.0 2024-09-22T09:02:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.036+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-22T09:02:17.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.037+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.037+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.039+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[530e834e-7701-4a35-ad82-1b0744ba8777.4617.4])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.040+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-22T09:02:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.040+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.041+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=204 2024-09-22T09:02:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.041+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-22T09:02:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.041+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-22T09:02:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.042+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-22T09:02:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.042+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-22T09:02:17.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.042+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529696 cookie 93953653059760 notifier 5636 bl.length()=162 2024-09-22T09:02:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.045+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 from cache 2024-09-22T09:02:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.045+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:530e834e-7701-4a35-ad82-1b0744ba8777.4617.4, ofs0, ns] 2024-09-22T09:02:17.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.045+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 93953653057232 notifier 5636 bl.length()=219 2024-09-22T09:02:17.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.048+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 : miss 2024-09-22T09:02:17.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.048+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.048+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.048+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 info.flags=0x0 2024-09-22T09:02:17.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.048+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/530e834e-7701-4a35-ad82-1b0744ba8777.4617.4 to cache LRU end 2024-09-22T09:02:17.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.051+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 : miss 2024-09-22T09:02:17.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.051+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=457 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 info.flags=0x17 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 to cache LRU end 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 10 cls_bucket_list_unordered: got foo 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.052+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.053+0000 7f510c640800 10 manifest: total_size = 1667 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.053+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14506039106474669975 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.053+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.053+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21c848 2024-09-22T09:02:17.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.053+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.11.0 2024-09-22T09:02:17.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T09:02:17.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-22T09:02:17.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-22T09:02:17.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T09:02:17.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14506039106474669975 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.1 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.2 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.3 2024-09-22T09:02:17.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-22T09:02:17.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.4 2024-09-22T09:02:17.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-22T09:02:17.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.056+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14506039106474669975 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.058+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.058+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.058+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.059+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.059+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.059+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.059+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.059+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.11])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.060+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-22T09:02:17.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.060+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.061+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=235 2024-09-22T09:02:17.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.061+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-22T09:02:17.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.061+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-22T09:02:17.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.062+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-22T09:02:17.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.062+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-22T09:02:17.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.063+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 93953653057232 notifier 5636 bl.length()=191 2024-09-22T09:02:17.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.065+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 from cache 2024-09-22T09:02:17.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.065+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11, ofs0, ns] 2024-09-22T09:02:17.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.065+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529678 cookie 93953653076320 notifier 5636 bl.length()=249 2024-09-22T09:02:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.068+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 : miss 2024-09-22T09:02:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.068+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.068+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.068+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 info.flags=0x0 2024-09-22T09:02:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.068+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.11 to cache LRU end 2024-09-22T09:02:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.070+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 : miss 2024-09-22T09:02:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.070+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=464 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 info.flags=0x17 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 to cache LRU end 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 cls_bucket_list_unordered: got foo 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055a70 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 10 manifest: total_size = 74198 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6956427252035123885 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055a70 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21c848 2024-09-22T09:02:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.071+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.12.0 2024-09-22T09:02:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-22T09:02:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T09:02:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6956427252035123885 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.1 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.2 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.3 2024-09-22T09:02:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.4 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.075+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6956427252035123885 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.076+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.12])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.078+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-22T09:02:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.078+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.078+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=242 2024-09-22T09:02:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.078+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-22T09:02:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.078+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-22T09:02:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.079+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-22T09:02:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.079+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-22T09:02:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.080+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529728 cookie 93953653068080 notifier 5636 bl.length()=198 2024-09-22T09:02:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.082+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 from cache 2024-09-22T09:02:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.082+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12, ofs0, ns] 2024-09-22T09:02:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.083+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529729 cookie 93953653068080 notifier 5636 bl.length()=256 2024-09-22T09:02:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.085+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 : miss 2024-09-22T09:02:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.085+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.085+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.085+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 info.flags=0x0 2024-09-22T09:02:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.085+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.12 to cache LRU end 2024-09-22T09:02:17.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.087+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 : miss 2024-09-22T09:02:17.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.087+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=459 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 info.flags=0x17 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 to cache LRU end 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 10 cls_bucket_list_unordered: got foo[xm9mNki.CDXvhMw-1y6uT62O4tSynLl] 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.088+0000 7f510c640800 20 get_obj_state: octx=0x55734a225ab0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.089+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 7x0psn64hc2qzjjiimqv4uhnvp564jln 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.089+0000 7f510c640800 20 get_obj_state_impl: setting s->olh_tag to xr9h4zbfgwe7tnt2jvswfhtif72dpfku 2024-09-22T09:02:17.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.089+0000 7f510c640800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xr9h4zbfgwe7tnt2jvswfhtif72dpfku 2024-09-22T09:02:17.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.090+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.091+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-22T09:02:17.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 olh_log_entry: epoch=3 op=3 key=foo[xm9mNki.CDXvhMw-1y6uT62O4tSynLl] 2024-09-22T09:02:17.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 get_obj_state: octx=0x55734a225ab0 obj=test-client.0-r-test-multipart-index-versioning.1:_:xm9mNki.CDXvhMw-1y6uT62O4tSynLl_foo state=0x55734a2347d8 s->prefetch_data=0 2024-09-22T09:02:17.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 10 manifest: total_size = 74198 2024-09-22T09:02:17.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.5200090918335847265 2024-09-22T09:02:17.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 get_obj_state: octx=0x55734a225ab0 obj=test-client.0-r-test-multipart-index-versioning.1:_:xm9mNki.CDXvhMw-1y6uT62O4tSynLl_foo state=0x55734a2347d8 s->prefetch_data=0 2024-09-22T09:02:17.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2347d8 2024-09-22T09:02:17.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.092+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.5200090918335847265 2024-09-22T09:02:17.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.1 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.2 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.3 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.4 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.095+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.5200090918335847265 2024-09-22T09:02:17.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.096+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo[xm9mNki.CDXvhMw-1y6uT62O4tSynLl] 2024-09-22T09:02:17.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.098+0000 7f510c640800 20 get_obj_state: octx=0x55734a225ab0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.099+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.10.0 2024-09-22T09:02:17.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.101+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.10])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.102+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-22T09:02:17.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.102+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.103+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=237 2024-09-22T09:02:17.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.103+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-22T09:02:17.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.103+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-22T09:02:17.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.104+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-22T09:02:17.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.104+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-22T09:02:17.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.104+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529730 cookie 93953653068080 notifier 5636 bl.length()=193 2024-09-22T09:02:17.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.107+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 from cache 2024-09-22T09:02:17.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.107+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10, ofs0, ns] 2024-09-22T09:02:17.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.107+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529697 cookie 93953653059760 notifier 5636 bl.length()=251 2024-09-22T09:02:17.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.110+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 : miss 2024-09-22T09:02:17.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.110+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.110+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.110+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 info.flags=0x0 2024-09-22T09:02:17.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.110+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.10 to cache LRU end 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.112+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 : miss 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.112+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 info.flags=0x17 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 to cache LRU end 2024-09-22T09:02:17.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.113+0000 7f510c640800 10 cls_bucket_list_unordered: got foo 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 20 get_obj_state: octx=0x7f5104090f80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 10 manifest: total_size = 18874368 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.245704419642164049 2024-09-22T09:02:17.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 20 get_obj_state: octx=0x7f5104090f80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55734a21c848 s->prefetch_data=0 2024-09-22T09:02:17.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21c848 2024-09-22T09:02:17.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.114+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.9.0 2024-09-22T09:02:17.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-22T09:02:17.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.245704419642164049 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.1 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 343 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.2 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 587 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.3 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 831 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.4 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1075 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.116+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.245704419642164049 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.118+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.9])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.120+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-22T09:02:17.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.120+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.120+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=225 2024-09-22T09:02:17.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.120+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-22T09:02:17.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.120+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-22T09:02:17.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.122+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-22T09:02:17.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.122+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-22T09:02:17.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.122+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529698 cookie 93953653066032 notifier 5636 bl.length()=183 2024-09-22T09:02:17.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.125+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 from cache 2024-09-22T09:02:17.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.125+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9, ofs0, ns] 2024-09-22T09:02:17.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.125+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529680 cookie 93953653074704 notifier 5636 bl.length()=240 2024-09-22T09:02:17.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.128+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 : miss 2024-09-22T09:02:17.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.128+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.128+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.128+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 info.flags=0x0 2024-09-22T09:02:17.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.128+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.9 to cache LRU end 2024-09-22T09:02:17.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.130+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 : miss 2024-09-22T09:02:17.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.130+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 info.flags=0x17 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 to cache LRU end 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 2024-09-22T09:02:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T09:02:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T09:02:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T09:02:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T09:02:17.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.131+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.132+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.132+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.7751789128567278334 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.132+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.132+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.132+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.7751789128567278334 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.U4VxWvXHHoDhuo8JkbRxIIOjuedHI4H_0 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T09:02:17.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.134+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.7751789128567278334 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.135+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.135+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.136+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.136+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11709535482568247405 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.136+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.136+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.136+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11709535482568247405 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.U4VxWvXHHoDhuo8JkbRxIIOjuedHI4H_0 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.138+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11709535482568247405 2024-09-22T09:02:17.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.139+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 20 get_obj_state: octx=0x55734a229c60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _f3m4eohaKxzublDUotRxfNEPXx23uK4 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 20 get_obj_state: octx=0x55734a229c60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.140+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _f3m4eohaKxzublDUotRxfNEPXx23uK4 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.oDS2Vd4r_j0J4WFdIf_6FkwbMbuNCs__0 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.142+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _f3m4eohaKxzublDUotRxfNEPXx23uK4 2024-09-22T09:02:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T09:02:17.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc06b730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _onm2uqcoKmFnA_rur12GAxhazHztx2r 2024-09-22T09:02:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc06b730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.144+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _onm2uqcoKmFnA_rur12GAxhazHztx2r 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.85FbXUeoud50gbEEcfW9-wB-n4Kptnm_1 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.147+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _onm2uqcoKmFnA_rur12GAxhazHztx2r 2024-09-22T09:02:17.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T09:02:17.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.2756330665792251302 2024-09-22T09:02:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.148+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.149+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.2756330665792251302 2024-09-22T09:02:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.OPHXHWHrSXWfLOB7Ma_kRLhPbOBorZk_0 2024-09-22T09:02:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-22T09:02:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.151+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.2756330665792251302 2024-09-22T09:02:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.152+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.152+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055c50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.153+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.153+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _ZOTig1kI-BD1J6BfroDbzaKOu1wElak 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.153+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055c50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.153+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.153+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZOTig1kI-BD1J6BfroDbzaKOu1wElak 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.BI5dwxAFmiRkTutSYsiXmR18Ud6PRA-_0 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.155+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _ZOTig1kI-BD1J6BfroDbzaKOu1wElak 2024-09-22T09:02:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.156+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.156+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.157+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.157+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3549030833625285912 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.157+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.157+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.157+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3549030833625285912 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.OPHXHWHrSXWfLOB7Ma_kRLhPbOBorZk_0 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.160+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3549030833625285912 2024-09-22T09:02:17.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T09:02:17.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 20 get_obj_state: octx=0x55734a21a6c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _ER2s-LSFZ0CVhluRyXHUuCAZISZCEsz 2024-09-22T09:02:17.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 20 get_obj_state: octx=0x55734a21a6c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.161+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _ER2s-LSFZ0CVhluRyXHUuCAZISZCEsz 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.RcR6yVAG2MfgvY5JYQ9gDhtWGmNauzI_1 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T09:02:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.164+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _ER2s-LSFZ0CVhluRyXHUuCAZISZCEsz 2024-09-22T09:02:17.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.165+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T09:02:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3231443603765549351 2024-09-22T09:02:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.166+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3231443603765549351 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.SgUEElGY1rhh04UluMZy12Jqtf5yjEs_1 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.169+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3231443603765549351 2024-09-22T09:02:17.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055c50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T09:02:17.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _4jJO9PVDbxdI4_BGspHKxVpIrxZ7TiO 2024-09-22T09:02:17.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 20 get_obj_state: octx=0x7f5104055c50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.170+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _4jJO9PVDbxdI4_BGspHKxVpIrxZ7TiO 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.fcSXLPf11PTeSSCgrgP_g8HReVTOTV2_0 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.173+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _4jJO9PVDbxdI4_BGspHKxVpIrxZ7TiO 2024-09-22T09:02:17.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T09:02:17.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _BvbF_0qUwd_iGAJwG7njC7pw8cQxHIn 2024-09-22T09:02:17.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.175+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _BvbF_0qUwd_iGAJwG7njC7pw8cQxHIn 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.-TcASjjkjGOKcInYcsDJlxjUXpg_fsr_0 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.177+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _BvbF_0qUwd_iGAJwG7njC7pw8cQxHIn 2024-09-22T09:02:17.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.178+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T09:02:17.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc06b730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 10 manifest: total_size = 5242880 2024-09-22T09:02:17.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6497966623138020771 2024-09-22T09:02:17.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc06b730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.179+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.15.0 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6497966623138020771 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.SgUEElGY1rhh04UluMZy12Jqtf5yjEs_1 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.182+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.6497966623138020771 2024-09-22T09:02:17.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.183+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T09:02:17.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.184+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.15])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.185+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-22T09:02:17.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.185+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.186+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=233 2024-09-22T09:02:17.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.186+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-22T09:02:17.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.186+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-22T09:02:17.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.187+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-22T09:02:17.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.187+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-22T09:02:17.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.187+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529731 cookie 93953653068080 notifier 5636 bl.length()=189 2024-09-22T09:02:17.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.190+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 from cache 2024-09-22T09:02:17.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.190+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15, ofs0, ns] 2024-09-22T09:02:17.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.190+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 93953653059760 notifier 5636 bl.length()=247 2024-09-22T09:02:17.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.193+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 : miss 2024-09-22T09:02:17.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.193+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.193+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.193+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 info.flags=0x0 2024-09-22T09:02:17.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.193+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.15 to cache LRU end 2024-09-22T09:02:17.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.195+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 : miss 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.195+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=465 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 info.flags=0x17 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 to cache LRU end 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 2024-09-22T09:02:17.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T09:02:17.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-22T09:02:17.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-22T09:02:17.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.196+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 20 get_obj_state: octx=0x55734a21d0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12807449107205085774 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 20 get_obj_state: octx=0x55734a21d0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.197+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12807449107205085774 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.1 2024-09-22T09:02:17.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.2 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.3 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.199+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12807449107205085774 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.200+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 20 get_obj_state: octx=0x55734a232cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18086739026202241027 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 20 get_obj_state: octx=0x55734a232cf0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.201+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18086739026202241027 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.1 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.2 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.3 2024-09-22T09:02:17.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-22T09:02:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.210+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18086739026202241027 2024-09-22T09:02:17.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _kJyoIXE3F6zCayDW78NPax4-0VpKeHZ 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.211+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _kJyoIXE3F6zCayDW78NPax4-0VpKeHZ 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.FPiu0W-rw8d_TR5BSnw2fF1j36g4PRb_0 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.FPiu0W-rw8d_TR5BSnw2fF1j36g4PRb_1 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.214+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _kJyoIXE3F6zCayDW78NPax4-0VpKeHZ 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.215+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.215+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.216+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.216+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _t0QQhegl34CKLI82G_YJEnIU5q5gZfA 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.216+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.216+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.216+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _t0QQhegl34CKLI82G_YJEnIU5q5gZfA 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.CqpO-QUQ6DQVREiOGLWLG_jTXJk5giO_1 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.CqpO-QUQ6DQVREiOGLWLG_jTXJk5giO_2 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.218+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _t0QQhegl34CKLI82G_YJEnIU5q5gZfA 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.219+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-22T09:02:17.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.219+0000 7f510c640800 20 get_obj_state: octx=0x55734a2257e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.220+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.220+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12253096733284433394 2024-09-22T09:02:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.220+0000 7f510c640800 20 get_obj_state: octx=0x55734a2257e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.220+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.220+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12253096733284433394 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.1 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.2 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.3 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.222+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.12253096733284433394 2024-09-22T09:02:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T09:02:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _21FB5ChAIayUH4YIjEDvZAv16q35Ecl 2024-09-22T09:02:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.224+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _21FB5ChAIayUH4YIjEDvZAv16q35Ecl 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.ElZBMp1Ylrz10f-j5RMGU3AycKkpABR_0 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.ElZBMp1Ylrz10f-j5RMGU3AycKkpABR_1 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.226+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _21FB5ChAIayUH4YIjEDvZAv16q35Ecl 2024-09-22T09:02:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-22T09:02:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9399811591066906751 2024-09-22T09:02:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.228+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9399811591066906751 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.1 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.2 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.3 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.231+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9399811591066906751 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _vmdh5N7olxNGuLtLajiVzUOSze-fLRp 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.232+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _vmdh5N7olxNGuLtLajiVzUOSze-fLRp 2024-09-22T09:02:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.OY733wXLZ1djbtCE1KFDXkf-bDlnLJE_1 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.OY733wXLZ1djbtCE1KFDXkf-bDlnLJE_2 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.235+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _vmdh5N7olxNGuLtLajiVzUOSze-fLRp 2024-09-22T09:02:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.236+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-22T09:02:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.236+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc067f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.237+0000 7f510c640800 10 manifest: total_size = 16380 2024-09-22T09:02:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.237+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.114289834528138657 2024-09-22T09:02:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.237+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc067f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.237+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.237+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-22T09:02:17.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-22T09:02:17.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7674 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7674 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.114289834528138657 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.1 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.2 2024-09-22T09:02:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.3 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.239+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.114289834528138657 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.240+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T09:02:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.240+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.241+0000 7f510c640800 10 manifest: total_size = 16380 2024-09-22T09:02:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.241+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _E5zXxC9WTc2qSbtl68vuD8dY9QPKgFy 2024-09-22T09:02:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.241+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.241+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.241+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _E5zXxC9WTc2qSbtl68vuD8dY9QPKgFy 2024-09-22T09:02:17.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.dMaL7ztAqAu9ZK1prM7PmZXTcMfIWmm_0 2024-09-22T09:02:17.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-22T09:02:17.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.243+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _E5zXxC9WTc2qSbtl68vuD8dY9QPKgFy 2024-09-22T09:02:17.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.244+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.244+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.245+0000 7f510c640800 10 manifest: total_size = 16380 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.245+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to _T00OrO0YW-eIv73988MkBB6ZEn3lKJn 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.245+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.245+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.245+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: _T00OrO0YW-eIv73988MkBB6ZEn3lKJn 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.RDmeTSp0jDVko8ZeY31Vq5JZuPfhlFp_0 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.247+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _T00OrO0YW-eIv73988MkBB6ZEn3lKJn 2024-09-22T09:02:17.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-22T09:02:17.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 20 get_obj_state: octx=0x55734a220710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 10 manifest: total_size = 16380 2024-09-22T09:02:17.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.662418120770494123 2024-09-22T09:02:17.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 20 get_obj_state: octx=0x55734a220710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55734a21de68 s->prefetch_data=0 2024-09-22T09:02:17.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a21de68 2024-09-22T09:02:17.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.249+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.16.0 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7674 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7674 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-22T09:02:17.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.662418120770494123 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.1 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.2 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.3 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.251+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.662418120770494123 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.253+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.16])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.254+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.254+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.255+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=243 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.255+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.255+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.256+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-22T09:02:17.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.256+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-22T09:02:17.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.256+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529682 cookie 93953653072368 notifier 5636 bl.length()=199 2024-09-22T09:02:17.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.259+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 from cache 2024-09-22T09:02:17.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.259+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16, ofs0, ns] 2024-09-22T09:02:17.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.259+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 93953653072368 notifier 5636 bl.length()=257 2024-09-22T09:02:17.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.262+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 : miss 2024-09-22T09:02:17.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.262+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.262+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.262+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 info.flags=0x0 2024-09-22T09:02:17.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.262+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.16 to cache LRU end 2024-09-22T09:02:17.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 : miss 2024-09-22T09:02:17.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 info.flags=0x17 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 to cache LRU end 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.264+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T09:02:17.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 20 get_obj_state: octx=0x55734a23a600 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16691927038598613190 2024-09-22T09:02:17.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 20 get_obj_state: octx=0x55734a23a600 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.265+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.14.0 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16691927038598613190 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.1 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.267+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.2 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.268+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.268+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.3 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.268+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.268+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.268+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.16691927038598613190 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.269+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.269+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.270+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.270+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11362012038409363565 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.270+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.270+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.270+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.14.0 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11362012038409363565 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.1 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.2 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.3 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.272+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11362012038409363565 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.273+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 10 manifest: total_size = 11534336 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.124404739904928078 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.274+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.14.0 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-22T09:02:17.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.124404739904928078 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.1 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.2 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.3 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.276+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.124404739904928078 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.278+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.14])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.280+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-22T09:02:17.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.280+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.280+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=238 2024-09-22T09:02:17.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.280+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-22T09:02:17.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.280+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-22T09:02:17.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.282+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-22T09:02:17.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.282+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-22T09:02:17.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.282+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529679 cookie 93953653076320 notifier 5636 bl.length()=194 2024-09-22T09:02:17.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.285+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 from cache 2024-09-22T09:02:17.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.285+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14, ofs0, ns] 2024-09-22T09:02:17.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.285+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 93953653072368 notifier 5636 bl.length()=252 2024-09-22T09:02:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.287+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 : miss 2024-09-22T09:02:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.287+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.288+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.288+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 info.flags=0x0 2024-09-22T09:02:17.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.288+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.14 to cache LRU end 2024-09-22T09:02:17.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.290+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 : miss 2024-09-22T09:02:17.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.290+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=450 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 info.flags=0x17 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 to cache LRU end 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.291+0000 7f510c640800 20 get_obj_state: octx=0x55734a220710 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.292+0000 7f510c640800 10 manifest: total_size = 10485760 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.292+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.4621551648394144862 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.292+0000 7f510c640800 20 get_obj_state: octx=0x55734a220710 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.292+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.292+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.13.0 2024-09-22T09:02:17.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.4621551648394144862 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.mOaaBVKp8_e58qJx2Hs6nTk-7Cw9gl1_0 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.mOaaBVKp8_e58qJx2Hs6nTk-7Cw9gl1_1 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.295+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.4621551648394144862 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.296+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.296+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.297+0000 7f510c640800 10 manifest: total_size = 10485760 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.297+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.275507411603225826 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.297+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6140 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.297+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.297+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.13.0 2024-09-22T09:02:17.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-22T09:02:17.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.275507411603225826 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.X0t9ubZBsA_FK7CPIgEfaMp-NK9EHQ1_0 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.X0t9ubZBsA_FK7CPIgEfaMp-NK9EHQ1_1 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 577 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.299+0000 7f510c640800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.275507411603225826 2024-09-22T09:02:17.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.300+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 10 manifest: total_size = 649292 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15402204420199279655 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 20 get_obj_state: octx=0x7f50f407f050 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55734a2344f8 s->prefetch_data=0 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2344f8 2024-09-22T09:02:17.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.301+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.13.0 2024-09-22T09:02:17.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.303+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.303+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.305+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.13])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.307+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-22T09:02:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.307+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.307+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=228 2024-09-22T09:02:17.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.307+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-22T09:02:17.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.307+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-22T09:02:17.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.308+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-22T09:02:17.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.308+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-22T09:02:17.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.309+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529732 cookie 93953653068080 notifier 5636 bl.length()=184 2024-09-22T09:02:17.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.312+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 from cache 2024-09-22T09:02:17.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.312+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13, ofs0, ns] 2024-09-22T09:02:17.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.312+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529733 cookie 93953653068080 notifier 5636 bl.length()=242 2024-09-22T09:02:17.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.314+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 : miss 2024-09-22T09:02:17.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.314+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.314+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.314+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 info.flags=0x0 2024-09-22T09:02:17.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.314+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.13 to cache LRU end 2024-09-22T09:02:17.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 : miss 2024-09-22T09:02:17.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 info.flags=0x17 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 to cache LRU end 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.317+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 10 cls_bucket_list_unordered: got __ 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 10 cls_bucket_list_unordered: got ___ 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 10 cls_bucket_list_unordered: got obj 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 10 manifest: total_size = 0 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.5345500428892860095 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 20 get_obj_state: octx=0x7f5104074bb0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.318+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.6.0 2024-09-22T09:02:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6520 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 10 manifest: total_size = 0 2024-09-22T09:02:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15561485151583168505 2024-09-22T09:02:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6520 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.321+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.6.0 2024-09-22T09:02:17.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.322+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-22T09:02:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.324+0000 7f510c640800 20 get_obj_state: octx=0x7f50f4075840 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f510c640800 10 manifest: total_size = 0 2024-09-22T09:02:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.3871372455540696676 2024-09-22T09:02:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f510c640800 20 get_obj_state: octx=0x7f50f4075840 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.6.0 2024-09-22T09:02:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.325+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T09:02:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.327+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6520 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f510c640800 10 manifest: total_size = 0 2024-09-22T09:02:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.8746332881170155784 2024-09-22T09:02:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f510c640800 20 get_obj_state: octx=0x7f50f40a6520 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.6.0 2024-09-22T09:02:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.328+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-22T09:02:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.330+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.330+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.331+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.332+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.332+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.332+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.332+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.332+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[530e834e-7701-4a35-ad82-1b0744ba8777.4617.6])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.333+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-22T09:02:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.333+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.334+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T09:02:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.334+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-22T09:02:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.334+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-22T09:02:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.335+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-22T09:02:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.335+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-22T09:02:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.335+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529717 cookie 93953653057232 notifier 5636 bl.length()=181 2024-09-22T09:02:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.337+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 from cache 2024-09-22T09:02:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.337+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:530e834e-7701-4a35-ad82-1b0744ba8777.4617.6, ofs0, ns] 2024-09-22T09:02:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.338+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 93953653066032 notifier 5636 bl.length()=238 2024-09-22T09:02:17.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.340+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 : miss 2024-09-22T09:02:17.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.340+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.340+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.340+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 info.flags=0x0 2024-09-22T09:02:17.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.340+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/530e834e-7701-4a35-ad82-1b0744ba8777.4617.6 to cache LRU end 2024-09-22T09:02:17.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.342+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 : miss 2024-09-22T09:02:17.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.342+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T09:02:17.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 info.flags=0x17 2024-09-22T09:02:17.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 to cache LRU end 2024-09-22T09:02:17.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 2024-09-22T09:02:17.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 cls_bucket_list_unordered: got __ 2024-09-22T09:02:17.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 cls_bucket_list_unordered: got ___ 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 10 cls_bucket_list_unordered: got obj 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.343+0000 7f510c640800 20 get_obj_state: octx=0x55734a299b00 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.344+0000 7f510c640800 10 manifest: total_size = 24595 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.344+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.9132063188795859518 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.344+0000 7f510c640800 20 get_obj_state: octx=0x55734a299b00 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.344+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.344+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.7.0 2024-09-22T09:02:17.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 20 get_obj_state: octx=0x55734a227f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 10 manifest: total_size = 527 2024-09-22T09:02:17.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.13849706035613160540 2024-09-22T09:02:17.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 20 get_obj_state: octx=0x55734a227f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55734a082538 s->prefetch_data=0 2024-09-22T09:02:17.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082538 2024-09-22T09:02:17.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.347+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.7.0 2024-09-22T09:02:17.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.348+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55734a0824f8 s->prefetch_data=0 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 10 manifest: total_size = 24595 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.298338936335769046 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc0087b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55734a0824f8 s->prefetch_data=0 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a0824f8 2024-09-22T09:02:17.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.350+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.7.0 2024-09-22T09:02:17.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.351+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T09:02:17.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc067f80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55734a082428 s->prefetch_data=0 2024-09-22T09:02:17.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 10 manifest: total_size = 2078 2024-09-22T09:02:17.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.8314673766603289148 2024-09-22T09:02:17.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 20 get_obj_state: octx=0x7f50fc067f80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55734a082428 s->prefetch_data=0 2024-09-22T09:02:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a082428 2024-09-22T09:02:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.353+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.7.0 2024-09-22T09:02:17.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.354+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-22T09:02:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.356+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.356+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T09:02:17.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.357+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[530e834e-7701-4a35-ad82-1b0744ba8777.4617.7])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.358+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-22T09:02:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.358+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.359+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T09:02:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.359+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-22T09:02:17.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.359+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-22T09:02:17.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.360+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-22T09:02:17.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.360+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-22T09:02:17.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.360+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 93953653057232 notifier 5636 bl.length()=181 2024-09-22T09:02:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.363+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 from cache 2024-09-22T09:02:17.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.363+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:530e834e-7701-4a35-ad82-1b0744ba8777.4617.7, ofs0, ns] 2024-09-22T09:02:17.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.364+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 93953653066032 notifier 5636 bl.length()=238 2024-09-22T09:02:17.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.366+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 : miss 2024-09-22T09:02:17.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.366+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.366+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.366+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 info.flags=0x0 2024-09-22T09:02:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.367+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/530e834e-7701-4a35-ad82-1b0744ba8777.4617.7 to cache LRU end 2024-09-22T09:02:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 : miss 2024-09-22T09:02:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=445 2024-09-22T09:02:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 info.flags=0x17 2024-09-22T09:02:17.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 to cache LRU end 2024-09-22T09:02:17.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:02:17.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.369+0000 7f510c640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 10 cls_bucket_list_unordered: got __ 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 10 cls_bucket_list_unordered: got __ _ 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 10 cls_bucket_list_unordered: got ___ 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 10 cls_bucket_list_unordered: got obj 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 20 get_obj_state: octx=0x7f50f4072a60 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 10 manifest: total_size = 49187 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.2787556479883531353 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 20 get_obj_state: octx=0x7f50f4072a60 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2210f8 2024-09-22T09:02:17.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.370+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.8.0 2024-09-22T09:02:17.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 20 get_obj_state: octx=0x55734a225560 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 10 manifest: total_size = 4134 2024-09-22T09:02:17.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.4348549160776983056 2024-09-22T09:02:17.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 20 get_obj_state: octx=0x55734a225560 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2210f8 2024-09-22T09:02:17.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.373+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.8.0 2024-09-22T09:02:17.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.374+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=__ 2024-09-22T09:02:17.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 20 get_obj_state: octx=0x55734a0833d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 10 manifest: total_size = 1048576 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.299474717112921175 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 20 get_obj_state: octx=0x55734a0833d0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2210f8 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.376+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.8.0 2024-09-22T09:02:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.377+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-22T09:02:17.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.379+0000 7f510c640800 20 get_obj_state: octx=0x55734a23a780 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.380+0000 7f510c640800 10 manifest: total_size = 1048576 2024-09-22T09:02:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.380+0000 7f510c640800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.11437257123513885806 2024-09-22T09:02:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.380+0000 7f510c640800 20 get_obj_state: octx=0x55734a23a780 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55734a2210f8 s->prefetch_data=0 2024-09-22T09:02:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.380+0000 7f510c640800 20 prepare_atomic_modification: state is not atomic. state=0x55734a2210f8 2024-09-22T09:02:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.380+0000 7f510c640800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.8.0 2024-09-22T09:02:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.381+0000 7f4fed7fa640 20 handle_completion(): completion ok for obj=___ 2024-09-22T09:02:17.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.382+0000 7f510c640800 20 list_objects_ordered: starting attempt 1 2024-09-22T09:02:17.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.382+0000 7f510c640800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f4fedffb640 20 handle_completion(): completion ok for obj=obj 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f510c640800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f510c640800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f510c640800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f510c640800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-22T09:02:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.384+0000 7f510c640800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[530e834e-7701-4a35-ad82-1b0744ba8777.4617.8])"; uploads.size()=0; is_truncated=0 2024-09-22T09:02:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.385+0000 7f510c640800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-22T09:02:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.385+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.386+0000 7f510c640800 20 rados_obj.operate() r=0 bl.length=223 2024-09-22T09:02:17.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.386+0000 7f510c640800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-22T09:02:17.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.386+0000 7f510c640800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-22T09:02:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.387+0000 7f510c640800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-22T09:02:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.387+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-22T09:02:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.387+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 93953653057232 notifier 5636 bl.length()=181 2024-09-22T09:02:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.390+0000 7f510c640800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 from cache 2024-09-22T09:02:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.390+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:530e834e-7701-4a35-ad82-1b0744ba8777.4617.8, ofs0, ns] 2024-09-22T09:02:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.390+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 93953653066032 notifier 5636 bl.length()=238 2024-09-22T09:02:17.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.392+0000 7f510c640800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 : miss 2024-09-22T09:02:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.392+0000 7f510c640800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.392+0000 7f510c640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.392+0000 7f510c640800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 info.flags=0x0 2024-09-22T09:02:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.392+0000 7f510c640800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/530e834e-7701-4a35-ad82-1b0744ba8777.4617.8 to cache LRU end 2024-09-22T09:02:17.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.395+0000 7f510c640800 10 removing key index: RHDJLLZGKIPJFOYKIUEK 2024-09-22T09:02:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.396+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:RHDJLLZGKIPJFOYKIUEK, ofs0, ns] 2024-09-22T09:02:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.396+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 93953653066032 notifier 5636 bl.length()=170 2024-09-22T09:02:17.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.398+0000 7f510c640800 10 removing email index: ragweed.client.0+test@test.test 2024-09-22T09:02:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.399+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-22T09:02:17.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.399+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529734 cookie 93953653068080 notifier 5636 bl.length()=182 2024-09-22T09:02:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.401+0000 7f510c640800 10 removing user buckets index 2024-09-22T09:02:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.402+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-22T09:02:17.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.402+0000 7f4fedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529680 cookie 93953653076320 notifier 5636 bl.length()=173 2024-09-22T09:02:17.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.403+0000 7f510c640800 10 removing user index: ragweed.client.0 2024-09-22T09:02:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.405+0000 7f510c640800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-22T09:02:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.405+0000 7f510c640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-22T09:02:17.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.405+0000 7f4fed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 93953653066032 notifier 5636 bl.length()=165 2024-09-22T09:02:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.409+0000 7f4fc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:02:17.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.411+0000 7f510c640800 20 remove_watcher() i=0 2024-09-22T09:02:17.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.411+0000 7f510c640800 2 removed watcher, disabling cache 2024-09-22T09:02:17.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.412+0000 7f510c640800 20 remove_watcher() i=1 2024-09-22T09:02:17.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.413+0000 7f510c640800 20 remove_watcher() i=2 2024-09-22T09:02:17.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.414+0000 7f510c640800 20 remove_watcher() i=3 2024-09-22T09:02:17.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.415+0000 7f510c640800 20 remove_watcher() i=4 2024-09-22T09:02:17.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.416+0000 7f510c640800 20 remove_watcher() i=5 2024-09-22T09:02:17.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.417+0000 7f510c640800 20 remove_watcher() i=6 2024-09-22T09:02:17.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.418+0000 7f510c640800 20 remove_watcher() i=7 2024-09-22T09:02:17.432 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-22T09:02:17.491 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:02:17.491 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:02:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.526+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 realm 2024-09-22T09:02:17.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:02:17.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.528+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.529+0000 7f56ea80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:02:17.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.529+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.529+0000 7f56ea80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:02:17.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.529+0000 7f56ea80e800 20 searching for the correct realm 2024-09-22T09:02:17.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.531+0000 7f56e665a640 0 -- 172.21.15.39:0/1174783582 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f56dc0738e0 msgr2=0x7f56dc06e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:02:17.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.737+0000 7f56e5658640 0 -- 172.21.15.39:0/1174783582 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f56e00842e0 msgr2=0x7f56e00982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:02:17.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:02:17.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:02:17.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:02:17.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.942+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:02:17.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 zone default found 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 4 Realm: () 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 zonegroup default 2024-09-22T09:02:17.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.943+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.944+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.944+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.944+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.944+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.945+0000 7f56ea80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.945+0000 7f56ea80e800 20 started sync module instance, tier type = 2024-09-22T09:02:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.945+0000 7f56ea80e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=0 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=1 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=2 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=3 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=4 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=5 2024-09-22T09:02:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.955+0000 7f56ea80e800 20 add_watcher() i=6 2024-09-22T09:02:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.956+0000 7f56ea80e800 20 add_watcher() i=7 2024-09-22T09:02:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.956+0000 7f56ea80e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:02:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.957+0000 7f559bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:02:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.957+0000 7f56ea80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:02:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.957+0000 7f56ea80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:02:17.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.992+0000 7f559afe5640 20 reqs_thread_entry: start 2024-09-22T09:02:17.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.992+0000 7f56ea80e800 20 init_complete bucket index max shards: 1 2024-09-22T09:02:17.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 20 Filter name: none 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f5598fe1640 20 reqs_thread_entry: start 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 20 rados->read ofs=0 len=0 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-22T09:02:17.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.993+0000 7f56ea80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:02:17.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.994+0000 7f56ea80e800 10 removing key index: EBKISFXQZJDLVVSKJBOX 2024-09-22T09:02:17.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.995+0000 7f56ea80e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:EBKISFXQZJDLVVSKJBOX, ofs0, ns] 2024-09-22T09:02:17.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.995+0000 7f55c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94808452362336 notifier 5654 bl.length()=170 2024-09-22T09:02:17.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.996+0000 7f56ea80e800 10 removing email index: sysuser.client.0+test@test.test 2024-09-22T09:02:17.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.997+0000 7f56ea80e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-22T09:02:17.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.998+0000 7f55c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 94808452364080 notifier 5654 bl.length()=182 2024-09-22T09:02:18.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:17.999+0000 7f56ea80e800 10 removing user buckets index 2024-09-22T09:02:18.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.000+0000 7f56ea80e800 10 removing user index: sysuser.client.0 2024-09-22T09:02:18.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.001+0000 7f56ea80e800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-22T09:02:18.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.001+0000 7f56ea80e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-22T09:02:18.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.001+0000 7f55c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529735 cookie 94808452360064 notifier 5654 bl.length()=165 2024-09-22T09:02:18.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.004+0000 7f559bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:02:18.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.006+0000 7f56ea80e800 20 remove_watcher() i=0 2024-09-22T09:02:18.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.006+0000 7f56ea80e800 2 removed watcher, disabling cache 2024-09-22T09:02:18.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.007+0000 7f56ea80e800 20 remove_watcher() i=1 2024-09-22T09:02:18.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.008+0000 7f56ea80e800 20 remove_watcher() i=2 2024-09-22T09:02:18.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.009+0000 7f56ea80e800 20 remove_watcher() i=3 2024-09-22T09:02:18.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.010+0000 7f56ea80e800 20 remove_watcher() i=4 2024-09-22T09:02:18.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.011+0000 7f56ea80e800 20 remove_watcher() i=5 2024-09-22T09:02:18.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.012+0000 7f56ea80e800 20 remove_watcher() i=6 2024-09-22T09:02:18.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:02:18.013+0000 7f56ea80e800 20 remove_watcher() i=7 2024-09-22T09:02:18.026 INFO:tasks.ragweed:Removing ragweed... 2024-09-22T09:02:18.026 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-22T09:02:18.112 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T09:02:18.122 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:02:18.122 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T09:02:18.122 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:02:18.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:02:18.152 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T09:02:18.152 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:02:18.221 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T09:02:18.222 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T09:02:18.292 INFO:tasks.workunit:timeout=3h 2024-09-22T09:02:18.292 INFO:tasks.workunit:cleanup=True 2024-09-22T09:02:18.293 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:02:18.362 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T09:03:21.556 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 92% (11769/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T09:03:22.333 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:22.334 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T09:03:22.338 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T09:03:22.408 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T09:03:22.410 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:03:22.410 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T09:03:22.460 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T09:03:22.512 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T09:03:22.552 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:03:22.554 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:03:22.554 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T09:03:22.594 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:03:22.598 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:03:22.598 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T09:03:22.668 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-22T09:03:22.669 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-22T09:03:22.670 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T09:03:22.743 INFO:tasks.workunit.client.0.smithi039.stderr:+ ulimit -c 0 2024-09-22T09:03:22.743 INFO:tasks.workunit.client.0.smithi039.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-22T09:03:22.743 INFO:tasks.workunit.client.0.smithi039.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:03:22.743 INFO:tasks.workunit.client.0.smithi039.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:03:25.143 INFO:tasks.workunit.client.0.smithi039.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ deactivate nondestructive 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ unset VIRTUAL_ENV 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ export VIRTUAL_ENV 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:03:25.144 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PATH 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -z '' ']' 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ PS1='(rgw) ' 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PS1 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T09:03:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install pip --upgrade 2024-09-22T09:03:25.380 INFO:tasks.workunit.client.0.smithi039.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T09:03:25.559 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting pip 2024-09-22T09:03:25.565 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T09:03:25.611 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: pip 2024-09-22T09:03:25.612 INFO:tasks.workunit.client.0.smithi039.stdout: Attempting uninstall: pip 2024-09-22T09:03:25.612 INFO:tasks.workunit.client.0.smithi039.stdout: Found existing installation: pip 21.3.1 2024-09-22T09:03:25.780 INFO:tasks.workunit.client.0.smithi039.stdout: Uninstalling pip-21.3.1: 2024-09-22T09:03:25.786 INFO:tasks.workunit.client.0.smithi039.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T09:03:26.554 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed pip-24.2 2024-09-22T09:03:26.603 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install boto3 2024-09-22T09:03:27.420 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting boto3 2024-09-22T09:03:27.422 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T09:03:27.964 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T09:03:27.965 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T09:03:28.014 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T09:03:28.015 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T09:03:28.060 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T09:03:28.062 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T09:03:28.112 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:03:28.114 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T09:03:28.191 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:03:28.192 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T09:03:28.343 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:03:28.344 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T09:03:28.348 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T09:03:28.350 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T09:03:28.359 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T09:03:28.360 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T09:03:28.361 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T09:03:28.363 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T09:03:28.364 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T09:03:28.443 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T09:03:29.550 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T09:03:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-22T09:03:29.802 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-22T09:03:29.840 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:29.840 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:29.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.879+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:29.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:29.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 realm 2024-09-22T09:03:29.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:29.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:29.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:29.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:29.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:29.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.881+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:29.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.882+0000 7f22f0213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:29.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.882+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:29.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.883+0000 7f22f0213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:29.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.883+0000 7f22f0213800 20 searching for the correct realm 2024-09-22T09:03:29.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.886+0000 7f22ec193640 0 -- 172.21.15.39:0/1534843783 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f22e001a400 msgr2=0x7f22e001a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:03:29.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:29.891+0000 7f22eb191640 0 -- 172.21.15.39:0/1534843783 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f22e4018900 msgr2=0x7f22e4043330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:30.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.099+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 zone default found 2024-09-22T09:03:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 4 Realm: () 2024-09-22T09:03:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:30.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 zonegroup default 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 started sync module instance, tier type = 2024-09-22T09:03:30.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.100+0000 7f22f0213800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=0 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=1 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=2 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=3 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=4 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=5 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.110+0000 7f22f0213800 20 add_watcher() i=6 2024-09-22T09:03:30.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.111+0000 7f22f0213800 20 add_watcher() i=7 2024-09-22T09:03:30.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.111+0000 7f22f0213800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.113+0000 7f21a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 5 note: GC not initialized 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f21a0fe1640 20 reqs_thread_entry: start 2024-09-22T09:03:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:30.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 20 Filter name: none 2024-09-22T09:03:30.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f211a7fc640 20 reqs_thread_entry: start 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.114+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 20 rados->read ofs=0 len=0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T09:03:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.115+0000 7f22f0213800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-22T09:03:30.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f22f0213800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-22T09:03:30.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f22f0213800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T09:03:30.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f22f0213800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-22T09:03:30.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f21caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529681 cookie 94727917251328 notifier 5672 bl.length()=569 2024-09-22T09:03:30.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f21caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-22T09:03:30.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.117+0000 7f21caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f22f0213800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f22f0213800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f22f0213800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f21ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529682 cookie 94727917246400 notifier 5672 bl.length()=180 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f21ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-22T09:03:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.121+0000 7f21ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-22T09:03:30.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.123+0000 7f21a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:30.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.127+0000 7f22f0213800 20 remove_watcher() i=0 2024-09-22T09:03:30.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.127+0000 7f22f0213800 2 removed watcher, disabling cache 2024-09-22T09:03:30.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.128+0000 7f22f0213800 20 remove_watcher() i=1 2024-09-22T09:03:30.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.129+0000 7f22f0213800 20 remove_watcher() i=2 2024-09-22T09:03:30.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.130+0000 7f22f0213800 20 remove_watcher() i=3 2024-09-22T09:03:30.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.131+0000 7f22f0213800 20 remove_watcher() i=4 2024-09-22T09:03:30.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.132+0000 7f22f0213800 20 remove_watcher() i=5 2024-09-22T09:03:30.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.134+0000 7f22f0213800 20 remove_watcher() i=6 2024-09-22T09:03:30.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:30.135+0000 7f22f0213800 20 remove_watcher() i=7 2024-09-22T09:03:50.830 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:50.830 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:50.879 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:50.879 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:50.920 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:50.920 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:50.960 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:50.961 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:50.990 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:50.990 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:51.051 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:51.051 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:51.106 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard add 2024-09-22T09:03:51.107 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:51.108 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:03:51.139 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:51.139 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:51.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.179+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 20 realm 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.181+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.182+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.182+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.183+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:51.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.183+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.183+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:51.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.183+0000 7f7ab2331800 20 searching for the correct realm 2024-09-22T09:03:51.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.184+0000 7f7aadf99640 0 -- 172.21.15.39:0/4154614881 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x55ee753f1f60 msgr2=0x7f7aa801a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:51.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.389+0000 7f7aadf99640 0 -- 172.21.15.39:0/4154614881 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x55ee7548b930 msgr2=0x7f7aa802a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:03:51.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:51.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:51.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:51.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.597+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.598+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.598+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.598+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:51.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.598+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.598+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 zone default found 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 4 Realm: () 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:51.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 zonegroup default 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.599+0000 7f7ab2331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.600+0000 7f7ab2331800 20 started sync module instance, tier type = 2024-09-22T09:03:51.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.600+0000 7f7ab2331800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=0 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=1 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=2 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=3 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=4 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=5 2024-09-22T09:03:51.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.610+0000 7f7ab2331800 20 add_watcher() i=6 2024-09-22T09:03:51.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.611+0000 7f7ab2331800 20 add_watcher() i=7 2024-09-22T09:03:51.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.611+0000 7f7ab2331800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:51.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.612+0000 7f795ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:51.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:51.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 5 note: GC not initialized 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f795effd640 20 reqs_thread_entry: start 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 20 Filter name: none 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f795cff9640 20 reqs_thread_entry: start 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.613+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.614+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:51.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.614+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:51.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:51.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:51.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:51.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.615+0000 7f7ab2331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:51.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.617+0000 7f795ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:51.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.619+0000 7f7ab2331800 20 remove_watcher() i=0 2024-09-22T09:03:51.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.619+0000 7f7ab2331800 2 removed watcher, disabling cache 2024-09-22T09:03:51.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.620+0000 7f7ab2331800 20 remove_watcher() i=1 2024-09-22T09:03:51.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.621+0000 7f7ab2331800 20 remove_watcher() i=2 2024-09-22T09:03:51.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.622+0000 7f7ab2331800 20 remove_watcher() i=3 2024-09-22T09:03:51.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.623+0000 7f7ab2331800 20 remove_watcher() i=4 2024-09-22T09:03:51.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.624+0000 7f7ab2331800 20 remove_watcher() i=5 2024-09-22T09:03:51.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.625+0000 7f7ab2331800 20 remove_watcher() i=6 2024-09-22T09:03:51.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.626+0000 7f7ab2331800 20 remove_watcher() i=7 2024-09-22T09:03:51.640 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:51.640 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:03:51.640 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-22T09:03:51.641 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:51.642 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-22T09:03:51.673 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:51.673 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:51.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.712+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 realm 2024-09-22T09:03:51.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.714+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.715+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:51.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.715+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:51.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.716+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:51.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.716+0000 7f37c742b800 20 searching for the correct realm 2024-09-22T09:03:51.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.716+0000 7f37c4f15640 0 -- 172.21.15.39:0/1162214052 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f37bc042060 msgr2=0x7f37bc06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:51.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:51.921+0000 7f37c4f15640 0 -- 172.21.15.39:0/1162214052 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7f37bc06c0f0 msgr2=0x7f37bc074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:52.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:52.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.131+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:52.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 zone default found 2024-09-22T09:03:52.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 4 Realm: () 2024-09-22T09:03:52.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:52.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 zonegroup default 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.132+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.133+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.133+0000 7f37c742b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.133+0000 7f37c742b800 20 started sync module instance, tier type = 2024-09-22T09:03:52.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.133+0000 7f37c742b800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:52.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=0 2024-09-22T09:03:52.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=1 2024-09-22T09:03:52.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=2 2024-09-22T09:03:52.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=3 2024-09-22T09:03:52.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=4 2024-09-22T09:03:52.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=5 2024-09-22T09:03:52.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.144+0000 7f37c742b800 20 add_watcher() i=6 2024-09-22T09:03:52.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.145+0000 7f37c742b800 20 add_watcher() i=7 2024-09-22T09:03:52.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.145+0000 7f37c742b800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:52.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.147+0000 7f3676fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.147+0000 7f37c742b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.147+0000 7f37c742b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.147+0000 7f37c742b800 5 note: GC not initialized 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.147+0000 7f3675fe3640 20 reqs_thread_entry: start 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 20 Filter name: none 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f35e77fe640 20 reqs_thread_entry: start 2024-09-22T09:03:52.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:03:52.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.148+0000 7f37c742b800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:52.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.149+0000 7f37c742b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:03:52.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.151+0000 7f3676fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:52.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.153+0000 7f37c742b800 20 remove_watcher() i=0 2024-09-22T09:03:52.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.153+0000 7f37c742b800 2 removed watcher, disabling cache 2024-09-22T09:03:52.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.154+0000 7f37c742b800 20 remove_watcher() i=1 2024-09-22T09:03:52.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.155+0000 7f37c742b800 20 remove_watcher() i=2 2024-09-22T09:03:52.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.157+0000 7f37c742b800 20 remove_watcher() i=3 2024-09-22T09:03:52.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.158+0000 7f37c742b800 20 remove_watcher() i=4 2024-09-22T09:03:52.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.159+0000 7f37c742b800 20 remove_watcher() i=5 2024-09-22T09:03:52.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.160+0000 7f37c742b800 20 remove_watcher() i=6 2024-09-22T09:03:52.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.161+0000 7f37c742b800 20 remove_watcher() i=7 2024-09-22T09:03:52.177 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard list 2024-09-22T09:03:52.205 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:52.205 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:52.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.244+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.245+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.245+0000 7fe2fe020800 20 realm 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.245+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.246+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.246+0000 7fe2fe020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.246+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.246+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.246+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.247+0000 7fe2fe020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:52.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.247+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.247+0000 7fe2fe020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:52.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.247+0000 7fe2fe020800 20 searching for the correct realm 2024-09-22T09:03:52.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.249+0000 7fe2fc30b640 0 -- 172.21.15.39:0/2333986970 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe2f004f340 msgr2=0x7fe2f0066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:52.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.856+0000 7fe2fc30b640 0 -- 172.21.15.39:0/2333986970 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe2f004f340 msgr2=0x7fe2f0066b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:52.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:52.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.862+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 zone default found 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 4 Realm: () 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:52.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 zonegroup default 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.863+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.864+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.864+0000 7fe2fe020800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.864+0000 7fe2fe020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.864+0000 7fe2fe020800 20 started sync module instance, tier type = 2024-09-22T09:03:52.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.864+0000 7fe2fe020800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:52.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=0 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=1 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=2 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=3 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=4 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=5 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.874+0000 7fe2fe020800 20 add_watcher() i=6 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.875+0000 7fe2fe020800 20 add_watcher() i=7 2024-09-22T09:03:52.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.875+0000 7fe2fe020800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:52.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.877+0000 7fe1b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:52.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.877+0000 7fe2fe020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:52.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.877+0000 7fe2fe020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:52.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.877+0000 7fe2fe020800 5 note: GC not initialized 2024-09-22T09:03:52.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.878+0000 7fe1b0fe1640 20 reqs_thread_entry: start 2024-09-22T09:03:52.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.878+0000 7fe2fe020800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:52.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.878+0000 7fe2fe020800 20 Filter name: none 2024-09-22T09:03:52.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.878+0000 7fe12a7fc640 20 reqs_thread_entry: start 2024-09-22T09:03:52.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.884+0000 7fe1b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:52.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.887+0000 7fe2fe020800 20 remove_watcher() i=0 2024-09-22T09:03:52.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.887+0000 7fe2fe020800 2 removed watcher, disabling cache 2024-09-22T09:03:52.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.888+0000 7fe2fe020800 20 remove_watcher() i=1 2024-09-22T09:03:52.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.890+0000 7fe2fe020800 20 remove_watcher() i=2 2024-09-22T09:03:52.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.891+0000 7fe2fe020800 20 remove_watcher() i=3 2024-09-22T09:03:52.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.892+0000 7fe2fe020800 20 remove_watcher() i=4 2024-09-22T09:03:52.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.893+0000 7fe2fe020800 20 remove_watcher() i=5 2024-09-22T09:03:52.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.894+0000 7fe2fe020800 20 remove_watcher() i=6 2024-09-22T09:03:52.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.895+0000 7fe2fe020800 20 remove_watcher() i=7 2024-09-22T09:03:52.909 INFO:tasks.workunit.client.0.smithi039.stderr:bucket name a-bucket 2024-09-22T09:03:52.909 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard process 2024-09-22T09:03:52.909 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:52.910 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard process 2024-09-22T09:03:52.938 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:52.938 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:52.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.977+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.978+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.978+0000 7f21bae20800 20 realm 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.978+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.979+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.979+0000 7f21bae20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.979+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.979+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:52.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.979+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.980+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:52.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.980+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:52.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.980+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:52.983 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.981+0000 7f21bae20800 20 searching for the correct realm 2024-09-22T09:03:52.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.983+0000 7f21b9112640 0 -- 172.21.15.39:0/2134230614 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f21ac07ec20 msgr2=0x7f21ac067880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:52.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:52.987+0000 7f21b8110640 0 -- 172.21.15.39:0/2134230614 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f21b00ea1b0 msgr2=0x7f21b0093190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.193+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:53.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:53.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 zone default found 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 4 Realm: () 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 zonegroup default 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.194+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.195+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.195+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.195+0000 7f21bae20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.195+0000 7f21bae20800 20 started sync module instance, tier type = 2024-09-22T09:03:53.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.195+0000 7f21bae20800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=0 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=1 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=2 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=3 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=4 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=5 2024-09-22T09:03:53.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.205+0000 7f21bae20800 20 add_watcher() i=6 2024-09-22T09:03:53.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.206+0000 7f21bae20800 20 add_watcher() i=7 2024-09-22T09:03:53.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.206+0000 7f21bae20800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:53.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.207+0000 7f206f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:53.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:53.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 5 note: GC not initialized 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f206e7e4640 20 reqs_thread_entry: start 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 20 Filter name: none 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f20677fe640 20 reqs_thread_entry: start 2024-09-22T09:03:53.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.208+0000 7f21bae20800 20 processing logshard = reshard.0000000000 2024-09-22T09:03:53.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.211+0000 7f21bae20800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T09:03:53.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.211+0000 7f21bae20800 20 processing logshard = reshard.0000000001 2024-09-22T09:03:53.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.214+0000 7f21bae20800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T09:03:53.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.214+0000 7f21bae20800 20 processing logshard = reshard.0000000002 2024-09-22T09:03:53.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.217+0000 7f21bae20800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T09:03:53.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.217+0000 7f21bae20800 20 processing logshard = reshard.0000000003 2024-09-22T09:03:53.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.219+0000 7f21bae20800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T09:03:53.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.219+0000 7f21bae20800 20 processing logshard = reshard.0000000004 2024-09-22T09:03:53.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.223+0000 7f21bae20800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T09:03:53.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.223+0000 7f21bae20800 20 processing logshard = reshard.0000000005 2024-09-22T09:03:53.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.225+0000 7f21bae20800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T09:03:53.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.225+0000 7f21bae20800 20 processing logshard = reshard.0000000006 2024-09-22T09:03:53.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 20 process_entry resharding a-bucket 2024-09-22T09:03:53.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:03:53.229 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.227+0000 7f21bae20800 20 rados->read ofs=0 len=0 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:03:53.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.228+0000 7f21bae20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.233+0000 7f21bae20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.233+0000 7f21bae20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.233+0000 7f21bae20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.233+0000 7f21bae20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.234+0000 7f208ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529686 cookie 93826540495024 notifier 5738 bl.length()=827 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.234+0000 7f208ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.234+0000 7f208ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.234+0000 7f208ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.235+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:03:53.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.235+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:03:53.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.235+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:03:53.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.235+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:03:53.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.237+0000 7f21bae20800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:03:53.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.237+0000 7f21bae20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:03:53.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.237+0000 7f21bae20800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:03:53.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.237+0000 7f21bae20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:03:53.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.237+0000 7f21bae20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.0 2024-09-22T09:03:53.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.238+0000 7f21bae20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:03:53.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.238+0000 7f21bae20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:03:53.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f21bae20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f21bae20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f21bae20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f21bae20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:03:53.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f208ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529687 cookie 93826540495024 notifier 5738 bl.length()=827 2024-09-22T09:03:53.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f208ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f208ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.240+0000 7f208ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.242+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:03:53.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.242+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:03:53.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.242+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:03:53.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.242+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:03:53.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.243+0000 7f21bae20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.0 2024-09-22T09:03:53.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.243+0000 7f21bae20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:03:53.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.243+0000 7f21bae20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:03:53.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f21bae20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f21bae20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f21bae20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f21bae20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f208ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529688 cookie 93826540495024 notifier 5738 bl.length()=795 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f208ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f208ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.245+0000 7f208ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.246+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:03:53.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.246+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:03:53.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.246+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:03:53.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.246+0000 7f21bae20800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:03:53.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.247+0000 7f21bae20800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-22T09:03:53.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.249+0000 7f21bae20800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T09:03:53.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.251+0000 7f21bae20800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T09:03:53.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.251+0000 7f21bae20800 20 processing logshard = reshard.0000000007 2024-09-22T09:03:53.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.253+0000 7f21bae20800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T09:03:53.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.253+0000 7f21bae20800 20 processing logshard = reshard.0000000008 2024-09-22T09:03:53.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.256+0000 7f21bae20800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T09:03:53.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.256+0000 7f21bae20800 20 processing logshard = reshard.0000000009 2024-09-22T09:03:53.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.258+0000 7f21bae20800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T09:03:53.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.258+0000 7f21bae20800 20 processing logshard = reshard.0000000010 2024-09-22T09:03:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.261+0000 7f21bae20800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T09:03:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.261+0000 7f21bae20800 20 processing logshard = reshard.0000000011 2024-09-22T09:03:53.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.263+0000 7f21bae20800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T09:03:53.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.263+0000 7f21bae20800 20 processing logshard = reshard.0000000012 2024-09-22T09:03:53.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.266+0000 7f21bae20800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T09:03:53.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.266+0000 7f21bae20800 20 processing logshard = reshard.0000000013 2024-09-22T09:03:53.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.269+0000 7f21bae20800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T09:03:53.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.269+0000 7f21bae20800 20 processing logshard = reshard.0000000014 2024-09-22T09:03:53.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.271+0000 7f21bae20800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T09:03:53.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.271+0000 7f21bae20800 20 processing logshard = reshard.0000000015 2024-09-22T09:03:53.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.274+0000 7f21bae20800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T09:03:53.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.274+0000 7f206f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.277+0000 7f21bae20800 20 remove_watcher() i=0 2024-09-22T09:03:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.277+0000 7f21bae20800 2 removed watcher, disabling cache 2024-09-22T09:03:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.278+0000 7f21bae20800 20 remove_watcher() i=1 2024-09-22T09:03:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.279+0000 7f21bae20800 20 remove_watcher() i=2 2024-09-22T09:03:53.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.280+0000 7f21bae20800 20 remove_watcher() i=3 2024-09-22T09:03:53.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.281+0000 7f21bae20800 20 remove_watcher() i=4 2024-09-22T09:03:53.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.282+0000 7f21bae20800 20 remove_watcher() i=5 2024-09-22T09:03:53.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.283+0000 7f21bae20800 20 remove_watcher() i=6 2024-09-22T09:03:53.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:53.284+0000 7f21bae20800 20 remove_watcher() i=7 2024-09-22T09:03:58.303 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:03:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:58.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.381+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 realm 2024-09-22T09:03:58.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.383+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.384+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.384+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.385+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:58.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.385+0000 7fd4db72a800 20 searching for the correct realm 2024-09-22T09:03:58.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.388+0000 7fd4d7b62640 0 -- 172.21.15.39:0/575483768 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd4cc04c680 msgr2=0x7fd4cc066ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:03:58.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.594+0000 7fd4d6b60640 0 -- 172.21.15.39:0/575483768 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd4d0049910 msgr2=0x7fd4d0017400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:58.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.801+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.802+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.802+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.802+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.802+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 zone default found 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 4 Realm: () 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:58.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 zonegroup default 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.803+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.804+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.804+0000 7fd4db72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:58.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.804+0000 7fd4db72a800 20 started sync module instance, tier type = 2024-09-22T09:03:58.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.804+0000 7fd4db72a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:58.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=0 2024-09-22T09:03:58.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=1 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=2 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=3 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=4 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=5 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.816+0000 7fd4db72a800 20 add_watcher() i=6 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.817+0000 7fd4db72a800 20 add_watcher() i=7 2024-09-22T09:03:58.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.817+0000 7fd4db72a800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:58.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.819+0000 7fd38dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:58.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.819+0000 7fd4db72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:58.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.819+0000 7fd4db72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:58.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.819+0000 7fd4db72a800 5 note: GC not initialized 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.820+0000 7fd38cfe1640 20 reqs_thread_entry: start 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.820+0000 7fd4db72a800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.820+0000 7fd4db72a800 20 Filter name: none 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.820+0000 7fd3067fc640 20 reqs_thread_entry: start 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.820+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.821+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:58.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.821+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.821+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:58.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.821+0000 7fd4db72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:58.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.821+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.822+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:58.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.822+0000 7fd4db72a800 20 rados->read ofs=0 len=0 2024-09-22T09:03:58.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.822+0000 7fd4db72a800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:58.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.822+0000 7fd4db72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:58.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.824+0000 7fd38dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:58.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.826+0000 7fd4db72a800 20 remove_watcher() i=0 2024-09-22T09:03:58.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.826+0000 7fd4db72a800 2 removed watcher, disabling cache 2024-09-22T09:03:58.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.828+0000 7fd4db72a800 20 remove_watcher() i=1 2024-09-22T09:03:58.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.829+0000 7fd4db72a800 20 remove_watcher() i=2 2024-09-22T09:03:58.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.830+0000 7fd4db72a800 20 remove_watcher() i=3 2024-09-22T09:03:58.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.831+0000 7fd4db72a800 20 remove_watcher() i=4 2024-09-22T09:03:58.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.833+0000 7fd4db72a800 20 remove_watcher() i=5 2024-09-22T09:03:58.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.834+0000 7fd4db72a800 20 remove_watcher() i=6 2024-09-22T09:03:58.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:58.835+0000 7fd4db72a800 20 remove_watcher() i=7 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard add non empty bucket 2024-09-22T09:03:58.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:58.856 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:58.856 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:58.897 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:58.898 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:58.930 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:58.931 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:58.965 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:58.965 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:59.000 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:59.000 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:59.032 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:59.032 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:59.066 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:59.066 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:59.099 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:03:59.099 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:03:59.132 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:03:59.161 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:59.161 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:59.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.198+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 realm 2024-09-22T09:03:59.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:59.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.200+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.201+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:59.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.201+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.202+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:59.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.202+0000 7fc7a0775800 20 searching for the correct realm 2024-09-22T09:03:59.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.204+0000 7fc79ea60640 0 -- 172.21.15.39:0/1404777301 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc794095410 msgr2=0x7fc794095830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:59.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.410+0000 7fc79da5e640 0 -- 172.21.15.39:0/1404777301 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc7980473e0 msgr2=0x7fc798047820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:03:59.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:03:59.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:03:59.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:03:59.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.617+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:59.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:03:59.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 zone default found 2024-09-22T09:03:59.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 4 Realm: () 2024-09-22T09:03:59.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 zonegroup default 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.618+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 started sync module instance, tier type = 2024-09-22T09:03:59.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.619+0000 7fc7a0775800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=0 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=1 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=2 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=3 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=4 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=5 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.629+0000 7fc7a0775800 20 add_watcher() i=6 2024-09-22T09:03:59.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.630+0000 7fc7a0775800 20 add_watcher() i=7 2024-09-22T09:03:59.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.630+0000 7fc7a0775800 2 all 8 watchers are set, enabling cache 2024-09-22T09:03:59.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.632+0000 7fc654fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:59.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.632+0000 7fc7a0775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:03:59.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.632+0000 7fc7a0775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:03:59.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.632+0000 7fc7a0775800 5 note: GC not initialized 2024-09-22T09:03:59.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.633+0000 7fc5cf7fe640 20 reqs_thread_entry: start 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.633+0000 7fc7a0775800 20 init_complete bucket index max shards: 1 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.633+0000 7fc7a0775800 20 Filter name: none 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.633+0000 7fc5cd7fa640 20 reqs_thread_entry: start 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.633+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.634+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:59.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.634+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.634+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:59.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.634+0000 7fc7a0775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:59.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.634+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.635+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:03:59.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.635+0000 7fc7a0775800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.635+0000 7fc7a0775800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:03:59.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.635+0000 7fc7a0775800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:03:59.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.637+0000 7fc654fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:03:59.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.639+0000 7fc7a0775800 20 remove_watcher() i=0 2024-09-22T09:03:59.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.639+0000 7fc7a0775800 2 removed watcher, disabling cache 2024-09-22T09:03:59.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.640+0000 7fc7a0775800 20 remove_watcher() i=1 2024-09-22T09:03:59.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.641+0000 7fc7a0775800 20 remove_watcher() i=2 2024-09-22T09:03:59.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.642+0000 7fc7a0775800 20 remove_watcher() i=3 2024-09-22T09:03:59.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.644+0000 7fc7a0775800 20 remove_watcher() i=4 2024-09-22T09:03:59.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.645+0000 7fc7a0775800 20 remove_watcher() i=5 2024-09-22T09:03:59.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.646+0000 7fc7a0775800 20 remove_watcher() i=6 2024-09-22T09:03:59.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.647+0000 7fc7a0775800 20 remove_watcher() i=7 2024-09-22T09:03:59.661 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:59.661 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:03:59.661 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-22T09:03:59.661 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:03:59.663 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-22T09:03:59.695 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:03:59.695 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:03:59.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.733+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 20 realm 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.735+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.736+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:03:59.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.736+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.737+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:03:59.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.737+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:03:59.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.737+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:03:59.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.737+0000 7ff5ae344800 20 searching for the correct realm 2024-09-22T09:03:59.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.739+0000 7ff5ac62f640 0 -- 172.21.15.39:0/85899349 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff594036040 msgr2=0x7ff5940417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:03:59.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:03:59.946+0000 7ff5ab62d640 0 -- 172.21.15.39:0/85899349 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff5a4048830 msgr2=0x7ff5a405f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:00.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:00.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:00.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:00.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:00.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:00.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:00.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.154+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 zone default found 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 4 Realm: () 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:00.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 zonegroup default 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.155+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.156+0000 7ff5ae344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.156+0000 7ff5ae344800 20 started sync module instance, tier type = 2024-09-22T09:04:00.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.156+0000 7ff5ae344800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=0 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=1 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=2 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=3 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=4 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=5 2024-09-22T09:04:00.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.166+0000 7ff5ae344800 20 add_watcher() i=6 2024-09-22T09:04:00.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.167+0000 7ff5ae344800 20 add_watcher() i=7 2024-09-22T09:04:00.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.167+0000 7ff5ae344800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:00.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.169+0000 7ff461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.169+0000 7ff5ae344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.169+0000 7ff5ae344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.169+0000 7ff5ae344800 5 note: GC not initialized 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff460fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:00.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 20 Filter name: none 2024-09-22T09:04:00.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff3da7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:00.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:04:00.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:04:00.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.170+0000 7ff5ae344800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:00.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.171+0000 7ff5ae344800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:04:00.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.173+0000 7ff461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:00.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.175+0000 7ff5ae344800 20 remove_watcher() i=0 2024-09-22T09:04:00.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.175+0000 7ff5ae344800 2 removed watcher, disabling cache 2024-09-22T09:04:00.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.177+0000 7ff5ae344800 20 remove_watcher() i=1 2024-09-22T09:04:00.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.178+0000 7ff5ae344800 20 remove_watcher() i=2 2024-09-22T09:04:00.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.179+0000 7ff5ae344800 20 remove_watcher() i=3 2024-09-22T09:04:00.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.180+0000 7ff5ae344800 20 remove_watcher() i=4 2024-09-22T09:04:00.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.181+0000 7ff5ae344800 20 remove_watcher() i=5 2024-09-22T09:04:00.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.183+0000 7ff5ae344800 20 remove_watcher() i=6 2024-09-22T09:04:00.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.184+0000 7ff5ae344800 20 remove_watcher() i=7 2024-09-22T09:04:00.199 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard list 2024-09-22T09:04:00.227 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:00.227 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:00.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.264+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.266+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.266+0000 7f45f492c800 20 realm 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.266+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.267+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.267+0000 7f45f492c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:00.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.267+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.267+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.267+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.268+0000 7f45f492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:00.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.268+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.268+0000 7f45f492c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:00.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.268+0000 7f45f492c800 20 searching for the correct realm 2024-09-22T09:04:00.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.271+0000 7f45f0d3f640 0 -- 172.21.15.39:0/2960319506 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f45e4040020 msgr2=0x7f45e4078ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:00.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.476+0000 7f45efd3d640 0 -- 172.21.15.39:0/2960319506 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f45e80b30c0 msgr2=0x7f45e80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:00.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:00.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:00.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:00.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:00.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:00.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:00.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.683+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 zone default found 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 4 Realm: () 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:00.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 zonegroup default 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.684+0000 7f45f492c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.685+0000 7f45f492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.685+0000 7f45f492c800 20 started sync module instance, tier type = 2024-09-22T09:04:00.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.685+0000 7f45f492c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:00.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=0 2024-09-22T09:04:00.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=1 2024-09-22T09:04:00.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=2 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=3 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=4 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=5 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.695+0000 7f45f492c800 20 add_watcher() i=6 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.696+0000 7f45f492c800 20 add_watcher() i=7 2024-09-22T09:04:00.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.696+0000 7f45f492c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:00.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f44a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f45f492c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f45f492c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f45f492c800 5 note: GC not initialized 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f44a5fdb640 20 reqs_thread_entry: start 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f45f492c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f45f492c800 20 Filter name: none 2024-09-22T09:04:00.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.698+0000 7f44177fe640 20 reqs_thread_entry: start 2024-09-22T09:04:00.708 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.705+0000 7f44a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:00.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.708+0000 7f45f492c800 20 remove_watcher() i=0 2024-09-22T09:04:00.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.708+0000 7f45f492c800 2 removed watcher, disabling cache 2024-09-22T09:04:00.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.710+0000 7f45f492c800 20 remove_watcher() i=1 2024-09-22T09:04:00.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.711+0000 7f45f492c800 20 remove_watcher() i=2 2024-09-22T09:04:00.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.712+0000 7f45f492c800 20 remove_watcher() i=3 2024-09-22T09:04:00.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.713+0000 7f45f492c800 20 remove_watcher() i=4 2024-09-22T09:04:00.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.714+0000 7f45f492c800 20 remove_watcher() i=5 2024-09-22T09:04:00.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.715+0000 7f45f492c800 20 remove_watcher() i=6 2024-09-22T09:04:00.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.716+0000 7f45f492c800 20 remove_watcher() i=7 2024-09-22T09:04:00.730 INFO:tasks.workunit.client.0.smithi039.stderr:bucket name a-bucket 2024-09-22T09:04:00.730 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard process non empty bucket 2024-09-22T09:04:00.730 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:00.731 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshard process 2024-09-22T09:04:00.759 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:00.759 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:00.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.797+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.798+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.798+0000 7efc0ed22800 20 realm 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.798+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.799+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.799+0000 7efc0ed22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.799+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.799+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.799+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.800+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:00.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.800+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:00.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.801+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:00.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.801+0000 7efc0ed22800 20 searching for the correct realm 2024-09-22T09:04:00.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:00.803+0000 7efc0b103640 0 -- 172.21.15.39:0/3670481681 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7efc00082c20 msgr2=0x7efc0008d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:01.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.009+0000 7efc0a101640 0 -- 172.21.15.39:0/3670481681 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7efc04088930 msgr2=0x7efc040880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:01.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.216+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 zone default found 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 4 Realm: () 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 zonegroup default 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.217+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.218+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.218+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.218+0000 7efc0ed22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.218+0000 7efc0ed22800 20 started sync module instance, tier type = 2024-09-22T09:04:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.218+0000 7efc0ed22800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:01.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=0 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=1 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=2 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=3 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=4 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=5 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.229+0000 7efc0ed22800 20 add_watcher() i=6 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.230+0000 7efc0ed22800 20 add_watcher() i=7 2024-09-22T09:04:01.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.230+0000 7efc0ed22800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:01.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.232+0000 7efac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.232+0000 7efc0ed22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.232+0000 7efc0ed22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.232+0000 7efc0ed22800 5 note: GC not initialized 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.233+0000 7efa3bfff640 20 reqs_thread_entry: start 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.233+0000 7efc0ed22800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.233+0000 7efc0ed22800 20 Filter name: none 2024-09-22T09:04:01.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.233+0000 7efa39ffb640 20 reqs_thread_entry: start 2024-09-22T09:04:01.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.233+0000 7efc0ed22800 20 processing logshard = reshard.0000000000 2024-09-22T09:04:01.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.236+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-22T09:04:01.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.236+0000 7efc0ed22800 20 processing logshard = reshard.0000000001 2024-09-22T09:04:01.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.239+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-22T09:04:01.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.239+0000 7efc0ed22800 20 processing logshard = reshard.0000000002 2024-09-22T09:04:01.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.241+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-22T09:04:01.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.241+0000 7efc0ed22800 20 processing logshard = reshard.0000000003 2024-09-22T09:04:01.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.244+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-22T09:04:01.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.244+0000 7efc0ed22800 20 processing logshard = reshard.0000000004 2024-09-22T09:04:01.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.247+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-22T09:04:01.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.247+0000 7efc0ed22800 20 processing logshard = reshard.0000000005 2024-09-22T09:04:01.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.249+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-22T09:04:01.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.249+0000 7efc0ed22800 20 processing logshard = reshard.0000000006 2024-09-22T09:04:01.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 20 process_entry resharding a-bucket 2024-09-22T09:04:01.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:04:01.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.251+0000 7efc0ed22800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:01.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.252+0000 7efc0ed22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:04:01.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.257+0000 7efc0ed22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.257+0000 7efc0ed22800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.257+0000 7efc0ed22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.257+0000 7efc0ed22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.258+0000 7efaedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529689 cookie 94300319067360 notifier 6165 bl.length()=827 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.258+0000 7efaedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.258+0000 7efaedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.258+0000 7efaedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.259+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:04:01.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.259+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:04:01.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.259+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:04:01.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.259+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:04:01.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:04:01.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:04:01.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:04:01.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.262+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.263+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:04:01.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.263+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:04:01.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.265+0000 7efc0ed22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:01.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.265+0000 7efc0ed22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:04:01.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efc0ed22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efc0ed22800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efc0ed22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efc0ed22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:04:01.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efaedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94300319067360 notifier 6165 bl.length()=827 2024-09-22T09:04:01.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efaedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efaedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.266+0000 7efaedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.268+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:04:01.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.268+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:04:01.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.268+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:04:01.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.268+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:04:01.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.269+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:04:01.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.269+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.0 2024-09-22T09:04:01.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.269+0000 7efc0ed22800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:04:01.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.269+0000 7efc0ed22800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.1.1 2024-09-22T09:04:01.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.270+0000 7efc0ed22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:01.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.270+0000 7efc0ed22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:04:01.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efc0ed22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efc0ed22800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efc0ed22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efc0ed22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:04:01.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efaedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94300319067360 notifier 6165 bl.length()=795 2024-09-22T09:04:01.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efaedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:04:01.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efaedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:04:01.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.271+0000 7efaedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:04:01.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.273+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:04:01.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.273+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:04:01.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.273+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:04:01.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.273+0000 7efc0ed22800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:04:01.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.274+0000 7efc0ed22800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-22T09:04:01.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.275+0000 7efc0ed22800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-22T09:04:01.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.277+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-22T09:04:01.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.277+0000 7efc0ed22800 20 processing logshard = reshard.0000000007 2024-09-22T09:04:01.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.279+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-22T09:04:01.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.279+0000 7efc0ed22800 20 processing logshard = reshard.0000000008 2024-09-22T09:04:01.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.282+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-22T09:04:01.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.282+0000 7efc0ed22800 20 processing logshard = reshard.0000000009 2024-09-22T09:04:01.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.284+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-22T09:04:01.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.285+0000 7efc0ed22800 20 processing logshard = reshard.0000000010 2024-09-22T09:04:01.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.287+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-22T09:04:01.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.287+0000 7efc0ed22800 20 processing logshard = reshard.0000000011 2024-09-22T09:04:01.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.289+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-22T09:04:01.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.289+0000 7efc0ed22800 20 processing logshard = reshard.0000000012 2024-09-22T09:04:01.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.292+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-22T09:04:01.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.292+0000 7efc0ed22800 20 processing logshard = reshard.0000000013 2024-09-22T09:04:01.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.295+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-22T09:04:01.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.295+0000 7efc0ed22800 20 processing logshard = reshard.0000000014 2024-09-22T09:04:01.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.297+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-22T09:04:01.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.297+0000 7efc0ed22800 20 processing logshard = reshard.0000000015 2024-09-22T09:04:01.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.300+0000 7efc0ed22800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-22T09:04:01.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.301+0000 7efac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:01.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.303+0000 7efc0ed22800 20 remove_watcher() i=0 2024-09-22T09:04:01.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.303+0000 7efc0ed22800 2 removed watcher, disabling cache 2024-09-22T09:04:01.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.304+0000 7efc0ed22800 20 remove_watcher() i=1 2024-09-22T09:04:01.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.305+0000 7efc0ed22800 20 remove_watcher() i=2 2024-09-22T09:04:01.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.306+0000 7efc0ed22800 20 remove_watcher() i=3 2024-09-22T09:04:01.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.307+0000 7efc0ed22800 20 remove_watcher() i=4 2024-09-22T09:04:01.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.309+0000 7efc0ed22800 20 remove_watcher() i=5 2024-09-22T09:04:01.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.310+0000 7efc0ed22800 20 remove_watcher() i=6 2024-09-22T09:04:01.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.311+0000 7efc0ed22800 20 remove_watcher() i=7 2024-09-22T09:04:01.326 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:04:01.355 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:01.355 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:01.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.393+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 realm 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:01.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.395+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.396+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:01.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.396+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.397+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:01.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.397+0000 7f4ead773800 20 searching for the correct realm 2024-09-22T09:04:01.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.399+0000 7f4eaba5e640 0 -- 172.21.15.39:0/2137259615 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f4ea001a040 msgr2=0x7f4ea0068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:01.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.605+0000 7f4eaaa5c640 0 -- 172.21.15.39:0/2137259615 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f4ea4055410 msgr2=0x7f4ea4055870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:01.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.811+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 zone default found 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 4 Realm: () 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 zonegroup default 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.812+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.813+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.813+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.813+0000 7f4ead773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:01.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.813+0000 7f4ead773800 20 started sync module instance, tier type = 2024-09-22T09:04:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.813+0000 7f4ead773800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=0 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=1 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=2 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=3 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=4 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=5 2024-09-22T09:04:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.824+0000 7f4ead773800 20 add_watcher() i=6 2024-09-22T09:04:01.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.825+0000 7f4ead773800 20 add_watcher() i=7 2024-09-22T09:04:01.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.825+0000 7f4ead773800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:01.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.826+0000 7f4d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:01.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 5 note: GC not initialized 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4d60fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 20 Filter name: none 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4cda7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.827+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.828+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:04:01.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.828+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:04:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:04:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 rados->read ofs=0 len=0 2024-09-22T09:04:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.829+0000 7f4ead773800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:04:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.830+0000 7f4ead773800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.831+0000 7f4d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:01.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.833+0000 7f4ead773800 20 remove_watcher() i=0 2024-09-22T09:04:01.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.833+0000 7f4ead773800 2 removed watcher, disabling cache 2024-09-22T09:04:01.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.834+0000 7f4ead773800 20 remove_watcher() i=1 2024-09-22T09:04:01.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.835+0000 7f4ead773800 20 remove_watcher() i=2 2024-09-22T09:04:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.837+0000 7f4ead773800 20 remove_watcher() i=3 2024-09-22T09:04:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.838+0000 7f4ead773800 20 remove_watcher() i=4 2024-09-22T09:04:01.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.839+0000 7f4ead773800 20 remove_watcher() i=5 2024-09-22T09:04:01.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.840+0000 7f4ead773800 20 remove_watcher() i=6 2024-09-22T09:04:01.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:01.841+0000 7f4ead773800 20 remove_watcher() i=7 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-22T09:04:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:01.857 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:01.906 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:01.967 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:01.967 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.004 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.004 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.038 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.038 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.073 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.073 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.106 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.106 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.141 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.141 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.174 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.174 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.208 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.208 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.244 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.244 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.277 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.278 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.311 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.311 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.345 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.345 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.378 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.378 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.412 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.412 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.446 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.446 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.479 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.479 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.514 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.514 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.547 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.547 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.581 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.582 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.615 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:02.615 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:02.649 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T09:04:02.678 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:02.678 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:02.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.716+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:02.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:02.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 realm 2024-09-22T09:04:02.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.718+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.719+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:02.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.719+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:02.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.720+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:02.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.720+0000 7f57a612c800 20 searching for the correct realm 2024-09-22T09:04:02.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.720+0000 7f57a1e4f640 0 -- 172.21.15.39:0/3690682178 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f579c075070 msgr2=0x7f579c002440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:02.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:02.925+0000 7f57a1e4f640 0 -- 172.21.15.39:0/3690682178 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x5574cd146430 msgr2=0x7f579c095040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:03.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.133+0000 7f57a612c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:03.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.134+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 zone default found 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 4 Realm: () 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 zonegroup default 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.135+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.136+0000 7f57a612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.136+0000 7f57a612c800 20 started sync module instance, tier type = 2024-09-22T09:04:03.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.136+0000 7f57a612c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:03.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=0 2024-09-22T09:04:03.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=1 2024-09-22T09:04:03.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=2 2024-09-22T09:04:03.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=3 2024-09-22T09:04:03.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=4 2024-09-22T09:04:03.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=5 2024-09-22T09:04:03.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.146+0000 7f57a612c800 20 add_watcher() i=6 2024-09-22T09:04:03.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.147+0000 7f57a612c800 20 add_watcher() i=7 2024-09-22T09:04:03.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.147+0000 7f57a612c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:03.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.148+0000 7f56537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:03.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 5 note: GC not initialized 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f56527fc640 20 reqs_thread_entry: start 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 20 Filter name: none 2024-09-22T09:04:03.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f55c3fff640 20 reqs_thread_entry: start 2024-09-22T09:04:03.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.149+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.150+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:03.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.150+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:03.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:03.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:03.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:03.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.151+0000 7f57a612c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:03.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.153+0000 7f56537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:03.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.155+0000 7f57a612c800 20 remove_watcher() i=0 2024-09-22T09:04:03.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.155+0000 7f57a612c800 2 removed watcher, disabling cache 2024-09-22T09:04:03.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.156+0000 7f57a612c800 20 remove_watcher() i=1 2024-09-22T09:04:03.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.157+0000 7f57a612c800 20 remove_watcher() i=2 2024-09-22T09:04:03.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.158+0000 7f57a612c800 20 remove_watcher() i=3 2024-09-22T09:04:03.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.159+0000 7f57a612c800 20 remove_watcher() i=4 2024-09-22T09:04:03.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.160+0000 7f57a612c800 20 remove_watcher() i=5 2024-09-22T09:04:03.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.161+0000 7f57a612c800 20 remove_watcher() i=6 2024-09-22T09:04:03.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.162+0000 7f57a612c800 20 remove_watcher() i=7 2024-09-22T09:04:03.176 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:03.176 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:03.176 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-init-index id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:03.176 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:03.178 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-22T09:04:03.213 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:03.213 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:03.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.250+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 realm 2024-09-22T09:04:03.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:03.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.252+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.253+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:03.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.253+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.254+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.254+0000 7f566e732800 20 searching for the correct realm 2024-09-22T09:04:03.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.257+0000 7f566abbd640 0 -- 172.21.15.39:0/3323477238 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f56600a1040 msgr2=0x7f56600a1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:03.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.261+0000 7f5669bbb640 0 -- 172.21.15.39:0/3323477238 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5664020910 msgr2=0x7f5664022420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:03.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:03.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.467+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:03.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 zone default found 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 4 Realm: () 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 zonegroup default 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.468+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.469+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.469+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.469+0000 7f566e732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.469+0000 7f566e732800 20 started sync module instance, tier type = 2024-09-22T09:04:03.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.469+0000 7f566e732800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=0 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=1 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=2 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=3 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=4 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=5 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.479+0000 7f566e732800 20 add_watcher() i=6 2024-09-22T09:04:03.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.480+0000 7f566e732800 20 add_watcher() i=7 2024-09-22T09:04:03.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.480+0000 7f566e732800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:03.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.481+0000 7f5520fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:03.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f566e732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:03.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f566e732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:03.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f566e732800 5 note: GC not initialized 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f549b7fe640 20 reqs_thread_entry: start 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f566e732800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.482+0000 7f566e732800 20 Filter name: none 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f54997fa640 20 reqs_thread_entry: start 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T09:04:03.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 : miss 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.483+0000 7f566e732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.484+0000 7f566e732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 2024-09-22T09:04:03.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.485+0000 7f566e732800 -1 Injecting error=-5 at location=init_index 2024-09-22T09:04:03.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.485+0000 7f566e732800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-22T09:04:03.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.487+0000 7f5520fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:03.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.490+0000 7f566e732800 20 remove_watcher() i=0 2024-09-22T09:04:03.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.490+0000 7f566e732800 2 removed watcher, disabling cache 2024-09-22T09:04:03.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.491+0000 7f566e732800 20 remove_watcher() i=1 2024-09-22T09:04:03.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.492+0000 7f566e732800 20 remove_watcher() i=2 2024-09-22T09:04:03.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.493+0000 7f566e732800 20 remove_watcher() i=3 2024-09-22T09:04:03.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.494+0000 7f566e732800 20 remove_watcher() i=4 2024-09-22T09:04:03.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.495+0000 7f566e732800 20 remove_watcher() i=5 2024-09-22T09:04:03.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.496+0000 7f566e732800 20 remove_watcher() i=6 2024-09-22T09:04:03.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.497+0000 7f566e732800 20 remove_watcher() i=7 2024-09-22T09:04:03.512 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T09:04:03.541 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:03.541 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:03.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.578+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.580+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.580+0000 7f6129732800 20 realm 2024-09-22T09:04:03.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.580+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.581+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.581+0000 7f6129732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:03.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.581+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.581+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:03.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.581+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.582+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:03.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.582+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:03.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.583+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:03.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.583+0000 7f6129732800 20 searching for the correct realm 2024-09-22T09:04:03.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.585+0000 7f6125bbd640 0 -- 172.21.15.39:0/3632741815 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f611c0c7040 msgr2=0x7f611c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:03.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.790+0000 7f6124bbb640 0 -- 172.21.15.39:0/3632741815 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f6120076200 msgr2=0x7f6120076930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:04.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:04.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.997+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:04.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 zone default found 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 4 Realm: () 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 zonegroup default 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.998+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.999+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.999+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.999+0000 7f6129732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.999+0000 7f6129732800 20 started sync module instance, tier type = 2024-09-22T09:04:04.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:03.999+0000 7f6129732800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=0 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=1 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=2 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=3 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=4 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=5 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.009+0000 7f6129732800 20 add_watcher() i=6 2024-09-22T09:04:04.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.010+0000 7f6129732800 20 add_watcher() i=7 2024-09-22T09:04:04.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.010+0000 7f6129732800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:04.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.012+0000 7f5fdbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:04.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.012+0000 7f6129732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:04.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.012+0000 7f6129732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f6129732800 5 note: GC not initialized 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f5fdafe5640 20 reqs_thread_entry: start 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f6129732800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f6129732800 20 Filter name: none 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f5fd8fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:04.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.013+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.014+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.015+0000 7f6129732800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.015+0000 7f6129732800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:04.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.015+0000 7f6129732800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:04.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.016+0000 7f5fdbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:04.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.018+0000 7f6129732800 20 remove_watcher() i=0 2024-09-22T09:04:04.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.018+0000 7f6129732800 2 removed watcher, disabling cache 2024-09-22T09:04:04.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.020+0000 7f6129732800 20 remove_watcher() i=1 2024-09-22T09:04:04.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.021+0000 7f6129732800 20 remove_watcher() i=2 2024-09-22T09:04:04.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.022+0000 7f6129732800 20 remove_watcher() i=3 2024-09-22T09:04:04.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.023+0000 7f6129732800 20 remove_watcher() i=4 2024-09-22T09:04:04.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.024+0000 7f6129732800 20 remove_watcher() i=5 2024-09-22T09:04:04.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.025+0000 7f6129732800 20 remove_watcher() i=6 2024-09-22T09:04:04.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.026+0000 7f6129732800 20 remove_watcher() i=7 2024-09-22T09:04:04.040 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:04.040 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:04.040 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-init-index id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:04.040 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:04.042 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:04.043 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:04.072 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:04.073 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:04.131 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:04:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:04.164 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:04.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.202+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 realm 2024-09-22T09:04:04.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.204+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.205+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:04.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.205+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.206+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:04.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.206+0000 7fab7ad1f800 20 searching for the correct realm 2024-09-22T09:04:04.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.206+0000 7fab76aa2640 0 -- 172.21.15.39:0/598312236 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fab70037070 msgr2=0x7fab70048990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:04.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.413+0000 7fab76aa2640 0 -- 172.21.15.39:0/598312236 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7fab60003ab0 msgr2=0x7fab70015430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:04.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:04.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.623+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:04.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 zone default found 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 4 Realm: () 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 zonegroup default 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.624+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.625+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.625+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.625+0000 7fab7ad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.625+0000 7fab7ad1f800 20 started sync module instance, tier type = 2024-09-22T09:04:04.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.625+0000 7fab7ad1f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=0 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=1 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=2 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=3 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=4 2024-09-22T09:04:04.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=5 2024-09-22T09:04:04.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.636+0000 7fab7ad1f800 20 add_watcher() i=6 2024-09-22T09:04:04.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.637+0000 7fab7ad1f800 20 add_watcher() i=7 2024-09-22T09:04:04.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.637+0000 7fab7ad1f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:04.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.638+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:04.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.638+0000 7fab7ad1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:04.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.638+0000 7fab7ad1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:04.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7fab7ad1f800 5 note: GC not initialized 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7faa2cfe1640 20 reqs_thread_entry: start 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7fab7ad1f800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7fab7ad1f800 20 Filter name: none 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7faa25ffb640 20 reqs_thread_entry: start 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7fab7ad1f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.639+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 : miss 2024-09-22T09:04:04.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.640+0000 7fab7ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 2024-09-22T09:04:04.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7fab7ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7fab7ad1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7fab7ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7fab7ad1f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19, ofs0, ns] 2024-09-22T09:04:04.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7faa5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529683 cookie 94587725647328 notifier 6258 bl.length()=911 2024-09-22T09:04:04.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7faa5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7faa5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.644+0000 7faa5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.646+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_sources= new_sources= 2024-09-22T09:04:04.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.646+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential sources added=[] removed=[] 2024-09-22T09:04:04.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.646+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_dests= new_dests= 2024-09-22T09:04:04.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.646+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential dests added=[] removed=[] 2024-09-22T09:04:04.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.649+0000 7fab7ad1f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.1.0 2024-09-22T09:04:04.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.649+0000 7fab7ad1f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.1.0 2024-09-22T09:04:04.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.649+0000 7fab7ad1f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.1.1 2024-09-22T09:04:04.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.649+0000 7fab7ad1f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.1.1 2024-09-22T09:04:04.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.649+0000 7fab7ad1f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.0 2024-09-22T09:04:04.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.652+0000 7fab7ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:04.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.652+0000 7fab7ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 2024-09-22T09:04:04.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7fab7ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7fab7ad1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7fab7ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7fab7ad1f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19, ofs0, ns] 2024-09-22T09:04:04.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7faa5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529684 cookie 94587725647328 notifier 6258 bl.length()=911 2024-09-22T09:04:04.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7faa5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7faa5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.653+0000 7faa5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.655+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_sources= new_sources= 2024-09-22T09:04:04.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.655+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential sources added=[] removed=[] 2024-09-22T09:04:04.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.655+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_dests= new_dests= 2024-09-22T09:04:04.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.655+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential dests added=[] removed=[] 2024-09-22T09:04:04.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.656+0000 7fab7ad1f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.19.0 2024-09-22T09:04:04.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.656+0000 7fab7ad1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:04.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.656+0000 7fab7ad1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 2024-09-22T09:04:04.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7fab7ad1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7fab7ad1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7fab7ad1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7fab7ad1f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19, ofs0, ns] 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7faa59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529685 cookie 94587725647328 notifier 6258 bl.length()=879 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7faa59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 info.flags=0x17 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7faa59ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 to cache LRU end 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.658+0000 7faa59ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.659+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_sources= new_sources= 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.659+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential sources added=[] removed=[] 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.659+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): orig_dests= new_dests= 2024-09-22T09:04:04.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.659+0000 7fab7ad1f800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.19]): potential dests added=[] removed=[] 2024-09-22T09:04:04.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.661+0000 7fab7ad1f800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-22T09:04:04.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.663+0000 7faa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:04.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.665+0000 7fab7ad1f800 20 remove_watcher() i=0 2024-09-22T09:04:04.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.665+0000 7fab7ad1f800 2 removed watcher, disabling cache 2024-09-22T09:04:04.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.667+0000 7fab7ad1f800 20 remove_watcher() i=1 2024-09-22T09:04:04.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.668+0000 7fab7ad1f800 20 remove_watcher() i=2 2024-09-22T09:04:04.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.669+0000 7fab7ad1f800 20 remove_watcher() i=3 2024-09-22T09:04:04.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.670+0000 7fab7ad1f800 20 remove_watcher() i=4 2024-09-22T09:04:04.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.671+0000 7fab7ad1f800 20 remove_watcher() i=5 2024-09-22T09:04:04.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.672+0000 7fab7ad1f800 20 remove_watcher() i=6 2024-09-22T09:04:04.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.673+0000 7fab7ad1f800 20 remove_watcher() i=7 2024-09-22T09:04:04.687 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T09:04:04.717 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:04.717 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:04.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.756+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 20 realm 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.758+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.759+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:04.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.759+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.759+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:04.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.759+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:04.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.760+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:04.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.760+0000 7fb22c123800 20 searching for the correct realm 2024-09-22T09:04:04.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.762+0000 7fb228645640 0 -- 172.21.15.39:0/252503203 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb21c064410 msgr2=0x7fb21c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:04.970 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:04.969+0000 7fb227643640 0 -- 172.21.15.39:0/252503203 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb220097030 msgr2=0x7fb22006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:05.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:05.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.176+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:05.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:05.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 zone default found 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 4 Realm: () 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 zonegroup default 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.177+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.178+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.178+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.178+0000 7fb22c123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.178+0000 7fb22c123800 20 started sync module instance, tier type = 2024-09-22T09:04:05.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.178+0000 7fb22c123800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=0 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=1 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=2 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=3 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=4 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=5 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.188+0000 7fb22c123800 20 add_watcher() i=6 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.189+0000 7fb22c123800 20 add_watcher() i=7 2024-09-22T09:04:05.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.189+0000 7fb22c123800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:05.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.191+0000 7fb0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.191+0000 7fb22c123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.191+0000 7fb22c123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb22c123800 5 note: GC not initialized 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb0dcfe1640 20 reqs_thread_entry: start 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb22c123800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:05.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb22c123800 20 Filter name: none 2024-09-22T09:04:05.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb0567fc640 20 reqs_thread_entry: start 2024-09-22T09:04:05.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.192+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.193+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:05.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.193+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.193+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.193+0000 7fb22c123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.193+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.194+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.194+0000 7fb22c123800 20 rados->read ofs=0 len=0 2024-09-22T09:04:05.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.194+0000 7fb22c123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:05.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.194+0000 7fb22c123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:05.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.195+0000 7fb0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:05.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.198+0000 7fb22c123800 20 remove_watcher() i=0 2024-09-22T09:04:05.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.198+0000 7fb22c123800 2 removed watcher, disabling cache 2024-09-22T09:04:05.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.199+0000 7fb22c123800 20 remove_watcher() i=1 2024-09-22T09:04:05.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.200+0000 7fb22c123800 20 remove_watcher() i=2 2024-09-22T09:04:05.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.201+0000 7fb22c123800 20 remove_watcher() i=3 2024-09-22T09:04:05.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.202+0000 7fb22c123800 20 remove_watcher() i=4 2024-09-22T09:04:05.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.203+0000 7fb22c123800 20 remove_watcher() i=5 2024-09-22T09:04:05.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.204+0000 7fb22c123800 20 remove_watcher() i=6 2024-09-22T09:04:05.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:05.206+0000 7fb22c123800 20 remove_watcher() i=7 2024-09-22T09:04:05.218 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:05.218 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:05.218 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-init-index id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:04:05.219 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:05.220 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.220 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.239 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.239 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.441 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.441 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.512 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-22T09:04:05.512 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:05.513 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.513 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.554 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.554 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.610 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.611 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.642 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.642 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.676 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.677 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.711 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.711 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.746 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.746 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.778 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.779 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.812 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.812 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.845 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.845 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.880 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.881 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.915 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.915 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.948 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.949 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:05.982 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:05.983 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.017 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.018 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.052 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.053 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.087 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.087 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.121 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.121 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.156 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.156 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.190 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.190 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.224 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.224 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.259 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:06.259 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:06.293 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T09:04:06.323 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:06.323 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:06.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.361+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 20 realm 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:06.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.363+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.364+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.364+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.365+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:06.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.365+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.567+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:06.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.567+0000 7f868c9af800 20 searching for the correct realm 2024-09-22T09:04:06.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.569+0000 7f8683fff640 0 -- 172.21.15.39:0/3394226937 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f867c017070 msgr2=0x7f867c0601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:06.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.775+0000 7f868a499640 0 -- 172.21.15.39:0/3394226937 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f868400fbe0 msgr2=0x7f8684044950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:06.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.781+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:06.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:06.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 zone default found 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 4 Realm: () 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 zonegroup default 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.782+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 started sync module instance, tier type = 2024-09-22T09:04:06.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.783+0000 7f868c9af800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:06.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=0 2024-09-22T09:04:06.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=1 2024-09-22T09:04:06.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=2 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=3 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=4 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=5 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.794+0000 7f868c9af800 20 add_watcher() i=6 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.795+0000 7f868c9af800 20 add_watcher() i=7 2024-09-22T09:04:06.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.795+0000 7f868c9af800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:06.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f8540fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f868c9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f868c9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f868c9af800 5 note: GC not initialized 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f84bb7fe640 20 reqs_thread_entry: start 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f868c9af800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.797+0000 7f868c9af800 20 Filter name: none 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.798+0000 7f84b97fa640 20 reqs_thread_entry: start 2024-09-22T09:04:06.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.798+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.798+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:06.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.798+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.799+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:06.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.799+0000 7f868c9af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:06.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.799+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.799+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:06.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.800+0000 7f868c9af800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.800+0000 7f868c9af800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:06.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.800+0000 7f868c9af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:06.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.802+0000 7f8540fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:06.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.804+0000 7f868c9af800 20 remove_watcher() i=0 2024-09-22T09:04:06.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.804+0000 7f868c9af800 2 removed watcher, disabling cache 2024-09-22T09:04:06.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.805+0000 7f868c9af800 20 remove_watcher() i=1 2024-09-22T09:04:06.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.806+0000 7f868c9af800 20 remove_watcher() i=2 2024-09-22T09:04:06.808 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.807+0000 7f868c9af800 20 remove_watcher() i=3 2024-09-22T09:04:06.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.808+0000 7f868c9af800 20 remove_watcher() i=4 2024-09-22T09:04:06.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.809+0000 7f868c9af800 20 remove_watcher() i=5 2024-09-22T09:04:06.811 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.810+0000 7f868c9af800 20 remove_watcher() i=6 2024-09-22T09:04:06.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.811+0000 7f868c9af800 20 remove_watcher() i=7 2024-09-22T09:04:06.823 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:06.824 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:06.824 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-init-index id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:06.824 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:06.826 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-22T09:04:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:06.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.901+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 realm 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.903+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.904+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:06.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.904+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:06.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.905+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:06.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.905+0000 7f732d373800 20 searching for the correct realm 2024-09-22T09:04:06.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:06.907+0000 7f732b65e640 0 -- 172.21.15.39:0/3373998809 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f73200b4040 msgr2=0x7f7320072950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:07.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.113+0000 7f732a65c640 0 -- 172.21.15.39:0/3373998809 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f732404e8d0 msgr2=0x7f7324072780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.319+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.320+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.320+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.320+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.320+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 zone default found 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 4 Realm: () 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 zonegroup default 2024-09-22T09:04:07.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.321+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.322+0000 7f732d373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.322+0000 7f732d373800 20 started sync module instance, tier type = 2024-09-22T09:04:07.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.322+0000 7f732d373800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=0 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=1 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=2 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=3 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=4 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=5 2024-09-22T09:04:07.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.333+0000 7f732d373800 20 add_watcher() i=6 2024-09-22T09:04:07.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.334+0000 7f732d373800 20 add_watcher() i=7 2024-09-22T09:04:07.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.334+0000 7f732d373800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:07.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f71e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f732d373800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f732d373800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f732d373800 5 note: GC not initialized 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f71e0fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f732d373800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f732d373800 20 Filter name: none 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.336+0000 7f71d9ffb640 20 reqs_thread_entry: start 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-22T09:04:07.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:07.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-22T09:04:07.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-22T09:04:07.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 : miss 2024-09-22T09:04:07.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.337+0000 7f732d373800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 info.flags=0x17 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 to cache LRU end 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.338+0000 7f732d373800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.339+0000 7f732d373800 -1 Injecting error=-95 at location=init_index 2024-09-22T09:04:07.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.339+0000 7f732d373800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-22T09:04:07.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f732d373800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 info.flags=0x17 2024-09-22T09:04:07.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f732d373800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 to cache LRU end 2024-09-22T09:04:07.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f732d373800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:07.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f732d373800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20, ofs0, ns] 2024-09-22T09:04:07.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f720e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529690 cookie 94898625661296 notifier 5954 bl.length()=911 2024-09-22T09:04:07.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f720e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 info.flags=0x17 2024-09-22T09:04:07.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f720e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 to cache LRU end 2024-09-22T09:04:07.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.342+0000 7f720e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:07.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.344+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): orig_sources= new_sources= 2024-09-22T09:04:07.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.344+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): potential sources added=[] removed=[] 2024-09-22T09:04:07.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.344+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): orig_dests= new_dests= 2024-09-22T09:04:07.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.344+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): potential dests added=[] removed=[] 2024-09-22T09:04:07.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.345+0000 7f732d373800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.20.1.0 2024-09-22T09:04:07.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.345+0000 7f732d373800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.20.1.0 2024-09-22T09:04:07.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.345+0000 7f732d373800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.20.1.1 2024-09-22T09:04:07.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.345+0000 7f732d373800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.20.1.1 2024-09-22T09:04:07.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.345+0000 7f732d373800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.20.0 2024-09-22T09:04:07.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.348+0000 7f732d373800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:07.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.348+0000 7f732d373800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 2024-09-22T09:04:07.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f732d373800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 info.flags=0x17 2024-09-22T09:04:07.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f732d373800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 to cache LRU end 2024-09-22T09:04:07.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f732d373800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:07.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f732d373800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20, ofs0, ns] 2024-09-22T09:04:07.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f720dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529691 cookie 94898625661296 notifier 5954 bl.length()=879 2024-09-22T09:04:07.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f720dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 info.flags=0x17 2024-09-22T09:04:07.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f720dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 to cache LRU end 2024-09-22T09:04:07.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.350+0000 7f720dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:07.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.351+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): orig_sources= new_sources= 2024-09-22T09:04:07.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.351+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): potential sources added=[] removed=[] 2024-09-22T09:04:07.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.351+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): orig_dests= new_dests= 2024-09-22T09:04:07.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.351+0000 7f732d373800 20 handle_bi_update(): bucket=:error-at-init-index[530e834e-7701-4a35-ad82-1b0744ba8777.4617.20]): potential dests added=[] removed=[] 2024-09-22T09:04:07.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.352+0000 7f732d373800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-22T09:04:07.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.354+0000 7f71e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:07.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.357+0000 7f732d373800 20 remove_watcher() i=0 2024-09-22T09:04:07.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.357+0000 7f732d373800 2 removed watcher, disabling cache 2024-09-22T09:04:07.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.358+0000 7f732d373800 20 remove_watcher() i=1 2024-09-22T09:04:07.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.359+0000 7f732d373800 20 remove_watcher() i=2 2024-09-22T09:04:07.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.361+0000 7f732d373800 20 remove_watcher() i=3 2024-09-22T09:04:07.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.362+0000 7f732d373800 20 remove_watcher() i=4 2024-09-22T09:04:07.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.364+0000 7f732d373800 20 remove_watcher() i=5 2024-09-22T09:04:07.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.365+0000 7f732d373800 20 remove_watcher() i=6 2024-09-22T09:04:07.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.366+0000 7f732d373800 20 remove_watcher() i=7 2024-09-22T09:04:07.380 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-22T09:04:07.410 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:07.410 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:07.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.451+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.452+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 realm 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.453+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.454+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:07.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.454+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.455+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:07.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.455+0000 7efc17810800 20 searching for the correct realm 2024-09-22T09:04:07.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.457+0000 7efc137bd640 0 -- 172.21.15.39:0/3883972815 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7efbfc04e040 msgr2=0x7efbfc02d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:07.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.663+0000 7efc127bb640 0 -- 172.21.15.39:0/3883972815 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7efc0c099b30 msgr2=0x7efc0c03d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.871+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.872+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.872+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.872+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.872+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 zone default found 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 4 Realm: () 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 zonegroup default 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:07.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 started sync module instance, tier type = 2024-09-22T09:04:07.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.873+0000 7efc17810800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:07.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=0 2024-09-22T09:04:07.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=1 2024-09-22T09:04:07.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=2 2024-09-22T09:04:07.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=3 2024-09-22T09:04:07.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=4 2024-09-22T09:04:07.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=5 2024-09-22T09:04:07.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.886+0000 7efc17810800 20 add_watcher() i=6 2024-09-22T09:04:07.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.887+0000 7efc17810800 20 add_watcher() i=7 2024-09-22T09:04:07.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.887+0000 7efc17810800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:07.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.889+0000 7efac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:07.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.889+0000 7efc17810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:07.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.889+0000 7efc17810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:07.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.889+0000 7efc17810800 5 note: GC not initialized 2024-09-22T09:04:07.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.890+0000 7efa43fff640 20 reqs_thread_entry: start 2024-09-22T09:04:07.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.890+0000 7efc17810800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:07.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.890+0000 7efc17810800 20 Filter name: none 2024-09-22T09:04:07.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.890+0000 7efa41ffb640 20 reqs_thread_entry: start 2024-09-22T09:04:07.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.890+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.891+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.891+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.891+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.891+0000 7efc17810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.891+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.892+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.892+0000 7efc17810800 20 rados->read ofs=0 len=0 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.892+0000 7efc17810800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:04:07.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.892+0000 7efc17810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:07.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.893+0000 7efac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:07.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.896+0000 7efc17810800 20 remove_watcher() i=0 2024-09-22T09:04:07.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.896+0000 7efc17810800 2 removed watcher, disabling cache 2024-09-22T09:04:07.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.897+0000 7efc17810800 20 remove_watcher() i=1 2024-09-22T09:04:07.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.899+0000 7efc17810800 20 remove_watcher() i=2 2024-09-22T09:04:07.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.900+0000 7efc17810800 20 remove_watcher() i=3 2024-09-22T09:04:07.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.901+0000 7efc17810800 20 remove_watcher() i=4 2024-09-22T09:04:07.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.903+0000 7efc17810800 20 remove_watcher() i=5 2024-09-22T09:04:07.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.905+0000 7efc17810800 20 remove_watcher() i=6 2024-09-22T09:04:07.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:07.906+0000 7efc17810800 20 remove_watcher() i=7 2024-09-22T09:04:07.918 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:07.918 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:07.918 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-init-index id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-22T09:04:07.919 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:07.920 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:07.921 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:07.938 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:07.938 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.156 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.156 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.221 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at init_index 2024-09-22T09:04:08.221 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:08.222 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.222 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.263 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.264 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.323 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.323 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.360 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.360 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.394 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.394 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.427 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.462 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.463 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.497 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.497 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.530 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.531 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.565 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.565 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.599 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.599 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.632 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.633 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.665 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.665 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.703 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.703 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.737 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.737 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.772 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.773 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.806 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.806 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.840 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.840 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.872 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.873 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.906 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.906 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.940 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.941 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:08.974 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:08.974 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:09.008 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T09:04:09.037 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:09.038 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:09.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.076+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 realm 2024-09-22T09:04:09.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.078+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.079+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:09.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.079+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.080+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:09.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.080+0000 7f55c9820800 20 searching for the correct realm 2024-09-22T09:04:09.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.082+0000 7f55c7b0b640 0 -- 172.21.15.39:0/1694659457 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f55bc043430 msgr2=0x7f55bc0438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:09.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.289+0000 7f55c6b09640 0 -- 172.21.15.39:0/1694659457 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f55c00a81e0 msgr2=0x7f55c006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:09.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:09.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:09.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:09.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:09.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:09.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:09.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.497+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 zone default found 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 4 Realm: () 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 zonegroup default 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.498+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.499+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.499+0000 7f55c9820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.499+0000 7f55c9820800 20 started sync module instance, tier type = 2024-09-22T09:04:09.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.499+0000 7f55c9820800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=0 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=1 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=2 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=3 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=4 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=5 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.512+0000 7f55c9820800 20 add_watcher() i=6 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.513+0000 7f55c9820800 20 add_watcher() i=7 2024-09-22T09:04:09.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.513+0000 7f55c9820800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:09.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.515+0000 7f547dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:09.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:09.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:09.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 5 note: GC not initialized 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f547cfe1640 20 reqs_thread_entry: start 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 20 Filter name: none 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f53f67fc640 20 reqs_thread_entry: start 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.516+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.517+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:09.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.517+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:09.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:09.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:09.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:09.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.518+0000 7f55c9820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:09.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.520+0000 7f547dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:09.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.522+0000 7f55c9820800 20 remove_watcher() i=0 2024-09-22T09:04:09.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.522+0000 7f55c9820800 2 removed watcher, disabling cache 2024-09-22T09:04:09.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.523+0000 7f55c9820800 20 remove_watcher() i=1 2024-09-22T09:04:09.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.524+0000 7f55c9820800 20 remove_watcher() i=2 2024-09-22T09:04:09.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.526+0000 7f55c9820800 20 remove_watcher() i=3 2024-09-22T09:04:09.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.527+0000 7f55c9820800 20 remove_watcher() i=4 2024-09-22T09:04:09.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.528+0000 7f55c9820800 20 remove_watcher() i=5 2024-09-22T09:04:09.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.529+0000 7f55c9820800 20 remove_watcher() i=6 2024-09-22T09:04:09.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.530+0000 7f55c9820800 20 remove_watcher() i=7 2024-09-22T09:04:09.545 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:09.546 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:09.546 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-init-indext id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:09.546 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:09.546 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-22T09:04:09.580 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:09.580 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:09.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.619+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 realm 2024-09-22T09:04:09.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:09.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:09.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.623+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:09.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.623+0000 7f46bfd23800 20 searching for the correct realm 2024-09-22T09:04:09.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.625+0000 7f46bc1af640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f46a40b7040 msgr2=0x7f46a40b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:09.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:09.832+0000 7f46bb1ad640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f46b4082ba0 msgr2=0x7f46b4066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:10.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:10.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:10.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:10.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:10.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:10.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zone default found 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Realm: () 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:10.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zonegroup default 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started sync module instance, tier type = 2024-09-22T09:04:10.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=0 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=1 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=2 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=3 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=4 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=5 2024-09-22T09:04:10.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=6 2024-09-22T09:04:10.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.054+0000 7f46bfd23800 20 add_watcher() i=7 2024-09-22T09:04:10.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.054+0000 7f46bfd23800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:10.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.055+0000 7f4571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f46bfd23800 5 note: GC not initialized 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f4570fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f46bfd23800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f46bfd23800 20 Filter name: none 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.056+0000 7f44ea7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T09:04:10.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : miss 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:10.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:10.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:10.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:10.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.058+0000 7f46bfd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:10.060 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f46bfd23800 time 2024-09-22T09:04:10.060359+0000 2024-09-22T09:04:10.060 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:10.061 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f46c138c748] 2024-09-22T09:04:10.061 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.061 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f46bfd23800 thread_name:radosgw-admin 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.060+0000 7f46bfd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f46bfd23800 time 2024-09-22T09:04:10.060359+0000 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.062 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f46c138c748] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:10.063 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.080 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.080 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46c003e6f0] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f46c008b99c] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f46c138c7a2] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.061+0000 7f46bfd23800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:10.081 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f46bfd23800 thread_name:radosgw-admin 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46c003e6f0] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f46c008b99c] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f46c138c7a2] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.082 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf08a5160 auth_method 0 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.083 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 5993 payload 274 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: dump: 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.084 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:04:09.601+0000 7f46bfd23800 5 monclient: authenticate success, global_id 5993 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:04:09.601+0000 7f46bfd23800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:04:09.601+0000 7f46bfd23800 4 set_mon_vals no callback set 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: dump: 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.085 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: shutdown 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 asok(0x55cbf07400f0) unregister_commands rotate-key 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.086 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.087 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:04:09.602+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: starting msgr at 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: starting objecter 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests hook 0x55cbf0965e40 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: setting wanted keys 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: calling monclient init 2024-09-22T09:04:10.088 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.089 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:04:09.602+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:04:09.603+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:04:09.603+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key hook 0x55cbf0962288 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf07d8960 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf080f4a0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf08a5160 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.863251s 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf07d8960 auth_method 0 2024-09-22T09:04:10.090 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf080f4a0 auth_method 0 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6363 payload 824 2024-09-22T09:04:10.091 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 1 monclient: found mon.noname-a 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: dump: 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.092 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: dump: 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.093 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:04:09.603+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6363 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:04:09.603+0000 7f45a9e0b640 4 set_mon_vals no callback set 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:04:09.604+0000 7f46bfd23800 1 librados: init done 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.094 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:04:09.605+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f45a40775a0 auth_method 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:04:09.606+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf09a3c70 auth_method 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:04:09.607+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x55cbf09ad3d0 auth_method 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:04:09.608+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x55cbf09b1730 auth_method 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:04:09.609+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf09b0cb0 auth_method 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:04:09.609+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:04:09.609+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:04:09.609+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.095 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.096 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests cmddesc objecter_requests hook 0x55cbf09bcc50 EEXIST 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.097 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x55cbf09b8980 EEXIST 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:04:10.098 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf09e0f70 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf09e1350 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf09dfc80 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.870935s 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf09e1350 auth_method 0 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf09dfc80 auth_method 0 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.099 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf09e0f70 auth_method 0 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.100 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_done global_id 6366 payload 824 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:04:09.611+0000 7f46bc1af640 1 monclient: found mon.noname-a 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: dump: 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.101 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: dump: 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.102 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:04:09.611+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6366 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:04:09.611+0000 7f46bc9b0640 4 set_mon_vals no callback set 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:04:09.613+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f4594077480 auth_method 0 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: get_monmap_and_config 2024-09-22T09:04:10.103 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:04:09.614+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.104 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:04:09.614+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.105 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.106 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:04:09.614+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:04:09.615+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:04:09.615+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x7fffd8c7f4f8 EEXIST 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf0a05090 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf0a2fb00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf0a30eb0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.875150s 2024-09-22T09:04:10.107 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf0a05090 auth_method 0 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf0a2fb00 auth_method 0 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.108 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf0a30eb0 auth_method 0 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6002 payload 274 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: dump: 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.109 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: dump: 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.110 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:04:09.615+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6002 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:04:09.615+0000 7f46bfd23800 4 set_mon_vals no callback set 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: shutdown 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.111 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.112 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:04:09.616+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: starting msgr at 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: starting objecter 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests cmddesc objecter_requests hook 0x55cbf0a326e0 EEXIST 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: setting wanted keys 2024-09-22T09:04:10.113 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: calling monclient init 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.114 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:04:09.617+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:04:09.617+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:04:09.617+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x55cbf09f5978 EEXIST 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf0a05090 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf0a30eb0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf0a34b00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.115 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.877444s 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf0a05090 auth_method 0 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf0a34b00 auth_method 0 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.116 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6005 payload 824 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: dump: 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.117 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: dump: 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.118 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:04:09.618+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6005 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:04:09.618+0000 7f459affd640 4 set_mon_vals no callback set 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:04:09.618+0000 7f46bfd23800 1 librados: init done 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:04:09.618+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cr dump hook 0x55cbf0a2f5f8 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:04:09.619+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:04:09.620+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f4584077570 auth_method 0 2024-09-22T09:04:10.119 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:04:09.620+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x55cbf0a4f2f0 auth_method 0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 realm 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:04:09.621+0000 7f46bfd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:04:09.622+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x55cbf0a535b0 auth_method 0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:04:09.622+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf0a56e10 auth_method 0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:04:09.623+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:04:09.623+0000 7f46bfd23800 20 searching for the correct realm 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:04:09.623+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f46b402b070 auth_method 0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:04:09.624+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46ac02b040 auth_method 0 2024-09-22T09:04:10.120 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:04:09.625+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f46a40b7040 auth_method 0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:04:09.625+0000 7f46bc1af640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f46a40b7040 msgr2=0x7f46a40b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:04:09.827+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f46a40b7040 auth_method 0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:04:09.829+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f46b4076040 auth_method 0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:04:09.832+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46b4082ba0 auth_method 0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:04:09.832+0000 7f46bb1ad640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f46b4082ba0 msgr2=0x7f46b4066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:04:10.033+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46b4082ba0 auth_method 0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.121 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zone default found 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Realm: () 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:04:10.041+0000 7f46bfd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zonegroup default 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.122 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started sync module instance, tier type = 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=0 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=1 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=2 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=3 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=4 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=5 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=6 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:04:10.054+0000 7f46bfd23800 20 add_watcher() i=7 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:04:10.054+0000 7f46bfd23800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.123 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:04:10.055+0000 7f4571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:04:10.056+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache list hook 0x55cbf0a35400 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache inspect hook 0x55cbf0a35400 2024-09-22T09:04:10.124 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache erase hook 0x55cbf0a35400 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache zap hook 0x55cbf0a35400 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 note: GC not initialized 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:04:10.056+0000 7f4570fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace show hook 0x7f46ac0014f0 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace history hook 0x7f46ac0014f0 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace active hook 0x7f46ac0014f0 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace active_short hook 0x7f46ac0014f0 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 Filter name: none 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:04:10.056+0000 7f44ea7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T09:04:10.125 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : miss 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:04:10.058+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:04:10.060+0000 7f46bfd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f46bfd23800 time 2024-09-22T09:04:10.060359+0000 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f46c138c748] 2024-09-22T09:04:10.126 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:04:10.061+0000 7f46bfd23800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f46bfd23800 thread_name:radosgw-admin 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46c003e6f0] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f46c008b99c] 2024-09-22T09:04:10.127 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f46c138c7a2] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:04:10.128 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:04:10.129 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:04:10.130 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:04:10.131 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:04:10.132 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:04:10.133 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44ea7fc640 / http_manager 2024-09-22T09:04:10.134 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4570fe1640 / http_manager 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4571fe3640 / rgw_dt_lg_renew 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45997fa640 / ms_dispatch 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f459affd640 / io_context_pool 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a17fa640 / ms_dispatch 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a3fff640 / ms_dispatch 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a9e0b640 / io_context_pool 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bb1ad640 / msgr-worker-2 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bb9ae640 / msgr-worker-1 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bc1af640 / msgr-worker-0 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bc9b0640 / io_context_pool 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bfd23800 / radosgw-admin 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.89760.log 2024-09-22T09:04:10.135 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:04:09.600+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf08a5160 auth_method 0 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:04:09.600+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 5993 payload 274 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.136 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:04:09.600+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: dump: 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.137 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:04:09.601+0000 7f46bfd23800 5 monclient: authenticate success, global_id 5993 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:04:09.601+0000 7f46bfd23800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:04:09.601+0000 7f46bfd23800 4 set_mon_vals no callback set 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:04:09.601+0000 7f45a9e0b640 10 monclient: dump: 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.138 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: shutdown 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 asok(0x55cbf07400f0) unregister_commands rotate-key 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.139 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding auth protocol: cephx 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.140 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: crc 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09678d0) adding con mode: secure 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:04:09.602+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: starting msgr at 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: starting objecter 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests hook 0x55cbf0965e40 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: setting wanted keys 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:04:09.602+0000 7f46bfd23800 1 librados: calling monclient init 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:04:09.602+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding auth protocol: cephx 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.141 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: crc 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:04:09.602+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0962140) adding con mode: secure 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:04:09.602+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:04:09.603+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.142 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:04:09.603+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key hook 0x55cbf0962288 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf07d8960 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf080f4a0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf08a5160 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.863251s 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf07d8960 auth_method 0 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.143 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf080f4a0 auth_method 0 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:04:09.603+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6363 payload 824 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 1 monclient: found mon.noname-a 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:04:09.603+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:10.144 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: dump: 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.145 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:04:09.603+0000 7f45a3fff640 10 monclient: dump: 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:04:09.603+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6363 2024-09-22T09:04:10.146 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:04:09.603+0000 7f45a9e0b640 4 set_mon_vals no callback set 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:04:09.603+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:04:09.604+0000 7f46bfd23800 1 librados: init done 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:04:09.605+0000 7f45a3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:04:09.605+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f45a40775a0 auth_method 0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:04:09.606+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf09a3c70 auth_method 0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:04:09.607+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x55cbf09ad3d0 auth_method 0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:04:09.608+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x55cbf09b1730 auth_method 0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:04:09.609+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf09b0cb0 auth_method 0 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:04:09.609+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.147 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:04:09.609+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:04:09.609+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.148 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding auth protocol: cephx 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: crc 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:04:09.609+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b98b0) adding con mode: secure 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests cmddesc objecter_requests hook 0x55cbf09bcc50 EEXIST 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.149 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding auth protocol: cephx 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: crc 2024-09-22T09:04:10.150 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09b8838) adding con mode: secure 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:04:09.610+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:04:09.610+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x55cbf09b8980 EEXIST 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf09e0f70 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf09e1350 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf09dfc80 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:04:09.610+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.870935s 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf09e1350 auth_method 0 2024-09-22T09:04:10.151 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf09dfc80 auth_method 0 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:04:09.611+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf09e0f70 auth_method 0 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.152 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:04:09.611+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient(hunting): handle_auth_done global_id 6366 payload 824 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:04:09.611+0000 7f46bc1af640 1 monclient: found mon.noname-a 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:04:09.611+0000 7f46bc1af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: dump: 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.153 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:04:09.611+0000 7f45a17fa640 10 monclient: dump: 2024-09-22T09:04:10.154 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:04:09.611+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6366 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:04:09.611+0000 7f46bc9b0640 4 set_mon_vals no callback set 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.155 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:04:09.611+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:04:09.613+0000 7f45a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:04:09.613+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f4594077480 auth_method 0 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: get_monmap_and_config 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:04:09.614+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.156 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding auth protocol: cephx 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.157 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: crc 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a00f00) adding con mode: secure 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:04:09.614+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:04:09.614+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding auth protocol: cephx 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.158 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: crc 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:04:09.614+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f3b0) adding con mode: secure 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:04:09.614+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:04:09.615+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:04:09.615+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x7fffd8c7f4f8 EEXIST 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf0a05090 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf0a2fb00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.159 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf0a30eb0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.875150s 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf0a05090 auth_method 0 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): get_auth_request con 0x55cbf0a2fb00 auth_method 0 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.160 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:04:09.615+0000 7f46bc1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf0a30eb0 auth_method 0 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:04:09.615+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6002 payload 274 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:04:09.615+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.161 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: dump: 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.162 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:04:09.615+0000 7f459affd640 10 monclient: dump: 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:04:09.615+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6002 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:04:09.615+0000 7f46bfd23800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:10.163 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:04:09.615+0000 7f46bfd23800 4 set_mon_vals no callback set 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: shutdown 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: build_initial_monmap 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 build_initial for_mkfs: 0 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: monmap: 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.164 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding auth protocol: cephx 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: crc 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf0a05c70) adding con mode: secure 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:04:09.616+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: starting msgr at 2024-09-22T09:04:10.165 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: starting objecter 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command objecter_requests cmddesc objecter_requests hook 0x55cbf0a326e0 EEXIST 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: setting wanted keys 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:04:09.616+0000 7f46bfd23800 1 librados: calling monclient init 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:04:09.616+0000 7f46bfd23800 10 monclient: init 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding auth protocol: cephx 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.166 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: crc 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:04:09.616+0000 7f46bfd23800 5 AuthRegistry(0x55cbf09f5830) adding con mode: secure 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:04:09.617+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:04:09.617+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:04:09.617+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command rotate-key cmddesc rotate-key hook 0x55cbf09f5978 EEXIST 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-c con 0x55cbf0a05090 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-b con 0x55cbf0a30eb0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): picked mon.noname-a con 0x55cbf0a34b00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.167 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:04:09.617+0000 7f46bfd23800 10 monclient(hunting): authenticate will time out at 2147.877444s 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request con 0x55cbf0a05090 auth_method 0 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request con 0x55cbf0a34b00 auth_method 0 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:04:09.617+0000 7f46bb9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:10.168 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient(hunting): handle_auth_done global_id 6005 payload 824 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient: _finish_hunting 0 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 1 monclient: found mon.noname-c 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:04:09.617+0000 7f46bb1ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: dump: 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.169 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:04:09.618+0000 7f45997fa640 10 monclient: dump: 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:10.170 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:04:09.618+0000 7f46bfd23800 5 monclient: authenticate success, global_id 6005 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:04:09.618+0000 7f459affd640 4 set_mon_vals no callback set 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _renew_subs 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:04:09.618+0000 7f46bfd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:04:09.618+0000 7f46bfd23800 1 librados: init done 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:04:09.618+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cr dump hook 0x55cbf0a2f5f8 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:04:09.619+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.171 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:04:09.620+0000 7f45997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:04:09.620+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f4584077570 auth_method 0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:04:09.620+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x55cbf0a4f2f0 auth_method 0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 realm 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:04:09.621+0000 7f46bfd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:04:09.621+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:04:09.622+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x55cbf0a535b0 auth_method 0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:04:09.622+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.172 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:04:09.622+0000 7f46bc1af640 10 monclient: get_auth_request con 0x55cbf0a56e10 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:04:09.623+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:04:09.623+0000 7f46bfd23800 20 searching for the correct realm 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:04:09.623+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f46b402b070 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:04:09.624+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46ac02b040 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:04:09.625+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f46a40b7040 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:04:09.625+0000 7f46bc1af640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f46a40b7040 msgr2=0x7f46a40b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:04:09.827+0000 7f46bc1af640 10 monclient: get_auth_request con 0x7f46a40b7040 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:04:09.829+0000 7f46bb9ae640 10 monclient: get_auth_request con 0x7f46b4076040 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:04:09.832+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46b4082ba0 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:04:09.832+0000 7f46bb1ad640 0 -- 172.21.15.39:0/1951970657 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f46b4082ba0 msgr2=0x7f46b4066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:04:10.033+0000 7f46bb1ad640 10 monclient: get_auth_request con 0x7f46b4082ba0 auth_method 0 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:10.173 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:04:10.039+0000 7f46bfd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:04:10.040+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zone default found 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Realm: () 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:04:10.041+0000 7f46bfd23800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:10.174 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:04:10.041+0000 7f46bfd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 zonegroup default 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:04:10.041+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started sync module instance, tier type = 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:04:10.042+0000 7f46bfd23800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=0 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=1 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=2 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=3 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=4 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=5 2024-09-22T09:04:10.175 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:04:10.053+0000 7f46bfd23800 20 add_watcher() i=6 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:04:10.054+0000 7f46bfd23800 20 add_watcher() i=7 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:04:10.054+0000 7f46bfd23800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding auth protocol: cephx 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.176 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: crc 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:04:10.055+0000 7f46bfd23800 5 AuthRegistry(0x7fffd8c7f880) adding con mode: secure 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:04:10.055+0000 7f4571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:04:10.056+0000 7f46bfd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache list hook 0x55cbf0a35400 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache inspect hook 0x55cbf0a35400 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache erase hook 0x55cbf0a35400 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command cache zap hook 0x55cbf0a35400 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 note: GC not initialized 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:04:10.056+0000 7f4570fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace show hook 0x7f46ac0014f0 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace history hook 0x7f46ac0014f0 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace active hook 0x7f46ac0014f0 2024-09-22T09:04:10.177 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:04:10.056+0000 7f46bfd23800 5 asok(0x55cbf07400f0) register_command sync trace active_short hook 0x7f46ac0014f0 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:04:10.056+0000 7f46bfd23800 20 Filter name: none 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:04:10.056+0000 7f44ea7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:04:10.057+0000 7f46bfd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : miss 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:04:10.057+0000 7f46bfd23800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:04:10.058+0000 7f46bfd23800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:10.178 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:04:10.058+0000 7f46bfd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:04:10.060+0000 7f46bfd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f46bfd23800 time 2024-09-22T09:04:10.060359+0000 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f46c138c748] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.179 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:04:10.061+0000 7f46bfd23800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f46bfd23800 thread_name:radosgw-admin 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f46c003e6f0] 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f46c008b99c] 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f46c138c7a2] 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f46c138c906] 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbefb85e01] 2024-09-22T09:04:10.180 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80ac4) [0x55cbf0097ac4] 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cbefb95c9d] 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f46c0029590] 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:04:10.181 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:04:10.182 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:04:10.183 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:04:10.184 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:04:10.185 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:04:10.186 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44ea7fc640 / http_manager 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4570fe1640 / http_manager 2024-09-22T09:04:10.187 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4571fe3640 / rgw_dt_lg_renew 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45997fa640 / ms_dispatch 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f459affd640 / io_context_pool 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a17fa640 / ms_dispatch 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a3fff640 / ms_dispatch 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45a9e0b640 / io_context_pool 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bb1ad640 / msgr-worker-2 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bb9ae640 / msgr-worker-1 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bc1af640 / msgr-worker-0 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bc9b0640 / io_context_pool 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bfd23800 / radosgw-admin 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:04:10.062053Z_e08818cf-ab05-4188-9d48-c57820fb0f1d/log 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:04:10.188 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.142+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.144+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.144+0000 7f608550c800 20 realm 2024-09-22T09:04:10.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.144+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.145+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.145+0000 7f608550c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.145+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.145+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.145+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.146+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.146+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.146+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.146+0000 7f608550c800 20 searching for the correct realm 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.148+0000 7f60827fc640 0 -- 172.21.15.39:0/2991302695 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f607c025030 msgr2=0x7f607c0682b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.152+0000 7f6082ffd640 0 -- 172.21.15.39:0/2991302695 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f6074017040 msgr2=0x7f6074068aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:10.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.158+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 zone default found 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 4 Realm: () 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:10.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 zonegroup default 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.159+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.160+0000 7f608550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.160+0000 7f608550c800 20 started sync module instance, tier type = 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.160+0000 7f608550c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=0 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=1 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=2 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=3 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=4 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=5 2024-09-22T09:04:10.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.169+0000 7f608550c800 20 add_watcher() i=6 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.170+0000 7f608550c800 20 add_watcher() i=7 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.170+0000 7f608550c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.171+0000 7f5f397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 5 note: GC not initialized 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f5eb3fff640 20 reqs_thread_entry: start 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 20 Filter name: none 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f5eb1ffb640 20 reqs_thread_entry: start 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.172+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.173+0000 7f608550c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.174+0000 7f608550c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.174+0000 7f608550c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.175+0000 7f5f397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.177+0000 7f608550c800 20 remove_watcher() i=0 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.177+0000 7f608550c800 2 removed watcher, disabling cache 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.178+0000 7f608550c800 20 remove_watcher() i=1 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.179+0000 7f608550c800 20 remove_watcher() i=2 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.181+0000 7f608550c800 20 remove_watcher() i=3 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.182+0000 7f608550c800 20 remove_watcher() i=4 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.183+0000 7f608550c800 20 remove_watcher() i=5 2024-09-22T09:04:10.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.184+0000 7f608550c800 20 remove_watcher() i=6 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.185+0000 7f608550c800 20 remove_watcher() i=7 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-init-indext id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:10.199 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:10.200 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:10.228 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:10.228 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:10.286 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:04:10.318 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:10.318 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:10.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.357+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 20 realm 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.358+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.359+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.359+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.360+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.360+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.361 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.360+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:10.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.360+0000 7f8ad3146800 20 searching for the correct realm 2024-09-22T09:04:10.363 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.362+0000 7f8ad1431640 0 -- 172.21.15.39:0/2715658718 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8ab8090070 msgr2=0x7f8ab8087030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.569+0000 7f8ad042f640 0 -- 172.21.15.39:0/2715658718 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8ac0051920 msgr2=0x7f8ac002b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:10.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.776+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:10.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 zone default found 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 4 Realm: () 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 zonegroup default 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.777+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.778+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.778+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.778+0000 7f8ad3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:10.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.778+0000 7f8ad3146800 20 started sync module instance, tier type = 2024-09-22T09:04:10.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.778+0000 7f8ad3146800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:10.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=0 2024-09-22T09:04:10.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=1 2024-09-22T09:04:10.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=2 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=3 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=4 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=5 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.788+0000 7f8ad3146800 20 add_watcher() i=6 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.789+0000 7f8ad3146800 20 add_watcher() i=7 2024-09-22T09:04:10.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.789+0000 7f8ad3146800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:10.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.791+0000 7f89877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.791+0000 7f8ad3146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.791+0000 7f8ad3146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.791+0000 7f8ad3146800 5 note: GC not initialized 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.791+0000 7f89867e4640 20 reqs_thread_entry: start 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 20 Filter name: none 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f897ffff640 20 reqs_thread_entry: start 2024-09-22T09:04:10.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T09:04:10.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:10.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T09:04:10.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T09:04:10.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : miss 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.792+0000 7f8ad3146800 20 rados->read ofs=0 len=0 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.793+0000 7f8ad3146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:10.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.794+0000 7f8ad3146800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to be held by another RGW process; skipping for now 2024-09-22T09:04:10.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.795+0000 7f89877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:10.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.798+0000 7f8ad3146800 20 remove_watcher() i=0 2024-09-22T09:04:10.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.798+0000 7f8ad3146800 2 removed watcher, disabling cache 2024-09-22T09:04:10.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.799+0000 7f8ad3146800 20 remove_watcher() i=1 2024-09-22T09:04:10.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.800+0000 7f8ad3146800 20 remove_watcher() i=2 2024-09-22T09:04:10.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.802+0000 7f8ad3146800 20 remove_watcher() i=3 2024-09-22T09:04:10.804 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.803+0000 7f8ad3146800 20 remove_watcher() i=4 2024-09-22T09:04:10.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.804+0000 7f8ad3146800 20 remove_watcher() i=5 2024-09-22T09:04:10.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.805+0000 7f8ad3146800 20 remove_watcher() i=6 2024-09-22T09:04:10.807 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:10.806+0000 7f8ad3146800 20 remove_watcher() i=7 2024-09-22T09:04:10.818 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:04:40.850 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:04:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:40.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.933+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:40.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:40.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 realm 2024-09-22T09:04:40.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:40.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.935+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.936+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:40.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.936+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:40.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.937+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:40.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.937+0000 7fa0c6922800 20 searching for the correct realm 2024-09-22T09:04:40.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:40.939+0000 7fa0c2daf640 0 -- 172.21.15.39:0/619209014 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa0ac00fa30 msgr2=0x7fa0ac00a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:41.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.145+0000 7fa0bbfff640 0 -- 172.21.15.39:0/619209014 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa0bc0b2450 msgr2=0x7fa0bc0c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.352+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.353+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.353+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.353+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.353+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 zone default found 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 4 Realm: () 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 zonegroup default 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.354+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.355+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.355+0000 7fa0c6922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.355+0000 7fa0c6922800 20 started sync module instance, tier type = 2024-09-22T09:04:41.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.355+0000 7fa0c6922800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:41.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=0 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=1 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=2 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=3 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=4 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=5 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.366+0000 7fa0c6922800 20 add_watcher() i=6 2024-09-22T09:04:41.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.367+0000 7fa0c6922800 20 add_watcher() i=7 2024-09-22T09:04:41.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.367+0000 7fa0c6922800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:41.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.369+0000 7f9f78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:41.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7fa0c6922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:41.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7fa0c6922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:41.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7fa0c6922800 5 note: GC not initialized 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7f9ef37fe640 20 reqs_thread_entry: start 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7fa0c6922800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7fa0c6922800 20 Filter name: none 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.370+0000 7f9ef17fa640 20 reqs_thread_entry: start 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : miss 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.371+0000 7fa0c6922800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:41.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.372+0000 7fa0c6922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.377+0000 7fa0c6922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.377+0000 7fa0c6922800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.377+0000 7fa0c6922800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.377+0000 7fa0c6922800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21, ofs0, ns] 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.378+0000 7f9fa5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 94849769678432 notifier 6059 bl.length()=913 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.378+0000 7f9fa5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.378+0000 7f9fa5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.378+0000 7f9fa5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.380+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_sources= new_sources= 2024-09-22T09:04:41.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.380+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential sources added=[] removed=[] 2024-09-22T09:04:41.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.380+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_dests= new_dests= 2024-09-22T09:04:41.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.380+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential dests added=[] removed=[] 2024-09-22T09:04:41.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.383+0000 7fa0c6922800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.1.0 2024-09-22T09:04:41.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.383+0000 7fa0c6922800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.1.0 2024-09-22T09:04:41.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.383+0000 7fa0c6922800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.1.1 2024-09-22T09:04:41.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.383+0000 7fa0c6922800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.1.1 2024-09-22T09:04:41.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.383+0000 7fa0c6922800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.0 2024-09-22T09:04:41.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.386+0000 7fa0c6922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:41.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.386+0000 7fa0c6922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:41.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7fa0c6922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7fa0c6922800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7fa0c6922800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7fa0c6922800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21, ofs0, ns] 2024-09-22T09:04:41.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7f9fa5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529696 cookie 94849769678432 notifier 6059 bl.length()=913 2024-09-22T09:04:41.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7f9fa5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7f9fa5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.387+0000 7f9fa5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.389+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_sources= new_sources= 2024-09-22T09:04:41.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.389+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential sources added=[] removed=[] 2024-09-22T09:04:41.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.389+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_dests= new_dests= 2024-09-22T09:04:41.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.389+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential dests added=[] removed=[] 2024-09-22T09:04:41.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.390+0000 7fa0c6922800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.21.0 2024-09-22T09:04:41.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.391+0000 7fa0c6922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:41.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.391+0000 7fa0c6922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 2024-09-22T09:04:41.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.392+0000 7fa0c6922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.392+0000 7fa0c6922800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.392+0000 7fa0c6922800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.392+0000 7fa0c6922800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21, ofs0, ns] 2024-09-22T09:04:41.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.393+0000 7f9fa57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529697 cookie 94849769678432 notifier 6059 bl.length()=881 2024-09-22T09:04:41.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.393+0000 7f9fa57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 info.flags=0x17 2024-09-22T09:04:41.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.393+0000 7f9fa57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 to cache LRU end 2024-09-22T09:04:41.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.393+0000 7f9fa57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:41.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.394+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_sources= new_sources= 2024-09-22T09:04:41.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.394+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential sources added=[] removed=[] 2024-09-22T09:04:41.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.394+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): orig_dests= new_dests= 2024-09-22T09:04:41.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.394+0000 7fa0c6922800 20 handle_bi_update(): bucket=:abort-at-init-indext[530e834e-7701-4a35-ad82-1b0744ba8777.4617.21]): potential dests added=[] removed=[] 2024-09-22T09:04:41.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.395+0000 7fa0c6922800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-22T09:04:41.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.398+0000 7f9f78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:41.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.400+0000 7fa0c6922800 20 remove_watcher() i=0 2024-09-22T09:04:41.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.400+0000 7fa0c6922800 2 removed watcher, disabling cache 2024-09-22T09:04:41.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.402+0000 7fa0c6922800 20 remove_watcher() i=1 2024-09-22T09:04:41.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.403+0000 7fa0c6922800 20 remove_watcher() i=2 2024-09-22T09:04:41.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.404+0000 7fa0c6922800 20 remove_watcher() i=3 2024-09-22T09:04:41.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.405+0000 7fa0c6922800 20 remove_watcher() i=4 2024-09-22T09:04:41.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.406+0000 7fa0c6922800 20 remove_watcher() i=5 2024-09-22T09:04:41.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.408+0000 7fa0c6922800 20 remove_watcher() i=6 2024-09-22T09:04:41.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.409+0000 7fa0c6922800 20 remove_watcher() i=7 2024-09-22T09:04:41.424 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-22T09:04:41.456 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:41.456 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:41.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.498+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 20 realm 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.500+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.501+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.501+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.502+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:41.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.502+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.502+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:41.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.502+0000 7fada5a98800 20 searching for the correct realm 2024-09-22T09:04:41.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.505+0000 7fada3d83640 0 -- 172.21.15.39:0/3906352382 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fad9802eb70 msgr2=0x7fad98053410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:41.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.509+0000 7fada2d81640 0 -- 172.21.15.39:0/3906352382 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fad9c0483d0 msgr2=0x7fad9c061540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.718 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.716+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:41.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 zone default found 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 4 Realm: () 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 zonegroup default 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.717+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:41.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 started sync module instance, tier type = 2024-09-22T09:04:41.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.718+0000 7fada5a98800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=0 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=1 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=2 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=3 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=4 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=5 2024-09-22T09:04:41.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.728+0000 7fada5a98800 20 add_watcher() i=6 2024-09-22T09:04:41.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.729+0000 7fada5a98800 20 add_watcher() i=7 2024-09-22T09:04:41.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.729+0000 7fada5a98800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:41.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fac59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fada5a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fada5a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fada5a98800 5 note: GC not initialized 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fac58fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.731+0000 7fada5a98800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.732+0000 7fada5a98800 20 Filter name: none 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.732+0000 7fabd27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:41.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.732+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.732+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:41.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.732+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.733+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:41.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.733+0000 7fada5a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:41.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.733+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.734+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=188 2024-09-22T09:04:41.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.734+0000 7fada5a98800 20 rados->read ofs=0 len=0 2024-09-22T09:04:41.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.734+0000 7fada5a98800 20 rados_obj.operate() r=0 bl.length=410 2024-09-22T09:04:41.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.734+0000 7fada5a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:41.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.736+0000 7fac59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:41.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.738+0000 7fada5a98800 20 remove_watcher() i=0 2024-09-22T09:04:41.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.738+0000 7fada5a98800 2 removed watcher, disabling cache 2024-09-22T09:04:41.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.739+0000 7fada5a98800 20 remove_watcher() i=1 2024-09-22T09:04:41.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.740+0000 7fada5a98800 20 remove_watcher() i=2 2024-09-22T09:04:41.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.741+0000 7fada5a98800 20 remove_watcher() i=3 2024-09-22T09:04:41.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.743+0000 7fada5a98800 20 remove_watcher() i=4 2024-09-22T09:04:41.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.744+0000 7fada5a98800 20 remove_watcher() i=5 2024-09-22T09:04:41.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.745+0000 7fada5a98800 20 remove_watcher() i=6 2024-09-22T09:04:41.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:41.745+0000 7fada5a98800 20 remove_watcher() i=7 2024-09-22T09:04:41.758 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-init-indext id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:04:41.758 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:41.760 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:41.760 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:41.778 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:41.779 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:41.978 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:41.978 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.043 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-22T09:04:42.043 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:42.044 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.044 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.085 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.085 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.142 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.142 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.180 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.181 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.213 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.214 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.247 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.247 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.280 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.280 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.316 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.316 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.348 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.349 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.383 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.383 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.415 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.416 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.449 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.449 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.485 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.519 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.519 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.553 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.554 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.587 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.588 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.621 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.621 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.655 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.656 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.689 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.689 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.724 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.724 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.758 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.758 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T09:04:42.856 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:42.856 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:42.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.893+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 20 realm 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.895+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.896+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:42.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.896+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:42.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.897+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:42.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.897+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:42.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.897+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:42.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.897+0000 7f7d14c11800 20 searching for the correct realm 2024-09-22T09:04:42.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:42.899+0000 7f7d10b49640 0 -- 172.21.15.39:0/155455352 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f7d0408e060 msgr2=0x7f7d040843f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:43.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.105+0000 7f7d0fb47640 0 -- 172.21.15.39:0/155455352 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f7d0801d920 msgr2=0x7f7d0800e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:43.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.312+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:43.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 zone default found 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 4 Realm: () 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 zonegroup default 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.313+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.314+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.314+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.314+0000 7f7d14c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.314+0000 7f7d14c11800 20 started sync module instance, tier type = 2024-09-22T09:04:43.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.314+0000 7f7d14c11800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=0 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=1 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=2 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=3 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=4 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=5 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.323+0000 7f7d14c11800 20 add_watcher() i=6 2024-09-22T09:04:43.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.324+0000 7f7d14c11800 20 add_watcher() i=7 2024-09-22T09:04:43.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.324+0000 7f7d14c11800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:43.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.326+0000 7f7bc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.326+0000 7f7d14c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.326+0000 7f7d14c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7d14c11800 5 note: GC not initialized 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7bc5fe3640 20 reqs_thread_entry: start 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7d14c11800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:43.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7d14c11800 20 Filter name: none 2024-09-22T09:04:43.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7bbf7fe640 20 reqs_thread_entry: start 2024-09-22T09:04:43.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.327+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.328+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:43.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.328+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.328+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:43.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.328+0000 7f7d14c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:43.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.328+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.329+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:43.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.329+0000 7f7d14c11800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.329+0000 7f7d14c11800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:43.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.329+0000 7f7d14c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:43.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.330+0000 7f7bc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:43.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.333+0000 7f7d14c11800 20 remove_watcher() i=0 2024-09-22T09:04:43.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.333+0000 7f7d14c11800 2 removed watcher, disabling cache 2024-09-22T09:04:43.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.334+0000 7f7d14c11800 20 remove_watcher() i=1 2024-09-22T09:04:43.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.335+0000 7f7d14c11800 20 remove_watcher() i=2 2024-09-22T09:04:43.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.337+0000 7f7d14c11800 20 remove_watcher() i=3 2024-09-22T09:04:43.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.338+0000 7f7d14c11800 20 remove_watcher() i=4 2024-09-22T09:04:43.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.339+0000 7f7d14c11800 20 remove_watcher() i=5 2024-09-22T09:04:43.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.340+0000 7f7d14c11800 20 remove_watcher() i=6 2024-09-22T09:04:43.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.341+0000 7f7d14c11800 20 remove_watcher() i=7 2024-09-22T09:04:43.354 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:43.354 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:43.354 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:43.354 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:43.355 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-22T09:04:43.391 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:43.391 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:43.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.430+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.431+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.431+0000 7f36b732c800 20 realm 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.431+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.432+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.432+0000 7f36b732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.432+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.432+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.432+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.433+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:43.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.433+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.434+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:43.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.434+0000 7f36b732c800 20 searching for the correct realm 2024-09-22T09:04:43.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.436+0000 7f36b3850640 0 -- 172.21.15.39:0/2781149634 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f36a8041020 msgr2=0x7f36a806c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:43.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.440+0000 7f36b284e640 0 -- 172.21.15.39:0/2781149634 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f36ac03b980 msgr2=0x7f36ac05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:43.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:43.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.646+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 zone default found 2024-09-22T09:04:43.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 4 Realm: () 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 zonegroup default 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.647+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.648+0000 7f36b732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.648+0000 7f36b732c800 20 started sync module instance, tier type = 2024-09-22T09:04:43.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.648+0000 7f36b732c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:43.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=0 2024-09-22T09:04:43.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=1 2024-09-22T09:04:43.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=2 2024-09-22T09:04:43.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=3 2024-09-22T09:04:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=4 2024-09-22T09:04:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=5 2024-09-22T09:04:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.657+0000 7f36b732c800 20 add_watcher() i=6 2024-09-22T09:04:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.658+0000 7f36b732c800 20 add_watcher() i=7 2024-09-22T09:04:43.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.658+0000 7f36b732c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:43.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f3569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f36b732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f36b732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f36b732c800 5 note: GC not initialized 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f3568fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.660+0000 7f36b732c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 20 Filter name: none 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f34e27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T09:04:43.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 : miss 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:43.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:43.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:43.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:43.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.661+0000 7f36b732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 2024-09-22T09:04:43.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.664+0000 7f36b732c800 -1 Injecting error=-5 at location=set_target_layout 2024-09-22T09:04:43.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.664+0000 7f36b732c800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-22T09:04:43.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.667+0000 7f3569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:43.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.669+0000 7f36b732c800 20 remove_watcher() i=0 2024-09-22T09:04:43.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.669+0000 7f36b732c800 2 removed watcher, disabling cache 2024-09-22T09:04:43.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.670+0000 7f36b732c800 20 remove_watcher() i=1 2024-09-22T09:04:43.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.671+0000 7f36b732c800 20 remove_watcher() i=2 2024-09-22T09:04:43.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.672+0000 7f36b732c800 20 remove_watcher() i=3 2024-09-22T09:04:43.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.673+0000 7f36b732c800 20 remove_watcher() i=4 2024-09-22T09:04:43.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.674+0000 7f36b732c800 20 remove_watcher() i=5 2024-09-22T09:04:43.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.675+0000 7f36b732c800 20 remove_watcher() i=6 2024-09-22T09:04:43.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.676+0000 7f36b732c800 20 remove_watcher() i=7 2024-09-22T09:04:43.689 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T09:04:43.719 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:43.719 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:43.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.757+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 20 realm 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.758+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.759+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:43.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.759+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.760+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:43.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.760+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:43.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.761+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:43.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.761+0000 7f6354040800 20 searching for the correct realm 2024-09-22T09:04:43.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.763+0000 7f635232b640 0 -- 172.21.15.39:0/2640869740 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6348020070 msgr2=0x7f634806a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:43.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:43.968+0000 7f6351329640 0 -- 172.21.15.39:0/2640869740 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f634c09c3d0 msgr2=0x7f634c09c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:44.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.174+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 zone default found 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 4 Realm: () 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 zonegroup default 2024-09-22T09:04:44.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.175+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 started sync module instance, tier type = 2024-09-22T09:04:44.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.176+0000 7f6354040800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=0 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=1 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=2 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=3 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=4 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=5 2024-09-22T09:04:44.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.186+0000 7f6354040800 20 add_watcher() i=6 2024-09-22T09:04:44.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.188+0000 7f6354040800 20 add_watcher() i=7 2024-09-22T09:04:44.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.188+0000 7f6354040800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:44.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.190+0000 7f61f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.190+0000 7f6354040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.190+0000 7f6354040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.190+0000 7f6354040800 5 note: GC not initialized 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.190+0000 7f61f27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6354040800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6354040800 20 Filter name: none 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6173fff640 20 reqs_thread_entry: start 2024-09-22T09:04:44.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:44.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.191+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:44.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.192+0000 7f6354040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:44.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.194+0000 7f61f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:44.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.196+0000 7f6354040800 20 remove_watcher() i=0 2024-09-22T09:04:44.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.196+0000 7f6354040800 2 removed watcher, disabling cache 2024-09-22T09:04:44.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.197+0000 7f6354040800 20 remove_watcher() i=1 2024-09-22T09:04:44.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.198+0000 7f6354040800 20 remove_watcher() i=2 2024-09-22T09:04:44.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.200+0000 7f6354040800 20 remove_watcher() i=3 2024-09-22T09:04:44.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.201+0000 7f6354040800 20 remove_watcher() i=4 2024-09-22T09:04:44.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.202+0000 7f6354040800 20 remove_watcher() i=5 2024-09-22T09:04:44.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.202+0000 7f6354040800 20 remove_watcher() i=6 2024-09-22T09:04:44.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.203+0000 7f6354040800 20 remove_watcher() i=7 2024-09-22T09:04:44.216 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:44.216 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:44.216 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:44.216 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:44.218 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:44.218 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:44.249 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:44.249 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:44.307 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:04:44.339 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:44.340 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:44.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.379+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 20 realm 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.380+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.381+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.381+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.382+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:44.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.382+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.382+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:44.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.382+0000 7f40f0013800 20 searching for the correct realm 2024-09-22T09:04:44.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.383+0000 7f40eb748640 0 -- 172.21.15.39:0/3248906905 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x557a4db138a0 msgr2=0x7f40e406e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:44.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.588+0000 7f40eb748640 0 -- 172.21.15.39:0/3248906905 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x557a4db1ab40 msgr2=0x7f40e4072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.798+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.799+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.799+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.799+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:44.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.799+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 zone default found 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 4 Realm: () 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 zonegroup default 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.800+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.801+0000 7f40f0013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.801+0000 7f40f0013800 20 started sync module instance, tier type = 2024-09-22T09:04:44.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.801+0000 7f40f0013800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=0 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=1 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=2 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=3 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=4 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=5 2024-09-22T09:04:44.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.811+0000 7f40f0013800 20 add_watcher() i=6 2024-09-22T09:04:44.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.812+0000 7f40f0013800 20 add_watcher() i=7 2024-09-22T09:04:44.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.812+0000 7f40f0013800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:44.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f3fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f40f0013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f40f0013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f40f0013800 5 note: GC not initialized 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f3fa0fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f40f0013800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.814+0000 7f40f0013800 20 Filter name: none 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f3f1a7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T09:04:44.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 : miss 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:44.817 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:44.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.815+0000 7f40f0013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 2024-09-22T09:04:44.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.819+0000 7f40f0013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.819+0000 7f40f0013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.819+0000 7f40f0013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.819+0000 7f40f0013800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22, ofs0, ns] 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.819+0000 7f3fceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 93983780269168 notifier 6519 bl.length()=925 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.820+0000 7f3fceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.820+0000 7f3fceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.820+0000 7f3fceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.821+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_sources= new_sources= 2024-09-22T09:04:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.821+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential sources added=[] removed=[] 2024-09-22T09:04:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.821+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_dests= new_dests= 2024-09-22T09:04:44.823 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.821+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential dests added=[] removed=[] 2024-09-22T09:04:44.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.824+0000 7f40f0013800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.1.0 2024-09-22T09:04:44.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.824+0000 7f40f0013800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.1.0 2024-09-22T09:04:44.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.824+0000 7f40f0013800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.1.1 2024-09-22T09:04:44.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.824+0000 7f40f0013800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.1.1 2024-09-22T09:04:44.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.824+0000 7f40f0013800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.0 2024-09-22T09:04:44.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.826+0000 7f40f0013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:44.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.826+0000 7f40f0013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f40f0013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f40f0013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f40f0013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f40f0013800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22, ofs0, ns] 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f3fceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 93983780269168 notifier 6519 bl.length()=925 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f3fceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f3fceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.827+0000 7f3fceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.829+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_sources= new_sources= 2024-09-22T09:04:44.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.829+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential sources added=[] removed=[] 2024-09-22T09:04:44.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.829+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_dests= new_dests= 2024-09-22T09:04:44.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.829+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential dests added=[] removed=[] 2024-09-22T09:04:44.831 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.830+0000 7f40f0013800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.22.0 2024-09-22T09:04:44.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.830+0000 7f40f0013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:44.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.831+0000 7f40f0013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 2024-09-22T09:04:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f40f0013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f40f0013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f40f0013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f40f0013800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22, ofs0, ns] 2024-09-22T09:04:44.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f3fce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 93983780269168 notifier 6519 bl.length()=893 2024-09-22T09:04:44.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f3fce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 info.flags=0x17 2024-09-22T09:04:44.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f3fce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 to cache LRU end 2024-09-22T09:04:44.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.832+0000 7f3fce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:44.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.833+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_sources= new_sources= 2024-09-22T09:04:44.834 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.833+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential sources added=[] removed=[] 2024-09-22T09:04:44.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.833+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): orig_dests= new_dests= 2024-09-22T09:04:44.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.833+0000 7f40f0013800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.22]): potential dests added=[] removed=[] 2024-09-22T09:04:44.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.835+0000 7f40f0013800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:04:44.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.837+0000 7f3fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:44.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.839+0000 7f40f0013800 20 remove_watcher() i=0 2024-09-22T09:04:44.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.839+0000 7f40f0013800 2 removed watcher, disabling cache 2024-09-22T09:04:44.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.840+0000 7f40f0013800 20 remove_watcher() i=1 2024-09-22T09:04:44.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.841+0000 7f40f0013800 20 remove_watcher() i=2 2024-09-22T09:04:44.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.843+0000 7f40f0013800 20 remove_watcher() i=3 2024-09-22T09:04:44.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.844+0000 7f40f0013800 20 remove_watcher() i=4 2024-09-22T09:04:44.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.845+0000 7f40f0013800 20 remove_watcher() i=5 2024-09-22T09:04:44.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.846+0000 7f40f0013800 20 remove_watcher() i=6 2024-09-22T09:04:44.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.847+0000 7f40f0013800 20 remove_watcher() i=7 2024-09-22T09:04:44.861 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T09:04:44.890 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:44.890 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:44.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.928+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 20 realm 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.930+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.931+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:44.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.931+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.932+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:44.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.932+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:44.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.932+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:44.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.932+0000 7ffaf7730800 20 searching for the correct realm 2024-09-22T09:04:44.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.935+0000 7ffaf3bbd640 0 -- 172.21.15.39:0/2564052304 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ffae8017070 msgr2=0x7ffae80524b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:44.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:44.939+0000 7ffaf2bbb640 0 -- 172.21.15.39:0/2564052304 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ffaec039970 msgr2=0x7ffaec0103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:45.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:45.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:45.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.146+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 zone default found 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 4 Realm: () 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 zonegroup default 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.147+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.148+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.148+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.148+0000 7ffaf7730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.148+0000 7ffaf7730800 20 started sync module instance, tier type = 2024-09-22T09:04:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.148+0000 7ffaf7730800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=0 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=1 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=2 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=3 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=4 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=5 2024-09-22T09:04:45.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.159+0000 7ffaf7730800 20 add_watcher() i=6 2024-09-22T09:04:45.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.160+0000 7ffaf7730800 20 add_watcher() i=7 2024-09-22T09:04:45.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.160+0000 7ffaf7730800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:45.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.161+0000 7ff9a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.161+0000 7ffaf7730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.161+0000 7ffaf7730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.161+0000 7ffaf7730800 5 note: GC not initialized 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ff9a8fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ffaf7730800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ffaf7730800 20 Filter name: none 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ff9227fc640 20 reqs_thread_entry: start 2024-09-22T09:04:45.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.162+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.163+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.163+0000 7ffaf7730800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:45.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.163+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.163+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:45.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.163+0000 7ffaf7730800 20 rados->read ofs=0 len=0 2024-09-22T09:04:45.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.164+0000 7ffaf7730800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:45.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.164+0000 7ffaf7730800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.165+0000 7ff9a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:45.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.167+0000 7ffaf7730800 20 remove_watcher() i=0 2024-09-22T09:04:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.167+0000 7ffaf7730800 2 removed watcher, disabling cache 2024-09-22T09:04:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.168+0000 7ffaf7730800 20 remove_watcher() i=1 2024-09-22T09:04:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.169+0000 7ffaf7730800 20 remove_watcher() i=2 2024-09-22T09:04:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.171+0000 7ffaf7730800 20 remove_watcher() i=3 2024-09-22T09:04:45.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.172+0000 7ffaf7730800 20 remove_watcher() i=4 2024-09-22T09:04:45.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.173+0000 7ffaf7730800 20 remove_watcher() i=5 2024-09-22T09:04:45.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.174+0000 7ffaf7730800 20 remove_watcher() i=6 2024-09-22T09:04:45.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:45.175+0000 7ffaf7730800 20 remove_watcher() i=7 2024-09-22T09:04:45.187 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:45.187 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:45.187 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:04:45.187 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:45.189 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.189 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.210 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.210 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.421 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.421 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.486 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-22T09:04:45.486 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:45.487 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.487 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.528 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.528 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.585 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.585 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.616 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.616 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.650 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.650 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.684 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.684 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.718 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.718 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.751 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.751 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.785 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.785 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.819 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.820 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.854 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.855 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.888 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.888 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.922 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.922 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.956 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.957 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:45.991 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:45.991 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.025 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.025 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.059 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.059 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.091 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.092 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.126 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.126 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.161 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.161 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.195 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.195 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.228 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:46.228 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:46.263 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T09:04:46.293 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:46.293 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:46.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.333+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.334+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.334+0000 7faa65c20800 20 realm 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.334+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.335+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.335+0000 7faa65c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.335+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.335+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.335+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.336+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:46.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.336+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.336+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:46.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.337+0000 7faa65c20800 20 searching for the correct realm 2024-09-22T09:04:46.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.337+0000 7faa63711640 0 -- 172.21.15.39:0/2972453674 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7faa5c06b040 msgr2=0x7faa5c0ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:46.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.542+0000 7faa63711640 0 -- 172.21.15.39:0/2972453674 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x5652f897f7c0 msgr2=0x7faa5c0c78d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:46.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:46.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:46.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.750+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.751+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.751+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.751+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.751+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 zone default found 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 4 Realm: () 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 zonegroup default 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.752+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.753+0000 7faa65c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.753+0000 7faa65c20800 20 started sync module instance, tier type = 2024-09-22T09:04:46.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.753+0000 7faa65c20800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=0 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=1 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=2 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=3 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=4 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=5 2024-09-22T09:04:46.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.763+0000 7faa65c20800 20 add_watcher() i=6 2024-09-22T09:04:46.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.764+0000 7faa65c20800 20 add_watcher() i=7 2024-09-22T09:04:46.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.764+0000 7faa65c20800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:46.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7faa65c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7faa65c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7faa65c20800 5 note: GC not initialized 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7fa918fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7faa65c20800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.766+0000 7faa65c20800 20 Filter name: none 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.767+0000 7fa8927fc640 20 reqs_thread_entry: start 2024-09-22T09:04:46.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.767+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.767+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.767+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.768+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.768+0000 7faa65c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.768+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.768+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.768+0000 7faa65c20800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.769+0000 7faa65c20800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:46.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.769+0000 7faa65c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:46.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.770+0000 7fa919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:46.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.772+0000 7faa65c20800 20 remove_watcher() i=0 2024-09-22T09:04:46.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.772+0000 7faa65c20800 2 removed watcher, disabling cache 2024-09-22T09:04:46.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.773+0000 7faa65c20800 20 remove_watcher() i=1 2024-09-22T09:04:46.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.774+0000 7faa65c20800 20 remove_watcher() i=2 2024-09-22T09:04:46.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.776+0000 7faa65c20800 20 remove_watcher() i=3 2024-09-22T09:04:46.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.777+0000 7faa65c20800 20 remove_watcher() i=4 2024-09-22T09:04:46.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.778+0000 7faa65c20800 20 remove_watcher() i=5 2024-09-22T09:04:46.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.779+0000 7faa65c20800 20 remove_watcher() i=6 2024-09-22T09:04:46.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.780+0000 7faa65c20800 20 remove_watcher() i=7 2024-09-22T09:04:46.793 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:46.793 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:46.793 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:46.793 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:46.795 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-22T09:04:46.832 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:46.833 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:46.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.870+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 realm 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:46.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.872+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.873+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:46.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.873+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:46.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.874+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:46.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.874+0000 7f2f7672e800 20 searching for the correct realm 2024-09-22T09:04:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:46.876+0000 7f2f72cde640 0 -- 172.21.15.39:0/2429599272 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f2f68036070 msgr2=0x7f2f68067870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:47.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.083+0000 7f2f71cdc640 0 -- 172.21.15.39:0/2429599272 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2f6c0984d0 msgr2=0x7f2f6c097ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:47.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.290+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:47.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 zone default found 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 4 Realm: () 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 zonegroup default 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.291+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 started sync module instance, tier type = 2024-09-22T09:04:47.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.292+0000 7f2f7672e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=0 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=1 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=2 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=3 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=4 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=5 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.303+0000 7f2f7672e800 20 add_watcher() i=6 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.304+0000 7f2f7672e800 20 add_watcher() i=7 2024-09-22T09:04:47.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.304+0000 7f2f7672e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:47.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.306+0000 7f2e297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:47.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:47.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 5 note: GC not initialized 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2e237fe640 20 reqs_thread_entry: start 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 20 Filter name: none 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2e217fa640 20 reqs_thread_entry: start 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-22T09:04:47.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.307+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 : miss 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.308+0000 7f2f7672e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 2024-09-22T09:04:47.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.311+0000 7f2f7672e800 -1 Injecting error=-125 at location=set_target_layout 2024-09-22T09:04:47.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2f7672e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2f7672e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2f7672e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2f7672e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23, ofs0, ns] 2024-09-22T09:04:47.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529698 cookie 94329690905984 notifier 6191 bl.length()=925 2024-09-22T09:04:47.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2e55ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.312+0000 7f2e55ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.314+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_sources= new_sources= 2024-09-22T09:04:47.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.314+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential sources added=[] removed=[] 2024-09-22T09:04:47.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.314+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_dests= new_dests= 2024-09-22T09:04:47.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.314+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential dests added=[] removed=[] 2024-09-22T09:04:47.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.316+0000 7f2f7672e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.1.0 2024-09-22T09:04:47.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.316+0000 7f2f7672e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.1.0 2024-09-22T09:04:47.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.316+0000 7f2f7672e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.1.1 2024-09-22T09:04:47.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.316+0000 7f2f7672e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.1.1 2024-09-22T09:04:47.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.316+0000 7f2f7672e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.0 2024-09-22T09:04:47.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.319+0000 7f2f7672e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:47.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.319+0000 7f2f7672e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.320+0000 7f2f7672e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.320+0000 7f2f7672e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.320+0000 7f2f7672e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.320+0000 7f2f7672e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23, ofs0, ns] 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.320+0000 7f2e55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529699 cookie 94329690905984 notifier 6191 bl.length()=925 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.321+0000 7f2e55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.321+0000 7f2e55ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.321+0000 7f2e55ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.322+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_sources= new_sources= 2024-09-22T09:04:47.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.322+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential sources added=[] removed=[] 2024-09-22T09:04:47.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.322+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_dests= new_dests= 2024-09-22T09:04:47.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.322+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential dests added=[] removed=[] 2024-09-22T09:04:47.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.323+0000 7f2f7672e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.23.0 2024-09-22T09:04:47.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.324+0000 7f2f7672e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 : hit (requested=0x17, cached=0x17) 2024-09-22T09:04:47.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.324+0000 7f2f7672e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 2024-09-22T09:04:47.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2f7672e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2f7672e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2f7672e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2f7672e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23, ofs0, ns] 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2e557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529700 cookie 94329690905984 notifier 6191 bl.length()=893 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2e557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 info.flags=0x17 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2e557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 to cache LRU end 2024-09-22T09:04:47.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.325+0000 7f2e557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:47.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.327+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_sources= new_sources= 2024-09-22T09:04:47.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.327+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential sources added=[] removed=[] 2024-09-22T09:04:47.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.327+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): orig_dests= new_dests= 2024-09-22T09:04:47.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.327+0000 7f2f7672e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.23]): potential dests added=[] removed=[] 2024-09-22T09:04:47.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.328+0000 7f2f7672e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:04:47.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.330+0000 7f2e297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:47.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.333+0000 7f2f7672e800 20 remove_watcher() i=0 2024-09-22T09:04:47.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.333+0000 7f2f7672e800 2 removed watcher, disabling cache 2024-09-22T09:04:47.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.334+0000 7f2f7672e800 20 remove_watcher() i=1 2024-09-22T09:04:47.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.335+0000 7f2f7672e800 20 remove_watcher() i=2 2024-09-22T09:04:47.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.336+0000 7f2f7672e800 20 remove_watcher() i=3 2024-09-22T09:04:47.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.337+0000 7f2f7672e800 20 remove_watcher() i=4 2024-09-22T09:04:47.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.339+0000 7f2f7672e800 20 remove_watcher() i=5 2024-09-22T09:04:47.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.340+0000 7f2f7672e800 20 remove_watcher() i=6 2024-09-22T09:04:47.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.341+0000 7f2f7672e800 20 remove_watcher() i=7 2024-09-22T09:04:47.355 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-22T09:04:47.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:47.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:47.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.624+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.626+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.626+0000 7f8645d75800 20 realm 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.626+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.626+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.626+0000 7f8645d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.627+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.627+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:47.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.627+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.628+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:47.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.628+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:47.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.628+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:47.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.628+0000 7f8645d75800 20 searching for the correct realm 2024-09-22T09:04:47.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.630+0000 7f8644060640 0 -- 172.21.15.39:0/1178523355 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f863801b040 msgr2=0x7f8638066910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:47.838 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:47.836+0000 7f864305e640 0 -- 172.21.15.39:0/1178523355 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f863c0ab0b0 msgr2=0x7f863c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:48.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:48.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:48.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:48.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:48.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:48.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:48.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:48.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.044+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 zone default found 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 4 Realm: () 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 zonegroup default 2024-09-22T09:04:48.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.045+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.046+0000 7f8645d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.046+0000 7f8645d75800 20 started sync module instance, tier type = 2024-09-22T09:04:48.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.046+0000 7f8645d75800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=0 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=1 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=2 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=3 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=4 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=5 2024-09-22T09:04:48.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.056+0000 7f8645d75800 20 add_watcher() i=6 2024-09-22T09:04:48.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.057+0000 7f8645d75800 20 add_watcher() i=7 2024-09-22T09:04:48.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.057+0000 7f8645d75800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:48.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.059+0000 7f84f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.059+0000 7f8645d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.059+0000 7f8645d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.059+0000 7f8645d75800 5 note: GC not initialized 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.059+0000 7f84f8fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f8645d75800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f8645d75800 20 Filter name: none 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f84727fc640 20 reqs_thread_entry: start 2024-09-22T09:04:48.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:48.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.060+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.061+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.061+0000 7f8645d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.061+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.061+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.061+0000 7f8645d75800 20 rados->read ofs=0 len=0 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.062+0000 7f8645d75800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:48.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.062+0000 7f8645d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:48.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.063+0000 7f84f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:48.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.066+0000 7f8645d75800 20 remove_watcher() i=0 2024-09-22T09:04:48.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.066+0000 7f8645d75800 2 removed watcher, disabling cache 2024-09-22T09:04:48.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.067+0000 7f8645d75800 20 remove_watcher() i=1 2024-09-22T09:04:48.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.068+0000 7f8645d75800 20 remove_watcher() i=2 2024-09-22T09:04:48.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.069+0000 7f8645d75800 20 remove_watcher() i=3 2024-09-22T09:04:48.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.070+0000 7f8645d75800 20 remove_watcher() i=4 2024-09-22T09:04:48.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.071+0000 7f8645d75800 20 remove_watcher() i=5 2024-09-22T09:04:48.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.072+0000 7f8645d75800 20 remove_watcher() i=6 2024-09-22T09:04:48.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:48.073+0000 7f8645d75800 20 remove_watcher() i=7 2024-09-22T09:04:48.087 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:48.087 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:48.087 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-22T09:04:48.087 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:48.089 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.089 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.110 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.110 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.317 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.317 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.384 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-22T09:04:48.384 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:48.385 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.385 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.427 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.427 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.484 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.484 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.524 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.524 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.557 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.558 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.593 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.593 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.627 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.627 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.663 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.695 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.696 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.735 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.735 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.768 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.769 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.801 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.801 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.835 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.835 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.869 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.869 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.903 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.903 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.938 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.939 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:48.973 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:48.973 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.008 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:49.008 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.042 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:49.042 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.076 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:49.076 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.110 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:49.110 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.143 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:49.143 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:49.177 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T09:04:49.206 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:49.206 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:49.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.245+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 realm 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:49.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.247+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.248+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.248+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.249+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:49.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.249+0000 7fad1c526800 20 searching for the correct realm 2024-09-22T09:04:49.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.250+0000 7fad181d9640 0 -- 172.21.15.39:0/3334907127 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fad100bbc20 msgr2=0x7fad100a37c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:49.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.253+0000 7fad181d9640 0 -- 172.21.15.39:0/3334907127 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x557c1ac758a0 msgr2=0x7fad100ca680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:49.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:49.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.463+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 zone default found 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 4 Realm: () 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 zonegroup default 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.464+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 started sync module instance, tier type = 2024-09-22T09:04:49.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.465+0000 7fad1c526800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:49.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=0 2024-09-22T09:04:49.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=1 2024-09-22T09:04:49.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=2 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=3 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=4 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=5 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.476+0000 7fad1c526800 20 add_watcher() i=6 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.477+0000 7fad1c526800 20 add_watcher() i=7 2024-09-22T09:04:49.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.477+0000 7fad1c526800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:49.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fabcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fad1c526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fad1c526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fad1c526800 5 note: GC not initialized 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fabcdfdb640 20 reqs_thread_entry: start 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.479+0000 7fad1c526800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.480+0000 7fad1c526800 20 Filter name: none 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.480+0000 7fab3f7fe640 20 reqs_thread_entry: start 2024-09-22T09:04:49.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.480+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.481+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:49.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.481+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.481+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:49.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.481+0000 7fad1c526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:49.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.481+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.482+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:49.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.482+0000 7fad1c526800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.482+0000 7fad1c526800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:49.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.482+0000 7fad1c526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.484+0000 7fabcefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:49.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.486+0000 7fad1c526800 20 remove_watcher() i=0 2024-09-22T09:04:49.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.486+0000 7fad1c526800 2 removed watcher, disabling cache 2024-09-22T09:04:49.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.487+0000 7fad1c526800 20 remove_watcher() i=1 2024-09-22T09:04:49.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.488+0000 7fad1c526800 20 remove_watcher() i=2 2024-09-22T09:04:49.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.490+0000 7fad1c526800 20 remove_watcher() i=3 2024-09-22T09:04:49.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.492+0000 7fad1c526800 20 remove_watcher() i=4 2024-09-22T09:04:49.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.494+0000 7fad1c526800 20 remove_watcher() i=5 2024-09-22T09:04:49.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.495+0000 7fad1c526800 20 remove_watcher() i=6 2024-09-22T09:04:49.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.496+0000 7fad1c526800 20 remove_watcher() i=7 2024-09-22T09:04:49.509 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.509 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:49.509 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:49.510 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.511 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-22T09:04:49.546 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:49.546 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.584+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 realm 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.588+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:49.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.588+0000 7fd08970c800 20 searching for the correct realm 2024-09-22T09:04:49.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.589+0000 7fd0869f5640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd078066250 msgr2=0x7fd078064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:49.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.794+0000 7fd0871f6640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fd08008f040 msgr2=0x7fd080007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.800+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.803 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 zone default found 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 4 Realm: () 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 zonegroup default 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 started sync module instance, tier type = 2024-09-22T09:04:49.806 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.802+0000 7fd08970c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:49.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=0 2024-09-22T09:04:49.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=1 2024-09-22T09:04:49.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=2 2024-09-22T09:04:49.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=3 2024-09-22T09:04:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=4 2024-09-22T09:04:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=5 2024-09-22T09:04:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=6 2024-09-22T09:04:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.814+0000 7fd08970c800 20 add_watcher() i=7 2024-09-22T09:04:49.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.814+0000 7fd08970c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:49.818 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fcf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fd08970c800 5 note: GC not initialized 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fcf38fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.816+0000 7fd08970c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 20 Filter name: none 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fceb27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T09:04:49.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : miss 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:49.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:04:49.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:04:49.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:49.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:49.821 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.818+0000 7fd08970c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:04:49.823 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd08970c800 time 2024-09-22T09:04:49.822796+0000 2024-09-22T09:04:49.823 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd08cb8c748] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fd08970c800 thread_name:radosgw-admin 2024-09-22T09:04:49.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.821+0000 7fd08970c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd08970c800 time 2024-09-22T09:04:49.822796+0000 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd08cb8c748] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.825 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:49.826 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:49.826 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.842 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.842 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd08b83e6f0] 2024-09-22T09:04:49.842 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd08b88b99c] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd08cb8c7a2] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.822+0000 7fd08970c800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fd08970c800 thread_name:radosgw-admin 2024-09-22T09:04:49.843 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd08b83e6f0] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd08b88b99c] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd08cb8c7a2] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.844 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x56432213b950) adding con mode: crc 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x56432213b950) adding con mode: secure 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:04:49.566+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: starting msgr at 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: starting objecter 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests hook 0x5643221390c0 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: setting wanted keys 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: calling monclient init 2024-09-22T09:04:49.845 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:04:49.566+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.846 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:04:49.567+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:04:49.567+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:04:49.567+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key hook 0x5643221363f8 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x56432207ef00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x56432207f2e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x56432215fdd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.847 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.828426s 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x56432207f2e0 auth_method 0 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x56432215fdd0 auth_method 0 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.848 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_done global_id 6230 payload 824 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:04:49.567+0000 7fd0869f5640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: dump: 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: dump: 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.850 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:04:49.568+0000 7fd08970c800 5 monclient: authenticate success, global_id 6230 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:04:49.568+0000 7fcf7560a640 4 set_mon_vals no callback set 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:04:49.568+0000 7fd08970c800 1 librados: init done 2024-09-22T09:04:49.851 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:04:49.570+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fcf6c077570 auth_method 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:04:49.570+0000 7fd0879f7640 10 monclient: get_auth_request con 0x56432215ecd0 auth_method 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:04:49.571+0000 7fd0871f6640 10 monclient: get_auth_request con 0x564322181a70 auth_method 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:04:49.572+0000 7fd0869f5640 10 monclient: get_auth_request con 0x564322185e20 auth_method 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:04:49.573+0000 7fd0879f7640 10 monclient: get_auth_request con 0x564322185350 auth_method 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:04:49.574+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.852 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.853 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:04:49.574+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests cmddesc objecter_requests hook 0x564322192740 EEXIST 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.854 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:04:49.574+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:04:49.575+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:04:49.575+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x56432218d0c0 EEXIST 2024-09-22T09:04:49.855 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221b6fb0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x5643221b9200 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x5643221cb780 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.836204s 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221b9200 auth_method 0 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.856 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221b6fb0 auth_method 0 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x5643221cb780 auth_method 0 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.857 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_done global_id 6233 payload 824 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:04:49.575+0000 7fd0879f7640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.859 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:04:49.575+0000 7fd08970c800 5 monclient: authenticate success, global_id 6233 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:04:49.575+0000 7fd0881f8640 4 set_mon_vals no callback set 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:04:49.576+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:04:49.576+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: ms_handle_reset current mon [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.860 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.a con 0x5643221b6fb0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.b con 0x5643221cb780 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.c con 0x7fcf600075b0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x7fcf600075b0 auth_method 0 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221b6fb0 auth_method 0 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.861 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221cb780 auth_method 0 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.862 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_done global_id 6233 payload 293 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:04:49.576+0000 7fd0871f6640 1 monclient: found mon.c 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:04:49.577+0000 7fd0871f6640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:04:49.577+0000 7fd0871f6640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.863 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:04:49.577+0000 7fd0861f4640 4 set_mon_vals no callback set 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:04:49.579+0000 7fd0869f5640 10 monclient: get_auth_request con 0x5643221b9200 auth_method 0 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: get_monmap_and_config 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.864 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:04:49.579+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.865 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.866 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:04:49.579+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.867 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:04:49.579+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:04:49.580+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:04:49.580+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc10c08dd8 EEXIST 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x564322203e90 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x5643221d1d30 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221fdfd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.868 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.841243s 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x564322203e90 auth_method 0 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x5643221fdfd0 auth_method 0 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.869 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221d1d30 auth_method 0 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_done global_id 6236 payload 274 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:04:49.580+0000 7fd0869f5640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: dump: 2024-09-22T09:04:49.870 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: dump: 2024-09-22T09:04:49.871 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:04:49.580+0000 7fd08970c800 5 monclient: authenticate success, global_id 6236 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:04:49.580+0000 7fd08970c800 4 set_mon_vals no callback set 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: shutdown 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.872 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.873 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:04:49.581+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: starting msgr at 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: starting objecter 2024-09-22T09:04:49.874 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests cmddesc objecter_requests hook 0x5643221ffbd0 EEXIST 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: setting wanted keys 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: calling monclient init 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.875 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:04:49.582+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:04:49.582+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:04:49.582+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x5643221cfcc8 EEXIST 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x5643221d1d30 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221fdfd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x564322203e90 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.876 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.843363s 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221fdfd0 auth_method 0 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221d1d30 auth_method 0 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.877 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_done global_id 6630 payload 824 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:04:49.582+0000 7fd0879f7640 1 monclient: found mon.noname-a 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:04:49.582+0000 7fd0871f6640 10 monclient: get_auth_request con 0x564322203e90 auth_method 0 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: dump: 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.878 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:04:49.583+0000 7fcf697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:49.879 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:04:49.583+0000 7fcf697fa640 10 monclient: dump: 2024-09-22T09:04:49.880 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.880 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.880 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.880 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.881 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:04:49.583+0000 7fd08970c800 5 monclient: authenticate success, global_id 6630 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:04:49.582+0000 7fcf6affd640 4 set_mon_vals no callback set 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:04:49.583+0000 7fd08970c800 1 librados: init done 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:04:49.583+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cr dump hook 0x5643221fa5c8 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:04:49.584+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:04:49.585+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fcf54077570 auth_method 0 2024-09-22T09:04:49.882 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:04:49.585+0000 7fd0871f6640 10 monclient: get_auth_request con 0x56432221fcc0 auth_method 0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 realm 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:04:49.586+0000 7fd08970c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:04:49.587+0000 7fd0869f5640 10 monclient: get_auth_request con 0x564322223e40 auth_method 0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:04:49.587+0000 7fd0879f7640 10 monclient: get_auth_request con 0x5643222276a0 auth_method 0 2024-09-22T09:04:49.883 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:04:49.588+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:04:49.588+0000 7fd08970c800 20 searching for the correct realm 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:04:49.588+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fd08008f040 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:04:49.589+0000 7fd0869f5640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd078066250 msgr2=0x7fd078064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:04:49.790+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fd078066250 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:04:49.791+0000 7fd0879f7640 10 monclient: get_auth_request con 0x7fd070028030 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:04:49.793+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fd080082060 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:04:49.794+0000 7fd0871f6640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fd08008f040 msgr2=0x7fd080007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:04:49.794+0000 7fcf697fa640 1 client.6630.objecter ms_handle_reset 0x7fd08008f040 session 0x7fd080071040 osd.7 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:04:49.794+0000 7fcf697fa640 10 monclient: _renew_subs 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:04:49.794+0000 7fcf697fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:04:49.794+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fcf54087cf0 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:04:49.795+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fd08004e0c0 auth_method 0 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:49.884 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 zone default found 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 Realm: () 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:04:49.801+0000 7fd08970c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 zonegroup default 2024-09-22T09:04:49.885 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 started sync module instance, tier type = 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=0 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=1 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=2 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=3 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=4 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=5 2024-09-22T09:04:49.886 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=6 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:04:49.814+0000 7fd08970c800 20 add_watcher() i=7 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:04:49.814+0000 7fd08970c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.887 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:04:49.816+0000 7fcf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:04:49.816+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache list hook 0x5643221f8870 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache inspect hook 0x5643221f8870 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache erase hook 0x5643221f8870 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache zap hook 0x5643221f8870 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 note: GC not initialized 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:04:49.816+0000 7fcf38fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:49.888 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace show hook 0x7fd08001c4b0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace history hook 0x7fd08001c4b0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace active hook 0x7fd08001c4b0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace active_short hook 0x7fd08001c4b0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 Filter name: none 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:04:49.817+0000 7fceb27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : miss 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:04:49.818+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:04:49.889 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:04:49.821+0000 7fd08970c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd08970c800 time 2024-09-22T09:04:49.822796+0000 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd08cb8c748] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.890 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:04:49.822+0000 7fd08970c800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fd08970c800 thread_name:radosgw-admin 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd08b83e6f0] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd08b88b99c] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd08cb8c7a2] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.891 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:04:49.892 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:04:49.893 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:04:49.894 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:04:49.895 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:04:49.896 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:04:49.897 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 7fceb27fc640 / http_manager 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf38fe1640 / http_manager 2024-09-22T09:04:49.898 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf39fe3640 / rgw_dt_lg_renew 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf697fa640 / ms_dispatch 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf6affd640 / io_context_pool 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf71602640 / ms_dispatch 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf73e07640 / ms_dispatch 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf7560a640 / io_context_pool 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0861f4640 / io_context_pool 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0869f5640 / msgr-worker-2 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0871f6640 / msgr-worker-1 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0879f7640 / msgr-worker-0 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0881f8640 / io_context_pool 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd08970c800 / radosgw-admin 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:04:49.899 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.98006.log 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x56432213b950) adding con mode: crc 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x56432213b950) adding con mode: secure 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:04:49.566+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: starting msgr at 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: starting objecter 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests hook 0x5643221390c0 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: setting wanted keys 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:04:49.566+0000 7fd08970c800 1 librados: calling monclient init 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:04:49.566+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.900 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding auth protocol: cephx 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: crc 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:04:49.566+0000 7fd08970c800 5 AuthRegistry(0x5643221362b0) adding con mode: secure 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:04:49.567+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:04:49.567+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.901 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:04:49.567+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key hook 0x5643221363f8 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x56432207ef00 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x56432207f2e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x56432215fdd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:04:49.567+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.828426s 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x56432207f2e0 auth_method 0 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.902 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x56432215fdd0 auth_method 0 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:04:49.567+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient(hunting): handle_auth_done global_id 6230 payload 824 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.903 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:04:49.567+0000 7fd0869f5640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:04:49.567+0000 7fd0869f5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: dump: 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.904 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:04:49.568+0000 7fcf73e07640 10 monclient: dump: 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.905 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:04:49.568+0000 7fd08970c800 5 monclient: authenticate success, global_id 6230 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:04:49.568+0000 7fcf7560a640 4 set_mon_vals no callback set 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:04:49.568+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:04:49.568+0000 7fd08970c800 1 librados: init done 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:04:49.570+0000 7fcf73e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.906 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:04:49.570+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fcf6c077570 auth_method 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:04:49.570+0000 7fd0879f7640 10 monclient: get_auth_request con 0x56432215ecd0 auth_method 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:04:49.571+0000 7fd0871f6640 10 monclient: get_auth_request con 0x564322181a70 auth_method 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:04:49.572+0000 7fd0869f5640 10 monclient: get_auth_request con 0x564322185e20 auth_method 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:04:49.573+0000 7fd0879f7640 10 monclient: get_auth_request con 0x564322185350 auth_method 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:04:49.574+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.907 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding auth protocol: cephx 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.908 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: crc 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218e170) adding con mode: secure 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:04:49.574+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests cmddesc objecter_requests hook 0x564322192740 EEXIST 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:04:49.574+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding auth protocol: cephx 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.909 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: crc 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:04:49.574+0000 7fd08970c800 5 AuthRegistry(0x56432218cf78) adding con mode: secure 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:04:49.574+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:04:49.575+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:04:49.575+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x56432218d0c0 EEXIST 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:04:49.910 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221b6fb0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x5643221b9200 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x5643221cb780 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.836204s 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221b9200 auth_method 0 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221b6fb0 auth_method 0 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.911 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:04:49.575+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x5643221cb780 auth_method 0 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:04:49.575+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.912 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient(hunting): handle_auth_done global_id 6233 payload 824 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:04:49.575+0000 7fd0879f7640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:04:49.575+0000 7fd0879f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.913 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:04:49.575+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.914 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:04:49.575+0000 7fd08970c800 5 monclient: authenticate success, global_id 6233 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:04:49.575+0000 7fd0881f8640 4 set_mon_vals no callback set 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:04:49.575+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:04:49.576+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:04:49.576+0000 7fd08970c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: ms_handle_reset current mon [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.915 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.a con 0x5643221b6fb0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.b con 0x5643221cb780 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): picked mon.c con 0x7fcf600075b0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:04:49.576+0000 7fcf71602640 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x7fcf600075b0 auth_method 0 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221b6fb0 auth_method 0 2024-09-22T09:04:49.916 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221cb780 auth_method 0 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:04:49.576+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.917 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:04:49.576+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient(hunting): handle_auth_done global_id 6233 payload 293 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:04:49.576+0000 7fd0871f6640 1 monclient: found mon.c 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:04:49.576+0000 7fd0871f6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:04:49.577+0000 7fd0871f6640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:04:49.577+0000 7fd0871f6640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: dump: 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.918 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:04:49.577+0000 7fcf71602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:04:49.577+0000 7fd0861f4640 4 set_mon_vals no callback set 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:04:49.578+0000 7fcf71602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:04:49.579+0000 7fd0869f5640 10 monclient: get_auth_request con 0x5643221b9200 auth_method 0 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: get_monmap_and_config 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.919 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:04:49.579+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.920 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:04:49.579+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:04:49.579+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.921 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding auth protocol: cephx 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: crc 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:04:49.579+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c08c90) adding con mode: secure 2024-09-22T09:04:49.922 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:04:49.579+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:04:49.580+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:04:49.580+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc10c08dd8 EEXIST 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x564322203e90 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x5643221d1d30 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221fdfd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.841243s 2024-09-22T09:04:49.923 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x564322203e90 auth_method 0 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): get_auth_request con 0x5643221fdfd0 auth_method 0 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:04:49.580+0000 7fd0871f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.924 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221d1d30 auth_method 0 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:04:49.580+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient(hunting): handle_auth_done global_id 6236 payload 274 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:04:49.580+0000 7fd0869f5640 1 monclient: found mon.noname-c 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:04:49.580+0000 7fd0869f5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: dump: 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.925 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.926 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:04:49.580+0000 7fcf6affd640 10 monclient: dump: 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:04:49.580+0000 7fd08970c800 5 monclient: authenticate success, global_id 6236 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:04:49.580+0000 7fd08970c800 10 monclient: get_monmap_and_config success 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:04:49.580+0000 7fd08970c800 4 set_mon_vals no callback set 2024-09-22T09:04:49.927 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: shutdown 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: build_initial_monmap 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 build_initial for_mkfs: 0 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: monmap: 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.928 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding auth protocol: cephx 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: crc 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221b5670) adding con mode: secure 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:04:49.581+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: starting msgr at 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: starting objecter 2024-09-22T09:04:49.929 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 asok(0x564321f150f0) register_command objecter_requests cmddesc objecter_requests hook 0x5643221ffbd0 EEXIST 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: setting wanted keys 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:04:49.581+0000 7fd08970c800 1 librados: calling monclient init 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:04:49.581+0000 7fd08970c800 10 monclient: init 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding auth protocol: cephx 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.930 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: crc 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:04:49.581+0000 7fd08970c800 5 AuthRegistry(0x5643221cfb80) adding con mode: secure 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:04:49.582+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:04:49.582+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:04:49.582+0000 7fd08970c800 5 asok(0x564321f150f0) register_command rotate-key cmddesc rotate-key hook 0x5643221cfcc8 EEXIST 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient: _reopen_session rank -1 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-c con 0x5643221d1d30 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-a con 0x5643221fdfd0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): picked mon.noname-b con 0x564322203e90 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.931 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): start opening mon connection 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): _renew_subs 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:04:49.582+0000 7fd08970c800 10 monclient(hunting): authenticate will time out at 2187.843363s 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): get_auth_request con 0x5643221fdfd0 auth_method 0 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): get_auth_request con 0x5643221d1d30 auth_method 0 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:04:49.932 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:04:49.582+0000 7fd0869f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient(hunting): handle_auth_done global_id 6630 payload 824 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient: _finish_hunting 0 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:04:49.582+0000 7fd0879f7640 1 monclient: found mon.noname-a 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:04:49.582+0000 7fd0879f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:04:49.582+0000 7fd0871f6640 10 monclient: get_auth_request con 0x564322203e90 auth_method 0 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: dump: 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.933 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: _finish_auth 0 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: _check_auth_tickets 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:04:49.582+0000 7fcf697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:04:49.583+0000 7fcf697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:04:49.583+0000 7fcf697fa640 10 monclient: dump: 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:04:49.934 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:04:49.583+0000 7fd08970c800 5 monclient: authenticate success, global_id 6630 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:04:49.582+0000 7fcf6affd640 4 set_mon_vals no callback set 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _renew_subs 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:04:49.583+0000 7fd08970c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:04:49.583+0000 7fd08970c800 1 librados: init done 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:04:49.583+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cr dump hook 0x5643221fa5c8 2024-09-22T09:04:49.935 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:04:49.584+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:04:49.585+0000 7fcf697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:04:49.585+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fcf54077570 auth_method 0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:04:49.585+0000 7fd0871f6640 10 monclient: get_auth_request con 0x56432221fcc0 auth_method 0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 realm 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:04:49.586+0000 7fd08970c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:04:49.586+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.936 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:04:49.587+0000 7fd0869f5640 10 monclient: get_auth_request con 0x564322223e40 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:04:49.587+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:04:49.587+0000 7fd0879f7640 10 monclient: get_auth_request con 0x5643222276a0 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:04:49.588+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:04:49.588+0000 7fd08970c800 20 searching for the correct realm 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:04:49.588+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fd08008f040 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:04:49.589+0000 7fd0869f5640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd078066250 msgr2=0x7fd078064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:04:49.790+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fd078066250 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:04:49.791+0000 7fd0879f7640 10 monclient: get_auth_request con 0x7fd070028030 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:04:49.793+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fd080082060 auth_method 0 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:04:49.794+0000 7fd0871f6640 0 -- 172.21.15.39:0/2794824747 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fd08008f040 msgr2=0x7fd080007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:04:49.794+0000 7fcf697fa640 1 client.6630.objecter ms_handle_reset 0x7fd08008f040 session 0x7fd080071040 osd.7 2024-09-22T09:04:49.937 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:04:49.794+0000 7fcf697fa640 10 monclient: _renew_subs 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:04:49.794+0000 7fcf697fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:04:49.794+0000 7fd0871f6640 10 monclient: get_auth_request con 0x7fcf54087cf0 auth_method 0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:04:49.795+0000 7fd0869f5640 10 monclient: get_auth_request con 0x7fd08004e0c0 auth_method 0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:04:49.800+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.938 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 zone default found 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 Realm: () 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:04:49.801+0000 7fd08970c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:04:49.801+0000 7fd08970c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 zonegroup default 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:04:49.801+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 started sync module instance, tier type = 2024-09-22T09:04:49.939 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:04:49.802+0000 7fd08970c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=0 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=1 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=2 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=3 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=4 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=5 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:04:49.813+0000 7fd08970c800 20 add_watcher() i=6 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:04:49.814+0000 7fd08970c800 20 add_watcher() i=7 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:04:49.814+0000 7fd08970c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding auth protocol: cephx 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.940 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: crc 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 AuthRegistry(0x7ffc10c09160) adding con mode: secure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:04:49.816+0000 7fcf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:04:49.816+0000 7fd08970c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache list hook 0x5643221f8870 2024-09-22T09:04:49.941 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache inspect hook 0x5643221f8870 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache erase hook 0x5643221f8870 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command cache zap hook 0x5643221f8870 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 note: GC not initialized 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:04:49.816+0000 7fcf38fe1640 20 reqs_thread_entry: start 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace show hook 0x7fd08001c4b0 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace history hook 0x7fd08001c4b0 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace active hook 0x7fd08001c4b0 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:04:49.816+0000 7fd08970c800 5 asok(0x564321f150f0) register_command sync trace active_short hook 0x7fd08001c4b0 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:04:49.816+0000 7fd08970c800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 Filter name: none 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:04:49.817+0000 7fceb27fc640 20 reqs_thread_entry: start 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:49.942 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:04:49.817+0000 7fd08970c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : miss 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:04:49.817+0000 7fd08970c800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:04:49.818+0000 7fd08970c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:04:49.818+0000 7fd08970c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:04:49.821+0000 7fd08970c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd08970c800 time 2024-09-22T09:04:49.822796+0000 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.943 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd08cb8c748] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:04:49.822+0000 7fd08970c800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fd08970c800 thread_name:radosgw-admin 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:04:49.944 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd08b83e6f0] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd08b88b99c] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd08cb8c7a2] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fd08cb8c906] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56431fbb3e01] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd80c08) [0x5643200c5c08] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56431fbc3c9d] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd08b829590] 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:04:49.945 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:04:49.946 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:04:49.947 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:04:49.948 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:04:49.949 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:04:49.950 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:04:49.951 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fceb27fc640 / http_manager 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf38fe1640 / http_manager 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf39fe3640 / rgw_dt_lg_renew 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf697fa640 / ms_dispatch 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf6affd640 / io_context_pool 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf71602640 / ms_dispatch 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf73e07640 / ms_dispatch 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fcf7560a640 / io_context_pool 2024-09-22T09:04:49.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0861f4640 / io_context_pool 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0869f5640 / msgr-worker-2 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0871f6640 / msgr-worker-1 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0879f7640 / msgr-worker-0 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd0881f8640 / io_context_pool 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7fd08970c800 / radosgw-admin 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:04:49.824443Z_cffed89c-13e7-4a53-81e3-50ba34b99431/log 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:04:49.953 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T09:04:49.955 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.901+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 realm 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.904+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.905+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.905+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.906+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.906+0000 7fb3ce20e800 20 searching for the correct realm 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.908+0000 7fb3ca0cc640 0 -- 172.21.15.39:0/831667513 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb3c0031070 msgr2=0x7fb3c0048440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:04:49.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:49.912+0000 7fb3c90ca640 0 -- 172.21.15.39:0/831667513 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb3c40cdb80 msgr2=0x7fb3c40bd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:50.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:50.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:50.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.118+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.119+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.119+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.119+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:50.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.119+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 zone default found 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 4 Realm: () 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 zonegroup default 2024-09-22T09:04:50.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 started sync module instance, tier type = 2024-09-22T09:04:50.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.120+0000 7fb3ce20e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=0 2024-09-22T09:04:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=1 2024-09-22T09:04:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=2 2024-09-22T09:04:50.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=3 2024-09-22T09:04:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=4 2024-09-22T09:04:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=5 2024-09-22T09:04:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.131+0000 7fb3ce20e800 20 add_watcher() i=6 2024-09-22T09:04:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.132+0000 7fb3ce20e800 20 add_watcher() i=7 2024-09-22T09:04:50.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.132+0000 7fb3ce20e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:50.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.134+0000 7fb27b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.134+0000 7fb3ce20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.134+0000 7fb3ce20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.134+0000 7fb3ce20e800 5 note: GC not initialized 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.134+0000 7fb27a7fc640 20 reqs_thread_entry: start 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb3ce20e800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:50.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb3ce20e800 20 Filter name: none 2024-09-22T09:04:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb1ebfff640 20 reqs_thread_entry: start 2024-09-22T09:04:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.135+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.136+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.136+0000 7fb3ce20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.136+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.136+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.136+0000 7fb3ce20e800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.137+0000 7fb3ce20e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:50.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.137+0000 7fb3ce20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:04:50.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.138+0000 7fb27b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:50.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.141+0000 7fb3ce20e800 20 remove_watcher() i=0 2024-09-22T09:04:50.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.141+0000 7fb3ce20e800 2 removed watcher, disabling cache 2024-09-22T09:04:50.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.142+0000 7fb3ce20e800 20 remove_watcher() i=1 2024-09-22T09:04:50.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.143+0000 7fb3ce20e800 20 remove_watcher() i=2 2024-09-22T09:04:50.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.144+0000 7fb3ce20e800 20 remove_watcher() i=3 2024-09-22T09:04:50.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.145+0000 7fb3ce20e800 20 remove_watcher() i=4 2024-09-22T09:04:50.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.146+0000 7fb3ce20e800 20 remove_watcher() i=5 2024-09-22T09:04:50.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.147+0000 7fb3ce20e800 20 remove_watcher() i=6 2024-09-22T09:04:50.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.148+0000 7fb3ce20e800 20 remove_watcher() i=7 2024-09-22T09:04:50.162 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:50.162 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:04:50.162 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:04:50.162 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:04:50.163 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:50.164 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:50.195 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:04:50.195 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:04:50.253 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:04:50.286 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:04:50.286 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:04:50.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.323+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 realm 2024-09-22T09:04:50.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:04:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.325+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.326+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:50.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.326+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.327+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:04:50.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.327+0000 7f21983ad800 20 searching for the correct realm 2024-09-22T09:04:50.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.329+0000 7f2196698640 0 -- 172.21.15.39:0/499526146 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f218c086030 msgr2=0x7f218c079920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:50.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.536+0000 7f2195696640 0 -- 172.21.15.39:0/499526146 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2190057960 msgr2=0x7f2190096040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.742+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 zone default found 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 4 Realm: () 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 zonegroup default 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.743+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:04:50.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 started sync module instance, tier type = 2024-09-22T09:04:50.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.744+0000 7f21983ad800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=0 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=1 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=2 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=3 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=4 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=5 2024-09-22T09:04:50.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.755+0000 7f21983ad800 20 add_watcher() i=6 2024-09-22T09:04:50.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.756+0000 7f21983ad800 20 add_watcher() i=7 2024-09-22T09:04:50.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.756+0000 7f21983ad800 2 all 8 watchers are set, enabling cache 2024-09-22T09:04:50.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.757+0000 7f20477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:50.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:04:50.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 5 note: GC not initialized 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f20467fc640 20 reqs_thread_entry: start 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 20 init_complete bucket index max shards: 1 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 20 Filter name: none 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f1fb7fff640 20 reqs_thread_entry: start 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.758+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.759+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.759+0000 7f21983ad800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T09:04:50.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.759+0000 7f21983ad800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T09:04:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.759+0000 7f21983ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : miss 2024-09-22T09:04:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.759+0000 7f21983ad800 20 rados->read ofs=0 len=0 2024-09-22T09:04:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:04:50.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:04:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:04:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:04:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:04:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.760+0000 7f21983ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:04:50.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.761+0000 7f21983ad800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to be held by another RGW process; skipping for now 2024-09-22T09:04:50.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.762+0000 7f20477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:04:50.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.764+0000 7f21983ad800 20 remove_watcher() i=0 2024-09-22T09:04:50.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.764+0000 7f21983ad800 2 removed watcher, disabling cache 2024-09-22T09:04:50.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.765+0000 7f21983ad800 20 remove_watcher() i=1 2024-09-22T09:04:50.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.766+0000 7f21983ad800 20 remove_watcher() i=2 2024-09-22T09:04:50.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.767+0000 7f21983ad800 20 remove_watcher() i=3 2024-09-22T09:04:50.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.769+0000 7f21983ad800 20 remove_watcher() i=4 2024-09-22T09:04:50.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.770+0000 7f21983ad800 20 remove_watcher() i=5 2024-09-22T09:04:50.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.770+0000 7f21983ad800 20 remove_watcher() i=6 2024-09-22T09:04:50.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:04:50.771+0000 7f21983ad800 20 remove_watcher() i=7 2024-09-22T09:04:50.784 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:05:20.814 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:05:20.850 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:20.850 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:20.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.895+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:20.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.896+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.896+0000 7f8c2061d800 20 realm 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.896+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.897+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.897+0000 7f8c2061d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.897+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:20.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.897+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:20.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.897+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:20.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.898+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:20.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.898+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:20.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.899+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:20.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.899+0000 7f8c2061d800 20 searching for the correct realm 2024-09-22T09:05:20.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:20.902+0000 7f8c1c5ec640 0 -- 172.21.15.39:0/1471366225 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8c100cd060 msgr2=0x7f8c100d1aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:21.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.109+0000 7f8c1b5ea640 0 -- 172.21.15.39:0/1471366225 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8c14083130 msgr2=0x7f8c140838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.316+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 zone default found 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 4 Realm: () 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 zonegroup default 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.317+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.318+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.318+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.318+0000 7f8c2061d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.318+0000 7f8c2061d800 20 started sync module instance, tier type = 2024-09-22T09:05:21.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.318+0000 7f8c2061d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=0 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=1 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=2 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=3 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=4 2024-09-22T09:05:21.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=5 2024-09-22T09:05:21.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.330+0000 7f8c2061d800 20 add_watcher() i=6 2024-09-22T09:05:21.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.331+0000 7f8c2061d800 20 add_watcher() i=7 2024-09-22T09:05:21.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.331+0000 7f8c2061d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:21.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.333+0000 7f8ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 5 note: GC not initialized 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8ad0fe1640 20 reqs_thread_entry: start 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 20 Filter name: none 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8a4a7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-22T09:05:21.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.334+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:05:21.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-22T09:05:21.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : miss 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.338 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.335+0000 7f8c2061d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:05:21.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8c2061d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8c2061d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8c2061d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8c2061d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24, ofs0, ns] 2024-09-22T09:05:21.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94396128985120 notifier 6287 bl.length()=925 2024-09-22T09:05:21.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.340+0000 7f8afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.342+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_sources= new_sources= 2024-09-22T09:05:21.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.342+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential sources added=[] removed=[] 2024-09-22T09:05:21.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.342+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_dests= new_dests= 2024-09-22T09:05:21.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.342+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential dests added=[] removed=[] 2024-09-22T09:05:21.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.345+0000 7f8c2061d800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.1.0 2024-09-22T09:05:21.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.345+0000 7f8c2061d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.1.0 2024-09-22T09:05:21.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.345+0000 7f8c2061d800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.1.1 2024-09-22T09:05:21.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.345+0000 7f8c2061d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.1.1 2024-09-22T09:05:21.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.345+0000 7f8c2061d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.0 2024-09-22T09:05:21.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.348+0000 7f8c2061d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : hit (requested=0x17, cached=0x17) 2024-09-22T09:05:21.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.348+0000 7f8c2061d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:05:21.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.349+0000 7f8c2061d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.349+0000 7f8c2061d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.349+0000 7f8c2061d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.349+0000 7f8c2061d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24, ofs0, ns] 2024-09-22T09:05:21.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.349+0000 7f8afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94396128985120 notifier 6287 bl.length()=925 2024-09-22T09:05:21.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.350+0000 7f8afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.350+0000 7f8afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.350+0000 7f8afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.351+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_sources= new_sources= 2024-09-22T09:05:21.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.351+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential sources added=[] removed=[] 2024-09-22T09:05:21.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.351+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_dests= new_dests= 2024-09-22T09:05:21.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.351+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential dests added=[] removed=[] 2024-09-22T09:05:21.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.353+0000 7f8c2061d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.24.0 2024-09-22T09:05:21.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.353+0000 7f8c2061d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 : hit (requested=0x17, cached=0x17) 2024-09-22T09:05:21.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.353+0000 7f8c2061d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 2024-09-22T09:05:21.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8c2061d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8c2061d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8c2061d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8c2061d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24, ofs0, ns] 2024-09-22T09:05:21.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8afaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94396128985120 notifier 6287 bl.length()=893 2024-09-22T09:05:21.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8afaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 info.flags=0x17 2024-09-22T09:05:21.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8afaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 to cache LRU end 2024-09-22T09:05:21.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.355+0000 7f8afaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:21.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.357+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_sources= new_sources= 2024-09-22T09:05:21.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.357+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential sources added=[] removed=[] 2024-09-22T09:05:21.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.357+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): orig_dests= new_dests= 2024-09-22T09:05:21.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.357+0000 7f8c2061d800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.24]): potential dests added=[] removed=[] 2024-09-22T09:05:21.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.359+0000 7f8c2061d800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:05:21.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.361+0000 7f8ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:21.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.364+0000 7f8c2061d800 20 remove_watcher() i=0 2024-09-22T09:05:21.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.364+0000 7f8c2061d800 2 removed watcher, disabling cache 2024-09-22T09:05:21.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.365+0000 7f8c2061d800 20 remove_watcher() i=1 2024-09-22T09:05:21.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.366+0000 7f8c2061d800 20 remove_watcher() i=2 2024-09-22T09:05:21.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.367+0000 7f8c2061d800 20 remove_watcher() i=3 2024-09-22T09:05:21.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.368+0000 7f8c2061d800 20 remove_watcher() i=4 2024-09-22T09:05:21.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.370+0000 7f8c2061d800 20 remove_watcher() i=5 2024-09-22T09:05:21.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.371+0000 7f8c2061d800 20 remove_watcher() i=6 2024-09-22T09:05:21.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.372+0000 7f8c2061d800 20 remove_watcher() i=7 2024-09-22T09:05:21.387 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-22T09:05:21.418 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:21.419 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:21.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.459+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 realm 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:21.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.461+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.462+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:21.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.462+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.463+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:21.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.463+0000 7f6b3fc87800 20 searching for the correct realm 2024-09-22T09:05:21.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.465+0000 7f6b3df72640 0 -- 172.21.15.39:0/211647361 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6b28094940 msgr2=0x7f6b28089420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:21.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.671+0000 7f6b3cf70640 0 -- 172.21.15.39:0/211647361 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f6b3005d8d0 msgr2=0x7f6b30060c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:21.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.878+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.879+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.879+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.879+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:21.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.879+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:21.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 zone default found 2024-09-22T09:05:21.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 4 Realm: () 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 zonegroup default 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.880+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.881+0000 7f6b3fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:21.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.881+0000 7f6b3fc87800 20 started sync module instance, tier type = 2024-09-22T09:05:21.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.881+0000 7f6b3fc87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:21.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=0 2024-09-22T09:05:21.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=1 2024-09-22T09:05:21.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=2 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=3 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=4 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=5 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.891+0000 7f6b3fc87800 20 add_watcher() i=6 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.892+0000 7f6b3fc87800 20 add_watcher() i=7 2024-09-22T09:05:21.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.892+0000 7f6b3fc87800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.894+0000 7f69f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.894+0000 7f6b3fc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.894+0000 7f6b3fc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.894+0000 7f6b3fc87800 5 note: GC not initialized 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.894+0000 7f69f27e4640 20 reqs_thread_entry: start 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6b3fc87800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6b3fc87800 20 Filter name: none 2024-09-22T09:05:21.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6963fff640 20 reqs_thread_entry: start 2024-09-22T09:05:21.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:05:21.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.895+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.896+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:05:21.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.896+0000 7f6b3fc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:21.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.896+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.896+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=194 2024-09-22T09:05:21.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.896+0000 7f6b3fc87800 20 rados->read ofs=0 len=0 2024-09-22T09:05:21.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.897+0000 7f6b3fc87800 20 rados_obj.operate() r=0 bl.length=416 2024-09-22T09:05:21.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.897+0000 7f6b3fc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:21.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.898+0000 7f69f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:21.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.901+0000 7f6b3fc87800 20 remove_watcher() i=0 2024-09-22T09:05:21.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.901+0000 7f6b3fc87800 2 removed watcher, disabling cache 2024-09-22T09:05:21.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.902+0000 7f6b3fc87800 20 remove_watcher() i=1 2024-09-22T09:05:21.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.903+0000 7f6b3fc87800 20 remove_watcher() i=2 2024-09-22T09:05:21.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.904+0000 7f6b3fc87800 20 remove_watcher() i=3 2024-09-22T09:05:21.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.906+0000 7f6b3fc87800 20 remove_watcher() i=4 2024-09-22T09:05:21.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.907+0000 7f6b3fc87800 20 remove_watcher() i=5 2024-09-22T09:05:21.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.908+0000 7f6b3fc87800 20 remove_watcher() i=6 2024-09-22T09:05:21.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:21.909+0000 7f6b3fc87800 20 remove_watcher() i=7 2024-09-22T09:05:21.922 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:21.922 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:21.922 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-set-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:05:21.922 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:21.924 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:21.924 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:21.945 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:21.945 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.135 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.135 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.199 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-22T09:05:22.200 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:22.201 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.201 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.242 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.243 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.300 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.300 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.338 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.338 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.372 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.373 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.406 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.406 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.440 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.440 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.475 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.475 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.510 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.510 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.544 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.545 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.578 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.578 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.612 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.612 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.646 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.646 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.680 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.680 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.714 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.714 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.749 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.749 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.783 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.783 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.852 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.852 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.887 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.887 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.925 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.925 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.958 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.959 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:22.992 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:22.992 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:23.026 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T09:05:23.055 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:23.057 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:23.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.093+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 20 realm 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:23.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.095+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.096+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.096+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.097+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:23.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.097+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.097+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:23.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.097+0000 7f2cdc32c800 20 searching for the correct realm 2024-09-22T09:05:23.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.100+0000 7f2cd8850640 0 -- 172.21.15.39:0/386551356 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f2cc0040bf0 msgr2=0x7f2cc006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:23.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.306+0000 7f2cd784e640 0 -- 172.21.15.39:0/386551356 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2cd0061040 msgr2=0x7f2cd0061930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:23.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.514+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 zone default found 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 4 Realm: () 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 zonegroup default 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.515+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.516+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.516+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.516+0000 7f2cdc32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.516+0000 7f2cdc32c800 20 started sync module instance, tier type = 2024-09-22T09:05:23.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.516+0000 7f2cdc32c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=0 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=1 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=2 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=3 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=4 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=5 2024-09-22T09:05:23.527 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.526+0000 7f2cdc32c800 20 add_watcher() i=6 2024-09-22T09:05:23.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.527+0000 7f2cdc32c800 20 add_watcher() i=7 2024-09-22T09:05:23.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.527+0000 7f2cdc32c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:23.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2b8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2cdc32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2cdc32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2cdc32c800 5 note: GC not initialized 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2b8dfdb640 20 reqs_thread_entry: start 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2cdc32c800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2cdc32c800 20 Filter name: none 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.529+0000 7f2aff7fe640 20 reqs_thread_entry: start 2024-09-22T09:05:23.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.530+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.530+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:23.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.530+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.531+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.531+0000 7f2cdc32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.531+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.531+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.531+0000 7f2cdc32c800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.532+0000 7f2cdc32c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:23.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.532+0000 7f2cdc32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:23.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.533+0000 7f2b8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:23.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.535+0000 7f2cdc32c800 20 remove_watcher() i=0 2024-09-22T09:05:23.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.535+0000 7f2cdc32c800 2 removed watcher, disabling cache 2024-09-22T09:05:23.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.536+0000 7f2cdc32c800 20 remove_watcher() i=1 2024-09-22T09:05:23.539 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.538+0000 7f2cdc32c800 20 remove_watcher() i=2 2024-09-22T09:05:23.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.539+0000 7f2cdc32c800 20 remove_watcher() i=3 2024-09-22T09:05:23.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.540+0000 7f2cdc32c800 20 remove_watcher() i=4 2024-09-22T09:05:23.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.541+0000 7f2cdc32c800 20 remove_watcher() i=5 2024-09-22T09:05:23.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.542+0000 7f2cdc32c800 20 remove_watcher() i=6 2024-09-22T09:05:23.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.543+0000 7f2cdc32c800 20 remove_watcher() i=7 2024-09-22T09:05:23.555 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:23.556 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:23.556 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:05:23.556 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:23.557 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-22T09:05:23.592 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:23.593 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:23.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.631+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 20 realm 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.633+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.634+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:23.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.634+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.635+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:23.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.635+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:23.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.635+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:23.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.635+0000 7f10e7975800 20 searching for the correct realm 2024-09-22T09:05:23.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.637+0000 7f10e5c60640 0 -- 172.21.15.39:0/559730116 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f10dc084070 msgr2=0x7f10dc0767b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:23.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:23.844+0000 7f10e4c5e640 0 -- 172.21.15.39:0/559730116 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f10e004f920 msgr2=0x7f10e00867a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.051+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.052+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.052+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.052+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.052+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 zone default found 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 4 Realm: () 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 zonegroup default 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.053+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.054+0000 7f10e7975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.054+0000 7f10e7975800 20 started sync module instance, tier type = 2024-09-22T09:05:24.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.054+0000 7f10e7975800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=0 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=1 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=2 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=3 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=4 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=5 2024-09-22T09:05:24.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.064+0000 7f10e7975800 20 add_watcher() i=6 2024-09-22T09:05:24.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.065+0000 7f10e7975800 20 add_watcher() i=7 2024-09-22T09:05:24.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.065+0000 7f10e7975800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:24.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.067+0000 7f0f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.067+0000 7f10e7975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:24.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.067+0000 7f10e7975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:24.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.067+0000 7f10e7975800 5 note: GC not initialized 2024-09-22T09:05:24.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f0f9a7e4640 20 reqs_thread_entry: start 2024-09-22T09:05:24.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f10e7975800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:24.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f10e7975800 20 Filter name: none 2024-09-22T09:05:24.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f0f0bfff640 20 reqs_thread_entry: start 2024-09-22T09:05:24.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f10e7975800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T09:05:24.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.068+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 : miss 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.069+0000 7f10e7975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.073+0000 7f10e7975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.073+0000 7f10e7975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.073+0000 7f10e7975800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.073+0000 7f10e7975800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25, ofs0, ns] 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.074+0000 7f0fc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529693 cookie 94190234839120 notifier 6341 bl.length()=939 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.074+0000 7f0fc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.074+0000 7f0fc8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.074+0000 7f0fc8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_sources= new_sources= 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential sources added=[] removed=[] 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_dests= new_dests= 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential dests added=[] removed=[] 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-22T09:05:24.077 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.076+0000 7f10e7975800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-22T09:05:24.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.078+0000 7f0f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.081+0000 7f10e7975800 20 remove_watcher() i=0 2024-09-22T09:05:24.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.081+0000 7f10e7975800 2 removed watcher, disabling cache 2024-09-22T09:05:24.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.082+0000 7f10e7975800 20 remove_watcher() i=1 2024-09-22T09:05:24.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.084+0000 7f10e7975800 20 remove_watcher() i=2 2024-09-22T09:05:24.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.085+0000 7f10e7975800 20 remove_watcher() i=3 2024-09-22T09:05:24.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.086+0000 7f10e7975800 20 remove_watcher() i=4 2024-09-22T09:05:24.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.087+0000 7f10e7975800 20 remove_watcher() i=5 2024-09-22T09:05:24.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.088+0000 7f10e7975800 20 remove_watcher() i=6 2024-09-22T09:05:24.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.089+0000 7f10e7975800 20 remove_watcher() i=7 2024-09-22T09:05:24.104 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T09:05:24.134 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:24.135 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.173+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 realm 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.176+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.177+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.177+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.178+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:24.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.178+0000 7eff7ad28800 20 searching for the correct realm 2024-09-22T09:05:24.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.179+0000 7eff7626e640 0 -- 172.21.15.39:0/872266629 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7eff6801f060 msgr2=0x7eff680720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.183+0000 7eff7626e640 0 -- 172.21.15.39:0/872266629 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7efe40087cc0 msgr2=0x7efe4008a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:24.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:24.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:24.388 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:24.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:24.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:24.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.387+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 zone default found 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 4 Realm: () 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:24.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 zonegroup default 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.388+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.389+0000 7eff7ad28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.389+0000 7eff7ad28800 20 started sync module instance, tier type = 2024-09-22T09:05:24.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.389+0000 7eff7ad28800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:24.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=0 2024-09-22T09:05:24.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=1 2024-09-22T09:05:24.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=2 2024-09-22T09:05:24.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=3 2024-09-22T09:05:24.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=4 2024-09-22T09:05:24.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=5 2024-09-22T09:05:24.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.399+0000 7eff7ad28800 20 add_watcher() i=6 2024-09-22T09:05:24.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.400+0000 7eff7ad28800 20 add_watcher() i=7 2024-09-22T09:05:24.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.400+0000 7eff7ad28800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:24.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.402+0000 7efe2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.402+0000 7eff7ad28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.402+0000 7eff7ad28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.402+0000 7eff7ad28800 5 note: GC not initialized 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.402+0000 7efda7fff640 20 reqs_thread_entry: start 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7eff7ad28800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7eff7ad28800 20 Filter name: none 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7efda5ffb640 20 reqs_thread_entry: start 2024-09-22T09:05:24.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:24.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.403+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.404+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:24.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.404+0000 7eff7ad28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:24.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.404+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.404+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:24.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.404+0000 7eff7ad28800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.405+0000 7eff7ad28800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:24.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.405+0000 7eff7ad28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:24.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.406+0000 7efe2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.408+0000 7eff7ad28800 20 remove_watcher() i=0 2024-09-22T09:05:24.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.408+0000 7eff7ad28800 2 removed watcher, disabling cache 2024-09-22T09:05:24.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.410+0000 7eff7ad28800 20 remove_watcher() i=1 2024-09-22T09:05:24.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.411+0000 7eff7ad28800 20 remove_watcher() i=2 2024-09-22T09:05:24.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.412+0000 7eff7ad28800 20 remove_watcher() i=3 2024-09-22T09:05:24.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.413+0000 7eff7ad28800 20 remove_watcher() i=4 2024-09-22T09:05:24.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.414+0000 7eff7ad28800 20 remove_watcher() i=5 2024-09-22T09:05:24.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.416+0000 7eff7ad28800 20 remove_watcher() i=6 2024-09-22T09:05:24.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.417+0000 7eff7ad28800 20 remove_watcher() i=7 2024-09-22T09:05:24.429 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:24.429 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:24.429 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:05:24.429 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:24.431 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:24.431 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:24.462 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:24.463 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:24.521 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:05:24.553 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:24.553 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:24.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.593+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.594+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.594+0000 7f6366123800 20 realm 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.594+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.595+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.595+0000 7f6366123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.595+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.595+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.595+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.596+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.596+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.597+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:24.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.597+0000 7f6366123800 20 searching for the correct realm 2024-09-22T09:05:24.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.599+0000 7f6361532640 0 -- 172.21.15.39:0/98773020 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f6354039040 msgr2=0x7f635402a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.602+0000 7f6361532640 0 -- 172.21.15.39:0/98773020 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f622c087cf0 msgr2=0x7f622c08a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.608+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 zone default found 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 4 Realm: () 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 zonegroup default 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.609+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.610+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.610+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.610+0000 7f6366123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.610+0000 7f6366123800 20 started sync module instance, tier type = 2024-09-22T09:05:24.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.610+0000 7f6366123800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=0 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=1 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=2 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=3 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=4 2024-09-22T09:05:24.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=5 2024-09-22T09:05:24.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.620+0000 7f6366123800 20 add_watcher() i=6 2024-09-22T09:05:24.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.621+0000 7f6366123800 20 add_watcher() i=7 2024-09-22T09:05:24.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.621+0000 7f6366123800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:24.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f62137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 5 note: GC not initialized 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f62127fc640 20 reqs_thread_entry: start 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 20 Filter name: none 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6183fff640 20 reqs_thread_entry: start 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.623+0000 7f6366123800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T09:05:24.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 : miss 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.624+0000 7f6366123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 2024-09-22T09:05:24.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.626+0000 7f6366123800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f6366123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f6366123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f6366123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f6366123800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25, ofs0, ns] 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f62457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529694 cookie 94564901640640 notifier 6789 bl.length()=939 2024-09-22T09:05:24.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f62457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f62457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.630+0000 7f62457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.632+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_sources= new_sources= 2024-09-22T09:05:24.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.632+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential sources added=[] removed=[] 2024-09-22T09:05:24.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.632+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_dests= new_dests= 2024-09-22T09:05:24.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.632+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential dests added=[] removed=[] 2024-09-22T09:05:24.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.634+0000 7f6366123800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.2.0 2024-09-22T09:05:24.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.634+0000 7f6366123800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.2.0 2024-09-22T09:05:24.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.634+0000 7f6366123800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.2.1 2024-09-22T09:05:24.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.634+0000 7f6366123800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.2.1 2024-09-22T09:05:24.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.634+0000 7f6366123800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.0 2024-09-22T09:05:24.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.636+0000 7f6366123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 : hit (requested=0x17, cached=0x17) 2024-09-22T09:05:24.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.636+0000 7f6366123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.637+0000 7f6366123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.637+0000 7f6366123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.637+0000 7f6366123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.637+0000 7f6366123800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25, ofs0, ns] 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.638+0000 7f62457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529695 cookie 94564901640640 notifier 6789 bl.length()=939 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.638+0000 7f62457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.638+0000 7f62457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.638+0000 7f62457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.639+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_sources= new_sources= 2024-09-22T09:05:24.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.639+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential sources added=[] removed=[] 2024-09-22T09:05:24.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.639+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_dests= new_dests= 2024-09-22T09:05:24.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.639+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential dests added=[] removed=[] 2024-09-22T09:05:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.640+0000 7f6366123800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.25.0 2024-09-22T09:05:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.641+0000 7f6366123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 : hit (requested=0x17, cached=0x17) 2024-09-22T09:05:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.641+0000 7f6366123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 2024-09-22T09:05:24.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f6366123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f6366123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f6366123800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f6366123800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25, ofs0, ns] 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f62457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529696 cookie 94564901640640 notifier 6789 bl.length()=907 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f62457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 info.flags=0x17 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f62457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 to cache LRU end 2024-09-22T09:05:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.642+0000 7f62457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:24.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.644+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_sources= new_sources= 2024-09-22T09:05:24.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.644+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential sources added=[] removed=[] 2024-09-22T09:05:24.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.644+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): orig_dests= new_dests= 2024-09-22T09:05:24.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.644+0000 7f6366123800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.25]): potential dests added=[] removed=[] 2024-09-22T09:05:24.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.645+0000 7f6366123800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-22T09:05:24.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.647+0000 7f62137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:24.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.649+0000 7f6366123800 20 remove_watcher() i=0 2024-09-22T09:05:24.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.649+0000 7f6366123800 2 removed watcher, disabling cache 2024-09-22T09:05:24.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.651+0000 7f6366123800 20 remove_watcher() i=1 2024-09-22T09:05:24.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.652+0000 7f6366123800 20 remove_watcher() i=2 2024-09-22T09:05:24.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.653+0000 7f6366123800 20 remove_watcher() i=3 2024-09-22T09:05:24.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.654+0000 7f6366123800 20 remove_watcher() i=4 2024-09-22T09:05:24.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.655+0000 7f6366123800 20 remove_watcher() i=5 2024-09-22T09:05:24.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.656+0000 7f6366123800 20 remove_watcher() i=6 2024-09-22T09:05:24.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.657+0000 7f6366123800 20 remove_watcher() i=7 2024-09-22T09:05:24.671 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T09:05:24.700 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:24.701 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:24.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.738+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.740+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.740+0000 7fe150b3e800 20 realm 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.740+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.741+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.741+0000 7fe150b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.741+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.741+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:24.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.741+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.742+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:24.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.742+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:24.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.742+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:24.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.742+0000 7fe150b3e800 20 searching for the correct realm 2024-09-22T09:05:24.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.744+0000 7fe14d0ee640 0 -- 172.21.15.39:0/3352682239 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe134094000 msgr2=0x7fe1340ba650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:24.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:24.950+0000 7fe14c0ec640 0 -- 172.21.15.39:0/3352682239 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe14406b2a0 msgr2=0x7fe144069410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:25.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:25.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.157+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 zone default found 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 4 Realm: () 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 zonegroup default 2024-09-22T09:05:25.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.158+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.159+0000 7fe150b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.159+0000 7fe150b3e800 20 started sync module instance, tier type = 2024-09-22T09:05:25.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.159+0000 7fe150b3e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=0 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=1 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=2 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=3 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=4 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=5 2024-09-22T09:05:25.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.169+0000 7fe150b3e800 20 add_watcher() i=6 2024-09-22T09:05:25.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.170+0000 7fe150b3e800 20 add_watcher() i=7 2024-09-22T09:05:25.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.170+0000 7fe150b3e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:25.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe0037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe150b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe150b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe150b3e800 5 note: GC not initialized 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe0027e4640 20 reqs_thread_entry: start 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe150b3e800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.172+0000 7fe150b3e800 20 Filter name: none 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.173+0000 7fdffbfff640 20 reqs_thread_entry: start 2024-09-22T09:05:25.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.173+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.173+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:25.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.173+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.174+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:25.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.174+0000 7fe150b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:25.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.174+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.174+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:25.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.174+0000 7fe150b3e800 20 rados->read ofs=0 len=0 2024-09-22T09:05:25.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.175+0000 7fe150b3e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:25.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.175+0000 7fe150b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:25.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.176+0000 7fe0037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:25.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.178+0000 7fe150b3e800 20 remove_watcher() i=0 2024-09-22T09:05:25.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.178+0000 7fe150b3e800 2 removed watcher, disabling cache 2024-09-22T09:05:25.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.180+0000 7fe150b3e800 20 remove_watcher() i=1 2024-09-22T09:05:25.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.181+0000 7fe150b3e800 20 remove_watcher() i=2 2024-09-22T09:05:25.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.182+0000 7fe150b3e800 20 remove_watcher() i=3 2024-09-22T09:05:25.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.183+0000 7fe150b3e800 20 remove_watcher() i=4 2024-09-22T09:05:25.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.184+0000 7fe150b3e800 20 remove_watcher() i=5 2024-09-22T09:05:25.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.186+0000 7fe150b3e800 20 remove_watcher() i=6 2024-09-22T09:05:25.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:25.187+0000 7fe150b3e800 20 remove_watcher() i=7 2024-09-22T09:05:25.199 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:25.199 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:25.199 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:05:25.199 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:25.201 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.202 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.223 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.223 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.419 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.419 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.487 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-22T09:05:25.487 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:25.488 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.488 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.531 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.532 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.588 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.588 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.620 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.620 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.654 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.654 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.687 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.687 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.722 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.722 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.755 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.755 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.789 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.789 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.823 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.823 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.857 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.857 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.889 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.889 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.924 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.924 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.957 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.957 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:25.990 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:25.990 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.024 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.024 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.059 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.059 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.092 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.092 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.128 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.128 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.163 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.163 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.198 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.198 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.235 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:26.235 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:26.269 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T09:05:26.298 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:26.298 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:26.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.336+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 realm 2024-09-22T09:05:26.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:26.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.338+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.339+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:26.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.339+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.340+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:26.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.340+0000 7fced4d46800 20 searching for the correct realm 2024-09-22T09:05:26.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.342+0000 7fced3038640 0 -- 172.21.15.39:0/2627277474 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fcebc038030 msgr2=0x7fcebc038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:26.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.548+0000 7fcecbfff640 0 -- 172.21.15.39:0/2627277474 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fcecc090860 msgr2=0x7fcecc08b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.755+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.756+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.756+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.756+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:26.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.756+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:26.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 zone default found 2024-09-22T09:05:26.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 4 Realm: () 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 zonegroup default 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.757+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.758+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.758+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.758+0000 7fced4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.758+0000 7fced4d46800 20 started sync module instance, tier type = 2024-09-22T09:05:26.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.758+0000 7fced4d46800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=0 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=1 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=2 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=3 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=4 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=5 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.768+0000 7fced4d46800 20 add_watcher() i=6 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.769+0000 7fced4d46800 20 add_watcher() i=7 2024-09-22T09:05:26.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.769+0000 7fced4d46800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:26.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.771+0000 7fcd897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:26.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:26.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:26.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 5 note: GC not initialized 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fcd03fff640 20 reqs_thread_entry: start 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 20 Filter name: none 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fcd01ffb640 20 reqs_thread_entry: start 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.772+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.773+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:26.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.773+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.774+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:26.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.774+0000 7fced4d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:26.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.774+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.774+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:26.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.774+0000 7fced4d46800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.775+0000 7fced4d46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:26.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.775+0000 7fced4d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:26.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.776+0000 7fcd897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:26.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.778+0000 7fced4d46800 20 remove_watcher() i=0 2024-09-22T09:05:26.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.778+0000 7fced4d46800 2 removed watcher, disabling cache 2024-09-22T09:05:26.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.780+0000 7fced4d46800 20 remove_watcher() i=1 2024-09-22T09:05:26.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.781+0000 7fced4d46800 20 remove_watcher() i=2 2024-09-22T09:05:26.783 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.782+0000 7fced4d46800 20 remove_watcher() i=3 2024-09-22T09:05:26.784 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.783+0000 7fced4d46800 20 remove_watcher() i=4 2024-09-22T09:05:26.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.784+0000 7fced4d46800 20 remove_watcher() i=5 2024-09-22T09:05:26.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.785+0000 7fced4d46800 20 remove_watcher() i=6 2024-09-22T09:05:26.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.786+0000 7fced4d46800 20 remove_watcher() i=7 2024-09-22T09:05:26.799 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:26.799 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:26.799 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:05:26.799 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:26.800 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-22T09:05:26.838 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:26.838 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:26.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.877+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 realm 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.879+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.880+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.880+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:26.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.881+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:26.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.881+0000 7f4a11d25800 20 searching for the correct realm 2024-09-22T09:05:26.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:26.883+0000 7f4a0e1af640 0 -- 172.21.15.39:0/1748599956 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f4a0406dd50 msgr2=0x7f4a0406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.090+0000 7f4a0d1ad640 0 -- 172.21.15.39:0/1748599956 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f4a08069930 msgr2=0x7f4a080821e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:27.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.297+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 zone default found 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 4 Realm: () 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:27.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 zonegroup default 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.298+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.299+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.299+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.299+0000 7f4a11d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.299+0000 7f4a11d25800 20 started sync module instance, tier type = 2024-09-22T09:05:27.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.299+0000 7f4a11d25800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=0 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=1 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=2 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=3 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=4 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=5 2024-09-22T09:05:27.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.309+0000 7f4a11d25800 20 add_watcher() i=6 2024-09-22T09:05:27.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.310+0000 7f4a11d25800 20 add_watcher() i=7 2024-09-22T09:05:27.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.310+0000 7f4a11d25800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:27.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.311+0000 7f48bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:27.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:27.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:27.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 5 note: GC not initialized 2024-09-22T09:05:27.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f48be7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:27.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:27.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 20 Filter name: none 2024-09-22T09:05:27.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f482ffff640 20 reqs_thread_entry: start 2024-09-22T09:05:27.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-22T09:05:27.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.312+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 : miss 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 info.flags=0x17 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 to cache LRU end 2024-09-22T09:05:27.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:27.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:27.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.313+0000 7f4a11d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 2024-09-22T09:05:27.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.317+0000 7f4a11d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 info.flags=0x17 2024-09-22T09:05:27.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.317+0000 7f4a11d25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 to cache LRU end 2024-09-22T09:05:27.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.317+0000 7f4a11d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:27.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.317+0000 7f4a11d25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26, ofs0, ns] 2024-09-22T09:05:27.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.319+0000 7f48f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94436582669056 notifier 6425 bl.length()=939 2024-09-22T09:05:27.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.319+0000 7f48f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 info.flags=0x17 2024-09-22T09:05:27.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.319+0000 7f48f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 to cache LRU end 2024-09-22T09:05:27.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.319+0000 7f48f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:27.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): orig_sources= new_sources= 2024-09-22T09:05:27.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): potential sources added=[] removed=[] 2024-09-22T09:05:27.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): orig_dests= new_dests= 2024-09-22T09:05:27.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): potential dests added=[] removed=[] 2024-09-22T09:05:27.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-22T09:05:27.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.320+0000 7f4a11d25800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-22T09:05:27.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.322+0000 7f4a11d25800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.26.1.0 2024-09-22T09:05:27.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.322+0000 7f4a11d25800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.26.1.0 2024-09-22T09:05:27.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.322+0000 7f4a11d25800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.26.1.1 2024-09-22T09:05:27.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.322+0000 7f4a11d25800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.26.1.1 2024-09-22T09:05:27.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.322+0000 7f4a11d25800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.26.0 2024-09-22T09:05:27.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.324+0000 7f4a11d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 : hit (requested=0x17, cached=0x17) 2024-09-22T09:05:27.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.324+0000 7f4a11d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 2024-09-22T09:05:27.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.325+0000 7f4a11d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 info.flags=0x17 2024-09-22T09:05:27.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.325+0000 7f4a11d25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 to cache LRU end 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.325+0000 7f4a11d25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.325+0000 7f4a11d25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26, ofs0, ns] 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.326+0000 7f48f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 94436582669056 notifier 6425 bl.length()=907 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.326+0000 7f48f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 info.flags=0x17 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.326+0000 7f48f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 to cache LRU end 2024-09-22T09:05:27.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.326+0000 7f48f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:27.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.327+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): orig_sources= new_sources= 2024-09-22T09:05:27.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.327+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): potential sources added=[] removed=[] 2024-09-22T09:05:27.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.327+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): orig_dests= new_dests= 2024-09-22T09:05:27.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.327+0000 7f4a11d25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.26]): potential dests added=[] removed=[] 2024-09-22T09:05:27.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.328+0000 7f4a11d25800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-22T09:05:27.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.330+0000 7f48bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:27.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.333+0000 7f4a11d25800 20 remove_watcher() i=0 2024-09-22T09:05:27.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.333+0000 7f4a11d25800 2 removed watcher, disabling cache 2024-09-22T09:05:27.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.334+0000 7f4a11d25800 20 remove_watcher() i=1 2024-09-22T09:05:27.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.335+0000 7f4a11d25800 20 remove_watcher() i=2 2024-09-22T09:05:27.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.336+0000 7f4a11d25800 20 remove_watcher() i=3 2024-09-22T09:05:27.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.338+0000 7f4a11d25800 20 remove_watcher() i=4 2024-09-22T09:05:27.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.339+0000 7f4a11d25800 20 remove_watcher() i=5 2024-09-22T09:05:27.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.340+0000 7f4a11d25800 20 remove_watcher() i=6 2024-09-22T09:05:27.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.341+0000 7f4a11d25800 20 remove_watcher() i=7 2024-09-22T09:05:27.355 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-22T09:05:27.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:27.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:27.425 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.423+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 realm 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:27.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:27.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.426+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.427+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:27.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.427+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:27.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.428+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:27.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.428+0000 7f19bcf35800 20 searching for the correct realm 2024-09-22T09:05:27.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.429+0000 7f19b84e3640 0 -- 172.21.15.39:0/235204459 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f19a806b070 msgr2=0x7f19a80a6070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:27.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:27.632+0000 7f19b84e3640 0 -- 172.21.15.39:0/235204459 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f1884087ec0 msgr2=0x7f188408a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:28.042 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.040+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:28.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:28.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 zone default found 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 4 Realm: () 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 zonegroup default 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.041+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.042+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.042+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.042+0000 7f19bcf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.042+0000 7f19bcf35800 20 started sync module instance, tier type = 2024-09-22T09:05:28.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.042+0000 7f19bcf35800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=0 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=1 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=2 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=3 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=4 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=5 2024-09-22T09:05:28.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.053+0000 7f19bcf35800 20 add_watcher() i=6 2024-09-22T09:05:28.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.054+0000 7f19bcf35800 20 add_watcher() i=7 2024-09-22T09:05:28.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.054+0000 7f19bcf35800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:28.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f186efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f19bcf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f19bcf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f19bcf35800 5 note: GC not initialized 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f186dfe3640 20 reqs_thread_entry: start 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f19bcf35800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.056+0000 7f19bcf35800 20 Filter name: none 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.057+0000 7f17df7fe640 20 reqs_thread_entry: start 2024-09-22T09:05:28.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.057+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.057+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.057+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.058+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.058+0000 7f19bcf35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:28.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.058+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.058+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.058+0000 7f19bcf35800 20 rados->read ofs=0 len=0 2024-09-22T09:05:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.059+0000 7f19bcf35800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:28.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.059+0000 7f19bcf35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:28.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.060+0000 7f186efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:28.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.064+0000 7f19bcf35800 20 remove_watcher() i=0 2024-09-22T09:05:28.065 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.064+0000 7f19bcf35800 2 removed watcher, disabling cache 2024-09-22T09:05:28.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.065+0000 7f19bcf35800 20 remove_watcher() i=1 2024-09-22T09:05:28.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.066+0000 7f19bcf35800 20 remove_watcher() i=2 2024-09-22T09:05:28.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.068+0000 7f19bcf35800 20 remove_watcher() i=3 2024-09-22T09:05:28.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.069+0000 7f19bcf35800 20 remove_watcher() i=4 2024-09-22T09:05:28.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.070+0000 7f19bcf35800 20 remove_watcher() i=5 2024-09-22T09:05:28.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.071+0000 7f19bcf35800 20 remove_watcher() i=6 2024-09-22T09:05:28.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:28.072+0000 7f19bcf35800 20 remove_watcher() i=7 2024-09-22T09:05:28.085 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:28.085 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:28.085 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-22T09:05:28.085 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:28.088 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.088 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.109 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.110 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.490 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.490 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.555 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-22T09:05:28.555 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:28.557 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.557 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.599 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.600 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.657 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.657 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.696 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.696 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.729 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.730 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.767 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.767 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.800 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.801 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.833 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.833 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.866 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.867 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.900 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.900 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.934 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.934 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:28.968 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:28.968 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.004 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.004 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.038 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.038 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.071 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.071 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.106 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.106 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.140 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.140 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.173 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.173 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.207 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.207 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.243 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.243 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.277 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.277 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.310 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:29.310 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:29.345 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T09:05:29.374 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:29.374 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:29.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.412+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 realm 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.414+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.415+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:29.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.415+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.416+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:29.417 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.416+0000 7fd2eff40800 20 searching for the correct realm 2024-09-22T09:05:29.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.418+0000 7fd2eb4bf640 0 -- 172.21.15.39:0/3520495378 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd2dc070ad0 msgr2=0x7fd2dc0583e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:29.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.421+0000 7fd2eb4bf640 0 -- 172.21.15.39:0/3520495378 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd1b4087c90 msgr2=0x7fd1b408a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.426+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:29.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 zone default found 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 4 Realm: () 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 zonegroup default 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.427+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 started sync module instance, tier type = 2024-09-22T09:05:29.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.428+0000 7fd2eff40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:29.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=0 2024-09-22T09:05:29.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=1 2024-09-22T09:05:29.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=2 2024-09-22T09:05:29.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=3 2024-09-22T09:05:29.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=4 2024-09-22T09:05:29.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=5 2024-09-22T09:05:29.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.438+0000 7fd2eff40800 20 add_watcher() i=6 2024-09-22T09:05:29.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.439+0000 7fd2eff40800 20 add_watcher() i=7 2024-09-22T09:05:29.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.439+0000 7fd2eff40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:29.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd1a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd2eff40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd2eff40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd2eff40800 5 note: GC not initialized 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd1a0fe1640 20 reqs_thread_entry: start 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.441+0000 7fd2eff40800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.442+0000 7fd2eff40800 20 Filter name: none 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.442+0000 7fd11a7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:29.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.442+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.442+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:29.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.442+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.443+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.443+0000 7fd2eff40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.443+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.443+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.443+0000 7fd2eff40800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.444+0000 7fd2eff40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:29.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.444+0000 7fd2eff40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:29.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.445+0000 7fd1a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:29.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.447+0000 7fd2eff40800 20 remove_watcher() i=0 2024-09-22T09:05:29.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.447+0000 7fd2eff40800 2 removed watcher, disabling cache 2024-09-22T09:05:29.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.448+0000 7fd2eff40800 20 remove_watcher() i=1 2024-09-22T09:05:29.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.449+0000 7fd2eff40800 20 remove_watcher() i=2 2024-09-22T09:05:29.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.451+0000 7fd2eff40800 20 remove_watcher() i=3 2024-09-22T09:05:29.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.452+0000 7fd2eff40800 20 remove_watcher() i=4 2024-09-22T09:05:29.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.453+0000 7fd2eff40800 20 remove_watcher() i=5 2024-09-22T09:05:29.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.454+0000 7fd2eff40800 20 remove_watcher() i=6 2024-09-22T09:05:29.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.455+0000 7fd2eff40800 20 remove_watcher() i=7 2024-09-22T09:05:29.467 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:29.467 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:29.467 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:05:29.467 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:29.469 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-22T09:05:29.503 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:29.504 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:29.545 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.544+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 realm 2024-09-22T09:05:29.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:29.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.547+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:29.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.547+0000 7f58c160f800 20 searching for the correct realm 2024-09-22T09:05:29.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.549+0000 7f58bf901640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f58b402e060 msgr2=0x7f58b4066790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:29.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.754+0000 7f58be8ff640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f58b8089910 msgr2=0x7f58b80890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.961+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:29.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 zone default found 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 4 Realm: () 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 zonegroup default 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.964+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:29.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.964+0000 7f58c160f800 20 started sync module instance, tier type = 2024-09-22T09:05:29.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.964+0000 7f58c160f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=0 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=1 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=2 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=3 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=4 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=5 2024-09-22T09:05:29.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=6 2024-09-22T09:05:29.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.976+0000 7f58c160f800 20 add_watcher() i=7 2024-09-22T09:05:29.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.976+0000 7f58c160f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:29.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f5775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f58c160f800 5 note: GC not initialized 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f5774fe1640 20 reqs_thread_entry: start 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f58c160f800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.978+0000 7f58c160f800 20 Filter name: none 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f56ee7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T09:05:29.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : miss 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:29.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:29.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:29.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.980+0000 7f58c160f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:05:29.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:29.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f58c160f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:29.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:29.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f58c160f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:05:29.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94124066927696 notifier 6903 bl.length()=939 2024-09-22T09:05:29.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:29.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:29.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:29.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58c160f800 time 2024-09-22T09:05:29.987638+0000 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58c4b8c748] 2024-09-22T09:05:29.988 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.987+0000 7f58c160f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58c160f800 time 2024-09-22T09:05:29.987638+0000 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58c4b8c748] 2024-09-22T09:05:29.989 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:05:29.990 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f58c160f800 thread_name:radosgw-admin 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58c383e6f0] 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58c388b99c] 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58c4b8c7a2] 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.006 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:29.988+0000 7f58c160f800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f58c160f800 thread_name:radosgw-admin 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58c383e6f0] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58c388b99c] 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:05:30.007 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58c4b8c7a2] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:05:29.526+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.008 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:05:29.526+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.009 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:05:29.526+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.010 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 librados: starting msgr at 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 librados: starting objecter 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests hook 0x559af7838e30 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:05:29.527+0000 7f58c160f800 1 librados: setting wanted keys 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:05:29.527+0000 7f58c160f800 1 librados: calling monclient init 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.011 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:05:29.527+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:05:29.527+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key hook 0x559af7831618 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af76ddc60 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af76e6c30 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af77775c0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.012 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.787561s 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af77775c0 auth_method 0 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af76e6c30 auth_method 0 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af76ddc60 auth_method 0 2024-09-22T09:05:30.013 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_done global_id 6464 payload 824 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:05:29.527+0000 7f58bf901640 1 monclient: found mon.noname-c 2024-09-22T09:05:30.014 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: dump: 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.015 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: dump: 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.016 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:05:29.528+0000 7f58c160f800 5 monclient: authenticate success, global_id 6464 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:05:29.528+0000 7f57ad60a640 4 set_mon_vals no callback set 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:05:29.528+0000 7f58c160f800 1 librados: init done 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:05:29.530+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f57a4077570 auth_method 0 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:05:29.531+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7859d90 auth_method 0 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:05:29.531+0000 7f58bf100640 10 monclient: get_auth_request con 0x559af787daa0 auth_method 0 2024-09-22T09:05:30.017 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:05:29.532+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7881ef0 auth_method 0 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:05:29.533+0000 7f58bf901640 10 monclient: get_auth_request con 0x559af7881360 auth_method 0 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:05:29.534+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.018 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.019 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:05:29.534+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests cmddesc objecter_requests hook 0x559af788dae0 EEXIST 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.020 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:05:29.535+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:05:29.535+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:05:29.535+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x559af7889140 EEXIST 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af78b17d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af78b3aa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af78affa0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.021 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.795357s 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af78b17d0 auth_method 0 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af78b3aa0 auth_method 0 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.022 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af78affa0 auth_method 0 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-22T09:05:30.023 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:05:29.535+0000 7f58be8ff640 1 monclient: found mon.noname-c 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: dump: 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.024 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: dump: 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.025 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:05:29.536+0000 7f58c160f800 5 monclient: authenticate success, global_id 6467 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:05:29.536+0000 7f58c0102640 4 set_mon_vals no callback set 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:05:29.537+0000 7f57a9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:05:29.537+0000 7f57a9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:05:29.538+0000 7f57a9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:05:29.538+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f5798077480 auth_method 0 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: get_monmap_and_config 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.026 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:05:29.538+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.027 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:05:29.538+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.028 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.029 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:05:29.539+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:05:29.539+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:05:29.539+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5d40d2c8 EEXIST 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af7905c70 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af78f65c0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af79010a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.799441s 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af7905c70 auth_method 0 2024-09-22T09:05:30.030 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af78f65c0 auth_method 0 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af79010a0 auth_method 0 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.031 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.032 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.032 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.032 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.033 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.033 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.033 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.033 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-22T09:05:30.033 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:05:29.539+0000 7f58be8ff640 1 monclient: found mon.noname-a 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: dump: 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.034 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 monclient: authenticate success, global_id 6900 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: get_monmap_and_config success 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:05:29.540+0000 7f58c160f800 4 set_mon_vals no callback set 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: dump: 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.035 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: shutdown 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:05:29.540+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.036 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.037 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: starting msgr at 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: starting objecter 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests cmddesc objecter_requests hook 0x559af78fc350 EEXIST 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: setting wanted keys 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: calling monclient init 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.038 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.039 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x559af78c96c8 EEXIST 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af78f65c0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af79010a0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af7905c70 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.040 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.801783s 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af78f65c0 auth_method 0 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af79010a0 auth_method 0 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.041 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af7905c70 auth_method 0 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6903 payload 824 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.042 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:05:29.542+0000 7f58be8ff640 1 monclient: found mon.noname-a 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: dump: 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.043 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: dump: 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.044 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:05:29.542+0000 7f58c160f800 5 monclient: authenticate success, global_id 6903 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:05:29.542+0000 7f57a2ffd640 4 set_mon_vals no callback set 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:05:29.542+0000 7f58c160f800 1 librados: init done 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:05:29.542+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cr dump hook 0x559af78ffd48 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:05:29.544+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.045 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:05:29.544+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f57880775a0 auth_method 0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:05:29.544+0000 7f58bf100640 10 monclient: get_auth_request con 0x559af791fae0 auth_method 0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 realm 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:05:29.545+0000 7f58c160f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.046 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:05:29.546+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7923ec0 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:05:29.546+0000 7f58bf901640 10 monclient: get_auth_request con 0x559af79275e0 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:05:29.547+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:05:29.547+0000 7f58c160f800 20 searching for the correct realm 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:05:29.547+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f58b800ac20 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:05:29.548+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b0070430 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:05:29.549+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f58b402e060 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:05:29.549+0000 7f58bf901640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f58b402e060 msgr2=0x7f58b4066790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:05:29.750+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f58b402e060 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:05:29.752+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f58b8017070 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:05:29.754+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b8089910 auth_method 0 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:05:29.754+0000 7f58be8ff640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f58b8089910 msgr2=0x7f58b80890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.047 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:05:29.956+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b8089910 auth_method 0 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 zone default found 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 Realm: () 2024-09-22T09:05:30.048 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:05:29.963+0000 7f58c160f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 zonegroup default 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 started sync module instance, tier type = 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=0 2024-09-22T09:05:30.049 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=1 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=2 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=3 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=4 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=5 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=6 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:05:29.976+0000 7f58c160f800 20 add_watcher() i=7 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:05:29.976+0000 7f58c160f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.050 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:05:29.978+0000 7f5775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:05:29.978+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache list hook 0x559af78fa850 2024-09-22T09:05:30.051 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache inspect hook 0x559af78fa850 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache erase hook 0x559af78fa850 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache zap hook 0x559af78fa850 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 note: GC not initialized 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:05:29.978+0000 7f5774fe1640 20 reqs_thread_entry: start 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace show hook 0x7f58b4004580 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace history hook 0x7f58b4004580 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace active hook 0x7f58b4004580 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace active_short hook 0x7f58b4004580 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 Filter name: none 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:05:29.979+0000 7f56ee7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.052 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : miss 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:05:29.980+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.053 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94124066927696 notifier 6903 bl.length()=939 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:05:29.987+0000 7f58c160f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58c160f800 time 2024-09-22T09:05:29.987638+0000 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.054 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58c4b8c748] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:05:29.988+0000 7f58c160f800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f58c160f800 thread_name:radosgw-admin 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.055 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58c383e6f0] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58c388b99c] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58c4b8c7a2] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:05:30.056 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:05:30.057 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:05:30.058 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:05:30.059 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:05:30.060 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:05:30.061 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:05:30.062 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:05:30.063 INFO:tasks.workunit.client.0.smithi039.stderr: 7f56ee7fc640 / http_manager 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f5774fe1640 / http_manager 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f5775fe3640 / rgw_dt_lg_renew 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a17fa640 / ms_dispatch 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a2ffd640 / io_context_pool 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a9602640 / ms_dispatch 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57abe07640 / ms_dispatch 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57ad60a640 / io_context_pool 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58be8ff640 / msgr-worker-2 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58bf100640 / msgr-worker-1 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58bf901640 / msgr-worker-0 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58c0102640 / io_context_pool 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58c160f800 / radosgw-admin 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:05:30.064 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.106252.log 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:05:29.526+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:05:29.526+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.065 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding auth protocol: cephx 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.066 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: crc 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 AuthRegistry(0x559af7836b80) adding con mode: secure 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:05:29.526+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 librados: starting msgr at 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:05:29.526+0000 7f58c160f800 1 librados: starting objecter 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:05:29.526+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests hook 0x559af7838e30 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:05:29.527+0000 7f58c160f800 1 librados: setting wanted keys 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:05:29.527+0000 7f58c160f800 1 librados: calling monclient init 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding auth protocol: cephx 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.067 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: crc 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 AuthRegistry(0x559af78314d0) adding con mode: secure 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:05:29.527+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:05:29.527+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:05:29.527+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key hook 0x559af7831618 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:05:30.068 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af76ddc60 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af76e6c30 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af77775c0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:05:29.527+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.787561s 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af77775c0 auth_method 0 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af76e6c30 auth_method 0 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.069 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af76ddc60 auth_method 0 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:05:29.527+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.070 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:05:29.527+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient(hunting): handle_auth_done global_id 6464 payload 824 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:05:29.527+0000 7f58bf901640 1 monclient: found mon.noname-c 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:05:29.527+0000 7f58bf901640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: dump: 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.071 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:05:29.528+0000 7f57abe07640 10 monclient: dump: 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.072 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:05:29.528+0000 7f58c160f800 5 monclient: authenticate success, global_id 6464 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:05:29.528+0000 7f57ad60a640 4 set_mon_vals no callback set 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:05:29.528+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:05:29.528+0000 7f58c160f800 1 librados: init done 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:05:29.530+0000 7f57abe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:05:29.530+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f57a4077570 auth_method 0 2024-09-22T09:05:30.073 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:05:29.531+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7859d90 auth_method 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:05:29.531+0000 7f58bf100640 10 monclient: get_auth_request con 0x559af787daa0 auth_method 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:05:29.532+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7881ef0 auth_method 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:05:29.533+0000 7f58bf901640 10 monclient: get_auth_request con 0x559af7881360 auth_method 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:05:29.534+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.074 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding auth protocol: cephx 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.075 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: crc 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af788a0b0) adding con mode: secure 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:05:29.534+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests cmddesc objecter_requests hook 0x559af788dae0 EEXIST 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:05:29.534+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding auth protocol: cephx 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.076 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: crc 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:05:29.534+0000 7f58c160f800 5 AuthRegistry(0x559af7888ff8) adding con mode: secure 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:05:29.535+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:05:29.535+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:05:29.535+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x559af7889140 EEXIST 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af78b17d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af78b3aa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.077 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af78affa0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:05:29.535+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.795357s 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af78b17d0 auth_method 0 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af78b3aa0 auth_method 0 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.078 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af78affa0 auth_method 0 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:05:29.535+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:05:29.535+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-22T09:05:30.079 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:05:29.535+0000 7f58be8ff640 1 monclient: found mon.noname-c 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:05:29.535+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: dump: 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.080 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:05:29.536+0000 7f57a9602640 10 monclient: dump: 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.081 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:05:29.536+0000 7f58c160f800 5 monclient: authenticate success, global_id 6467 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:05:29.536+0000 7f58c0102640 4 set_mon_vals no callback set 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:05:29.536+0000 7f58c160f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:05:29.537+0000 7f57a9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:05:29.537+0000 7f57a9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:05:29.538+0000 7f57a9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:05:29.538+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f5798077480 auth_method 0 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: get_monmap_and_config 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.082 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:05:29.538+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding auth protocol: cephx 2024-09-22T09:05:30.083 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: crc 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x559af78d1680) adding con mode: secure 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:05:29.538+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:05:29.538+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.084 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding auth protocol: cephx 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: crc 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:05:29.538+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d180) adding con mode: secure 2024-09-22T09:05:30.085 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:05:29.539+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:05:29.539+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:05:29.539+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5d40d2c8 EEXIST 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af7905c70 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af78f65c0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af79010a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:05:29.539+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.799441s 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af7905c70 auth_method 0 2024-09-22T09:05:30.086 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af78f65c0 auth_method 0 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af79010a0 auth_method 0 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.087 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:05:29.539+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:05:29.539+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:05:29.539+0000 7f58be8ff640 1 monclient: found mon.noname-a 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:05:29.539+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: dump: 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.088 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 monclient: authenticate success, global_id 6900 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: get_monmap_and_config success 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:05:29.540+0000 7f58c160f800 4 set_mon_vals no callback set 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.089 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:05:29.540+0000 7f57a2ffd640 10 monclient: dump: 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: shutdown 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: build_initial_monmap 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:05:29.540+0000 7f58c160f800 1 build_initial for_mkfs: 0 2024-09-22T09:05:30.090 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:05:29.540+0000 7f58c160f800 10 monclient: monmap: 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding auth protocol: cephx 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.091 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: crc 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:05:29.540+0000 7f58c160f800 5 AuthRegistry(0x559af78d5350) adding con mode: secure 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: starting msgr at 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: starting objecter 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 asok(0x559af76100f0) register_command objecter_requests cmddesc objecter_requests hook 0x559af78fc350 EEXIST 2024-09-22T09:05:30.092 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: setting wanted keys 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:05:29.541+0000 7f58c160f800 1 librados: calling monclient init 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: init 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding auth protocol: cephx 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.093 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: crc 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 AuthRegistry(0x559af78c9580) adding con mode: secure 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:05:29.541+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:05:29.541+0000 7f58c160f800 5 asok(0x559af76100f0) register_command rotate-key cmddesc rotate-key hook 0x559af78c96c8 EEXIST 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: _reopen_session rank -1 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-a con 0x559af78f65c0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-c con 0x559af79010a0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): picked mon.noname-b con 0x559af7905c70 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:05:30.094 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): start opening mon connection 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): _renew_subs 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:05:29.541+0000 7f58c160f800 10 monclient(hunting): authenticate will time out at 2227.801783s 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): get_auth_request con 0x559af78f65c0 auth_method 0 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.095 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): get_auth_request con 0x559af79010a0 auth_method 0 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:05:29.541+0000 7f58be8ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:05:29.541+0000 7f58bf901640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): get_auth_request con 0x559af7905c70 auth_method 0 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:05:30.096 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:05:29.541+0000 7f58bf100640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:05:29.542+0000 7f58bf100640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient(hunting): handle_auth_done global_id 6903 payload 824 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient: _finish_hunting 0 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:05:29.542+0000 7f58be8ff640 1 monclient: found mon.noname-a 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:05:29.542+0000 7f58be8ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:05:30.097 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: dump: 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.098 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: _finish_auth 0 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:05:29.542+0000 7f57a17fa640 10 monclient: dump: 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:05:30.099 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:05:29.542+0000 7f58c160f800 5 monclient: authenticate success, global_id 6903 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:05:29.542+0000 7f57a2ffd640 4 set_mon_vals no callback set 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _renew_subs 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:05:29.542+0000 7f58c160f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:05:30.100 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:05:29.542+0000 7f58c160f800 1 librados: init done 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:05:29.542+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cr dump hook 0x559af78ffd48 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:05:29.544+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:05:29.544+0000 7f57a17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:05:29.544+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f57880775a0 auth_method 0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:05:29.544+0000 7f58bf100640 10 monclient: get_auth_request con 0x559af791fae0 auth_method 0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 realm 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:05:29.545+0000 7f58c160f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.101 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:05:29.545+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:05:29.546+0000 7f58be8ff640 10 monclient: get_auth_request con 0x559af7923ec0 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:05:29.546+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:05:29.546+0000 7f58bf901640 10 monclient: get_auth_request con 0x559af79275e0 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:05:29.547+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:05:29.547+0000 7f58c160f800 20 searching for the correct realm 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:05:29.547+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f58b800ac20 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:05:29.548+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b0070430 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:05:29.549+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f58b402e060 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:05:29.549+0000 7f58bf901640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f58b402e060 msgr2=0x7f58b4066790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:05:29.750+0000 7f58bf901640 10 monclient: get_auth_request con 0x7f58b402e060 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:05:29.752+0000 7f58bf100640 10 monclient: get_auth_request con 0x7f58b8017070 auth_method 0 2024-09-22T09:05:30.102 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:05:29.754+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b8089910 auth_method 0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:05:29.754+0000 7f58be8ff640 0 -- 172.21.15.39:0/1712395237 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f58b8089910 msgr2=0x7f58b80890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:05:29.956+0000 7f58be8ff640 10 monclient: get_auth_request con 0x7f58b8089910 auth_method 0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:05:29.961+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:05:29.962+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.103 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 zone default found 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 Realm: () 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:05:29.963+0000 7f58c160f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:05:29.963+0000 7f58c160f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 zonegroup default 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:05:29.963+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 started sync module instance, tier type = 2024-09-22T09:05:30.104 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:05:29.964+0000 7f58c160f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=0 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=1 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=2 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=3 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=4 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=5 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:05:29.975+0000 7f58c160f800 20 add_watcher() i=6 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:05:29.976+0000 7f58c160f800 20 add_watcher() i=7 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:05:29.976+0000 7f58c160f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding auth protocol: cephx 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.105 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: crc 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 AuthRegistry(0x7ffc5d40d650) adding con mode: secure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:05:29.978+0000 7f5775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:05:29.978+0000 7f58c160f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:30.106 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache list hook 0x559af78fa850 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache inspect hook 0x559af78fa850 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache erase hook 0x559af78fa850 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command cache zap hook 0x559af78fa850 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 note: GC not initialized 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:05:29.978+0000 7f5774fe1640 20 reqs_thread_entry: start 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace show hook 0x7f58b4004580 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace history hook 0x7f58b4004580 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace active hook 0x7f58b4004580 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:05:29.978+0000 7f58c160f800 5 asok(0x559af76100f0) register_command sync trace active_short hook 0x7f58b4004580 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:05:29.978+0000 7f58c160f800 20 Filter name: none 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:05:29.979+0000 7f56ee7fc640 20 reqs_thread_entry: start 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.107 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:05:29.979+0000 7f58c160f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : miss 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:05:29.979+0000 7f58c160f800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:05:29.980+0000 7f58c160f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:05:29.980+0000 7f58c160f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:05:29.984+0000 7f58c160f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:05:30.108 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94124066927696 notifier 6903 bl.length()=939 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:05:29.984+0000 7f57a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:05:29.986+0000 7f58c160f800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:05:29.987+0000 7f58c160f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58c160f800 time 2024-09-22T09:05:29.987638+0000 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f58c4b8c748] 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.109 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:05:29.988+0000 7f58c160f800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f58c160f800 thread_name:radosgw-admin 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f58c383e6f0] 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f58c388b99c] 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:05:30.110 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f58c4b8c7a2] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f58c4b8c906] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559af6048e01] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd817fe) [0x559af655b7fe] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559af6058c9d] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f58c3829590] 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.111 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:05:30.112 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:05:30.113 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:05:30.114 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:05:30.115 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:05:30.116 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:05:30.117 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 7f56ee7fc640 / http_manager 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 7f5774fe1640 / http_manager 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 7f5775fe3640 / rgw_dt_lg_renew 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a17fa640 / ms_dispatch 2024-09-22T09:05:30.118 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a2ffd640 / io_context_pool 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57a9602640 / ms_dispatch 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57abe07640 / ms_dispatch 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f57ad60a640 / io_context_pool 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58be8ff640 / msgr-worker-2 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58bf100640 / msgr-worker-1 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58bf901640 / msgr-worker-0 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58c0102640 / io_context_pool 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: 7f58c160f800 / radosgw-admin 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:05:29.989336Z_887c9b24-fd5a-4cee-bc5b-483bb5fa6e59/log 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:05:30.119 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.069+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.070+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.070+0000 7f81d8f30800 20 realm 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.071+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.072+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.072+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.073+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.073+0000 7f81d8f30800 20 searching for the correct realm 2024-09-22T09:05:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.075+0000 7f81d53bd640 0 -- 172.21.15.39:0/2386144798 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f81c8017070 msgr2=0x7f81c80924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:05:30.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.281+0000 7f81d43bb640 0 -- 172.21.15.39:0/2386144798 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f81cc050400 msgr2=0x7f81cc050880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.487+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 zone default found 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 4 Realm: () 2024-09-22T09:05:30.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 zonegroup default 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.488+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.489+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.489+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.489+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.489+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.490+0000 7f81d8f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.490+0000 7f81d8f30800 20 started sync module instance, tier type = 2024-09-22T09:05:30.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.490+0000 7f81d8f30800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=0 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=1 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=2 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=3 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=4 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=5 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.500+0000 7f81d8f30800 20 add_watcher() i=6 2024-09-22T09:05:30.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.501+0000 7f81d8f30800 20 add_watcher() i=7 2024-09-22T09:05:30.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.501+0000 7f81d8f30800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:30.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.503+0000 7f808b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.503+0000 7f81d8f30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:30.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.503+0000 7f81d8f30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:30.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.503+0000 7f81d8f30800 5 note: GC not initialized 2024-09-22T09:05:30.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.504+0000 7f808a7e4640 20 reqs_thread_entry: start 2024-09-22T09:05:30.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.504+0000 7f81d8f30800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:30.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.504+0000 7f81d8f30800 20 Filter name: none 2024-09-22T09:05:30.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.504+0000 7f80837fe640 20 reqs_thread_entry: start 2024-09-22T09:05:30.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.504+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.505+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:30.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.505+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.505+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:30.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.505+0000 7f81d8f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:30.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.505+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.506+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:30.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.506+0000 7f81d8f30800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.506+0000 7f81d8f30800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:30.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.506+0000 7f81d8f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:05:30.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.508+0000 7f808b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.512+0000 7f81d8f30800 20 remove_watcher() i=0 2024-09-22T09:05:30.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.512+0000 7f81d8f30800 2 removed watcher, disabling cache 2024-09-22T09:05:30.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.514+0000 7f81d8f30800 20 remove_watcher() i=1 2024-09-22T09:05:30.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.515+0000 7f81d8f30800 20 remove_watcher() i=2 2024-09-22T09:05:30.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.516+0000 7f81d8f30800 20 remove_watcher() i=3 2024-09-22T09:05:30.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.517+0000 7f81d8f30800 20 remove_watcher() i=4 2024-09-22T09:05:30.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.518+0000 7f81d8f30800 20 remove_watcher() i=5 2024-09-22T09:05:30.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.519+0000 7f81d8f30800 20 remove_watcher() i=6 2024-09-22T09:05:30.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.520+0000 7f81d8f30800 20 remove_watcher() i=7 2024-09-22T09:05:30.532 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.533 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:05:30.533 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:05:30.533 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:05:30.534 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:30.535 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:30.564 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:05:30.564 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:05:30.623 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:05:30.655 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:05:30.655 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:05:30.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.694+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 realm 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.698 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.696+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.697+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.697+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.698+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:05:30.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.698+0000 7f61c1296800 20 searching for the correct realm 2024-09-22T09:05:30.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.701+0000 7f61bf581640 0 -- 172.21.15.39:0/813858089 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f61a8035ba0 msgr2=0x7f61a8040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.704+0000 7f61be57f640 0 -- 172.21.15.39:0/813858089 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f61b00ccec0 msgr2=0x7f61b00be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.910+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:05:30.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 zone default found 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 4 Realm: () 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 zonegroup default 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.911+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.912+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.912+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.912+0000 7f61c1296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:05:30.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.912+0000 7f61c1296800 20 started sync module instance, tier type = 2024-09-22T09:05:30.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.912+0000 7f61c1296800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=0 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=1 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=2 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=3 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=4 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.922+0000 7f61c1296800 20 add_watcher() i=5 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.923+0000 7f61c1296800 20 add_watcher() i=6 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.923+0000 7f61c1296800 20 add_watcher() i=7 2024-09-22T09:05:30.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.923+0000 7f61c1296800 2 all 8 watchers are set, enabling cache 2024-09-22T09:05:30.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.925+0000 7f60757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 5 note: GC not initialized 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f5feffff640 20 reqs_thread_entry: start 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 20 init_complete bucket index max shards: 1 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 20 Filter name: none 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f5fedffb640 20 reqs_thread_entry: start 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T09:05:30.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.926+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:05:30.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:05:30.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : miss 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 20 rados->read ofs=0 len=0 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.927+0000 7f61c1296800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.928+0000 7f61c1296800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.928+0000 7f61c1296800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.928+0000 7f61c1296800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.928+0000 7f61c1296800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:05:30.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.928+0000 7f61c1296800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:05:30.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.929+0000 7f61c1296800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to be held by another RGW process; skipping for now 2024-09-22T09:05:30.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.930+0000 7f60757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:05:30.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.932+0000 7f61c1296800 20 remove_watcher() i=0 2024-09-22T09:05:30.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.932+0000 7f61c1296800 2 removed watcher, disabling cache 2024-09-22T09:05:30.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.933+0000 7f61c1296800 20 remove_watcher() i=1 2024-09-22T09:05:30.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.934+0000 7f61c1296800 20 remove_watcher() i=2 2024-09-22T09:05:30.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.935+0000 7f61c1296800 20 remove_watcher() i=3 2024-09-22T09:05:30.938 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.937+0000 7f61c1296800 20 remove_watcher() i=4 2024-09-22T09:05:30.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.938+0000 7f61c1296800 20 remove_watcher() i=5 2024-09-22T09:05:30.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.939+0000 7f61c1296800 20 remove_watcher() i=6 2024-09-22T09:05:30.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:05:30.940+0000 7f61c1296800 20 remove_watcher() i=7 2024-09-22T09:05:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:06:00.982 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:06:01.019 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:01.019 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:01.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.064+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 20 realm 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.066+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.067+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.067+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.068+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:01.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.068+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.068+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:01.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.068+0000 7f7331c87800 20 searching for the correct realm 2024-09-22T09:06:01.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.070+0000 7f732ef70640 0 -- 172.21.15.39:0/4052779070 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f7320062f30 msgr2=0x7f73200619a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:01.076 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.074+0000 7f732ef70640 0 -- 172.21.15.39:0/4052779070 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f71f8087c90 msgr2=0x7f71f808a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:01.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.081+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 zone default found 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 4 Realm: () 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:01.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 zonegroup default 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.082+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.083+0000 7f7331c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.083+0000 7f7331c87800 20 started sync module instance, tier type = 2024-09-22T09:06:01.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.083+0000 7f7331c87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=0 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=1 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=2 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=3 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=4 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=5 2024-09-22T09:06:01.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.093+0000 7f7331c87800 20 add_watcher() i=6 2024-09-22T09:06:01.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.094+0000 7f7331c87800 20 add_watcher() i=7 2024-09-22T09:06:01.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.094+0000 7f7331c87800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:01.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.096+0000 7f71e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:01.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.096+0000 7f7331c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:01.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.096+0000 7f7331c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:01.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f7331c87800 5 note: GC not initialized 2024-09-22T09:06:01.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f71e4fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:01.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f7331c87800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:01.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f7331c87800 20 Filter name: none 2024-09-22T09:06:01.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f715e7fc640 20 reqs_thread_entry: start 2024-09-22T09:06:01.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f7331c87800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-22T09:06:01.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.097+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : miss 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 20 rados_obj.operate() r=0 bl.length=455 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.100 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.098+0000 7f7331c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:06:01.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.099+0000 7f7331c87800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.103+0000 7f7331c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.103+0000 7f7331c87800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.103+0000 7f7331c87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.103+0000 7f7331c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.104+0000 7f7212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529745 cookie 94213285659072 notifier 6957 bl.length()=939 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.104+0000 7f7212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.104+0000 7f7212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.104+0000 7f7212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.106+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:06:01.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.106+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:06:01.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.106+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:06:01.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.106+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:06:01.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.108+0000 7f7331c87800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.2.0 2024-09-22T09:06:01.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.108+0000 7f7331c87800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.2.0 2024-09-22T09:06:01.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.108+0000 7f7331c87800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.2.1 2024-09-22T09:06:01.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.108+0000 7f7331c87800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.2.1 2024-09-22T09:06:01.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.108+0000 7f7331c87800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.0 2024-09-22T09:06:01.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.111+0000 7f7331c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:01.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.111+0000 7f7331c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:06:01.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.112+0000 7f7331c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.112+0000 7f7331c87800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.112+0000 7f7331c87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.112+0000 7f7331c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.113+0000 7f7212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529746 cookie 94213285659072 notifier 6957 bl.length()=939 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.113+0000 7f7212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.113+0000 7f7212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.113+0000 7f7212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.114+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:06:01.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.114+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:06:01.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.114+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:06:01.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.114+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:06:01.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.115+0000 7f7331c87800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.27.0 2024-09-22T09:06:01.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.116+0000 7f7331c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:01.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.116+0000 7f7331c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 2024-09-22T09:06:01.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.117+0000 7f7331c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.117+0000 7f7331c87800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.117+0000 7f7331c87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.117+0000 7f7331c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27, ofs0, ns] 2024-09-22T09:06:01.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.118+0000 7f72127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529747 cookie 94213285659072 notifier 6957 bl.length()=907 2024-09-22T09:06:01.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.118+0000 7f72127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 info.flags=0x17 2024-09-22T09:06:01.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.118+0000 7f72127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 to cache LRU end 2024-09-22T09:06:01.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.118+0000 7f72127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:01.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.119+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_sources= new_sources= 2024-09-22T09:06:01.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.119+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential sources added=[] removed=[] 2024-09-22T09:06:01.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.119+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): orig_dests= new_dests= 2024-09-22T09:06:01.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.119+0000 7f7331c87800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[530e834e-7701-4a35-ad82-1b0744ba8777.4617.27]): potential dests added=[] removed=[] 2024-09-22T09:06:01.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.120+0000 7f7331c87800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-22T09:06:01.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.123+0000 7f71e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:01.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.125+0000 7f7331c87800 20 remove_watcher() i=0 2024-09-22T09:06:01.126 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.125+0000 7f7331c87800 2 removed watcher, disabling cache 2024-09-22T09:06:01.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.126+0000 7f7331c87800 20 remove_watcher() i=1 2024-09-22T09:06:01.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.127+0000 7f7331c87800 20 remove_watcher() i=2 2024-09-22T09:06:01.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.128+0000 7f7331c87800 20 remove_watcher() i=3 2024-09-22T09:06:01.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.129+0000 7f7331c87800 20 remove_watcher() i=4 2024-09-22T09:06:01.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.131+0000 7f7331c87800 20 remove_watcher() i=5 2024-09-22T09:06:01.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.133+0000 7f7331c87800 20 remove_watcher() i=6 2024-09-22T09:06:01.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.134+0000 7f7331c87800 20 remove_watcher() i=7 2024-09-22T09:06:01.148 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-22T09:06:01.178 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:01.178 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:01.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.216+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 realm 2024-09-22T09:06:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.218+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.219+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:01.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.219+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.220+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:01.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.220+0000 7f6c9ef44800 20 searching for the correct realm 2024-09-22T09:06:01.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.222+0000 7f6c9d22f640 0 -- 172.21.15.39:0/3085669852 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6c84095040 msgr2=0x7f6c8406d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:01.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.226+0000 7f6c9c22d640 0 -- 172.21.15.39:0/3085669852 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f6c9408aa50 msgr2=0x7f6c940925f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:01.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:01.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:01.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:01.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:01.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:01.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:01.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.432+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.433+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.433+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.433+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.433+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 zone default found 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 4 Realm: () 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 zonegroup default 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.434+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.435+0000 7f6c9ef44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:01.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.435+0000 7f6c9ef44800 20 started sync module instance, tier type = 2024-09-22T09:06:01.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.435+0000 7f6c9ef44800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=0 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=1 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=2 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=3 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=4 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=5 2024-09-22T09:06:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=6 2024-09-22T09:06:01.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 20 add_watcher() i=7 2024-09-22T09:06:01.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.448+0000 7f6c9ef44800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:01.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.450+0000 7f6b52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:01.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6c9ef44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:01.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6c9ef44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:01.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6c9ef44800 5 note: GC not initialized 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6b51fe3640 20 reqs_thread_entry: start 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6c9ef44800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.451+0000 7f6c9ef44800 20 Filter name: none 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.452+0000 7f6ac37fe640 20 reqs_thread_entry: start 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.452+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.452+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.452+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.453+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.453+0000 7f6c9ef44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.453+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.453+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=201 2024-09-22T09:06:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.453+0000 7f6c9ef44800 20 rados->read ofs=0 len=0 2024-09-22T09:06:01.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.454+0000 7f6c9ef44800 20 rados_obj.operate() r=0 bl.length=423 2024-09-22T09:06:01.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.454+0000 7f6c9ef44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:01.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.455+0000 7f6b52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:01.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.457+0000 7f6c9ef44800 20 remove_watcher() i=0 2024-09-22T09:06:01.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.457+0000 7f6c9ef44800 2 removed watcher, disabling cache 2024-09-22T09:06:01.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.458+0000 7f6c9ef44800 20 remove_watcher() i=1 2024-09-22T09:06:01.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.460+0000 7f6c9ef44800 20 remove_watcher() i=2 2024-09-22T09:06:01.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.461+0000 7f6c9ef44800 20 remove_watcher() i=3 2024-09-22T09:06:01.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.462+0000 7f6c9ef44800 20 remove_watcher() i=4 2024-09-22T09:06:01.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.463+0000 7f6c9ef44800 20 remove_watcher() i=5 2024-09-22T09:06:01.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.464+0000 7f6c9ef44800 20 remove_watcher() i=6 2024-09-22T09:06:01.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:01.465+0000 7f6c9ef44800 20 remove_watcher() i=7 2024-09-22T09:06:01.477 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:01.477 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:01.478 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-trim-reshard-log-entries id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:06:01.478 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:01.480 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.480 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.500 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.500 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.701 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.702 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.770 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-22T09:06:01.770 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:01.771 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.771 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.813 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.871 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.910 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.944 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.944 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:01.977 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:01.978 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.012 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.012 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.047 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.047 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.081 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.081 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.114 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.114 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.151 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.151 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.185 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.185 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.219 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.219 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.253 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.254 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.287 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.288 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.321 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.321 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.355 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.356 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.389 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.389 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.425 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.425 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.460 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.460 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.493 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.493 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.533 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:02.533 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:02.567 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T09:06:02.596 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:02.596 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:02.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.635+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:02.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:02.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 realm 2024-09-22T09:06:02.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:02.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:02.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:02.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:02.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:02.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.637+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:02.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.638+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:02.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.638+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:02.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.639+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:02.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.639+0000 7f757bd75800 20 searching for the correct realm 2024-09-22T09:06:02.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:02.841+0000 7f757905e640 0 -- 172.21.15.39:0/2353584652 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f756c082260 msgr2=0x7f756c06a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:03.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.247+0000 7f757985f640 0 -- 172.21.15.39:0/2353584652 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f75740b50f0 msgr2=0x7f75740c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.254+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 zone default found 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 4 Realm: () 2024-09-22T09:06:03.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 zonegroup default 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.255+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 started sync module instance, tier type = 2024-09-22T09:06:03.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.256+0000 7f757bd75800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:03.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=0 2024-09-22T09:06:03.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=1 2024-09-22T09:06:03.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=2 2024-09-22T09:06:03.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=3 2024-09-22T09:06:03.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=4 2024-09-22T09:06:03.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=5 2024-09-22T09:06:03.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.267+0000 7f757bd75800 20 add_watcher() i=6 2024-09-22T09:06:03.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.268+0000 7f757bd75800 20 add_watcher() i=7 2024-09-22T09:06:03.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.268+0000 7f757bd75800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:03.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.270+0000 7f742b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:03.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.270+0000 7f757bd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:03.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.270+0000 7f757bd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:03.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.270+0000 7f757bd75800 5 note: GC not initialized 2024-09-22T09:06:03.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.270+0000 7f742a7fc640 20 reqs_thread_entry: start 2024-09-22T09:06:03.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.271+0000 7f757bd75800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:03.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.271+0000 7f757bd75800 20 Filter name: none 2024-09-22T09:06:03.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.271+0000 7f739bfff640 20 reqs_thread_entry: start 2024-09-22T09:06:03.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.271+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.272+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:03.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.272+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.272+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:03.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.272+0000 7f757bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:03.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.272+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.273+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:03.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.273+0000 7f757bd75800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.273+0000 7f757bd75800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:03.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.273+0000 7f757bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:03.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.274+0000 7f742b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:03.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.277+0000 7f757bd75800 20 remove_watcher() i=0 2024-09-22T09:06:03.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.277+0000 7f757bd75800 2 removed watcher, disabling cache 2024-09-22T09:06:03.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.278+0000 7f757bd75800 20 remove_watcher() i=1 2024-09-22T09:06:03.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.279+0000 7f757bd75800 20 remove_watcher() i=2 2024-09-22T09:06:03.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.280+0000 7f757bd75800 20 remove_watcher() i=3 2024-09-22T09:06:03.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.282+0000 7f757bd75800 20 remove_watcher() i=4 2024-09-22T09:06:03.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.283+0000 7f757bd75800 20 remove_watcher() i=5 2024-09-22T09:06:03.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.284+0000 7f757bd75800 20 remove_watcher() i=6 2024-09-22T09:06:03.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.285+0000 7f757bd75800 20 remove_watcher() i=7 2024-09-22T09:06:03.298 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:03.298 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:03.298 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:03.298 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:03.300 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-22T09:06:03.336 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:03.336 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:03.377 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.376+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.379 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 realm 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.378+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.379+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:03.380 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.379+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.380+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:03.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.380+0000 7fae06c20800 20 searching for the correct realm 2024-09-22T09:06:03.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.382+0000 7fae04f0b640 0 -- 172.21.15.39:0/2776947792 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fadf80a23a0 msgr2=0x7fadf806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:03.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.589+0000 7fae03f09640 0 -- 172.21.15.39:0/2776947792 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fadfc0263a0 msgr2=0x7fadfc026800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:03.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.795+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.796+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.796+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.796+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.796+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 zone default found 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 4 Realm: () 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:03.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 zonegroup default 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.797+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.798+0000 7fae06c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.798+0000 7fae06c20800 20 started sync module instance, tier type = 2024-09-22T09:06:03.802 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.798+0000 7fae06c20800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:03.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=0 2024-09-22T09:06:03.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=1 2024-09-22T09:06:03.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=2 2024-09-22T09:06:03.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=3 2024-09-22T09:06:03.809 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=4 2024-09-22T09:06:03.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=5 2024-09-22T09:06:03.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.808+0000 7fae06c20800 20 add_watcher() i=6 2024-09-22T09:06:03.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.809+0000 7fae06c20800 20 add_watcher() i=7 2024-09-22T09:06:03.810 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.809+0000 7fae06c20800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:03.812 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.811+0000 7facbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:03.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.811+0000 7fae06c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:03.813 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.811+0000 7fae06c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.811+0000 7fae06c20800 5 note: GC not initialized 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7facb9fdb640 20 reqs_thread_entry: start 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7fae06c20800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7fae06c20800 20 Filter name: none 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7fac2b7fe640 20 reqs_thread_entry: start 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7fae06c20800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T09:06:03.814 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.812+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : miss 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:03.815 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:03.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.816 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.813+0000 7fae06c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:03.819 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.818+0000 7fae06c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.818+0000 7fae06c20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.818+0000 7fae06c20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.818+0000 7fae06c20800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.819+0000 7facdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94397192559392 notifier 7014 bl.length()=915 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.819+0000 7facdb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.819+0000 7facdb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.820 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.819+0000 7facdb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.820+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:03.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.820+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:03.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.820+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:03.822 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.820+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:03.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.823+0000 7fae06c20800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.0 2024-09-22T09:06:03.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.823+0000 7fae06c20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.0 2024-09-22T09:06:03.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.823+0000 7fae06c20800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.1 2024-09-22T09:06:03.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.823+0000 7fae06c20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.1 2024-09-22T09:06:03.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.823+0000 7fae06c20800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.0 2024-09-22T09:06:03.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.825+0000 7fae06c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:03.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.825+0000 7fae06c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:03.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7fae06c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7fae06c20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7fae06c20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7fae06c20800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:03.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7facdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529708 cookie 94397192559392 notifier 7014 bl.length()=915 2024-09-22T09:06:03.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7facdb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7facdb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.829 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.827+0000 7facdb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 -1 Injecting error=-5 at location=block_writes 2024-09-22T09:06:03.830 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.829+0000 7fae06c20800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-22T09:06:03.832 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.831+0000 7fae06c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:03.833 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.831+0000 7fae06c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.833+0000 7fae06c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.833+0000 7fae06c20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.833+0000 7fae06c20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.833+0000 7fae06c20800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.834+0000 7facdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529709 cookie 94397192559392 notifier 7014 bl.length()=883 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.834+0000 7facdb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.834+0000 7facdb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:03.835 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.834+0000 7facdb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:03.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.835+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:03.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.835+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:03.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.835+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:03.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.835+0000 7fae06c20800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:03.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.836+0000 7fae06c20800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-22T09:06:03.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.838+0000 7facbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:03.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.841+0000 7fae06c20800 20 remove_watcher() i=0 2024-09-22T09:06:03.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.841+0000 7fae06c20800 2 removed watcher, disabling cache 2024-09-22T09:06:03.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.842+0000 7fae06c20800 20 remove_watcher() i=1 2024-09-22T09:06:03.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.843+0000 7fae06c20800 20 remove_watcher() i=2 2024-09-22T09:06:03.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.844+0000 7fae06c20800 20 remove_watcher() i=3 2024-09-22T09:06:03.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.846+0000 7fae06c20800 20 remove_watcher() i=4 2024-09-22T09:06:03.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.847+0000 7fae06c20800 20 remove_watcher() i=5 2024-09-22T09:06:03.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.848+0000 7fae06c20800 20 remove_watcher() i=6 2024-09-22T09:06:03.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.849+0000 7fae06c20800 20 remove_watcher() i=7 2024-09-22T09:06:03.864 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T09:06:03.893 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:03.893 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:03.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.931+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.933+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.933+0000 7fe1d9922800 20 realm 2024-09-22T09:06:03.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.933+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.934+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.934+0000 7fe1d9922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:03.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.934+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.934+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:03.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.934+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.935+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:03.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.935+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:03.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.936+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:03.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.936+0000 7fe1d9922800 20 searching for the correct realm 2024-09-22T09:06:03.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.938+0000 7fe1d5d03640 0 -- 172.21.15.39:0/769196885 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe1c0021bf0 msgr2=0x7fe1c0067180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:03.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:03.942+0000 7fe1d4d01640 0 -- 172.21.15.39:0/769196885 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe1d0018910 msgr2=0x7fe1d001a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:04.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:04.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:04.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.149+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 zone default found 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 4 Realm: () 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:04.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 zonegroup default 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.150+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.151+0000 7fe1d9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.151+0000 7fe1d9922800 20 started sync module instance, tier type = 2024-09-22T09:06:04.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.151+0000 7fe1d9922800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=0 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=1 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=2 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=3 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=4 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=5 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.161+0000 7fe1d9922800 20 add_watcher() i=6 2024-09-22T09:06:04.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.162+0000 7fe1d9922800 20 add_watcher() i=7 2024-09-22T09:06:04.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.162+0000 7fe1d9922800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:04.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.164+0000 7fe08b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.164+0000 7fe1d9922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:04.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.164+0000 7fe1d9922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:04.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fe1d9922800 5 note: GC not initialized 2024-09-22T09:06:04.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fe08a7e4640 20 reqs_thread_entry: start 2024-09-22T09:06:04.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fe1d9922800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:04.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fe1d9922800 20 Filter name: none 2024-09-22T09:06:04.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fdffbfff640 20 reqs_thread_entry: start 2024-09-22T09:06:04.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.165+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.166+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.166+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.166+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.166+0000 7fe1d9922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.166+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.167+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.167+0000 7fe1d9922800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.167+0000 7fe1d9922800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:04.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.167+0000 7fe1d9922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:04.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.168+0000 7fe08b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.171+0000 7fe1d9922800 20 remove_watcher() i=0 2024-09-22T09:06:04.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.171+0000 7fe1d9922800 2 removed watcher, disabling cache 2024-09-22T09:06:04.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.172+0000 7fe1d9922800 20 remove_watcher() i=1 2024-09-22T09:06:04.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.173+0000 7fe1d9922800 20 remove_watcher() i=2 2024-09-22T09:06:04.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.174+0000 7fe1d9922800 20 remove_watcher() i=3 2024-09-22T09:06:04.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.176+0000 7fe1d9922800 20 remove_watcher() i=4 2024-09-22T09:06:04.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.177+0000 7fe1d9922800 20 remove_watcher() i=5 2024-09-22T09:06:04.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.178+0000 7fe1d9922800 20 remove_watcher() i=6 2024-09-22T09:06:04.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.179+0000 7fe1d9922800 20 remove_watcher() i=7 2024-09-22T09:06:04.191 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:04.191 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:04.191 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:04.191 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:04.193 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:04.193 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:04.223 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:04.223 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:04.281 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:06:04.315 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:04.315 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:04.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.354+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.355+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.355+0000 7f7117d26800 20 realm 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.355+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.356+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.356+0000 7f7117d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.356+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.356+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.356+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.357+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:04.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.357+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.357+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:04.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.357+0000 7f7117d26800 20 searching for the correct realm 2024-09-22T09:06:04.362 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.361+0000 7f71139d9640 0 -- 172.21.15.39:0/2463329291 >> [v2:172.21.15.39:6800/1561628689,v1:172.21.15.39:6801/1561628689] conn(0x55f152a71720 msgr2=0x55f152a73bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:04.365 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.364+0000 7f71131d8640 0 -- 172.21.15.39:0/2463329291 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f710c06d040 msgr2=0x7f710c0b4d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:04.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:04.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.368+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:04.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 zone default found 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 4 Realm: () 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 zonegroup default 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.369+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.370+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.370+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.370+0000 7f7117d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.372 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.370+0000 7f7117d26800 20 started sync module instance, tier type = 2024-09-22T09:06:04.373 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.370+0000 7f7117d26800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=0 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=1 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=2 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=3 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=4 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=5 2024-09-22T09:06:04.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.380+0000 7f7117d26800 20 add_watcher() i=6 2024-09-22T09:06:04.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.381+0000 7f7117d26800 20 add_watcher() i=7 2024-09-22T09:06:04.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.381+0000 7f7117d26800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:04.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.382+0000 7f6fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:04.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 5 note: GC not initialized 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f6fc8fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 20 Filter name: none 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f6f427fc640 20 reqs_thread_entry: start 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-22T09:06:04.385 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.383+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : miss 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.386 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.384+0000 7f7117d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:04.389 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.388+0000 7f7117d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.388+0000 7f7117d26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.388+0000 7f7117d26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.388+0000 7f7117d26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.389+0000 7f6ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529710 cookie 94494962220128 notifier 6608 bl.length()=915 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.389+0000 7f6ff2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.389+0000 7f6ff2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.390 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.389+0000 7f6ff2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.390+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:04.391 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.390+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:04.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.390+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:04.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.390+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:04.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.393+0000 7f7117d26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.0 2024-09-22T09:06:04.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.393+0000 7f7117d26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.0 2024-09-22T09:06:04.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.393+0000 7f7117d26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.1 2024-09-22T09:06:04.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.393+0000 7f7117d26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.1.1 2024-09-22T09:06:04.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.393+0000 7f7117d26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.0 2024-09-22T09:06:04.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.395+0000 7f7117d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:04.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.395+0000 7f7117d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.396+0000 7f7117d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.396+0000 7f7117d26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.396+0000 7f7117d26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.396+0000 7f7117d26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.397+0000 7f6ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 94494962220128 notifier 6608 bl.length()=915 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.397+0000 7f6ff2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.397+0000 7f6ff2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.397+0000 7f6ff2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.398+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:04.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.398+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:04.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.398+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:04.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.398+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:04.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.399+0000 7f7117d26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.28.0 2024-09-22T09:06:04.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.399+0000 7f7117d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:04.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.399+0000 7f7117d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f7117d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f7117d26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f7117d26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f7117d26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28, ofs0, ns] 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f6ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529712 cookie 94494962220128 notifier 6608 bl.length()=883 2024-09-22T09:06:04.402 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f6ff2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 info.flags=0x17 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f6ff2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 to cache LRU end 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.401+0000 7f6ff2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.402+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_sources= new_sources= 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.402+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential sources added=[] removed=[] 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.402+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): orig_dests= new_dests= 2024-09-22T09:06:04.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.402+0000 7f7117d26800 20 handle_bi_update(): bucket=:error-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.28]): potential dests added=[] removed=[] 2024-09-22T09:06:04.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.403+0000 7f7117d26800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-22T09:06:04.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.405+0000 7f6fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.408+0000 7f7117d26800 20 remove_watcher() i=0 2024-09-22T09:06:04.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.408+0000 7f7117d26800 2 removed watcher, disabling cache 2024-09-22T09:06:04.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.409+0000 7f7117d26800 20 remove_watcher() i=1 2024-09-22T09:06:04.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.410+0000 7f7117d26800 20 remove_watcher() i=2 2024-09-22T09:06:04.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.411+0000 7f7117d26800 20 remove_watcher() i=3 2024-09-22T09:06:04.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.412+0000 7f7117d26800 20 remove_watcher() i=4 2024-09-22T09:06:04.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.413+0000 7f7117d26800 20 remove_watcher() i=5 2024-09-22T09:06:04.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.414+0000 7f7117d26800 20 remove_watcher() i=6 2024-09-22T09:06:04.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.415+0000 7f7117d26800 20 remove_watcher() i=7 2024-09-22T09:06:04.428 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-22T09:06:04.457 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:04.458 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:04.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.495+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 realm 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.497+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.498+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:04.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.498+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.499+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:04.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.499+0000 7fc022f25800 20 searching for the correct realm 2024-09-22T09:06:04.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.501+0000 7fc01f334640 0 -- 172.21.15.39:0/127480181 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc0140a7040 msgr2=0x7fc0140894d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:06:04.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.708+0000 7fc01e332640 0 -- 172.21.15.39:0/127480181 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc01806b940 msgr2=0x7fc018055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.915+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.916+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.916+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.916+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.916+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 zone default found 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 4 Realm: () 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 zonegroup default 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.917+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.918+0000 7fc022f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:04.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.918+0000 7fc022f25800 20 started sync module instance, tier type = 2024-09-22T09:06:04.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.918+0000 7fc022f25800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:04.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=0 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=1 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=2 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=3 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=4 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=5 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.928+0000 7fc022f25800 20 add_watcher() i=6 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.929+0000 7fc022f25800 20 add_watcher() i=7 2024-09-22T09:06:04.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.929+0000 7fc022f25800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:04.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.931+0000 7fbed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:04.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:04.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 5 note: GC not initialized 2024-09-22T09:06:04.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fbe4ffff640 20 reqs_thread_entry: start 2024-09-22T09:06:04.933 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:04.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 20 Filter name: none 2024-09-22T09:06:04.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fbe4dffb640 20 reqs_thread_entry: start 2024-09-22T09:06:04.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.932+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.933+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.933+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.933+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.933+0000 7fc022f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.933+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.934+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:04.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.934+0000 7fc022f25800 20 rados->read ofs=0 len=0 2024-09-22T09:06:04.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.934+0000 7fc022f25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:04.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.934+0000 7fc022f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:04.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.936+0000 7fbed57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:04.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.938+0000 7fc022f25800 20 remove_watcher() i=0 2024-09-22T09:06:04.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.938+0000 7fc022f25800 2 removed watcher, disabling cache 2024-09-22T09:06:04.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.939+0000 7fc022f25800 20 remove_watcher() i=1 2024-09-22T09:06:04.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.940+0000 7fc022f25800 20 remove_watcher() i=2 2024-09-22T09:06:04.943 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.941+0000 7fc022f25800 20 remove_watcher() i=3 2024-09-22T09:06:04.944 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.943+0000 7fc022f25800 20 remove_watcher() i=4 2024-09-22T09:06:04.945 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.944+0000 7fc022f25800 20 remove_watcher() i=5 2024-09-22T09:06:04.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.945+0000 7fc022f25800 20 remove_watcher() i=6 2024-09-22T09:06:04.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:04.946+0000 7fc022f25800 20 remove_watcher() i=7 2024-09-22T09:06:04.958 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:04.958 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:04.959 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:06:04.959 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:04.961 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:04.962 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:04.984 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:04.984 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.172 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.172 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.236 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at block_writes 2024-09-22T09:06:05.236 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:05.237 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.237 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.279 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.279 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.336 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.336 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.373 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.373 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.407 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.407 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.442 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.442 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.476 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.476 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.510 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.510 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.546 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.546 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.580 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.581 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.617 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.617 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.651 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.651 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.685 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.685 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.720 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.720 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.753 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.753 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.788 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.788 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.821 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.821 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.855 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.855 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.889 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.889 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.923 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.923 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.956 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.956 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:05.990 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:05.990 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:06.024 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T09:06:06.053 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:06.053 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:06.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.091+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 realm 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.093+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.094+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.094+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.095+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:06.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.095+0000 7f92d2d1f800 20 searching for the correct realm 2024-09-22T09:06:06.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.097+0000 7f92cf2a3640 0 -- 172.21.15.39:0/2584802345 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f92c4065420 msgr2=0x7f92c4065840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.303+0000 7f92ce2a1640 0 -- 172.21.15.39:0/2584802345 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f92c80494d0 msgr2=0x7f92c80487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:06.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:06.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:06.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:06.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:06.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:06.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.510+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 zone default found 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 4 Realm: () 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 zonegroup default 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.511+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.512+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.512+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.512+0000 7f92d2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.512+0000 7f92d2d1f800 20 started sync module instance, tier type = 2024-09-22T09:06:06.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.512+0000 7f92d2d1f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=0 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=1 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=2 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=3 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=4 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=5 2024-09-22T09:06:06.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.522+0000 7f92d2d1f800 20 add_watcher() i=6 2024-09-22T09:06:06.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.524+0000 7f92d2d1f800 20 add_watcher() i=7 2024-09-22T09:06:06.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.524+0000 7f92d2d1f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:06.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.527+0000 7f91857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:06.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.527+0000 7f92d2d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:06.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.527+0000 7f92d2d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:06.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.527+0000 7f92d2d1f800 5 note: GC not initialized 2024-09-22T09:06:06.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.528+0000 7f90fffff640 20 reqs_thread_entry: start 2024-09-22T09:06:06.529 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.528+0000 7f92d2d1f800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:06.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.528+0000 7f92d2d1f800 20 Filter name: none 2024-09-22T09:06:06.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.528+0000 7f90fdffb640 20 reqs_thread_entry: start 2024-09-22T09:06:06.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.528+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.529+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:06.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.529+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.529+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:06.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.529+0000 7f92d2d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:06.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.529+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.530+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:06.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.530+0000 7f92d2d1f800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.530+0000 7f92d2d1f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:06.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.530+0000 7f92d2d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:06.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.531+0000 7f91857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:06.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.534+0000 7f92d2d1f800 20 remove_watcher() i=0 2024-09-22T09:06:06.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.534+0000 7f92d2d1f800 2 removed watcher, disabling cache 2024-09-22T09:06:06.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.535+0000 7f92d2d1f800 20 remove_watcher() i=1 2024-09-22T09:06:06.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.536+0000 7f92d2d1f800 20 remove_watcher() i=2 2024-09-22T09:06:06.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.537+0000 7f92d2d1f800 20 remove_watcher() i=3 2024-09-22T09:06:06.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.539+0000 7f92d2d1f800 20 remove_watcher() i=4 2024-09-22T09:06:06.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.540+0000 7f92d2d1f800 20 remove_watcher() i=5 2024-09-22T09:06:06.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.541+0000 7f92d2d1f800 20 remove_watcher() i=6 2024-09-22T09:06:06.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.542+0000 7f92d2d1f800 20 remove_watcher() i=7 2024-09-22T09:06:06.554 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.555 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:06.555 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:06.555 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.556 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-22T09:06:06.592 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:06.592 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:06.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.631+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 realm 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:06.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 searching for the correct realm 2024-09-22T09:06:06.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.637+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7ff09c044040 msgr2=0x7ff09c046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.640+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7ff08c003ab0 msgr2=0x7ff09c044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.849+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:06.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:06.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 zone default found 2024-09-22T09:06:06.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Realm: () 2024-09-22T09:06:06.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:06.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 zonegroup default 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started sync module instance, tier type = 2024-09-22T09:06:06.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=0 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=1 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=2 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=3 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=4 2024-09-22T09:06:06.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=5 2024-09-22T09:06:06.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=6 2024-09-22T09:06:06.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.863+0000 7ff0a35a7800 20 add_watcher() i=7 2024-09-22T09:06:06.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.863+0000 7ff0a35a7800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:06.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.864+0000 7fef577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 note: GC not initialized 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7fef567e4640 20 reqs_thread_entry: start 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 Filter name: none 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7feec7fff640 20 reqs_thread_entry: start 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : miss 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:06.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:06.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:06.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:06.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:06.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:06.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:06.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:06.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:06.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.0 2024-09-22T09:06:06.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:06.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0a35a7800 time 2024-09-22T09:06:06.882098+0000 2024-09-22T09:06:06.882 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff0a6b8c748] 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:06:06.883 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0a35a7800 time 2024-09-22T09:06:06.882098+0000 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff0a6b8c748] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.884 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:06:06.885 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:06:06.885 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.885 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:06:06.885 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff0a35a7800 thread_name:radosgw-admin 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0a583e6f0] 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff0a588b99c] 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff0a6b8c7a2] 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.904 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff0a35a7800 thread_name:radosgw-admin 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0a583e6f0] 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff0a588b99c] 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:06.905 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff0a6b8c7a2] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: crc 2024-09-22T09:06:06.906 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: crc 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: starting msgr at 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: starting objecter 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests hook 0x5566734f2730 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: setting wanted keys 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: calling monclient init 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.907 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key hook 0x5566734c9358 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.908 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x5566734cc210 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x5566734cc630 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x7ff08c0030f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.875510s 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x5566734cc210 auth_method 0 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.909 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x7ff08c0030f0 auth_method 0 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.910 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x5566734cc630 auth_method 0 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_done global_id 7098 payload 824 2024-09-22T09:06:06.911 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:06:06.615+0000 7ff0a1091640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: dump: 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.912 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: dump: 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.913 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7098 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:06:06.616+0000 7fef8f606640 4 set_mon_vals no callback set 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 1 librados: init done 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.914 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:06:06.618+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7fef88077570 auth_method 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:06:06.618+0000 7ff0a1892640 10 monclient: get_auth_request con 0x5566734f1ba0 auth_method 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:06:06.619+0000 7ff0a1091640 10 monclient: get_auth_request con 0x556673514da0 auth_method 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:06:06.620+0000 7ff0a0890640 10 monclient: get_auth_request con 0x556673519100 auth_method 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:06:06.621+0000 7ff0a1892640 10 monclient: get_auth_request con 0x556673518650 auth_method 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.915 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.916 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x556673524850 EEXIST 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.917 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x556673520310 EEXIST 2024-09-22T09:06:06.918 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x556673548b70 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x556673548f50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x556673547880 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.883176s 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x556673548b70 auth_method 0 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.919 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x556673547880 auth_method 0 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x556673548f50 auth_method 0 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.920 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 7101 payload 824 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:06:06.623+0000 7ff0a0890640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: dump: 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.921 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.922 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: dump: 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7101 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.923 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:06:06.623+0000 7ff0a2093640 4 set_mon_vals no callback set 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:06:06.625+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7fef7c077620 auth_method 0 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: get_monmap_and_config 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.924 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.925 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.926 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed23f4608 EEXIST 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.927 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x55667359cbe0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x55667356dbf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x5566735980c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.887231s 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x55667359cbe0 auth_method 0 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x55667356dbf0 auth_method 0 2024-09-22T09:06:06.928 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 7104 payload 274 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:06:06.627+0000 7ff0a0890640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.929 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: dump: 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.930 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7104 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: get_monmap_and_config success 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 4 set_mon_vals no callback set 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: dump: 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.931 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: shutdown 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.932 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.933 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: starting msgr at 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: starting objecter 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x556673597480 EEXIST 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: setting wanted keys 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: calling monclient init 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.934 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.935 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x55667355d578 EEXIST 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x55667356dbf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x5566735980c0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x55667359cbe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.889540s 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x55667356dbf0 auth_method 0 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.936 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x5566735980c0 auth_method 0 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x55667359cbe0 auth_method 0 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.937 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 6653 payload 824 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:06:06.629+0000 7ff0a0890640 1 monclient: found mon.noname-c 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: dump: 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.938 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: dump: 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.939 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:06:06.630+0000 7fef84ff9640 4 set_mon_vals no callback set 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 6653 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 1 librados: init done 2024-09-22T09:06:06.940 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cr dump hook 0x556673589a08 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:06:06.631+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:06:06.632+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7fef6c077570 auth_method 0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:06:06.632+0000 7ff0a1091640 10 monclient: get_auth_request con 0x5566735b6750 auth_method 0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 realm 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.941 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:06:06.634+0000 7ff0a0890640 10 monclient: get_auth_request con 0x5566735ba960 auth_method 0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:06:06.635+0000 7ff0a1892640 10 monclient: get_auth_request con 0x5566735be1e0 auth_method 0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 searching for the correct realm 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:06:06.636+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff09c044040 auth_method 0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:06:06.637+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7ff09c044040 msgr2=0x7ff09c046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:06:06.637+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x7ff09c044040 session 0x7ff09c020030 osd.7 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:06:06.637+0000 7fef72ffd640 10 monclient: _renew_subs 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:06:06.637+0000 7fef72ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:06:06.637+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff094019070 auth_method 0 2024-09-22T09:06:06.942 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:06:06.637+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7fef6c087c90 auth_method 0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:06:06.637+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7ff0980ce020 auth_method 0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:06:06.639+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff08c003ab0 auth_method 0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:06:06.640+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7ff08c003ab0 msgr2=0x7ff09c044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:06:06.841+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff08c003ab0 auth_method 0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:06:06.844+0000 7ff0a0890640 10 monclient: get_auth_request con 0x5566733768a0 auth_method 0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:06:06.849+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.943 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 zone default found 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Realm: () 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 zonegroup default 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.944 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started sync module instance, tier type = 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:06:06.855+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x7ff094019070 session 0x7ff094082040 osd.2 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:06:06.856+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff09c044040 auth_method 0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=0 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=1 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=2 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=3 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=4 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=5 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=6 2024-09-22T09:06:06.945 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:06:06.863+0000 7ff0a35a7800 20 add_watcher() i=7 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:06:06.863+0000 7ff0a35a7800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:06:06.864+0000 7fef577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:06.946 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache list hook 0x556673593140 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache inspect hook 0x556673593140 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache erase hook 0x556673593140 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache zap hook 0x556673593140 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 note: GC not initialized 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:06:06.865+0000 7fef567e4640 20 reqs_thread_entry: start 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace show hook 0x7ff098087020 2024-09-22T09:06:06.947 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace history hook 0x7ff098087020 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace active hook 0x7ff098087020 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace active_short hook 0x7ff098087020 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 Filter name: none 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:06:06.865+0000 7feec7fff640 20 reqs_thread_entry: start 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : miss 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.948 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:06.949 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.0 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:06:06.877+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x5566735ba960 session 0x5566735ba2e0 osd.5 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:06:06.877+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff094019070 auth_method 0 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.950 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0a35a7800 time 2024-09-22T09:06:06.882098+0000 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:06.951 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff0a6b8c748] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff0a35a7800 thread_name:radosgw-admin 2024-09-22T09:06:06.952 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0a583e6f0] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff0a588b99c] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff0a6b8c7a2] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:06.953 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:06:06.954 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:06:06.955 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:06:06.956 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:06:06.957 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:06:06.958 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:06:06.959 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 7feec7fff640 / http_manager 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef567e4640 / http_manager 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef577e6640 / rgw_dt_lg_renew 2024-09-22T09:06:06.960 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef72ffd640 / ms_dispatch 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef84ff9640 / io_context_pool 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef86ffd640 / ms_dispatch 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef8de03640 / ms_dispatch 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef8f606640 / io_context_pool 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a0890640 / msgr-worker-2 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a1091640 / msgr-worker-1 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a1892640 / msgr-worker-0 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a2093640 / io_context_pool 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a35a7800 / radosgw-admin 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.112731.log 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:06:06.961 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: crc 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: crc 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734ce830) adding con mode: secure 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: starting msgr at 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: starting objecter 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests hook 0x5566734f2730 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: setting wanted keys 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 1 librados: calling monclient init 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.962 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding auth protocol: cephx 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.963 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: crc 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:06:06.614+0000 7ff0a35a7800 5 AuthRegistry(0x5566734c9210) adding con mode: secure 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key hook 0x5566734c9358 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x5566734cc210 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x5566734cc630 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x7ff08c0030f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.964 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:06:06.615+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.875510s 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x5566734cc210 auth_method 0 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x7ff08c0030f0 auth_method 0 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.965 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:06:06.615+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x5566734cc630 auth_method 0 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:06:06.615+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient(hunting): handle_auth_done global_id 7098 payload 824 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:06:06.615+0000 7ff0a1091640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:06:06.615+0000 7ff0a1091640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: dump: 2024-09-22T09:06:06.966 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.967 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:06:06.616+0000 7fef8de03640 10 monclient: dump: 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7098 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.968 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:06:06.616+0000 7fef8f606640 4 set_mon_vals no callback set 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:06:06.616+0000 7ff0a35a7800 1 librados: init done 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:06:06.618+0000 7fef8de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:06:06.618+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7fef88077570 auth_method 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:06:06.618+0000 7ff0a1892640 10 monclient: get_auth_request con 0x5566734f1ba0 auth_method 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:06:06.619+0000 7ff0a1091640 10 monclient: get_auth_request con 0x556673514da0 auth_method 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:06:06.620+0000 7ff0a0890640 10 monclient: get_auth_request con 0x556673519100 auth_method 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:06:06.621+0000 7ff0a1892640 10 monclient: get_auth_request con 0x556673518650 auth_method 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.969 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding auth protocol: cephx 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.970 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: crc 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735213c0) adding con mode: secure 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x556673524850 EEXIST 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.971 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding auth protocol: cephx 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: crc 2024-09-22T09:06:06.972 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 5 AuthRegistry(0x5566735201c8) adding con mode: secure 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:06:06.622+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x556673520310 EEXIST 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x556673548b70 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x556673548f50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x556673547880 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.883176s 2024-09-22T09:06:06.973 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x556673548b70 auth_method 0 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x556673547880 auth_method 0 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x556673548f50 auth_method 0 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.974 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:06:06.623+0000 7ff0a1091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:06:06.623+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 7101 payload 824 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:06:06.623+0000 7ff0a0890640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:06:06.623+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.975 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: dump: 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.976 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:06:06.623+0000 7fef86ffd640 10 monclient: dump: 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7101 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.977 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:06:06.623+0000 7ff0a2093640 4 set_mon_vals no callback set 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:06:06.623+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:06:06.625+0000 7fef86ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:06:06.625+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7fef7c077620 auth_method 0 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: get_monmap_and_config 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.978 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding auth protocol: cephx 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.979 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: crc 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x556673568640) adding con mode: secure 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding auth protocol: cephx 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.980 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: crc 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f44c0) adding con mode: secure 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:06:06.626+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed23f4608 EEXIST 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:06:06.981 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x55667359cbe0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x55667356dbf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x5566735980c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.887231s 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x55667359cbe0 auth_method 0 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x55667356dbf0 auth_method 0 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.982 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:06:06.627+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 7104 payload 274 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:06:06.627+0000 7ff0a0890640 1 monclient: found mon.noname-a 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:06:06.627+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: dump: 2024-09-22T09:06:06.983 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.984 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 7104 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 10 monclient: get_monmap_and_config success 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:06:06.627+0000 7ff0a35a7800 4 set_mon_vals no callback set 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:06:06.627+0000 7fef84ff9640 10 monclient: dump: 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.985 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: shutdown 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: build_initial_monmap 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 build_initial for_mkfs: 0 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: monmap: 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:06.986 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding auth protocol: cephx 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.987 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: crc 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x556673598ca0) adding con mode: secure 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: starting msgr at 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: starting objecter 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command objecter_requests cmddesc objecter_requests hook 0x556673597480 EEXIST 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: setting wanted keys 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 1 librados: calling monclient init 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 10 monclient: init 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding auth protocol: cephx 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.988 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:06:06.628+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: crc 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 AuthRegistry(0x55667355d430) adding con mode: secure 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command rotate-key cmddesc rotate-key hook 0x55667355d578 EEXIST 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:06:06.989 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-c con 0x55667356dbf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-a con 0x5566735980c0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): picked mon.noname-b con 0x55667359cbe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:06:06.629+0000 7ff0a35a7800 10 monclient(hunting): authenticate will time out at 2264.889540s 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): get_auth_request con 0x55667356dbf0 auth_method 0 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): get_auth_request con 0x5566735980c0 auth_method 0 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.990 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:06:06.629+0000 7ff0a1892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): get_auth_request con 0x55667359cbe0 auth_method 0 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:06:06.629+0000 7ff0a1091640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient(hunting): handle_auth_done global_id 6653 payload 824 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient: _finish_hunting 0 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:06:06.629+0000 7ff0a0890640 1 monclient: found mon.noname-c 2024-09-22T09:06:06.991 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:06:06.629+0000 7ff0a0890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: dump: 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.992 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: _finish_auth 0 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:06:06.630+0000 7fef72ffd640 10 monclient: dump: 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:06.993 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:06:06.630+0000 7fef84ff9640 4 set_mon_vals no callback set 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 5 monclient: authenticate success, global_id 6653 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _renew_subs 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 1 librados: init done 2024-09-22T09:06:06.994 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:06:06.630+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cr dump hook 0x556673589a08 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:06:06.631+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:06:06.632+0000 7fef72ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:06:06.632+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7fef6c077570 auth_method 0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:06:06.632+0000 7ff0a1091640 10 monclient: get_auth_request con 0x5566735b6750 auth_method 0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 realm 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.995 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:06:06.633+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:06:06.634+0000 7ff0a0890640 10 monclient: get_auth_request con 0x5566735ba960 auth_method 0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:06:06.634+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:06:06.635+0000 7ff0a1892640 10 monclient: get_auth_request con 0x5566735be1e0 auth_method 0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:06:06.635+0000 7ff0a35a7800 20 searching for the correct realm 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:06:06.636+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff09c044040 auth_method 0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:06:06.637+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7ff09c044040 msgr2=0x7ff09c046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:06:06.637+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x7ff09c044040 session 0x7ff09c020030 osd.7 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:06:06.637+0000 7fef72ffd640 10 monclient: _renew_subs 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:06:06.637+0000 7fef72ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:06:06.637+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff094019070 auth_method 0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:06:06.637+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7fef6c087c90 auth_method 0 2024-09-22T09:06:06.996 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:06:06.637+0000 7ff0a1892640 10 monclient: get_auth_request con 0x7ff0980ce020 auth_method 0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:06:06.639+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff08c003ab0 auth_method 0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:06:06.640+0000 7ff0a1091640 0 -- 172.21.15.39:0/1447526845 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7ff08c003ab0 msgr2=0x7ff09c044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:06:06.841+0000 7ff0a1091640 10 monclient: get_auth_request con 0x7ff08c003ab0 auth_method 0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:06:06.844+0000 7ff0a0890640 10 monclient: get_auth_request con 0x5566733768a0 auth_method 0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:06:06.849+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.997 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:06:06.850+0000 7ff0a35a7800 20 zone default found 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Realm: () 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 zonegroup default 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started sync module instance, tier type = 2024-09-22T09:06:06.998 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:06:06.851+0000 7ff0a35a7800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:06:06.855+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x7ff094019070 session 0x7ff094082040 osd.2 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:06:06.856+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff09c044040 auth_method 0 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=0 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=1 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=2 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=3 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=4 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=5 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:06:06.862+0000 7ff0a35a7800 20 add_watcher() i=6 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:06:06.863+0000 7ff0a35a7800 20 add_watcher() i=7 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:06:06.863+0000 7ff0a35a7800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:06.999 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding auth protocol: cephx 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:06:06.864+0000 7fef577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: crc 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:06:06.864+0000 7ff0a35a7800 5 AuthRegistry(0x7ffed23f4990) adding con mode: secure 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:07.000 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache list hook 0x556673593140 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache inspect hook 0x556673593140 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache erase hook 0x556673593140 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command cache zap hook 0x556673593140 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 note: GC not initialized 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:06:06.865+0000 7fef567e4640 20 reqs_thread_entry: start 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace show hook 0x7ff098087020 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace history hook 0x7ff098087020 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace active hook 0x7ff098087020 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 5 asok(0x5566732a70f0) register_command sync trace active_short hook 0x7ff098087020 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 Filter name: none 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:06:06.865+0000 7feec7fff640 20 reqs_thread_entry: start 2024-09-22T09:06:07.001 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:06:06.865+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : miss 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:06:06.866+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:07.002 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:06:06.870+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:06:06.871+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:06:06.872+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.0 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.1.1 2024-09-22T09:06:07.003 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:06:06.874+0000 7ff0a35a7800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.0 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:06:06.877+0000 7ff0a35a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:06:06.877+0000 7fef72ffd640 1 client.6653.objecter ms_handle_reset 0x5566735ba960 session 0x5566735ba2e0 osd.5 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:06:06.877+0000 7ff0a0890640 10 monclient: get_auth_request con 0x7ff094019070 auth_method 0 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:06:06.879+0000 7ff0a35a7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 93898510460144 notifier 6653 bl.length()=915 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:06:06.879+0000 7fef84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:07.004 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:06:06.881+0000 7ff0a35a7800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff0a35a7800 time 2024-09-22T09:06:06.882098+0000 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff0a6b8c748] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:06:07.005 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:06:06.882+0000 7ff0a35a7800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff0a35a7800 thread_name:radosgw-admin 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff0a583e6f0] 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff0a588b99c] 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff0a6b8c7a2] 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff0a6b8c906] 2024-09-22T09:06:07.006 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556672283e01] 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x556672292f02] 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556672293d64] 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff0a5829590] 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:06:07.007 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:06:07.008 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:06:07.009 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:06:07.010 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:06:07.011 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:06:07.012 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:06:07.013 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7feec7fff640 / http_manager 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef567e4640 / http_manager 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef577e6640 / rgw_dt_lg_renew 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef72ffd640 / ms_dispatch 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef84ff9640 / io_context_pool 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef86ffd640 / ms_dispatch 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef8de03640 / ms_dispatch 2024-09-22T09:06:07.014 INFO:tasks.workunit.client.0.smithi039.stderr: 7fef8f606640 / io_context_pool 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a0890640 / msgr-worker-2 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a1091640 / msgr-worker-1 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a1892640 / msgr-worker-0 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a2093640 / io_context_pool 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff0a35a7800 / radosgw-admin 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:06:06.883740Z_1bf1c412-552a-4f59-be56-a915df91a109/log 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:06:07.015 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.961+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 realm 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:07.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.963+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.964+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.964+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.965+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.965+0000 7f4ea7d2e800 20 searching for the correct realm 2024-09-22T09:06:07.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:06.967+0000 7f4ea42de640 0 -- 172.21.15.39:0/3370598394 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f4e9808abc0 msgr2=0x7f4e98095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:07.174 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.173+0000 7f4ea32dc640 0 -- 172.21.15.39:0/3370598394 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f4e9c072f40 msgr2=0x7f4e9c06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:07.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:07.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:07.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:07.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:07.381 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:07.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:07.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.382 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.380+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 zone default found 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 4 Realm: () 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:07.383 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 zonegroup default 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.381+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.382+0000 7f4ea7d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.382+0000 7f4ea7d2e800 20 started sync module instance, tier type = 2024-09-22T09:06:07.384 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.382+0000 7f4ea7d2e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:07.393 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=0 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=1 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=2 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=3 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=4 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=5 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.392+0000 7f4ea7d2e800 20 add_watcher() i=6 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.393+0000 7f4ea7d2e800 20 add_watcher() i=7 2024-09-22T09:06:07.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.393+0000 7f4ea7d2e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:07.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4ea7d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4ea7d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4ea7d2e800 5 note: GC not initialized 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4d58fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4ea7d2e800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.396+0000 7f4ea7d2e800 20 Filter name: none 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.397+0000 7f4cd27fc640 20 reqs_thread_entry: start 2024-09-22T09:06:07.398 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.397+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.397+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:07.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.397+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.398+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T09:06:07.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.398+0000 7f4ea7d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:07.399 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.398+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.398+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:07.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.398+0000 7f4ea7d2e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.399+0000 7f4ea7d2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T09:06:07.400 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.399+0000 7f4ea7d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:07.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.400+0000 7f4d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:07.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.403+0000 7f4ea7d2e800 20 remove_watcher() i=0 2024-09-22T09:06:07.404 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.403+0000 7f4ea7d2e800 2 removed watcher, disabling cache 2024-09-22T09:06:07.405 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.404+0000 7f4ea7d2e800 20 remove_watcher() i=1 2024-09-22T09:06:07.406 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.405+0000 7f4ea7d2e800 20 remove_watcher() i=2 2024-09-22T09:06:07.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.406+0000 7f4ea7d2e800 20 remove_watcher() i=3 2024-09-22T09:06:07.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.408+0000 7f4ea7d2e800 20 remove_watcher() i=4 2024-09-22T09:06:07.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.409+0000 7f4ea7d2e800 20 remove_watcher() i=5 2024-09-22T09:06:07.411 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.410+0000 7f4ea7d2e800 20 remove_watcher() i=6 2024-09-22T09:06:07.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.411+0000 7f4ea7d2e800 20 remove_watcher() i=7 2024-09-22T09:06:07.424 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.424 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:07.424 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:07.424 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:07.425 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:07.426 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:07.457 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:07.457 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:07.515 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:06:07.549 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:07.549 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:07.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.588+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 20 realm 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.590+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.591+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:07.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.591+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.591+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:07.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.591+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:07.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.592+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:07.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.592+0000 7f3025773800 20 searching for the correct realm 2024-09-22T09:06:07.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:07.796+0000 7f3023a5e640 0 -- 172.21.15.39:0/387817911 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f3018063070 msgr2=0x7f3018098920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:08.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.203+0000 7f3022a5c640 0 -- 172.21.15.39:0/387817911 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f301c08b2f0 msgr2=0x7f301c069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:08.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:08.412 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:08.413 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.411+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 zone default found 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 4 Realm: () 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:08.414 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 zonegroup default 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.412+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:08.415 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 started sync module instance, tier type = 2024-09-22T09:06:08.416 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.413+0000 7f3025773800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:08.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=0 2024-09-22T09:06:08.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=1 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=2 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=3 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=4 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=5 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.425+0000 7f3025773800 20 add_watcher() i=6 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.426+0000 7f3025773800 20 add_watcher() i=7 2024-09-22T09:06:08.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.426+0000 7f3025773800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:08.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.428+0000 7f2ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:08.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:08.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 5 note: GC not initialized 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f2ed8fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 20 Filter name: none 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f2e527fc640 20 reqs_thread_entry: start 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T09:06:08.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.429+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : miss 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 20 rados->read ofs=0 len=0 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:08.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.430+0000 7f3025773800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:08.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.432+0000 7f3025773800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to be held by another RGW process; skipping for now 2024-09-22T09:06:08.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.433+0000 7f2ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:08.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.436+0000 7f3025773800 20 remove_watcher() i=0 2024-09-22T09:06:08.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.436+0000 7f3025773800 2 removed watcher, disabling cache 2024-09-22T09:06:08.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.437+0000 7f3025773800 20 remove_watcher() i=1 2024-09-22T09:06:08.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.438+0000 7f3025773800 20 remove_watcher() i=2 2024-09-22T09:06:08.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.439+0000 7f3025773800 20 remove_watcher() i=3 2024-09-22T09:06:08.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.440+0000 7f3025773800 20 remove_watcher() i=4 2024-09-22T09:06:08.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.442+0000 7f3025773800 20 remove_watcher() i=5 2024-09-22T09:06:08.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.443+0000 7f3025773800 20 remove_watcher() i=6 2024-09-22T09:06:08.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:08.444+0000 7f3025773800 20 remove_watcher() i=7 2024-09-22T09:06:08.458 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:06:38.477 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:06:38.517 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:38.517 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:38.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.561+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 20 realm 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.562+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.563+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.563+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.564+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:38.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.564+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.565+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:38.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.565+0000 7f4b9bc2d800 20 searching for the correct realm 2024-09-22T09:06:38.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.567+0000 7f4b99f18640 0 -- 172.21.15.39:0/777129340 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f4b90021040 msgr2=0x7f4b90041950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:38.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.775+0000 7f4b98f16640 0 -- 172.21.15.39:0/777129340 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f4b94012bf0 msgr2=0x7f4b940a9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:38.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:38.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:38.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:38.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:38.985 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:38.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.982+0000 7f4b9bc2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:38.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.983+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.983+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.983+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.983+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.983+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 zone default found 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 4 Realm: () 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 zonegroup default 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.984+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.985+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.985+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.985+0000 7f4b9bc2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.985+0000 7f4b9bc2d800 20 started sync module instance, tier type = 2024-09-22T09:06:38.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.985+0000 7f4b9bc2d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=0 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=1 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=2 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=3 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=4 2024-09-22T09:06:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=5 2024-09-22T09:06:39.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.997+0000 7f4b9bc2d800 20 add_watcher() i=6 2024-09-22T09:06:39.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.998+0000 7f4b9bc2d800 20 add_watcher() i=7 2024-09-22T09:06:39.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:38.998+0000 7f4b9bc2d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:39.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.000+0000 7f4a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:39.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4b9bc2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4b9bc2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4b9bc2d800 5 note: GC not initialized 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4a4e7e4640 20 reqs_thread_entry: start 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4b9bc2d800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f4b9bc2d800 20 Filter name: none 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.001+0000 7f49bffff640 20 reqs_thread_entry: start 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-22T09:06:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : miss 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.002+0000 7f4b9bc2d800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:39.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.003+0000 7f4b9bc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:39.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.004+0000 7f4b9bc2d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:06:39.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.009+0000 7f4b9bc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.009+0000 7f4b9bc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.009+0000 7f4b9bc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.009+0000 7f4b9bc2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.010+0000 7f4a7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94458180065008 notifier 7164 bl.length()=915 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.010+0000 7f4a7cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.010+0000 7f4a7cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.010+0000 7f4a7cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.012+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:39.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.012+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:39.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.012+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:39.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.012+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:39.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.016+0000 7f4b9bc2d800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.2.0 2024-09-22T09:06:39.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.016+0000 7f4b9bc2d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.2.0 2024-09-22T09:06:39.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.016+0000 7f4b9bc2d800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.2.1 2024-09-22T09:06:39.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.016+0000 7f4b9bc2d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.2.1 2024-09-22T09:06:39.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.016+0000 7f4b9bc2d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.0 2024-09-22T09:06:39.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.019+0000 7f4b9bc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:39.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.019+0000 7f4b9bc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:39.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4b9bc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4b9bc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4b9bc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4b9bc2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:39.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4a6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 94458180065008 notifier 7164 bl.length()=915 2024-09-22T09:06:39.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4a6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4a6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.021+0000 7f4a6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.023+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:39.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.023+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:39.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.023+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:39.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.023+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:39.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.025+0000 7f4b9bc2d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.29.0 2024-09-22T09:06:39.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.025+0000 7f4b9bc2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:39.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.025+0000 7f4b9bc2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4b9bc2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4b9bc2d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4b9bc2d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4b9bc2d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29, ofs0, ns] 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4a7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529754 cookie 94458180065008 notifier 7164 bl.length()=883 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4a7cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 info.flags=0x17 2024-09-22T09:06:39.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4a7cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 to cache LRU end 2024-09-22T09:06:39.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.027+0000 7f4a7cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:39.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.029+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_sources= new_sources= 2024-09-22T09:06:39.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.029+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential sources added=[] removed=[] 2024-09-22T09:06:39.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.029+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): orig_dests= new_dests= 2024-09-22T09:06:39.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.029+0000 7f4b9bc2d800 20 handle_bi_update(): bucket=:abort-at-block-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.29]): potential dests added=[] removed=[] 2024-09-22T09:06:39.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.030+0000 7f4b9bc2d800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-22T09:06:39.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.033+0000 7f4a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:39.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.035+0000 7f4b9bc2d800 20 remove_watcher() i=0 2024-09-22T09:06:39.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.035+0000 7f4b9bc2d800 2 removed watcher, disabling cache 2024-09-22T09:06:39.039 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.036+0000 7f4b9bc2d800 20 remove_watcher() i=1 2024-09-22T09:06:39.040 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.038+0000 7f4b9bc2d800 20 remove_watcher() i=2 2024-09-22T09:06:39.041 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.039+0000 7f4b9bc2d800 20 remove_watcher() i=3 2024-09-22T09:06:39.043 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.040+0000 7f4b9bc2d800 20 remove_watcher() i=4 2024-09-22T09:06:39.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.042+0000 7f4b9bc2d800 20 remove_watcher() i=5 2024-09-22T09:06:39.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.043+0000 7f4b9bc2d800 20 remove_watcher() i=6 2024-09-22T09:06:39.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.044+0000 7f4b9bc2d800 20 remove_watcher() i=7 2024-09-22T09:06:39.060 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-22T09:06:39.091 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:39.091 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:39.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.131+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 realm 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.135 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.133+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.134+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:39.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.134+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.135+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:39.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.135+0000 7f1476c87800 20 searching for the correct realm 2024-09-22T09:06:39.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.137+0000 7f1474f79640 0 -- 172.21.15.39:0/3456440776 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f146809a070 msgr2=0x7f1468084410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:39.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.344+0000 7f1473f77640 0 -- 172.21.15.39:0/3456440776 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f146c0a1330 msgr2=0x7f146c07e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:39.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.551+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 zone default found 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 4 Realm: () 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 zonegroup default 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.552+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.556 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:39.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 started sync module instance, tier type = 2024-09-22T09:06:39.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.553+0000 7f1476c87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:39.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=0 2024-09-22T09:06:39.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=1 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=2 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=3 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=4 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=5 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.564+0000 7f1476c87800 20 add_watcher() i=6 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.565+0000 7f1476c87800 20 add_watcher() i=7 2024-09-22T09:06:39.567 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.565+0000 7f1476c87800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:39.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.567+0000 7f132afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:39.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 5 note: GC not initialized 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1329fdb640 20 reqs_thread_entry: start 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 20 Filter name: none 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f129b7fe640 20 reqs_thread_entry: start 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.568+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.569+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:39.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.569+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.570+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:39.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.570+0000 7f1476c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:39.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.570+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.570+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:06:39.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.570+0000 7f1476c87800 20 rados->read ofs=0 len=0 2024-09-22T09:06:39.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.571+0000 7f1476c87800 20 rados_obj.operate() r=0 bl.length=411 2024-09-22T09:06:39.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.571+0000 7f1476c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:39.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.572+0000 7f132afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:39.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.575+0000 7f1476c87800 20 remove_watcher() i=0 2024-09-22T09:06:39.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.575+0000 7f1476c87800 2 removed watcher, disabling cache 2024-09-22T09:06:39.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.576+0000 7f1476c87800 20 remove_watcher() i=1 2024-09-22T09:06:39.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.577+0000 7f1476c87800 20 remove_watcher() i=2 2024-09-22T09:06:39.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.578+0000 7f1476c87800 20 remove_watcher() i=3 2024-09-22T09:06:39.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.580+0000 7f1476c87800 20 remove_watcher() i=4 2024-09-22T09:06:39.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.581+0000 7f1476c87800 20 remove_watcher() i=5 2024-09-22T09:06:39.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.582+0000 7f1476c87800 20 remove_watcher() i=6 2024-09-22T09:06:39.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:39.583+0000 7f1476c87800 20 remove_watcher() i=7 2024-09-22T09:06:39.597 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:39.597 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:39.597 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-block-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:06:39.597 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:39.600 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.600 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:39.622 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.622 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:39.812 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.812 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:39.877 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-22T09:06:39.877 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.878 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:39.920 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.920 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:39.978 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:39.978 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.015 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.016 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.050 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.050 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.084 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.084 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.118 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.118 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.153 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.154 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.188 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.188 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.222 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.222 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.256 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.289 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.289 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.324 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.324 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.358 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.359 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.392 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.392 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.427 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.427 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.464 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.464 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.499 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.499 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.534 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.534 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.567 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.567 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.601 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.601 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.637 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:40.637 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:40.671 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T09:06:40.700 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:40.700 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:40.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.738+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 20 realm 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.740+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.741+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:40.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.741+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:40.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.742+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:40.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.742+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:40.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.742+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:40.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.742+0000 7f56b5010800 20 searching for the correct realm 2024-09-22T09:06:40.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.744+0000 7f56b0fe1640 0 -- 172.21.15.39:0/3638905113 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5698026040 msgr2=0x7f56980830b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:40.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:40.950+0000 7f56affdf640 0 -- 172.21.15.39:0/3638905113 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f56a8081900 msgr2=0x7f56a806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:41.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.157+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:41.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 zone default found 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 4 Realm: () 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 zonegroup default 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.158+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.159+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.159+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.159+0000 7f56b5010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.159+0000 7f56b5010800 20 started sync module instance, tier type = 2024-09-22T09:06:41.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.159+0000 7f56b5010800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:41.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=0 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=1 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=2 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=3 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=4 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=5 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.170+0000 7f56b5010800 20 add_watcher() i=6 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.171+0000 7f56b5010800 20 add_watcher() i=7 2024-09-22T09:06:41.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.171+0000 7f56b5010800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:41.175 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.173+0000 7f5566fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:41.176 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 5 note: GC not initialized 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f5565fdb640 20 reqs_thread_entry: start 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 20 Filter name: none 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f54d77fe640 20 reqs_thread_entry: start 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.174+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.175+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:41.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.175+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.176+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:41.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.176+0000 7f56b5010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:41.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.176+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.176+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:41.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.176+0000 7f56b5010800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.177+0000 7f56b5010800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:41.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.177+0000 7f56b5010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:41.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.178+0000 7f5566fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.181+0000 7f56b5010800 20 remove_watcher() i=0 2024-09-22T09:06:41.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.181+0000 7f56b5010800 2 removed watcher, disabling cache 2024-09-22T09:06:41.184 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.182+0000 7f56b5010800 20 remove_watcher() i=1 2024-09-22T09:06:41.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.183+0000 7f56b5010800 20 remove_watcher() i=2 2024-09-22T09:06:41.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.184+0000 7f56b5010800 20 remove_watcher() i=3 2024-09-22T09:06:41.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.185+0000 7f56b5010800 20 remove_watcher() i=4 2024-09-22T09:06:41.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.186+0000 7f56b5010800 20 remove_watcher() i=5 2024-09-22T09:06:41.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.187+0000 7f56b5010800 20 remove_watcher() i=6 2024-09-22T09:06:41.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.189+0000 7f56b5010800 20 remove_watcher() i=7 2024-09-22T09:06:41.202 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:41.202 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:41.203 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:41.203 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:41.204 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-22T09:06:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:41.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.278+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.279+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.279+0000 7f8f77f3e800 20 realm 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.279+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.280+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.280+0000 7f8f77f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.280+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.280+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.280+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.281+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:41.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.281+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.281+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:41.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.281+0000 7f8f77f3e800 20 searching for the correct realm 2024-09-22T09:06:41.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.283+0000 7f8f734bf640 0 -- 172.21.15.39:0/3838327635 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f8f6408e630 msgr2=0x7f8f6408d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:41.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.287+0000 7f8f734bf640 0 -- 172.21.15.39:0/3838327635 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f8e3c087cc0 msgr2=0x7f8e3c08a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:41.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.292+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:41.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 zone default found 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 4 Realm: () 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 zonegroup default 2024-09-22T09:06:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.293+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 started sync module instance, tier type = 2024-09-22T09:06:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.294+0000 7f8f77f3e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=0 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=1 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=2 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=3 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=4 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=5 2024-09-22T09:06:41.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.305+0000 7f8f77f3e800 20 add_watcher() i=6 2024-09-22T09:06:41.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.306+0000 7f8f77f3e800 20 add_watcher() i=7 2024-09-22T09:06:41.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.306+0000 7f8f77f3e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:41.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.307+0000 7f8e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 5 note: GC not initialized 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8e28fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 20 Filter name: none 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8da27fc640 20 reqs_thread_entry: start 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T09:06:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.308+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.309+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.309+0000 7f8f77f3e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.309+0000 7f8f77f3e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.309+0000 7f8f77f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 : miss 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.309+0000 7f8f77f3e800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:41.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:41.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.310+0000 7f8f77f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8f77f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8f77f3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8f77f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8f77f3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30, ofs0, ns] 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8e52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 94376705087888 notifier 6758 bl.length()=931 2024-09-22T09:06:41.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8e52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8e52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.314+0000 7f8e52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.315+0000 7f8e527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 94376705087888 notifier 6758 bl.length()=931 2024-09-22T09:06:41.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.315+0000 7f8e527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.315+0000 7f8e527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.315+0000 7f8e527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.318+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_sources= new_sources= 2024-09-22T09:06:41.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.318+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential sources added=[] removed=[] 2024-09-22T09:06:41.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.318+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_dests= new_dests= 2024-09-22T09:06:41.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.318+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential dests added=[] removed=[] 2024-09-22T09:06:41.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.320+0000 7f8f77f3e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.1.0 2024-09-22T09:06:41.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.320+0000 7f8f77f3e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.1.0 2024-09-22T09:06:41.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.320+0000 7f8f77f3e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.1.1 2024-09-22T09:06:41.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.320+0000 7f8f77f3e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.1.1 2024-09-22T09:06:41.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.320+0000 7f8f77f3e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.0 2024-09-22T09:06:41.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.323+0000 7f8f77f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:41.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.323+0000 7f8f77f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.324+0000 7f8f77f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.324+0000 7f8f77f3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.324+0000 7f8f77f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.324+0000 7f8f77f3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30, ofs0, ns] 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.325+0000 7f8e527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 94376705087888 notifier 6758 bl.length()=931 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.325+0000 7f8e527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.325+0000 7f8e527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:41.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.325+0000 7f8e527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:41.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.326+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_sources= new_sources= 2024-09-22T09:06:41.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.326+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential sources added=[] removed=[] 2024-09-22T09:06:41.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.326+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_dests= new_dests= 2024-09-22T09:06:41.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.326+0000 7f8f77f3e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential dests added=[] removed=[] 2024-09-22T09:06:41.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.327+0000 7f8f77f3e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.0 2024-09-22T09:06:41.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.327+0000 7f8f77f3e800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-22T09:06:41.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.327+0000 7f8f77f3e800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-22T09:06:41.333 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.331+0000 7f8e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.333+0000 7f8f77f3e800 20 remove_watcher() i=0 2024-09-22T09:06:41.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.333+0000 7f8f77f3e800 2 removed watcher, disabling cache 2024-09-22T09:06:41.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.334+0000 7f8f77f3e800 20 remove_watcher() i=1 2024-09-22T09:06:41.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.335+0000 7f8f77f3e800 20 remove_watcher() i=2 2024-09-22T09:06:41.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.337+0000 7f8f77f3e800 20 remove_watcher() i=3 2024-09-22T09:06:41.340 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.338+0000 7f8f77f3e800 20 remove_watcher() i=4 2024-09-22T09:06:41.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.339+0000 7f8f77f3e800 20 remove_watcher() i=5 2024-09-22T09:06:41.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.340+0000 7f8f77f3e800 20 remove_watcher() i=6 2024-09-22T09:06:41.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.341+0000 7f8f77f3e800 20 remove_watcher() i=7 2024-09-22T09:06:41.356 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T09:06:41.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:41.385 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:41.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.424+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 realm 2024-09-22T09:06:41.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.426+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.427+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:41.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.427+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.428+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:41.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.428+0000 7fc67e526800 20 searching for the correct realm 2024-09-22T09:06:41.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.430+0000 7fc67a9da640 0 -- 172.21.15.39:0/165235749 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc670014b70 msgr2=0x7fc67005fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:41.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.636+0000 7fc6799d8640 0 -- 172.21.15.39:0/165235749 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc674073440 msgr2=0x7fc674068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:41.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.843+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.844+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.844+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.844+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.844+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 zone default found 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 4 Realm: () 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 zonegroup default 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.845+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.846+0000 7fc67e526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:41.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.846+0000 7fc67e526800 20 started sync module instance, tier type = 2024-09-22T09:06:41.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.846+0000 7fc67e526800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=0 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=1 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=2 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=3 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=4 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=5 2024-09-22T09:06:41.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.856+0000 7fc67e526800 20 add_watcher() i=6 2024-09-22T09:06:41.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.857+0000 7fc67e526800 20 add_watcher() i=7 2024-09-22T09:06:41.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.857+0000 7fc67e526800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:41.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.858+0000 7fc530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:41.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:41.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 5 note: GC not initialized 2024-09-22T09:06:41.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc4ab7fe640 20 reqs_thread_entry: start 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 20 Filter name: none 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc4a97fa640 20 reqs_thread_entry: start 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.859+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.860+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:41.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.860+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:06:41.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:41.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:41.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 rados->read ofs=0 len=0 2024-09-22T09:06:41.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:06:41.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.861+0000 7fc67e526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:41.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.863+0000 7fc530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:41.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.865+0000 7fc67e526800 20 remove_watcher() i=0 2024-09-22T09:06:41.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.865+0000 7fc67e526800 2 removed watcher, disabling cache 2024-09-22T09:06:41.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.866+0000 7fc67e526800 20 remove_watcher() i=1 2024-09-22T09:06:41.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.867+0000 7fc67e526800 20 remove_watcher() i=2 2024-09-22T09:06:41.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.868+0000 7fc67e526800 20 remove_watcher() i=3 2024-09-22T09:06:41.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.869+0000 7fc67e526800 20 remove_watcher() i=4 2024-09-22T09:06:41.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.870+0000 7fc67e526800 20 remove_watcher() i=5 2024-09-22T09:06:41.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.872+0000 7fc67e526800 20 remove_watcher() i=6 2024-09-22T09:06:41.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:41.873+0000 7fc67e526800 20 remove_watcher() i=7 2024-09-22T09:06:41.886 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:41.886 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:41.887 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:41.887 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:41.888 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:41.888 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:41.919 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:41.919 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:41.976 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:06:42.008 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:42.008 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:42.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.046+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 20 realm 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.047+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.048+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.048+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.049+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:42.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.049+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.049+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:42.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.049+0000 7fd5cd52a800 20 searching for the correct realm 2024-09-22T09:06:42.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.051+0000 7fd5c9962640 0 -- 172.21.15.39:0/1924505912 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd5c0086030 msgr2=0x7fd5c007a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:42.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.258+0000 7fd5c8960640 0 -- 172.21.15.39:0/1924505912 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd5c4048b60 msgr2=0x7fd5c4052860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.464+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.465+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.465+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 zone default found 2024-09-22T09:06:42.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 4 Realm: () 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 zonegroup default 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.466+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.467+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.467+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.467+0000 7fd5cd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.467+0000 7fd5cd52a800 20 started sync module instance, tier type = 2024-09-22T09:06:42.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.467+0000 7fd5cd52a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=0 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=1 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=2 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=3 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=4 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=5 2024-09-22T09:06:42.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.477+0000 7fd5cd52a800 20 add_watcher() i=6 2024-09-22T09:06:42.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.479+0000 7fd5cd52a800 20 add_watcher() i=7 2024-09-22T09:06:42.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.479+0000 7fd5cd52a800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:42.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.480+0000 7fd47ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:42.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:42.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 5 note: GC not initialized 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd47efe5640 20 reqs_thread_entry: start 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 20 Filter name: none 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd47cfe1640 20 reqs_thread_entry: start 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.481+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 : miss 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.482+0000 7fd5cd52a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 2024-09-22T09:06:42.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.484+0000 7fd5cd52a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:06:42.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd5cd52a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd5cd52a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd5cd52a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd5cd52a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30, ofs0, ns] 2024-09-22T09:06:42.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd49bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 94785166208480 notifier 7263 bl.length()=931 2024-09-22T09:06:42.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd49bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd49bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.488+0000 7fd49bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.490+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_sources= new_sources= 2024-09-22T09:06:42.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.490+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential sources added=[] removed=[] 2024-09-22T09:06:42.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.490+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_dests= new_dests= 2024-09-22T09:06:42.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.490+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential dests added=[] removed=[] 2024-09-22T09:06:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.493+0000 7fd5cd52a800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.2.0 2024-09-22T09:06:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.493+0000 7fd5cd52a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.2.0 2024-09-22T09:06:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.493+0000 7fd5cd52a800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.2.1 2024-09-22T09:06:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.493+0000 7fd5cd52a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.2.1 2024-09-22T09:06:42.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.493+0000 7fd5cd52a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.0 2024-09-22T09:06:42.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.495+0000 7fd5cd52a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:42.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.495+0000 7fd5cd52a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd5cd52a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd5cd52a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd5cd52a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd5cd52a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30, ofs0, ns] 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd49bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94785166208480 notifier 7263 bl.length()=931 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd49bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd49bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.497+0000 7fd49bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.498+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_sources= new_sources= 2024-09-22T09:06:42.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.498+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential sources added=[] removed=[] 2024-09-22T09:06:42.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.498+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_dests= new_dests= 2024-09-22T09:06:42.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.498+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential dests added=[] removed=[] 2024-09-22T09:06:42.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.500+0000 7fd5cd52a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.30.0 2024-09-22T09:06:42.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.500+0000 7fd5cd52a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:42.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.500+0000 7fd5cd52a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 2024-09-22T09:06:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd5cd52a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd5cd52a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd5cd52a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd5cd52a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30, ofs0, ns] 2024-09-22T09:06:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd49bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529708 cookie 94785166208480 notifier 7263 bl.length()=899 2024-09-22T09:06:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd49bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 info.flags=0x17 2024-09-22T09:06:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd49bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 to cache LRU end 2024-09-22T09:06:42.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.502+0000 7fd49bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:42.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.504+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_sources= new_sources= 2024-09-22T09:06:42.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.504+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential sources added=[] removed=[] 2024-09-22T09:06:42.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.504+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): orig_dests= new_dests= 2024-09-22T09:06:42.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.504+0000 7fd5cd52a800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.30]): potential dests added=[] removed=[] 2024-09-22T09:06:42.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.505+0000 7fd5cd52a800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:06:42.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.507+0000 7fd47ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:42.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.510+0000 7fd5cd52a800 20 remove_watcher() i=0 2024-09-22T09:06:42.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.510+0000 7fd5cd52a800 2 removed watcher, disabling cache 2024-09-22T09:06:42.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.511+0000 7fd5cd52a800 20 remove_watcher() i=1 2024-09-22T09:06:42.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.512+0000 7fd5cd52a800 20 remove_watcher() i=2 2024-09-22T09:06:42.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.513+0000 7fd5cd52a800 20 remove_watcher() i=3 2024-09-22T09:06:42.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.514+0000 7fd5cd52a800 20 remove_watcher() i=4 2024-09-22T09:06:42.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.516+0000 7fd5cd52a800 20 remove_watcher() i=5 2024-09-22T09:06:42.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.521+0000 7fd5cd52a800 20 remove_watcher() i=6 2024-09-22T09:06:42.528 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.526+0000 7fd5cd52a800 20 remove_watcher() i=7 2024-09-22T09:06:42.542 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T09:06:42.572 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:42.572 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:42.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.610+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.611+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.611+0000 7f2999735800 20 realm 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.611+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.612+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.612+0000 7f2999735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.612+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.612+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:42.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.612+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.613+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:42.615 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.613+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:42.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.614+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:42.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.614+0000 7f2999735800 20 searching for the correct realm 2024-09-22T09:06:42.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.616+0000 7f2995ce5640 0 -- 172.21.15.39:0/707292134 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f298c06d040 msgr2=0x7f298c09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:42.822+0000 7f2994ce3640 0 -- 172.21.15.39:0/707292134 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2990045300 msgr2=0x7f29900a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.029+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:43.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 zone default found 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 4 Realm: () 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 zonegroup default 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.030+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:43.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 started sync module instance, tier type = 2024-09-22T09:06:43.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.031+0000 7f2999735800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=0 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=1 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=2 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=3 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=4 2024-09-22T09:06:43.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=5 2024-09-22T09:06:43.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.042+0000 7f2999735800 20 add_watcher() i=6 2024-09-22T09:06:43.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.043+0000 7f2999735800 20 add_watcher() i=7 2024-09-22T09:06:43.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.043+0000 7f2999735800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:43.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f284b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f2999735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f2999735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f2999735800 5 note: GC not initialized 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f284a7e4640 20 reqs_thread_entry: start 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.045+0000 7f2999735800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.046+0000 7f2999735800 20 Filter name: none 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.046+0000 7f27bbfff640 20 reqs_thread_entry: start 2024-09-22T09:06:43.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.046+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.046+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.046+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.047+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.047+0000 7f2999735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:43.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.047+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.047+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:43.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.047+0000 7f2999735800 20 rados->read ofs=0 len=0 2024-09-22T09:06:43.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.048+0000 7f2999735800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:43.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.048+0000 7f2999735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:43.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.049+0000 7f284b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:43.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.051+0000 7f2999735800 20 remove_watcher() i=0 2024-09-22T09:06:43.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.051+0000 7f2999735800 2 removed watcher, disabling cache 2024-09-22T09:06:43.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.053+0000 7f2999735800 20 remove_watcher() i=1 2024-09-22T09:06:43.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.054+0000 7f2999735800 20 remove_watcher() i=2 2024-09-22T09:06:43.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.055+0000 7f2999735800 20 remove_watcher() i=3 2024-09-22T09:06:43.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.056+0000 7f2999735800 20 remove_watcher() i=4 2024-09-22T09:06:43.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.057+0000 7f2999735800 20 remove_watcher() i=5 2024-09-22T09:06:43.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.058+0000 7f2999735800 20 remove_watcher() i=6 2024-09-22T09:06:43.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:43.060+0000 7f2999735800 20 remove_watcher() i=7 2024-09-22T09:06:43.073 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:43.073 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:43.073 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:06:43.073 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:43.075 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.075 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.098 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.098 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.292 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.292 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.358 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-22T09:06:43.359 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:43.359 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.359 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.402 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.402 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.458 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.459 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.492 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.493 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.527 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.527 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.562 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.562 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.597 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.597 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.632 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.632 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.666 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.666 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.700 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.700 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.734 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.734 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.768 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.768 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.807 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.808 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.847 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.847 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.880 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.880 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.913 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.913 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.947 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.948 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:43.981 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:43.981 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:44.015 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:44.015 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:44.049 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:44.050 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:44.083 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:44.083 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:44.117 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:44.117 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:44.153 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T09:06:44.182 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:44.183 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:44.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.220+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 realm 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.222+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.223+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:44.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.223+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.224+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:44.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.224+0000 7f31e0940800 20 searching for the correct realm 2024-09-22T09:06:44.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.225+0000 7f31dceee640 0 -- 172.21.15.39:0/1885824927 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f31c4063070 msgr2=0x7f31c40e3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:44.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.432+0000 7f31dbeec640 0 -- 172.21.15.39:0/1885824927 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f31d4051b00 msgr2=0x7f31d4060920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:44.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.638+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 zone default found 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 4 Realm: () 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 zonegroup default 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.639+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.640+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.640+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.640+0000 7f31e0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.640+0000 7f31e0940800 20 started sync module instance, tier type = 2024-09-22T09:06:44.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.640+0000 7f31e0940800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=0 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=1 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=2 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=3 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=4 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.650+0000 7f31e0940800 20 add_watcher() i=5 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.651+0000 7f31e0940800 20 add_watcher() i=6 2024-09-22T09:06:44.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.651+0000 7f31e0940800 20 add_watcher() i=7 2024-09-22T09:06:44.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.651+0000 7f31e0940800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:44.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.653+0000 7f30927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:44.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:44.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 5 note: GC not initialized 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f30917e2640 20 reqs_thread_entry: start 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 20 Filter name: none 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f3002ffd640 20 reqs_thread_entry: start 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.654+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.655+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:44.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.655+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.656+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:44.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.656+0000 7f31e0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:44.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.656+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.657+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:44.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.657+0000 7f31e0940800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.657+0000 7f31e0940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:44.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.657+0000 7f31e0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:44.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.659+0000 7f30927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:44.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.661+0000 7f31e0940800 20 remove_watcher() i=0 2024-09-22T09:06:44.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.661+0000 7f31e0940800 2 removed watcher, disabling cache 2024-09-22T09:06:44.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.662+0000 7f31e0940800 20 remove_watcher() i=1 2024-09-22T09:06:44.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.664+0000 7f31e0940800 20 remove_watcher() i=2 2024-09-22T09:06:44.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.665+0000 7f31e0940800 20 remove_watcher() i=3 2024-09-22T09:06:44.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.666+0000 7f31e0940800 20 remove_watcher() i=4 2024-09-22T09:06:44.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.667+0000 7f31e0940800 20 remove_watcher() i=5 2024-09-22T09:06:44.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.668+0000 7f31e0940800 20 remove_watcher() i=6 2024-09-22T09:06:44.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.669+0000 7f31e0940800 20 remove_watcher() i=7 2024-09-22T09:06:44.683 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:44.683 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:44.683 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:44.683 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:44.684 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-22T09:06:44.721 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:44.721 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:44.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.759+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 20 realm 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.760+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.761+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.761+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.762+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:44.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.762+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.762+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:44.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.762+0000 7f71a6128800 20 searching for the correct realm 2024-09-22T09:06:44.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.765+0000 7f71a255e640 0 -- 172.21.15.39:0/3099450787 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f719803a930 msgr2=0x7f719802b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:44.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.970+0000 7f71a155c640 0 -- 172.21.15.39:0/3099450787 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f719401f060 msgr2=0x7f7194085850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.977+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:44.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 zone default found 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 4 Realm: () 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 zonegroup default 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.978+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 started sync module instance, tier type = 2024-09-22T09:06:44.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.979+0000 7f71a6128800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=0 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=1 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=2 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=3 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=4 2024-09-22T09:06:44.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=5 2024-09-22T09:06:44.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.989+0000 7f71a6128800 20 add_watcher() i=6 2024-09-22T09:06:44.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.990+0000 7f71a6128800 20 add_watcher() i=7 2024-09-22T09:06:44.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.990+0000 7f71a6128800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:44.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f70537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:44.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f71a6128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f71a6128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f71a6128800 5 note: GC not initialized 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f70527fc640 20 reqs_thread_entry: start 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.992+0000 7f71a6128800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 20 Filter name: none 2024-09-22T09:06:44.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f6fc3fff640 20 reqs_thread_entry: start 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 : miss 2024-09-22T09:06:44.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.993+0000 7f71a6128800 20 rados->read ofs=0 len=0 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:44.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.994+0000 7f71a6128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 2024-09-22T09:06:45.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f71a6128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f71a6128800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f71a6128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f71a6128800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31, ofs0, ns] 2024-09-22T09:06:45.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f70857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529711 cookie 94497615167744 notifier 7320 bl.length()=931 2024-09-22T09:06:45.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f70857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f70857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:44.998+0000 7f70857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.000+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_sources= new_sources= 2024-09-22T09:06:45.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.000+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential sources added=[] removed=[] 2024-09-22T09:06:45.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.000+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_dests= new_dests= 2024-09-22T09:06:45.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.000+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential dests added=[] removed=[] 2024-09-22T09:06:45.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.003+0000 7f71a6128800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.1.0 2024-09-22T09:06:45.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.003+0000 7f71a6128800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.1.0 2024-09-22T09:06:45.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.003+0000 7f71a6128800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.1.1 2024-09-22T09:06:45.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.003+0000 7f71a6128800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.1.1 2024-09-22T09:06:45.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.003+0000 7f71a6128800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.0 2024-09-22T09:06:45.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.005+0000 7f71a6128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:45.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.005+0000 7f71a6128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 2024-09-22T09:06:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f71a6128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f71a6128800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f71a6128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f71a6128800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31, ofs0, ns] 2024-09-22T09:06:45.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f7084ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529712 cookie 94497615167744 notifier 7320 bl.length()=931 2024-09-22T09:06:45.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f7084ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f7084ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.007+0000 7f7084ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.009+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_sources= new_sources= 2024-09-22T09:06:45.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.009+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential sources added=[] removed=[] 2024-09-22T09:06:45.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.009+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_dests= new_dests= 2024-09-22T09:06:45.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.009+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential dests added=[] removed=[] 2024-09-22T09:06:45.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.010+0000 7f71a6128800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.31.0 2024-09-22T09:06:45.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.010+0000 7f71a6128800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-22T09:06:45.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.010+0000 7f71a6128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:45.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.010+0000 7f71a6128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f71a6128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f71a6128800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f71a6128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f71a6128800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31, ofs0, ns] 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f70857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529713 cookie 94497615167744 notifier 7320 bl.length()=899 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f70857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 info.flags=0x17 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f70857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 to cache LRU end 2024-09-22T09:06:45.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.012+0000 7f70857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:45.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.013+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_sources= new_sources= 2024-09-22T09:06:45.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.013+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential sources added=[] removed=[] 2024-09-22T09:06:45.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.013+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): orig_dests= new_dests= 2024-09-22T09:06:45.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.013+0000 7f71a6128800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.31]): potential dests added=[] removed=[] 2024-09-22T09:06:45.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.014+0000 7f71a6128800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:06:45.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.016+0000 7f70537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:45.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.019+0000 7f71a6128800 20 remove_watcher() i=0 2024-09-22T09:06:45.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.019+0000 7f71a6128800 2 removed watcher, disabling cache 2024-09-22T09:06:45.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.020+0000 7f71a6128800 20 remove_watcher() i=1 2024-09-22T09:06:45.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.021+0000 7f71a6128800 20 remove_watcher() i=2 2024-09-22T09:06:45.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.023+0000 7f71a6128800 20 remove_watcher() i=3 2024-09-22T09:06:45.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.024+0000 7f71a6128800 20 remove_watcher() i=4 2024-09-22T09:06:45.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.025+0000 7f71a6128800 20 remove_watcher() i=5 2024-09-22T09:06:45.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.026+0000 7f71a6128800 20 remove_watcher() i=6 2024-09-22T09:06:45.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.027+0000 7f71a6128800 20 remove_watcher() i=7 2024-09-22T09:06:45.041 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-22T09:06:45.071 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:45.071 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:45.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.108+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 20 realm 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.110+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.111+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.111+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.112+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:45.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.112+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.112+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:45.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.112+0000 7f092f694800 20 searching for the correct realm 2024-09-22T09:06:45.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.115+0000 7f092d97f640 0 -- 172.21.15.39:0/852309490 >> [v2:172.21.15.39:6816/2957971359,v1:172.21.15.39:6817/2957971359] conn(0x55eca1134a10 msgr2=0x55eca1136e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:06:45.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.120+0000 7f092c97d640 0 -- 172.21.15.39:0/852309490 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f092806a970 msgr2=0x7f09280438e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.124+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 zone default found 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 4 Realm: () 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 zonegroup default 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.125+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 started sync module instance, tier type = 2024-09-22T09:06:45.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.126+0000 7f092f694800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:45.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=0 2024-09-22T09:06:45.138 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=1 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=2 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=3 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=4 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=5 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.136+0000 7f092f694800 20 add_watcher() i=6 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.137+0000 7f092f694800 20 add_watcher() i=7 2024-09-22T09:06:45.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.137+0000 7f092f694800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:45.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f07e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:45.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 5 note: GC not initialized 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f07e27e4640 20 reqs_thread_entry: start 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 20 Filter name: none 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f0753fff640 20 reqs_thread_entry: start 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.139+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.140+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.140+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.141+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.141+0000 7f092f694800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:45.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.141+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.141+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:45.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.141+0000 7f092f694800 20 rados->read ofs=0 len=0 2024-09-22T09:06:45.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.142+0000 7f092f694800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:45.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.142+0000 7f092f694800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:45.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.143+0000 7f07e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:45.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.145+0000 7f092f694800 20 remove_watcher() i=0 2024-09-22T09:06:45.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.145+0000 7f092f694800 2 removed watcher, disabling cache 2024-09-22T09:06:45.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.146+0000 7f092f694800 20 remove_watcher() i=1 2024-09-22T09:06:45.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.147+0000 7f092f694800 20 remove_watcher() i=2 2024-09-22T09:06:45.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.148+0000 7f092f694800 20 remove_watcher() i=3 2024-09-22T09:06:45.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.150+0000 7f092f694800 20 remove_watcher() i=4 2024-09-22T09:06:45.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.151+0000 7f092f694800 20 remove_watcher() i=5 2024-09-22T09:06:45.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.152+0000 7f092f694800 20 remove_watcher() i=6 2024-09-22T09:06:45.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:45.152+0000 7f092f694800 20 remove_watcher() i=7 2024-09-22T09:06:45.166 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-22T09:06:45.166 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:45.168 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.168 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.189 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.189 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.391 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.391 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.459 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-22T09:06:45.459 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:45.460 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.460 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.502 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.502 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.559 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.559 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.596 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.596 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.630 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.630 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.663 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.664 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.697 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.697 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.730 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.730 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.764 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.764 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.798 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.798 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.830 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.830 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.865 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.865 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.899 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.899 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.933 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.933 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:45.967 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:45.967 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.003 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.003 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.036 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.036 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.071 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.071 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.105 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.105 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.142 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.142 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.178 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.178 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.213 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:46.213 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:06:46.246 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T09:06:46.275 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:46.275 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:46.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.312+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 realm 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.314+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.315+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.315+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.316+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:46.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.316+0000 7f9c18e13800 20 searching for the correct realm 2024-09-22T09:06:46.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.318+0000 7f9c13d47640 0 -- 172.21.15.39:0/4041838749 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f9c0400c2d0 msgr2=0x7f9c04090ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.322+0000 7f9c13d47640 0 -- 172.21.15.39:0/4041838749 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f9adc087c90 msgr2=0x7f9adc08a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.327+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 zone default found 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 4 Realm: () 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 zonegroup default 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.328+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 started sync module instance, tier type = 2024-09-22T09:06:46.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.329+0000 7f9c18e13800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=0 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=1 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=2 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=3 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=4 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.338+0000 7f9c18e13800 20 add_watcher() i=5 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.339+0000 7f9c18e13800 20 add_watcher() i=6 2024-09-22T09:06:46.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.339+0000 7f9c18e13800 20 add_watcher() i=7 2024-09-22T09:06:46.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.339+0000 7f9c18e13800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:46.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.341+0000 7f9acafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 5 note: GC not initialized 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9ac9fdb640 20 reqs_thread_entry: start 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:46.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 20 Filter name: none 2024-09-22T09:06:46.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9a3b7fe640 20 reqs_thread_entry: start 2024-09-22T09:06:46.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.342+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.343+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:46.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.343+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:46.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:46.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.344+0000 7f9c18e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:46.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.346+0000 7f9acafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:46.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.348+0000 7f9c18e13800 20 remove_watcher() i=0 2024-09-22T09:06:46.350 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.348+0000 7f9c18e13800 2 removed watcher, disabling cache 2024-09-22T09:06:46.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.349+0000 7f9c18e13800 20 remove_watcher() i=1 2024-09-22T09:06:46.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.350+0000 7f9c18e13800 20 remove_watcher() i=2 2024-09-22T09:06:46.353 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.351+0000 7f9c18e13800 20 remove_watcher() i=3 2024-09-22T09:06:46.354 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.352+0000 7f9c18e13800 20 remove_watcher() i=4 2024-09-22T09:06:46.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.353+0000 7f9c18e13800 20 remove_watcher() i=5 2024-09-22T09:06:46.356 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.354+0000 7f9c18e13800 20 remove_watcher() i=6 2024-09-22T09:06:46.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.355+0000 7f9c18e13800 20 remove_watcher() i=7 2024-09-22T09:06:46.369 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.369 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:46.369 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:46.369 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.370 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-22T09:06:46.404 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:46.405 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:46.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.442+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 realm 2024-09-22T09:06:46.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.445+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.447 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.445+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.446+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:46.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.446+0000 7ff980287800 20 searching for the correct realm 2024-09-22T09:06:46.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.448+0000 7ff97e572640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff968073070 msgr2=0x7ff968094060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.655+0000 7ff97d570640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff978067a70 msgr2=0x7ff978066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 zone default found 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 4 Realm: () 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 zonegroup default 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 started sync module instance, tier type = 2024-09-22T09:06:46.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.864+0000 7ff980287800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=0 2024-09-22T09:06:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=1 2024-09-22T09:06:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=2 2024-09-22T09:06:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=3 2024-09-22T09:06:46.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=4 2024-09-22T09:06:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=5 2024-09-22T09:06:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=6 2024-09-22T09:06:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.875+0000 7ff980287800 20 add_watcher() i=7 2024-09-22T09:06:46.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.875+0000 7ff980287800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:46.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.877+0000 7ff833fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:46.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:46.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 5 note: GC not initialized 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff832fe5640 20 reqs_thread_entry: start 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 20 Filter name: none 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff830fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:46.882 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.878+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : miss 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.879+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:46.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:46.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:46.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:46.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:46.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.890+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:46.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.890+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529717 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:46.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:46.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:46.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.894+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:46.897 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff980287800 time 2024-09-22T09:06:46.896834+0000 2024-09-22T09:06:46.897 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:46.897 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff98378c748] 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.895+0000 7ff980287800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff980287800 time 2024-09-22T09:06:46.896834+0000 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.898 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff98378c748] 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:06:46.899 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff980287800 thread_name:radosgw-admin 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff98243e6f0] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff98248b99c] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff98378c7a2] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:06:46.917 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.896+0000 7ff980287800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff980287800 thread_name:radosgw-admin 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff98243e6f0] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff98248b99c] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff98378c7a2] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.918 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding auth protocol: cephx 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding auth protocol: cephx 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.919 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:06:46.425+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: starting msgr at 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: starting objecter 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:06:46.425+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests hook 0x55f3bf77ca70 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: setting wanted keys 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: calling monclient init 2024-09-22T09:06:46.920 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:06:46.425+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.921 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:06:46.425+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:06:46.426+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:06:46.426+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key hook 0x55f3bf7532e8 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf5dcdf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf692aa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf69bf10 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.922 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.687298s 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf5dcdf0 auth_method 0 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf692aa0 auth_method 0 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.923 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7371 payload 824 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:06:46.426+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:06:46.426+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf69bf10 auth_method 0 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: dump: 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.924 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: dump: 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.925 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:06:46.426+0000 7ff980287800 5 monclient: authenticate success, global_id 7371 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:06:46.426+0000 7ff86be07640 4 set_mon_vals no callback set 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:06:46.427+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:06:46.427+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:06:46.427+0000 7ff980287800 1 librados: init done 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.926 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:06:46.429+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff8640775a0 auth_method 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:06:46.429+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf79b5b0 auth_method 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:06:46.430+0000 7ff97dd71640 10 monclient: get_auth_request con 0x55f3bf79e790 auth_method 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:06:46.431+0000 7ff97d570640 10 monclient: get_auth_request con 0x55f3bf7a2980 auth_method 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:06:46.432+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf7a2080 auth_method 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:06:46.432+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:06:46.432+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:06:46.432+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.927 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.928 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:06:46.433+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3bf7adef0 EEXIST 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.929 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:06:46.433+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x55f3bf7a99b0 EEXIST 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf7d2210 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7d25f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf7d0f20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.930 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.695032s 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): get_auth_request con 0x55f3bf7d25f0 auth_method 0 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf7d0f20 auth_method 0 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7d2210 auth_method 0 2024-09-22T09:06:46.931 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_done global_id 7374 payload 824 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:06:46.434+0000 7ff97e572640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.932 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: dump: 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.933 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:06:46.434+0000 7ff980287800 5 monclient: authenticate success, global_id 7374 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: dump: 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.934 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:06:46.434+0000 7ff97ed73640 4 set_mon_vals no callback set 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:06:46.436+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff858077480 auth_method 0 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: get_monmap_and_config 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:06:46.437+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.935 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.936 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:06:46.437+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.937 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.938 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:06:46.437+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:06:46.438+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:06:46.438+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd47204ed8 EEXIST 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7f6260 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf820cd0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf822080 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.699165s 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7f6260 auth_method 0 2024-09-22T09:06:46.939 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf822080 auth_method 0 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): get_auth_request con 0x55f3bf820cd0 auth_method 0 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.940 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7377 payload 274 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:06:46.438+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: dump: 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.941 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:06:46.438+0000 7ff980287800 5 monclient: authenticate success, global_id 7377 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: get_monmap_and_config success 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:06:46.438+0000 7ff980287800 4 set_mon_vals no callback set 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: dump: 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.942 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: shutdown 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:06:46.439+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.943 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.944 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:06:46.439+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: starting msgr at 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: starting objecter 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:06:46.439+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3bf8194b0 EEXIST 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: setting wanted keys 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: calling monclient init 2024-09-22T09:06:46.945 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.946 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:06:46.440+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:06:46.440+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:06:46.440+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x55f3bf7e6c18 EEXIST 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7f6260 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf822080 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf824af0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.701388s 2024-09-22T09:06:46.947 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7f6260 auth_method 0 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf824af0 auth_method 0 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.948 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7380 payload 824 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:06:46.440+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: dump: 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.949 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: dump: 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.950 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:06:46.441+0000 7ff980287800 5 monclient: authenticate success, global_id 7380 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:06:46.440+0000 7ff8617fa640 4 set_mon_vals no callback set 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:06:46.441+0000 7ff980287800 1 librados: init done 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:06:46.441+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cr dump hook 0x55f3bf818a98 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:06:46.442+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.951 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:06:46.443+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff8480775a0 auth_method 0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:06:46.443+0000 7ff97dd71640 10 monclient: get_auth_request con 0x55f3bf840ca0 auth_method 0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:06:46.444+0000 7ff980287800 20 realm 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:06:46.444+0000 7ff980287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:06:46.445+0000 7ff97d570640 10 monclient: get_auth_request con 0x55f3bf844f10 auth_method 0 2024-09-22T09:06:46.952 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:06:46.445+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:06:46.445+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:06:46.445+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf848770 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:06:46.446+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:06:46.446+0000 7ff980287800 20 searching for the correct realm 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:06:46.446+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff978082c20 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:06:46.447+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff97007f040 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:06:46.448+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff968073070 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:06:46.448+0000 7ff97e572640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff968073070 msgr2=0x7ff968094060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:06:46.650+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff968073070 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:06:46.652+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff9780a1370 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:06:46.655+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff978067a70 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:06:46.655+0000 7ff97d570640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff978067a70 msgr2=0x7ff978066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:06:46.857+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff978067a70 auth_method 0 2024-09-22T09:06:46.953 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:06:46.863+0000 7ff980287800 20 zone default found 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:06:46.863+0000 7ff980287800 4 Realm: () 2024-09-22T09:06:46.954 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:06:46.863+0000 7ff980287800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:06:46.863+0000 7ff980287800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:06:46.863+0000 7ff980287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:06:46.863+0000 7ff980287800 20 zonegroup default 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:06:46.864+0000 7ff980287800 20 started sync module instance, tier type = 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:06:46.864+0000 7ff980287800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=0 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=1 2024-09-22T09:06:46.955 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=2 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=3 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=4 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=5 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=6 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:06:46.875+0000 7ff980287800 20 add_watcher() i=7 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:06:46.875+0000 7ff980287800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.956 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:06:46.877+0000 7ff833fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:06:46.877+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache list hook 0x55f3bf81cf60 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache inspect hook 0x55f3bf81cf60 2024-09-22T09:06:46.957 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache erase hook 0x55f3bf81cf60 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache zap hook 0x55f3bf81cf60 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:06:46.878+0000 7ff980287800 5 note: GC not initialized 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:06:46.878+0000 7ff832fe5640 20 reqs_thread_entry: start 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace show hook 0x7ff968060b30 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace history hook 0x7ff968060b30 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace active hook 0x7ff968060b30 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace active_short hook 0x7ff968060b30 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:06:46.878+0000 7ff980287800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:06:46.878+0000 7ff980287800 20 Filter name: none 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:06:46.878+0000 7ff830fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:06:46.878+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:46.958 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : miss 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:06:46.879+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:06:46.884+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:06:46.884+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:06:46.884+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:06:46.884+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:46.959 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:06:46.890+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:46.960 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:06:46.890+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:06:46.892+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:06:46.892+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:06:46.892+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:06:46.892+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529717 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:06:46.894+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:46.961 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:06:46.895+0000 7ff980287800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff980287800 time 2024-09-22T09:06:46.896834+0000 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff98378c748] 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:06:46.896+0000 7ff980287800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:46.962 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff980287800 thread_name:radosgw-admin 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff98243e6f0] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff98248b99c] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff98378c7a2] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:06:46.963 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:06:46.964 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:06:46.965 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:06:46.966 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:06:46.967 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:06:46.968 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:06:46.969 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff830fe1640 / http_manager 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff832fe5640 / http_manager 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff833fe7640 / rgw_dt_lg_renew 2024-09-22T09:06:46.970 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff84f7fe640 / ms_dispatch 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff8617fa640 / io_context_pool 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff8637fe640 / ms_dispatch 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff86a604640 / ms_dispatch 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff86be07640 / io_context_pool 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97d570640 / msgr-worker-2 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97dd71640 / msgr-worker-1 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97e572640 / msgr-worker-0 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97ed73640 / io_context_pool 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff980287800 / radosgw-admin 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.120977.log 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:06:46.971 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding auth protocol: cephx 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding auth protocol: cephx 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: crc 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf758760) adding con mode: secure 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:06:46.425+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.972 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: starting msgr at 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: starting objecter 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:06:46.425+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests hook 0x55f3bf77ca70 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: setting wanted keys 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:06:46.425+0000 7ff980287800 1 librados: calling monclient init 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:06:46.425+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding auth protocol: cephx 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.973 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: crc 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:06:46.425+0000 7ff980287800 5 AuthRegistry(0x55f3bf7531a0) adding con mode: secure 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:06:46.425+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:06:46.426+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:06:46.426+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key hook 0x55f3bf7532e8 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf5dcdf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf692aa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.974 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf69bf10 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.687298s 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf5dcdf0 auth_method 0 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf692aa0 auth_method 0 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.975 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:06:46.426+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7371 payload 824 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:06:46.426+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:06:46.426+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:06:46.426+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf69bf10 auth_method 0 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: dump: 2024-09-22T09:06:46.976 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.977 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:06:46.426+0000 7ff86a604640 10 monclient: dump: 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:06:46.426+0000 7ff980287800 5 monclient: authenticate success, global_id 7371 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.978 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:06:46.426+0000 7ff86be07640 4 set_mon_vals no callback set 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:06:46.426+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:06:46.427+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:06:46.427+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:06:46.427+0000 7ff980287800 1 librados: init done 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:06:46.428+0000 7ff86a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:06:46.429+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff8640775a0 auth_method 0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:06:46.429+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf79b5b0 auth_method 0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:06:46.430+0000 7ff97dd71640 10 monclient: get_auth_request con 0x55f3bf79e790 auth_method 0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:06:46.431+0000 7ff97d570640 10 monclient: get_auth_request con 0x55f3bf7a2980 auth_method 0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:06:46.432+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf7a2080 auth_method 0 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:06:46.432+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.979 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:06:46.432+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:06:46.432+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding auth protocol: cephx 2024-09-22T09:06:46.980 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: crc 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:06:46.432+0000 7ff980287800 5 AuthRegistry(0x55f3bf7aaa60) adding con mode: secure 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:06:46.433+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3bf7adef0 EEXIST 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.981 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding auth protocol: cephx 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.982 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: crc 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:06:46.433+0000 7ff980287800 5 AuthRegistry(0x55f3bf7a9868) adding con mode: secure 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:06:46.433+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:06:46.433+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x55f3bf7a99b0 EEXIST 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:06:46.433+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf7d2210 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7d25f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf7d0f20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.983 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.695032s 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): get_auth_request con 0x55f3bf7d25f0 auth_method 0 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf7d0f20 auth_method 0 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7d2210 auth_method 0 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.984 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:06:46.434+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:06:46.434+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient(hunting): handle_auth_done global_id 7374 payload 824 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:06:46.434+0000 7ff97e572640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:06:46.434+0000 7ff97e572640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.985 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: dump: 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:06:46.434+0000 7ff980287800 5 monclient: authenticate success, global_id 7374 2024-09-22T09:06:46.986 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:06:46.434+0000 7ff8637fe640 10 monclient: dump: 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.987 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:06:46.434+0000 7ff97ed73640 4 set_mon_vals no callback set 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:06:46.434+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:06:46.436+0000 7ff8637fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:06:46.436+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff858077480 auth_method 0 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: get_monmap_and_config 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:06:46.437+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.988 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding auth protocol: cephx 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.989 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: crc 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x55f3bf7f20d0) adding con mode: secure 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:06:46.437+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:06:46.437+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.990 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding auth protocol: cephx 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: crc 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:06:46.437+0000 7ff980287800 5 AuthRegistry(0x7ffd47204d90) adding con mode: secure 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:06:46.437+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:06:46.438+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.991 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:06:46.438+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x7ffd47204ed8 EEXIST 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7f6260 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf820cd0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf822080 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.699165s 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7f6260 auth_method 0 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.992 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf822080 auth_method 0 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:06:46.438+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): get_auth_request con 0x55f3bf820cd0 auth_method 0 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:06:46.438+0000 7ff97e572640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:46.993 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7377 payload 274 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:06:46.438+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:06:46.438+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: dump: 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.994 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: _finish_auth 0 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: _check_auth_tickets 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:06:46.438+0000 7ff980287800 5 monclient: authenticate success, global_id 7377 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:06:46.438+0000 7ff980287800 10 monclient: get_monmap_and_config success 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:06:46.438+0000 7ff980287800 4 set_mon_vals no callback set 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:06:46.438+0000 7ff8617fa640 10 monclient: dump: 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.995 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: shutdown 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: build_initial_monmap 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:06:46.439+0000 7ff980287800 1 build_initial for_mkfs: 0 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: monmap: 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:06:46.996 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding auth protocol: cephx 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.997 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: crc 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf816e80) adding con mode: secure 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:06:46.439+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: starting msgr at 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: starting objecter 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:06:46.439+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3bf8194b0 EEXIST 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: setting wanted keys 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:06:46.439+0000 7ff980287800 1 librados: calling monclient init 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:06:46.439+0000 7ff980287800 10 monclient: init 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.998 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding auth protocol: cephx 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: crc 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:06:46.439+0000 7ff980287800 5 AuthRegistry(0x55f3bf7e6ad0) adding con mode: secure 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:06:46.440+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:06:46.440+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:46.999 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:06:46.440+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command rotate-key cmddesc rotate-key hook 0x55f3bf7e6c18 EEXIST 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient: _reopen_session rank -1 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-a con 0x55f3bf7f6260 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-b con 0x55f3bf822080 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): picked mon.noname-c con 0x55f3bf824af0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): start opening mon connection 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): _renew_subs 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:06:46.440+0000 7ff980287800 10 monclient(hunting): authenticate will time out at 2304.701388s 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): get_auth_request con 0x55f3bf7f6260 auth_method 0 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:47.000 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): get_auth_request con 0x55f3bf824af0 auth_method 0 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:06:46.440+0000 7ff97dd71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient(hunting): handle_auth_done global_id 7380 payload 824 2024-09-22T09:06:47.001 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient: _finish_hunting 0 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:06:46.440+0000 7ff97d570640 1 monclient: found mon.noname-a 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:06:46.440+0000 7ff97d570640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: dump: 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:47.002 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: _finish_auth 0 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: _check_auth_tickets 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:06:46.440+0000 7ff84f7fe640 10 monclient: dump: 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:06:47.003 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:06:46.441+0000 7ff980287800 5 monclient: authenticate success, global_id 7380 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:06:46.440+0000 7ff8617fa640 4 set_mon_vals no callback set 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _renew_subs 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:06:46.441+0000 7ff980287800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:06:46.441+0000 7ff980287800 1 librados: init done 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:06:46.441+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cr dump hook 0x55f3bf818a98 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:06:46.442+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.004 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:06:46.443+0000 7ff84f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:06:46.443+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff8480775a0 auth_method 0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:06:46.443+0000 7ff97dd71640 10 monclient: get_auth_request con 0x55f3bf840ca0 auth_method 0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:06:46.444+0000 7ff980287800 20 realm 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:06:46.444+0000 7ff980287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:06:46.444+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:06:46.445+0000 7ff97d570640 10 monclient: get_auth_request con 0x55f3bf844f10 auth_method 0 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:06:46.445+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:47.005 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:06:46.445+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:06:46.445+0000 7ff97e572640 10 monclient: get_auth_request con 0x55f3bf848770 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:06:46.446+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:06:46.446+0000 7ff980287800 20 searching for the correct realm 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:06:46.446+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff978082c20 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:06:46.447+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff97007f040 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:06:46.448+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff968073070 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:06:46.448+0000 7ff97e572640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff968073070 msgr2=0x7ff968094060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:06:46.650+0000 7ff97e572640 10 monclient: get_auth_request con 0x7ff968073070 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:06:46.652+0000 7ff97dd71640 10 monclient: get_auth_request con 0x7ff9780a1370 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:06:46.655+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff978067a70 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:06:46.655+0000 7ff97d570640 0 -- 172.21.15.39:0/662242002 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff978067a70 msgr2=0x7ff978066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:06:46.857+0000 7ff97d570640 10 monclient: get_auth_request con 0x7ff978067a70 auth_method 0 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:47.006 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:06:46.862+0000 7ff980287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:06:46.862+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:06:46.863+0000 7ff980287800 20 zone default found 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:06:46.863+0000 7ff980287800 4 Realm: () 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:06:46.863+0000 7ff980287800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:06:46.863+0000 7ff980287800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:06:46.863+0000 7ff980287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:47.007 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:06:46.863+0000 7ff980287800 20 zonegroup default 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:06:46.863+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:06:46.864+0000 7ff980287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:06:46.864+0000 7ff980287800 20 started sync module instance, tier type = 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:06:46.864+0000 7ff980287800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=0 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=1 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=2 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=3 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=4 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=5 2024-09-22T09:06:47.008 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:06:46.874+0000 7ff980287800 20 add_watcher() i=6 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:06:46.875+0000 7ff980287800 20 add_watcher() i=7 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:06:46.875+0000 7ff980287800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding auth protocol: cephx 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.009 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: crc 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:06:46.877+0000 7ff980287800 5 AuthRegistry(0x7ffd47205260) adding con mode: secure 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:06:46.877+0000 7ff833fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:06:46.877+0000 7ff980287800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache list hook 0x55f3bf81cf60 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache inspect hook 0x55f3bf81cf60 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache erase hook 0x55f3bf81cf60 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command cache zap hook 0x55f3bf81cf60 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:06:46.878+0000 7ff980287800 5 note: GC not initialized 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:06:46.878+0000 7ff832fe5640 20 reqs_thread_entry: start 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace show hook 0x7ff968060b30 2024-09-22T09:06:47.010 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace history hook 0x7ff968060b30 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace active hook 0x7ff968060b30 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:06:46.878+0000 7ff980287800 5 asok(0x55f3bf5310f0) register_command sync trace active_short hook 0x7ff968060b30 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:06:46.878+0000 7ff980287800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:06:46.878+0000 7ff980287800 20 Filter name: none 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:06:46.878+0000 7ff830fe1640 20 reqs_thread_entry: start 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:06:46.878+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:06:46.878+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : miss 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:06:46.879+0000 7ff980287800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:06:46.879+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:47.011 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:06:46.879+0000 7ff980287800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:06:46.879+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:06:46.879+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:06:46.884+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:06:46.884+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:06:46.884+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:06:46.884+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:06:46.884+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:47.012 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:06:46.885+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:06:46.888+0000 7ff980287800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:06:46.888+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:06:46.890+0000 7ff980287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : hit (requested=0x17, cached=0x17) 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:06:46.890+0000 7ff980287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:06:46.892+0000 7ff980287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:06:46.892+0000 7ff980287800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:06:46.892+0000 7ff980287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:06:46.892+0000 7ff980287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529717 cookie 94505378587200 notifier 7380 bl.length()=931 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:06:47.013 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:06:46.892+0000 7ff8617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:06:46.893+0000 7ff980287800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:06:46.894+0000 7ff980287800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:06:46.895+0000 7ff980287800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff980287800 time 2024-09-22T09:06:46.896834+0000 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff98378c748] 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:47.014 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:06:46.896+0000 7ff980287800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7ff980287800 thread_name:radosgw-admin 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff98243e6f0] 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff98248b99c] 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff98378c7a2] 2024-09-22T09:06:47.015 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7ff98378c906] 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3be63fe01] 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55f3be64ffb7] 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff982429590] 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:06:47.016 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:06:47.017 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:06:47.018 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:06:47.019 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:06:47.020 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:06:47.021 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff830fe1640 / http_manager 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff832fe5640 / http_manager 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff833fe7640 / rgw_dt_lg_renew 2024-09-22T09:06:47.022 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff84f7fe640 / ms_dispatch 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff8617fa640 / io_context_pool 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff8637fe640 / ms_dispatch 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff86a604640 / ms_dispatch 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff86be07640 / io_context_pool 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97d570640 / msgr-worker-2 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97dd71640 / msgr-worker-1 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97e572640 / msgr-worker-0 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff97ed73640 / io_context_pool 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: 7ff980287800 / radosgw-admin 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:06:46.898259Z_ed3abcb1-03a0-4a99-b94b-721762b633da/log 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:06:47.023 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.976+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 20 realm 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.978+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.979+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.979+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.979+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.979+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.980+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.980+0000 7fe9b0ebb800 20 searching for the correct realm 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.982+0000 7fe9af1a6640 0 -- 172.21.15.39:0/3857690298 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe9a4027070 msgr2=0x7fe9a4043440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:06:47.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:46.987+0000 7fe9ae1a4640 0 -- 172.21.15.39:0/3857690298 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe9a80c0c00 msgr2=0x7fe9a80ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.193+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:06:47.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 zone default found 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 4 Realm: () 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 zonegroup default 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.194+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.195+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.195+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.195+0000 7fe9b0ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.195+0000 7fe9b0ebb800 20 started sync module instance, tier type = 2024-09-22T09:06:47.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.195+0000 7fe9b0ebb800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=0 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=1 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=2 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=3 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=4 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=5 2024-09-22T09:06:47.208 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=6 2024-09-22T09:06:47.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 20 add_watcher() i=7 2024-09-22T09:06:47.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.206+0000 7fe9b0ebb800 2 all 8 watchers are set, enabling cache 2024-09-22T09:06:47.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.208+0000 7fe8657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:47.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:06:47.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:06:47.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 5 note: GC not initialized 2024-09-22T09:06:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe7dffff640 20 reqs_thread_entry: start 2024-09-22T09:06:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 20 init_complete bucket index max shards: 1 2024-09-22T09:06:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 20 Filter name: none 2024-09-22T09:06:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe7ddffb640 20 reqs_thread_entry: start 2024-09-22T09:06:47.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.209+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.210+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.210+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.210+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.210+0000 7fe9b0ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.210+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.211+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:06:47.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.211+0000 7fe9b0ebb800 20 rados->read ofs=0 len=0 2024-09-22T09:06:47.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.211+0000 7fe9b0ebb800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:06:47.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.211+0000 7fe9b0ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:06:47.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.213+0000 7fe8657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:06:47.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.215+0000 7fe9b0ebb800 20 remove_watcher() i=0 2024-09-22T09:06:47.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.215+0000 7fe9b0ebb800 2 removed watcher, disabling cache 2024-09-22T09:06:47.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.216+0000 7fe9b0ebb800 20 remove_watcher() i=1 2024-09-22T09:06:47.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.218+0000 7fe9b0ebb800 20 remove_watcher() i=2 2024-09-22T09:06:47.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.219+0000 7fe9b0ebb800 20 remove_watcher() i=3 2024-09-22T09:06:47.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.221+0000 7fe9b0ebb800 20 remove_watcher() i=4 2024-09-22T09:06:47.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.222+0000 7fe9b0ebb800 20 remove_watcher() i=5 2024-09-22T09:06:47.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.223+0000 7fe9b0ebb800 20 remove_watcher() i=6 2024-09-22T09:06:47.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:06:47.224+0000 7fe9b0ebb800 20 remove_watcher() i=7 2024-09-22T09:06:47.238 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.238 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:06:47.238 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:06:47.238 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:06:47.240 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:06:47.240 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:17.368 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:17.368 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:17.428 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:07:17.464 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:17.464 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:17.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.507+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.508+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.508+0000 7fa82780f800 20 realm 2024-09-22T09:07:17.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.508+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.509+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.509+0000 7fa82780f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:17.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.509+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.509+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.509+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.510+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:17.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.510+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.510+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:17.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.511+0000 7fa82780f800 20 searching for the correct realm 2024-09-22T09:07:17.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.513+0000 7fa823749640 0 -- 172.21.15.39:0/1580893291 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa818024070 msgr2=0x7fa818062170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:17.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.517+0000 7fa822747640 0 -- 172.21.15.39:0/1580893291 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa81c0c1950 msgr2=0x7fa81c0a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:17.724 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.723+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.724+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:17.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.724+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:17.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 zone default found 2024-09-22T09:07:17.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 4 Realm: () 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 zonegroup default 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.725+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.726+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.726+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.726+0000 7fa82780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.726+0000 7fa82780f800 20 started sync module instance, tier type = 2024-09-22T09:07:17.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.726+0000 7fa82780f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:17.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=0 2024-09-22T09:07:17.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=1 2024-09-22T09:07:17.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=2 2024-09-22T09:07:17.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=3 2024-09-22T09:07:17.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=4 2024-09-22T09:07:17.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=5 2024-09-22T09:07:17.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.736+0000 7fa82780f800 20 add_watcher() i=6 2024-09-22T09:07:17.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.737+0000 7fa82780f800 20 add_watcher() i=7 2024-09-22T09:07:17.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.737+0000 7fa82780f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.739+0000 7fa6d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.739+0000 7fa82780f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.739+0000 7fa82780f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.739+0000 7fa82780f800 5 note: GC not initialized 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.739+0000 7fa653fff640 20 reqs_thread_entry: start 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 20 Filter name: none 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa651ffb640 20 reqs_thread_entry: start 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-22T09:07:17.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:07:17.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-22T09:07:17.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-22T09:07:17.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : miss 2024-09-22T09:07:17.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.740+0000 7fa82780f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.741+0000 7fa82780f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa82780f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa82780f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa82780f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa82780f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa7067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94844938519632 notifier 7422 bl.length()=931 2024-09-22T09:07:17.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa7067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa7067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.745+0000 7fa7067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.747+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:07:17.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.747+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:07:17.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.747+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:07:17.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.747+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:07:17.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.749+0000 7fa82780f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:07:17.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.749+0000 7fa82780f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.0 2024-09-22T09:07:17.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.749+0000 7fa82780f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:07:17.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.749+0000 7fa82780f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.1.1 2024-09-22T09:07:17.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.749+0000 7fa82780f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:07:17.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.751+0000 7fa82780f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:17.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.752+0000 7fa82780f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.753+0000 7fa82780f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.753+0000 7fa82780f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.753+0000 7fa82780f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.753+0000 7fa82780f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.754+0000 7fa7067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94844938519632 notifier 7422 bl.length()=931 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.754+0000 7fa7067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.754+0000 7fa7067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.754+0000 7fa7067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.755+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:07:17.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.755+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:07:17.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.755+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:07:17.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.755+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:07:17.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.756+0000 7fa82780f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.32.0 2024-09-22T09:07:17.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.756+0000 7fa82780f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:17.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.756+0000 7fa82780f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 2024-09-22T09:07:17.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa82780f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa82780f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa82780f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa82780f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32, ofs0, ns] 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa705ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529721 cookie 94844938519632 notifier 7422 bl.length()=899 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa705ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 info.flags=0x17 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa705ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 to cache LRU end 2024-09-22T09:07:17.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.758+0000 7fa705ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:17.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.760+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_sources= new_sources= 2024-09-22T09:07:17.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.760+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential sources added=[] removed=[] 2024-09-22T09:07:17.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.760+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): orig_dests= new_dests= 2024-09-22T09:07:17.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.760+0000 7fa82780f800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[530e834e-7701-4a35-ad82-1b0744ba8777.4617.32]): potential dests added=[] removed=[] 2024-09-22T09:07:17.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.761+0000 7fa82780f800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-22T09:07:17.764 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.763+0000 7fa6d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:17.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.765+0000 7fa82780f800 20 remove_watcher() i=0 2024-09-22T09:07:17.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.765+0000 7fa82780f800 2 removed watcher, disabling cache 2024-09-22T09:07:17.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.767+0000 7fa82780f800 20 remove_watcher() i=1 2024-09-22T09:07:17.770 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.768+0000 7fa82780f800 20 remove_watcher() i=2 2024-09-22T09:07:17.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.770+0000 7fa82780f800 20 remove_watcher() i=3 2024-09-22T09:07:17.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.771+0000 7fa82780f800 20 remove_watcher() i=4 2024-09-22T09:07:17.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.772+0000 7fa82780f800 20 remove_watcher() i=5 2024-09-22T09:07:17.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.773+0000 7fa82780f800 20 remove_watcher() i=6 2024-09-22T09:07:17.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.774+0000 7fa82780f800 20 remove_watcher() i=7 2024-09-22T09:07:17.788 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-22T09:07:17.817 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:17.817 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:17.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.855+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 20 realm 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.857+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.858+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:17.859 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.858+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.859+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:17.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.859+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:17.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.859+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:17.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.859+0000 7f24d9f21800 20 searching for the correct realm 2024-09-22T09:07:17.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:17.862+0000 7f24d6445640 0 -- 172.21.15.39:0/153816645 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f24c0015070 msgr2=0x7f24c0067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:18.070 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.069+0000 7f24d5443640 0 -- 172.21.15.39:0/153816645 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f24d00ba0f0 msgr2=0x7f24d00869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:18.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:18.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:18.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:18.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:18.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:18.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.275+0000 7f24d9f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:18.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.276+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.276+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:18.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.276+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.276+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:18.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.276+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:18.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 zone default found 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 4 Realm: () 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 zonegroup default 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.277+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.278+0000 7f24d9f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.278+0000 7f24d9f21800 20 started sync module instance, tier type = 2024-09-22T09:07:18.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.278+0000 7f24d9f21800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:18.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=0 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=1 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=2 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=3 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=4 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=5 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.288+0000 7f24d9f21800 20 add_watcher() i=6 2024-09-22T09:07:18.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.289+0000 7f24d9f21800 20 add_watcher() i=7 2024-09-22T09:07:18.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.289+0000 7f24d9f21800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:18.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.291+0000 7f23877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:18.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:18.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 5 note: GC not initialized 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f23867fc640 20 reqs_thread_entry: start 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 20 Filter name: none 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f22f7fff640 20 reqs_thread_entry: start 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.292+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.293+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:07:18.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.293+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.294+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:07:18.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.294+0000 7f24d9f21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:18.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.294+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.294+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:07:18.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.294+0000 7f24d9f21800 20 rados->read ofs=0 len=0 2024-09-22T09:07:18.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.295+0000 7f24d9f21800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:07:18.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.295+0000 7f24d9f21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:18.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.296+0000 7f23877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:18.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.299+0000 7f24d9f21800 20 remove_watcher() i=0 2024-09-22T09:07:18.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.299+0000 7f24d9f21800 2 removed watcher, disabling cache 2024-09-22T09:07:18.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.301+0000 7f24d9f21800 20 remove_watcher() i=1 2024-09-22T09:07:18.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.302+0000 7f24d9f21800 20 remove_watcher() i=2 2024-09-22T09:07:18.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.303+0000 7f24d9f21800 20 remove_watcher() i=3 2024-09-22T09:07:18.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.304+0000 7f24d9f21800 20 remove_watcher() i=4 2024-09-22T09:07:18.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.306+0000 7f24d9f21800 20 remove_watcher() i=5 2024-09-22T09:07:18.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.307+0000 7f24d9f21800 20 remove_watcher() i=6 2024-09-22T09:07:18.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:18.308+0000 7f24d9f21800 20 remove_watcher() i=7 2024-09-22T09:07:18.320 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:18.320 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:18.320 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-commit-target-layout id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:07:18.321 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:18.322 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.322 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.344 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.344 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.529 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.530 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.595 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-22T09:07:18.595 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:18.596 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.596 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.638 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.638 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.695 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.695 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.732 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.732 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.763 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.764 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.797 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.797 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.836 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.836 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.871 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.871 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.905 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.905 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:18.937 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:18.937 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.006 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.006 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.039 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.040 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.073 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.074 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.106 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.106 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.140 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.140 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.173 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.173 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.208 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.208 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.243 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.243 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.276 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.276 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.309 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.310 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.343 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.343 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.377 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:19.377 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:19.411 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T09:07:19.440 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:19.440 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:19.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.481+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 realm 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:19.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.483+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.484+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:19.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.484+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.485+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:19.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.485+0000 7effdae40800 20 searching for the correct realm 2024-09-22T09:07:19.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.488+0000 7effd912b640 0 -- 172.21.15.39:0/3155271235 >> [v2:172.21.15.39:6816/2957971359,v1:172.21.15.39:6817/2957971359] conn(0x55a3abfa5c10 msgr2=0x55a3abfa8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:19.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.693+0000 7effd8129640 0 -- 172.21.15.39:0/3155271235 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7effd0061040 msgr2=0x7effd00ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:19.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.899+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 zone default found 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 4 Realm: () 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 zonegroup default 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.900+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.901+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.903 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.901+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.901+0000 7effdae40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:19.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.901+0000 7effdae40800 20 started sync module instance, tier type = 2024-09-22T09:07:19.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.901+0000 7effdae40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=0 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=1 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=2 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=3 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=4 2024-09-22T09:07:19.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=5 2024-09-22T09:07:19.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.912+0000 7effdae40800 20 add_watcher() i=6 2024-09-22T09:07:19.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.913+0000 7effdae40800 20 add_watcher() i=7 2024-09-22T09:07:19.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.913+0000 7effdae40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:19.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.915+0000 7efe8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:19.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.915+0000 7effdae40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:19.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.915+0000 7effdae40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:19.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.915+0000 7effdae40800 5 note: GC not initialized 2024-09-22T09:07:19.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.915+0000 7efe8dfe3640 20 reqs_thread_entry: start 2024-09-22T09:07:19.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7effdae40800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:19.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7effdae40800 20 Filter name: none 2024-09-22T09:07:19.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7efdff7fe640 20 reqs_thread_entry: start 2024-09-22T09:07:19.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:19.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.916+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.917+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:19.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.917+0000 7effdae40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:19.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.917+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.917+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:19.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.917+0000 7effdae40800 20 rados->read ofs=0 len=0 2024-09-22T09:07:19.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.918+0000 7effdae40800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:19.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.918+0000 7effdae40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:19.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.919+0000 7efe8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:19.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.922+0000 7effdae40800 20 remove_watcher() i=0 2024-09-22T09:07:19.923 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.922+0000 7effdae40800 2 removed watcher, disabling cache 2024-09-22T09:07:19.924 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.923+0000 7effdae40800 20 remove_watcher() i=1 2024-09-22T09:07:19.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.924+0000 7effdae40800 20 remove_watcher() i=2 2024-09-22T09:07:19.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.925+0000 7effdae40800 20 remove_watcher() i=3 2024-09-22T09:07:19.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.926+0000 7effdae40800 20 remove_watcher() i=4 2024-09-22T09:07:19.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.928+0000 7effdae40800 20 remove_watcher() i=5 2024-09-22T09:07:19.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.929+0000 7effdae40800 20 remove_watcher() i=6 2024-09-22T09:07:19.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:19.930+0000 7effdae40800 20 remove_watcher() i=7 2024-09-22T09:07:19.942 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:19.942 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:19.943 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:19.943 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:19.944 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-22T09:07:19.980 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:19.980 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:20.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.019+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 20 realm 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.020+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.021+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.021+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.021+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:20.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.021+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.022+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:20.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.022+0000 7f2789287800 20 searching for the correct realm 2024-09-22T09:07:20.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.024+0000 7f2787572640 0 -- 172.21.15.39:0/3093225963 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f277c037070 msgr2=0x7f277c0687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:20.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.230+0000 7f2786570640 0 -- 172.21.15.39:0/3093225963 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2780038900 msgr2=0x7f27800493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.437+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:20.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 zone default found 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 4 Realm: () 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 zonegroup default 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.438+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.439+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.439+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.439+0000 7f2789287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.439+0000 7f2789287800 20 started sync module instance, tier type = 2024-09-22T09:07:20.442 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.439+0000 7f2789287800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:20.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=0 2024-09-22T09:07:20.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=1 2024-09-22T09:07:20.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=2 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=3 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=4 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=5 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.449+0000 7f2789287800 20 add_watcher() i=6 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.450+0000 7f2789287800 20 add_watcher() i=7 2024-09-22T09:07:20.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.450+0000 7f2789287800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:20.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.452+0000 7f263d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.452+0000 7f2789287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.452+0000 7f2789287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.452+0000 7f2789287800 5 note: GC not initialized 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.452+0000 7f25b7fff640 20 reqs_thread_entry: start 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 20 Filter name: none 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f25b5ffb640 20 reqs_thread_entry: start 2024-09-22T09:07:20.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T09:07:20.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:20.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 : miss 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.453+0000 7f2789287800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:20.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.454+0000 7f2789287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 2024-09-22T09:07:20.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f2789287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:20.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f2789287800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:20.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f2789287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:20.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f2789287800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33, ofs0, ns] 2024-09-22T09:07:20.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f266a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529757 cookie 94260080376880 notifier 6980 bl.length()=911 2024-09-22T09:07:20.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f266a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:20.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f266a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:20.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.459+0000 7f266a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:20.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.461+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_sources= new_sources= 2024-09-22T09:07:20.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.461+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential sources added=[] removed=[] 2024-09-22T09:07:20.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.461+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_dests= new_dests= 2024-09-22T09:07:20.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.461+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential dests added=[] removed=[] 2024-09-22T09:07:20.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.463+0000 7f2789287800 -1 Injecting error=-5 at location=do_reshard 2024-09-22T09:07:20.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.467+0000 7f2789287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:20.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.467+0000 7f2789287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 2024-09-22T09:07:20.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2789287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:20.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2789287800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:20.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2789287800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:20.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2789287800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33, ofs0, ns] 2024-09-22T09:07:20.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2669ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529758 cookie 94260080376880 notifier 6980 bl.length()=879 2024-09-22T09:07:20.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2669ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:20.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2669ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:20.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.468+0000 7f2669ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:20.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.470+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_sources= new_sources= 2024-09-22T09:07:20.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.470+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential sources added=[] removed=[] 2024-09-22T09:07:20.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.470+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_dests= new_dests= 2024-09-22T09:07:20.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.470+0000 7f2789287800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential dests added=[] removed=[] 2024-09-22T09:07:20.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.470+0000 7f2789287800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-22T09:07:20.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.472+0000 7f263d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:20.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.474+0000 7f2789287800 20 remove_watcher() i=0 2024-09-22T09:07:20.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.474+0000 7f2789287800 2 removed watcher, disabling cache 2024-09-22T09:07:20.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.475+0000 7f2789287800 20 remove_watcher() i=1 2024-09-22T09:07:20.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.476+0000 7f2789287800 20 remove_watcher() i=2 2024-09-22T09:07:20.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.478+0000 7f2789287800 20 remove_watcher() i=3 2024-09-22T09:07:20.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.479+0000 7f2789287800 20 remove_watcher() i=4 2024-09-22T09:07:20.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.480+0000 7f2789287800 20 remove_watcher() i=5 2024-09-22T09:07:20.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.481+0000 7f2789287800 20 remove_watcher() i=6 2024-09-22T09:07:20.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.482+0000 7f2789287800 20 remove_watcher() i=7 2024-09-22T09:07:20.495 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T09:07:20.526 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:20.526 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:20.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.565+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 20 realm 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.566+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.567+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.567+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.568+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:20.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.568+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.568+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:20.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.568+0000 7fb3b9932800 20 searching for the correct realm 2024-09-22T09:07:20.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.570+0000 7fb3b5dbd640 0 -- 172.21.15.39:0/1083118998 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb3a0018070 msgr2=0x7fb3a003a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:20.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.777+0000 7fb3b4dbb640 0 -- 172.21.15.39:0/1083118998 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb3b00b4040 msgr2=0x7fb3b00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:20.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.984+0000 7fb3b9932800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:20.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:20.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:20.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:20.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:20.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:20.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.985+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 zone default found 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 4 Realm: () 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:20.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 zonegroup default 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.986+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.987+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.987+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.987+0000 7fb3b9932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.987+0000 7fb3b9932800 20 started sync module instance, tier type = 2024-09-22T09:07:20.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.987+0000 7fb3b9932800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:20.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=0 2024-09-22T09:07:20.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=1 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=2 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=3 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=4 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=5 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.997+0000 7fb3b9932800 20 add_watcher() i=6 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.998+0000 7fb3b9932800 20 add_watcher() i=7 2024-09-22T09:07:20.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:20.998+0000 7fb3b9932800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:21.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.000+0000 7fb26bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.000+0000 7fb3b9932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.000+0000 7fb3b9932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.000+0000 7fb3b9932800 5 note: GC not initialized 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb26afe5640 20 reqs_thread_entry: start 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb3b9932800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:21.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb3b9932800 20 Filter name: none 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb268fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.001+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.002+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:21.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.002+0000 7fb3b9932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:21.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.002+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.003+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:21.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.003+0000 7fb3b9932800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.003+0000 7fb3b9932800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:21.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.003+0000 7fb3b9932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:21.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.005+0000 7fb26bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:21.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.007+0000 7fb3b9932800 20 remove_watcher() i=0 2024-09-22T09:07:21.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.007+0000 7fb3b9932800 2 removed watcher, disabling cache 2024-09-22T09:07:21.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.009+0000 7fb3b9932800 20 remove_watcher() i=1 2024-09-22T09:07:21.011 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.010+0000 7fb3b9932800 20 remove_watcher() i=2 2024-09-22T09:07:21.012 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.011+0000 7fb3b9932800 20 remove_watcher() i=3 2024-09-22T09:07:21.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.012+0000 7fb3b9932800 20 remove_watcher() i=4 2024-09-22T09:07:21.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.013+0000 7fb3b9932800 20 remove_watcher() i=5 2024-09-22T09:07:21.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.014+0000 7fb3b9932800 20 remove_watcher() i=6 2024-09-22T09:07:21.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.015+0000 7fb3b9932800 20 remove_watcher() i=7 2024-09-22T09:07:21.028 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:21.028 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:21.028 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:21.029 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:21.030 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:21.030 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:21.061 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:21.061 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:21.119 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:07:21.151 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:21.151 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:21.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.190+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 realm 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.192+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.193+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:21.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.193+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.194+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:21.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.194+0000 7f0454919800 20 searching for the correct realm 2024-09-22T09:07:21.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.196+0000 7f0452c04640 0 -- 172.21.15.39:0/4267498849 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f0448041040 msgr2=0x7f044802c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:21.403 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.402+0000 7f0451c02640 0 -- 172.21.15.39:0/4267498849 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f044c0caa90 msgr2=0x7f044c0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:21.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:21.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:21.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:21.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.610+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:21.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 zone default found 2024-09-22T09:07:21.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 4 Realm: () 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 zonegroup default 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.611+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.612+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.612+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.612+0000 7f0454919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.612+0000 7f0454919800 20 started sync module instance, tier type = 2024-09-22T09:07:21.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.612+0000 7f0454919800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=0 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=1 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=2 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=3 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=4 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=5 2024-09-22T09:07:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.623+0000 7f0454919800 20 add_watcher() i=6 2024-09-22T09:07:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.624+0000 7f0454919800 20 add_watcher() i=7 2024-09-22T09:07:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.624+0000 7f0454919800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f0308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f0454919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f0454919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f0454919800 5 note: GC not initialized 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f02837fe640 20 reqs_thread_entry: start 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.626+0000 7f0454919800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 20 Filter name: none 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f02817fa640 20 reqs_thread_entry: start 2024-09-22T09:07:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-22T09:07:21.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 : miss 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.627+0000 7f0454919800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.628+0000 7f0454919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 2024-09-22T09:07:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0454919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0454919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0454919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0454919800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33, ofs0, ns] 2024-09-22T09:07:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0335ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529759 cookie 94659134173632 notifier 7518 bl.length()=911 2024-09-22T09:07:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0335ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0335ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.632+0000 7f0335ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.634+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_sources= new_sources= 2024-09-22T09:07:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.634+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential sources added=[] removed=[] 2024-09-22T09:07:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.634+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_dests= new_dests= 2024-09-22T09:07:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.634+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential dests added=[] removed=[] 2024-09-22T09:07:21.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.636+0000 7f0454919800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.1.0 2024-09-22T09:07:21.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.636+0000 7f0454919800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.1.0 2024-09-22T09:07:21.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.636+0000 7f0454919800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.1.1 2024-09-22T09:07:21.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.636+0000 7f0454919800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.1.1 2024-09-22T09:07:21.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.636+0000 7f0454919800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.0 2024-09-22T09:07:21.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.639+0000 7f0454919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:21.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.639+0000 7f0454919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 2024-09-22T09:07:21.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0454919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0454919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0454919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0454919800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33, ofs0, ns] 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0335ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529760 cookie 94659134173632 notifier 7518 bl.length()=911 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0335ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0335ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.640+0000 7f0335ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.642+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_sources= new_sources= 2024-09-22T09:07:21.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.642+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential sources added=[] removed=[] 2024-09-22T09:07:21.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.642+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_dests= new_dests= 2024-09-22T09:07:21.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.642+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential dests added=[] removed=[] 2024-09-22T09:07:21.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.643+0000 7f0454919800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.33.0 2024-09-22T09:07:21.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.643+0000 7f0454919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:21.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.643+0000 7f0454919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f0454919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f0454919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f0454919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f0454919800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33, ofs0, ns] 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f03357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529761 cookie 94659134173632 notifier 7518 bl.length()=879 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f03357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 info.flags=0x17 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f03357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 to cache LRU end 2024-09-22T09:07:21.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.645+0000 7f03357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:21.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.647+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_sources= new_sources= 2024-09-22T09:07:21.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.647+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential sources added=[] removed=[] 2024-09-22T09:07:21.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.647+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): orig_dests= new_dests= 2024-09-22T09:07:21.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.647+0000 7f0454919800 20 handle_bi_update(): bucket=:error-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.33]): potential dests added=[] removed=[] 2024-09-22T09:07:21.649 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.648+0000 7f0454919800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-22T09:07:21.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.650+0000 7f0308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:21.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.653+0000 7f0454919800 20 remove_watcher() i=0 2024-09-22T09:07:21.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.653+0000 7f0454919800 2 removed watcher, disabling cache 2024-09-22T09:07:21.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.654+0000 7f0454919800 20 remove_watcher() i=1 2024-09-22T09:07:21.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.655+0000 7f0454919800 20 remove_watcher() i=2 2024-09-22T09:07:21.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.656+0000 7f0454919800 20 remove_watcher() i=3 2024-09-22T09:07:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.658+0000 7f0454919800 20 remove_watcher() i=4 2024-09-22T09:07:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.659+0000 7f0454919800 20 remove_watcher() i=5 2024-09-22T09:07:21.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.660+0000 7f0454919800 20 remove_watcher() i=6 2024-09-22T09:07:21.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.661+0000 7f0454919800 20 remove_watcher() i=7 2024-09-22T09:07:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-22T09:07:21.705 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:21.705 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:21.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.743+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.745+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.745+0000 7f7155940800 20 realm 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.745+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.746+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.746+0000 7f7155940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.746+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.746+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:21.747 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.746+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.747+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:21.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.747+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:21.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.748+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:21.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.748+0000 7f7155940800 20 searching for the correct realm 2024-09-22T09:07:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.750+0000 7f7151ec1640 0 -- 172.21.15.39:0/3810195571 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f714801a040 msgr2=0x7f7148040910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:21.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:21.956+0000 7f7150ebf640 0 -- 172.21.15.39:0/3810195571 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f714c072240 msgr2=0x7f714c072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.163+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.164+0000 7f7155940800 20 zone default found 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 4 Realm: () 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 zonegroup default 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:22.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 started sync module instance, tier type = 2024-09-22T09:07:22.168 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.165+0000 7f7155940800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=0 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=1 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=2 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=3 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=4 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=5 2024-09-22T09:07:22.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.176+0000 7f7155940800 20 add_watcher() i=6 2024-09-22T09:07:22.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.177+0000 7f7155940800 20 add_watcher() i=7 2024-09-22T09:07:22.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.177+0000 7f7155940800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:22.180 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7007fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7155940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7155940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7155940800 5 note: GC not initialized 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7006fe5640 20 reqs_thread_entry: start 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.179+0000 7f7155940800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.180+0000 7f7155940800 20 Filter name: none 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.180+0000 7f7004fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:22.181 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.180+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.180+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:22.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.180+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.181+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:22.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.181+0000 7f7155940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:22.182 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.181+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.181+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:22.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.181+0000 7f7155940800 20 rados->read ofs=0 len=0 2024-09-22T09:07:22.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.182+0000 7f7155940800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:22.183 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.182+0000 7f7155940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:22.185 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.183+0000 7f7007fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:22.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.186+0000 7f7155940800 20 remove_watcher() i=0 2024-09-22T09:07:22.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.186+0000 7f7155940800 2 removed watcher, disabling cache 2024-09-22T09:07:22.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.187+0000 7f7155940800 20 remove_watcher() i=1 2024-09-22T09:07:22.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.188+0000 7f7155940800 20 remove_watcher() i=2 2024-09-22T09:07:22.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.190+0000 7f7155940800 20 remove_watcher() i=3 2024-09-22T09:07:22.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.191+0000 7f7155940800 20 remove_watcher() i=4 2024-09-22T09:07:22.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.192+0000 7f7155940800 20 remove_watcher() i=5 2024-09-22T09:07:22.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.193+0000 7f7155940800 20 remove_watcher() i=6 2024-09-22T09:07:22.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:22.194+0000 7f7155940800 20 remove_watcher() i=7 2024-09-22T09:07:22.207 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:22.207 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:22.207 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:07:22.207 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:22.209 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.209 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.230 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.230 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.450 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.450 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.515 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-22T09:07:22.515 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:22.517 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.517 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.561 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.561 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.619 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.619 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.655 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.655 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.688 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.688 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.720 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.721 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.753 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.754 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.786 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.786 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.820 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.820 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.853 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.853 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.887 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.887 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.920 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.920 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.955 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.955 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:22.991 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:22.991 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.027 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.027 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.061 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.061 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.095 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.095 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.130 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.130 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.165 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.165 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.196 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.196 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.229 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.229 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.262 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:23.262 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:23.296 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T09:07:23.325 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:23.325 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:23.364 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.363+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 realm 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.365+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.367 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.366+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:23.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.366+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.367+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:23.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.367+0000 7f90dc016800 20 searching for the correct realm 2024-09-22T09:07:23.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.369+0000 7f90d7fe8640 0 -- 172.21.15.39:0/4040758128 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f90c0074070 msgr2=0x7f90c00b7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:23.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.373+0000 7f90cefe6640 0 -- 172.21.15.39:0/4040758128 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f90d000e070 msgr2=0x7f90d00909e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:23.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:23.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.579+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 zone default found 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 4 Realm: () 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:23.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 zonegroup default 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.580+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.581+0000 7f90dc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.581+0000 7f90dc016800 20 started sync module instance, tier type = 2024-09-22T09:07:23.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.581+0000 7f90dc016800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=0 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=1 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=2 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=3 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=4 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=5 2024-09-22T09:07:23.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.590+0000 7f90dc016800 20 add_watcher() i=6 2024-09-22T09:07:23.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.591+0000 7f90dc016800 20 add_watcher() i=7 2024-09-22T09:07:23.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.591+0000 7f90dc016800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:23.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.592+0000 7f8f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:23.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.592+0000 7f90dc016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:23.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.592+0000 7f90dc016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:23.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.592+0000 7f90dc016800 5 note: GC not initialized 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.593+0000 7f8f8cfe1640 20 reqs_thread_entry: start 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.593+0000 7f90dc016800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.593+0000 7f90dc016800 20 Filter name: none 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.593+0000 7f8f067fc640 20 reqs_thread_entry: start 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.593+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.594+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:23.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.594+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.594+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.594+0000 7f90dc016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.594+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.595+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.595+0000 7f90dc016800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.595+0000 7f90dc016800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:23.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.595+0000 7f90dc016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:23.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.597+0000 7f8f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:23.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.598+0000 7f90dc016800 20 remove_watcher() i=0 2024-09-22T09:07:23.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.598+0000 7f90dc016800 2 removed watcher, disabling cache 2024-09-22T09:07:23.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.600+0000 7f90dc016800 20 remove_watcher() i=1 2024-09-22T09:07:23.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.601+0000 7f90dc016800 20 remove_watcher() i=2 2024-09-22T09:07:23.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.602+0000 7f90dc016800 20 remove_watcher() i=3 2024-09-22T09:07:23.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.603+0000 7f90dc016800 20 remove_watcher() i=4 2024-09-22T09:07:23.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.604+0000 7f90dc016800 20 remove_watcher() i=5 2024-09-22T09:07:23.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.605+0000 7f90dc016800 20 remove_watcher() i=6 2024-09-22T09:07:23.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.606+0000 7f90dc016800 20 remove_watcher() i=7 2024-09-22T09:07:23.618 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:23.618 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:23.618 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:23.618 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:23.619 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T09:07:23.655 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:23.655 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:23.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.692+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 realm 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:23.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:23.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.696+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:23.697 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.696+0000 7f44cf723800 20 searching for the correct realm 2024-09-22T09:07:23.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.698+0000 7f44cbc45640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f44c007bc20 msgr2=0x7f44c0060430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:23.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:23.904+0000 7f44cac43640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f44c40a4970 msgr2=0x7f44c40a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:24.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 zone default found 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 4 Realm: () 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 zonegroup default 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.113+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.113+0000 7f44cf723800 20 started sync module instance, tier type = 2024-09-22T09:07:24.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.113+0000 7f44cf723800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:24.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=0 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=1 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=2 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=3 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=4 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=5 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=6 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.124+0000 7f44cf723800 20 add_watcher() i=7 2024-09-22T09:07:24.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.124+0000 7f44cf723800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:24.127 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.126+0000 7f4381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:24.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:24.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:24.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 5 note: GC not initialized 2024-09-22T09:07:24.128 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f4380fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:24.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:24.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 20 Filter name: none 2024-09-22T09:07:24.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f42fa7fc640 20 reqs_thread_entry: start 2024-09-22T09:07:24.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T09:07:24.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.127+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : miss 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.128+0000 7f44cf723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:24.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f44cf723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.133 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f44cf723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:24.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94078927855952 notifier 7566 bl.length()=911 2024-09-22T09:07:24.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.134 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:24.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:24.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:24.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:24.138 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44cf723800 time 2024-09-22T09:07:24.137758+0000 2024-09-22T09:07:24.138 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:07:24.138 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44d0f8c748] 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f44cf723800 thread_name:radosgw-admin 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.137+0000 7f44cf723800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44cf723800 time 2024-09-22T09:07:24.137758+0000 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.139 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44d0f8c748] 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:07:24.140 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.155 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.155 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44cfc3e6f0] 2024-09-22T09:07:24.155 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44cfc8b99c] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44d0f8c7a2] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.138+0000 7f44cf723800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f44cf723800 thread_name:radosgw-admin 2024-09-22T09:07:24.156 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44cfc3e6f0] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44cfc8b99c] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44d0f8c7a2] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:07:24.157 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: dump: 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.158 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:07:23.675+0000 7f44cf723800 5 monclient: authenticate success, global_id 7554 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: get_monmap_and_config success 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:07:23.675+0000 7f44cf723800 4 set_mon_vals no callback set 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: dump: 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.159 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: shutdown 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:07:23.675+0000 7f44cf723800 5 asok(0x559074e180f0) unregister_commands rotate-key 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:07:23.675+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.160 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.161 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: starting msgr at 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: starting objecter 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests hook 0x55907503f4a0 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: setting wanted keys 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: calling monclient init 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.162 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key hook 0x55907503a3d8 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x559074eefc80 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.163 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x559074f80290 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x559074f806c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.936973s 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x559074f80290 auth_method 0 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x559074eefc80 auth_method 0 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.164 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x559074f806c0 auth_method 0 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7557 payload 824 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:07:23.677+0000 7f44cac43640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.165 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: dump: 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.166 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: dump: 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.167 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:07:23.677+0000 7f44cf723800 5 monclient: authenticate success, global_id 7557 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:07:23.677+0000 7f43b960a640 4 set_mon_vals no callback set 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:07:23.677+0000 7f44cf723800 1 librados: init done 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:07:23.679+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f43b00775a0 auth_method 0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:07:23.680+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075062a40 auth_method 0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:07:23.681+0000 7f44cb444640 10 monclient: get_auth_request con 0x5590750859e0 auth_method 0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:07:23.681+0000 7f44cac43640 10 monclient: get_auth_request con 0x559075089c20 auth_method 0 2024-09-22T09:07:24.168 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:07:23.682+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075089290 auth_method 0 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:07:23.683+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:07:23.683+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:07:23.683+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.169 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.170 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:07:23.683+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests cmddesc objecter_requests hook 0x559075095290 EEXIST 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.171 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:07:23.684+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:07:23.684+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x559075090e50 EEXIST 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x5590750b95b0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x5590750b9990 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x5590750b82c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.172 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.944613s 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x5590750b95b0 auth_method 0 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x5590750b9990 auth_method 0 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.173 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x5590750b82c0 auth_method 0 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7055 payload 824 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:07:23.684+0000 7f44cac43640 1 monclient: found mon.noname-c 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:07:24.174 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: dump: 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.175 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: dump: 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:07:23.685+0000 7f44cf723800 5 monclient: authenticate success, global_id 7055 2024-09-22T09:07:24.176 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:07:23.685+0000 7f44cc446640 4 set_mon_vals no callback set 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:07:23.687+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f43a4077480 auth_method 0 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: get_monmap_and_config 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:07:23.687+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.177 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.178 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:07:23.687+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.179 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:07:23.688+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:07:23.688+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:07:23.688+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x7fff771d9038 EEXIST 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:07:24.180 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x55907510daa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x5590750fe3f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x559075108ed0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.948386s 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x55907510daa0 auth_method 0 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x559075108ed0 auth_method 0 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.181 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7563 payload 274 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:07:23.688+0000 7f44cac43640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:07:23.688+0000 7f44cbc45640 10 monclient: get_auth_request con 0x5590750fe3f0 auth_method 0 2024-09-22T09:07:24.182 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: dump: 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.183 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:07:23.688+0000 7f44cf723800 5 monclient: authenticate success, global_id 7563 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: get_monmap_and_config success 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:07:23.688+0000 7f44cf723800 4 set_mon_vals no callback set 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: dump: 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.184 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: shutdown 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.185 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.186 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:07:23.689+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 librados: starting msgr at 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 librados: starting objecter 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests cmddesc objecter_requests hook 0x5590751092b0 EEXIST 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:07:23.690+0000 7f44cf723800 1 librados: setting wanted keys 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:07:23.690+0000 7f44cf723800 1 librados: calling monclient init 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.187 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:07:23.690+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:07:23.690+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.188 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x5590750cdfb8 EEXIST 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x5590750fe3f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x559075108ed0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x55907510daa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.950601s 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x55907510daa0 auth_method 0 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.189 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x5590750fe3f0 auth_method 0 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.190 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x559075108ed0 auth_method 0 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:07:23.690+0000 7f44cb444640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.191 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: dump: 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.192 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.193 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.193 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.193 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: dump: 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.194 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:07:23.691+0000 7f44cf723800 5 monclient: authenticate success, global_id 7566 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:07:23.691+0000 7f43aeffd640 4 set_mon_vals no callback set 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.195 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:07:23.691+0000 7f44cf723800 1 librados: init done 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:07:23.691+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cr dump hook 0x559075103758 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:07:23.692+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:07:23.693+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f43940775a0 auth_method 0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:07:23.694+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075127c50 auth_method 0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 realm 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:07:23.694+0000 7f44cf723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.196 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:07:23.695+0000 7f44cac43640 10 monclient: get_auth_request con 0x55907512c050 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:07:23.695+0000 7f44cbc45640 10 monclient: get_auth_request con 0x55907512f770 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:07:23.696+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:07:23.696+0000 7f44cf723800 20 searching for the correct realm 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:07:23.696+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f44c4078070 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:07:23.697+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44bc008070 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:07:23.698+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f44c007bc20 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:07:23.698+0000 7f44cbc45640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f44c007bc20 msgr2=0x7f44c0060430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:07:23.900+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f44c007bc20 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:07:23.902+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f44c4062430 auth_method 0 2024-09-22T09:07:24.197 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:07:23.904+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44c40a4970 auth_method 0 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:07:23.904+0000 7f44cac43640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f44c40a4970 msgr2=0x7f44c40a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:07:24.106+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44c40a4970 auth_method 0 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.198 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 zone default found 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 Realm: () 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:07:24.112+0000 7f44cf723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 zonegroup default 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 started sync module instance, tier type = 2024-09-22T09:07:24.199 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=0 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=1 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=2 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=3 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=4 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=5 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=6 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:07:24.124+0000 7f44cf723800 20 add_watcher() i=7 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:07:24.124+0000 7f44cf723800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.200 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:07:24.126+0000 7f4381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:07:24.127+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache list hook 0x559075103330 2024-09-22T09:07:24.201 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache inspect hook 0x559075103330 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache erase hook 0x559075103330 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache zap hook 0x559075103330 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 note: GC not initialized 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:07:24.127+0000 7f4380fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace show hook 0x7f44c404d7b0 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace history hook 0x7f44c404d7b0 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace active hook 0x7f44c404d7b0 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace active_short hook 0x7f44c404d7b0 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 Filter name: none 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:07:24.127+0000 7f42fa7fc640 20 reqs_thread_entry: start 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:07:24.127+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:24.202 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : miss 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:24.203 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94078927855952 notifier 7566 bl.length()=911 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:07:24.137+0000 7f44cf723800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44cf723800 time 2024-09-22T09:07:24.137758+0000 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44d0f8c748] 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.204 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:07:24.138+0000 7f44cf723800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f44cf723800 thread_name:radosgw-admin 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44cfc3e6f0] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44cfc8b99c] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44d0f8c7a2] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.205 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:07:24.206 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:07:24.207 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:07:24.208 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:07:24.209 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:07:24.210 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:07:24.211 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 7f42fa7fc640 / http_manager 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4380fe1640 / http_manager 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4381fe3640 / rgw_dt_lg_renew 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43ad7fa640 / ms_dispatch 2024-09-22T09:07:24.212 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43aeffd640 / io_context_pool 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b5602640 / ms_dispatch 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b7e07640 / ms_dispatch 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b960a640 / io_context_pool 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cac43640 / msgr-worker-2 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cb444640 / msgr-worker-1 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cbc45640 / msgr-worker-0 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cc446640 / io_context_pool 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cf723800 / radosgw-admin 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.126868.log 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: dump: 2024-09-22T09:07:24.213 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:07:23.675+0000 7f44cf723800 5 monclient: authenticate success, global_id 7554 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: get_monmap_and_config success 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:07:23.675+0000 7f44cf723800 4 set_mon_vals no callback set 2024-09-22T09:07:24.214 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:07:23.675+0000 7f43b960a640 10 monclient: dump: 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.215 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: shutdown 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:07:23.675+0000 7f44cf723800 5 asok(0x559074e180f0) unregister_commands rotate-key 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:07:23.675+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:07:23.675+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.216 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding auth protocol: cephx 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: crc 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503f9e0) adding con mode: secure 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: starting msgr at 2024-09-22T09:07:24.217 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: starting objecter 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests hook 0x55907503f4a0 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: setting wanted keys 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:07:23.676+0000 7f44cf723800 1 librados: calling monclient init 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding auth protocol: cephx 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.218 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: crc 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 AuthRegistry(0x55907503a290) adding con mode: secure 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:07:23.676+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:07:23.676+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key hook 0x55907503a3d8 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x559074eefc80 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x559074f80290 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.219 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x559074f806c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:07:23.676+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.936973s 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x559074f80290 auth_method 0 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x559074eefc80 auth_method 0 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.220 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:07:23.677+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x559074f806c0 auth_method 0 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:07:23.677+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7557 payload 824 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:07:23.677+0000 7f44cac43640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:07:23.677+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.221 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: dump: 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.222 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:07:23.677+0000 7f43b7e07640 10 monclient: dump: 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:07:23.677+0000 7f44cf723800 5 monclient: authenticate success, global_id 7557 2024-09-22T09:07:24.223 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:07:23.677+0000 7f43b960a640 4 set_mon_vals no callback set 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:07:23.677+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:07:23.677+0000 7f44cf723800 1 librados: init done 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:07:23.679+0000 7f43b7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:07:23.679+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f43b00775a0 auth_method 0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:07:23.680+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075062a40 auth_method 0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:07:23.681+0000 7f44cb444640 10 monclient: get_auth_request con 0x5590750859e0 auth_method 0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:07:23.681+0000 7f44cac43640 10 monclient: get_auth_request con 0x559075089c20 auth_method 0 2024-09-22T09:07:24.224 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:07:23.682+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075089290 auth_method 0 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:07:23.683+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:07:23.683+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:07:23.683+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.225 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding auth protocol: cephx 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: crc 2024-09-22T09:07:24.226 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 AuthRegistry(0x559075091dc0) adding con mode: secure 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:07:23.683+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:07:23.683+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests cmddesc objecter_requests hook 0x559075095290 EEXIST 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding auth protocol: cephx 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.227 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: crc 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 AuthRegistry(0x559075090d08) adding con mode: secure 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:07:23.684+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:07:23.684+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:07:23.684+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x559075090e50 EEXIST 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x5590750b95b0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x5590750b9990 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x5590750b82c0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.228 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:07:23.684+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.944613s 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x5590750b95b0 auth_method 0 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x5590750b9990 auth_method 0 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.229 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:07:23.684+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x5590750b82c0 auth_method 0 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:07:23.684+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7055 payload 824 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:07:23.684+0000 7f44cac43640 1 monclient: found mon.noname-c 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:07:23.684+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: dump: 2024-09-22T09:07:24.230 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:07:23.685+0000 7f43b5602640 10 monclient: dump: 2024-09-22T09:07:24.231 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:07:23.685+0000 7f44cf723800 5 monclient: authenticate success, global_id 7055 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:07:23.685+0000 7f44cc446640 4 set_mon_vals no callback set 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:07:23.685+0000 7f44cf723800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:07:24.232 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:07:23.687+0000 7f43b5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:07:23.687+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f43a4077480 auth_method 0 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: get_monmap_and_config 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:07:23.687+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.233 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding auth protocol: cephx 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.234 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: crc 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x5590750d9480) adding con mode: secure 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:07:23.687+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:07:23.687+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding auth protocol: cephx 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.235 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: crc 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:07:23.687+0000 7f44cf723800 5 AuthRegistry(0x7fff771d8ef0) adding con mode: secure 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:07:23.688+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:07:23.688+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:07:23.688+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x7fff771d9038 EEXIST 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x55907510daa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x5590750fe3f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x559075108ed0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.236 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.948386s 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x55907510daa0 auth_method 0 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x559075108ed0 auth_method 0 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.237 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:07:23.688+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient(hunting): handle_auth_done global_id 7563 payload 274 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:07:23.688+0000 7f44cac43640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:07:23.688+0000 7f44cac43640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:07:23.688+0000 7f44cbc45640 10 monclient: get_auth_request con 0x5590750fe3f0 auth_method 0 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: dump: 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.238 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:07:23.688+0000 7f44cf723800 5 monclient: authenticate success, global_id 7563 2024-09-22T09:07:24.239 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:07:23.688+0000 7f44cf723800 10 monclient: get_monmap_and_config success 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:07:23.688+0000 7f44cf723800 4 set_mon_vals no callback set 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:07:23.688+0000 7f43aeffd640 10 monclient: dump: 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.240 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: shutdown 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: build_initial_monmap 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 build_initial for_mkfs: 0 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:07:23.689+0000 7f44cf723800 10 monclient: monmap: 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:07:24.241 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding auth protocol: cephx 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.242 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: crc 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 AuthRegistry(0x5590750dd000) adding con mode: secure 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:07:23.689+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 librados: starting msgr at 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:07:23.689+0000 7f44cf723800 1 librados: starting objecter 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:07:23.689+0000 7f44cf723800 5 asok(0x559074e180f0) register_command objecter_requests cmddesc objecter_requests hook 0x5590751092b0 EEXIST 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:07:23.690+0000 7f44cf723800 1 librados: setting wanted keys 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:07:23.690+0000 7f44cf723800 1 librados: calling monclient init 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: init 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding auth protocol: cephx 2024-09-22T09:07:24.243 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: crc 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 AuthRegistry(0x5590750cde70) adding con mode: secure 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:07:23.690+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:07:23.690+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.244 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:07:23.690+0000 7f44cf723800 5 asok(0x559074e180f0) register_command rotate-key cmddesc rotate-key hook 0x5590750cdfb8 EEXIST 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: _reopen_session rank -1 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-c con 0x5590750fe3f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-b con 0x559075108ed0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): picked mon.noname-a con 0x55907510daa0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): start opening mon connection 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): _renew_subs 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:07:23.690+0000 7f44cf723800 10 monclient(hunting): authenticate will time out at 2341.950601s 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): get_auth_request con 0x55907510daa0 auth_method 0 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.245 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): get_auth_request con 0x5590750fe3f0 auth_method 0 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:07:23.690+0000 7f44cac43640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): get_auth_request con 0x559075108ed0 auth_method 0 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:07:24.246 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:07:23.690+0000 7f44cbc45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient(hunting): handle_auth_done global_id 7566 payload 824 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient: _finish_hunting 0 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:07:23.690+0000 7f44cb444640 1 monclient: found mon.noname-a 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:07:23.690+0000 7f44cb444640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: dump: 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.247 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: _finish_auth 0 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: _check_auth_tickets 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:07:23.691+0000 7f43ad7fa640 10 monclient: dump: 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:07:24.248 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:07:23.691+0000 7f44cf723800 5 monclient: authenticate success, global_id 7566 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:07:23.691+0000 7f43aeffd640 4 set_mon_vals no callback set 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _renew_subs 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:07:23.691+0000 7f44cf723800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:07:24.249 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:07:23.691+0000 7f44cf723800 1 librados: init done 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:07:23.691+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cr dump hook 0x559075103758 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:07:23.692+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:07:23.693+0000 7f43ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:07:23.693+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f43940775a0 auth_method 0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:07:23.694+0000 7f44cbc45640 10 monclient: get_auth_request con 0x559075127c50 auth_method 0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 realm 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:07:23.694+0000 7f44cf723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:07:23.694+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.250 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:07:23.695+0000 7f44cac43640 10 monclient: get_auth_request con 0x55907512c050 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:07:23.695+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:07:23.695+0000 7f44cbc45640 10 monclient: get_auth_request con 0x55907512f770 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:07:23.696+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:07:23.696+0000 7f44cf723800 20 searching for the correct realm 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:07:23.696+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f44c4078070 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:07:23.697+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44bc008070 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:07:23.698+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f44c007bc20 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:07:23.698+0000 7f44cbc45640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f44c007bc20 msgr2=0x7f44c0060430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:07:23.900+0000 7f44cbc45640 10 monclient: get_auth_request con 0x7f44c007bc20 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:07:23.902+0000 7f44cb444640 10 monclient: get_auth_request con 0x7f44c4062430 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:07:23.904+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44c40a4970 auth_method 0 2024-09-22T09:07:24.251 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:07:23.904+0000 7f44cac43640 0 -- 172.21.15.39:0/2092849425 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f44c40a4970 msgr2=0x7f44c40a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:07:24.106+0000 7f44cac43640 10 monclient: get_auth_request con 0x7f44c40a4970 auth_method 0 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:07:24.111+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:24.252 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 zone default found 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 Realm: () 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:07:24.112+0000 7f44cf723800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:07:24.112+0000 7f44cf723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 zonegroup default 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:07:24.112+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 started sync module instance, tier type = 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:07:24.113+0000 7f44cf723800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=0 2024-09-22T09:07:24.253 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=1 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=2 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=3 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=4 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=5 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:07:24.123+0000 7f44cf723800 20 add_watcher() i=6 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:07:24.124+0000 7f44cf723800 20 add_watcher() i=7 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:07:24.124+0000 7f44cf723800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding auth protocol: cephx 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.254 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:07:24.126+0000 7f4381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: crc 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:07:24.126+0000 7f44cf723800 5 AuthRegistry(0x7fff771d93c0) adding con mode: secure 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:07:24.127+0000 7f44cf723800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache list hook 0x559075103330 2024-09-22T09:07:24.255 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache inspect hook 0x559075103330 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache erase hook 0x559075103330 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command cache zap hook 0x559075103330 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 note: GC not initialized 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:07:24.127+0000 7f4380fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace show hook 0x7f44c404d7b0 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace history hook 0x7f44c404d7b0 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace active hook 0x7f44c404d7b0 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:07:24.127+0000 7f44cf723800 5 asok(0x559074e180f0) register_command sync trace active_short hook 0x7f44c404d7b0 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 Filter name: none 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:07:24.127+0000 7f42fa7fc640 20 reqs_thread_entry: start 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:07:24.127+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:07:24.127+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:24.256 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : miss 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:07:24.128+0000 7f44cf723800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:07:24.128+0000 7f44cf723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:07:24.132+0000 7f44cf723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94078927855952 notifier 7566 bl.length()=911 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:24.257 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:07:24.132+0000 7f43aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:07:24.134+0000 7f44cf723800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:07:24.137+0000 7f44cf723800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f44cf723800 time 2024-09-22T09:07:24.137758+0000 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f44d0f8c748] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:07:24.258 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:07:24.138+0000 7f44cf723800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f44cf723800 thread_name:radosgw-admin 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f44cfc3e6f0] 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f44cfc8b99c] 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f44d0f8c7a2] 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f44d0f8c906] 2024-09-22T09:07:24.259 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5590732e8e01] 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5590732f8d0a] 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f44cfc29590] 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:07:24.260 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:07:24.261 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:07:24.262 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:07:24.263 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:07:24.264 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:07:24.265 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:07:24.266 INFO:tasks.workunit.client.0.smithi039.stderr: 7f42fa7fc640 / http_manager 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4380fe1640 / http_manager 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4381fe3640 / rgw_dt_lg_renew 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43ad7fa640 / ms_dispatch 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43aeffd640 / io_context_pool 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b5602640 / ms_dispatch 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b7e07640 / ms_dispatch 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f43b960a640 / io_context_pool 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cac43640 / msgr-worker-2 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cb444640 / msgr-worker-1 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cbc45640 / msgr-worker-0 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cc446640 / io_context_pool 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: 7f44cf723800 / radosgw-admin 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:07:24.267 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:07:24.139362Z_c01f41cc-91cf-4fd7-bd2e-4ee48bbe4f6c/log 2024-09-22T09:07:24.268 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:07:24.268 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.219+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 realm 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.221+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.222+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.222+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.223+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.223+0000 7f185a51f800 20 searching for the correct realm 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.225+0000 7f1856aa3640 0 -- 172.21.15.39:0/794703405 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f184003c060 msgr2=0x7f1840002400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.229+0000 7f1855aa1640 0 -- 172.21.15.39:0/794703405 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f1850060210 msgr2=0x7f1850021440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.435+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 zone default found 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 4 Realm: () 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 zonegroup default 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.436+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 started sync module instance, tier type = 2024-09-22T09:07:24.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.437+0000 7f185a51f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.447+0000 7f185a51f800 20 add_watcher() i=0 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=1 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=2 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=3 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=4 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=5 2024-09-22T09:07:24.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.448+0000 7f185a51f800 20 add_watcher() i=6 2024-09-22T09:07:24.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.449+0000 7f185a51f800 20 add_watcher() i=7 2024-09-22T09:07:24.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.449+0000 7f185a51f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:24.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.450+0000 7f170cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:24.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:24.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:24.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 5 note: GC not initialized 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f16877fe640 20 reqs_thread_entry: start 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 20 Filter name: none 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f16857fa640 20 reqs_thread_entry: start 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.451+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.452+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:24.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.452+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.452+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T09:07:24.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.452+0000 7f185a51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:24.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.452+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.453+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:24.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.453+0000 7f185a51f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.453+0000 7f185a51f800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T09:07:24.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.453+0000 7f185a51f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:24.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.455+0000 7f170cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:24.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.457+0000 7f185a51f800 20 remove_watcher() i=0 2024-09-22T09:07:24.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.457+0000 7f185a51f800 2 removed watcher, disabling cache 2024-09-22T09:07:24.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.459+0000 7f185a51f800 20 remove_watcher() i=1 2024-09-22T09:07:24.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.460+0000 7f185a51f800 20 remove_watcher() i=2 2024-09-22T09:07:24.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.461+0000 7f185a51f800 20 remove_watcher() i=3 2024-09-22T09:07:24.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.462+0000 7f185a51f800 20 remove_watcher() i=4 2024-09-22T09:07:24.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.463+0000 7f185a51f800 20 remove_watcher() i=5 2024-09-22T09:07:24.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.464+0000 7f185a51f800 20 remove_watcher() i=6 2024-09-22T09:07:24.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.465+0000 7f185a51f800 20 remove_watcher() i=7 2024-09-22T09:07:24.477 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.477 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:24.477 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:24.477 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:24.479 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:24.479 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:24.508 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:24.508 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:24.566 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:07:24.599 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:24.599 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:24.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.638+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 20 realm 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.639+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.640+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:24.641 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.640+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.641+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.641+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.641+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:24.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.641+0000 7f6635140800 20 searching for the correct realm 2024-09-22T09:07:24.644 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.643+0000 7f66316ee640 0 -- 172.21.15.39:0/4259874207 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6618081040 msgr2=0x7f6618061b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:24.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:24.848+0000 7f66306ec640 0 -- 172.21.15.39:0/4259874207 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f66280a31b0 msgr2=0x7f6628068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:25.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:25.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:25.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:25.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.054+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 zone default found 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 4 Realm: () 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 zonegroup default 2024-09-22T09:07:25.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.055+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.056+0000 7f6635140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.056+0000 7f6635140800 20 started sync module instance, tier type = 2024-09-22T09:07:25.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.056+0000 7f6635140800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:25.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=0 2024-09-22T09:07:25.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=1 2024-09-22T09:07:25.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=2 2024-09-22T09:07:25.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=3 2024-09-22T09:07:25.068 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=4 2024-09-22T09:07:25.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=5 2024-09-22T09:07:25.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.067+0000 7f6635140800 20 add_watcher() i=6 2024-09-22T09:07:25.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.068+0000 7f6635140800 20 add_watcher() i=7 2024-09-22T09:07:25.069 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.068+0000 7f6635140800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:25.071 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f64e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f6635140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f6635140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f6635140800 5 note: GC not initialized 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f64e5fe3640 20 reqs_thread_entry: start 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.070+0000 7f6635140800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 20 Filter name: none 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f64577fe640 20 reqs_thread_entry: start 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T09:07:25.072 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : miss 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.071+0000 7f6635140800 20 rados->read ofs=0 len=0 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T09:07:25.073 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:25.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:25.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:25.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:25.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.072+0000 7f6635140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:25.074 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.073+0000 7f6635140800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to be held by another RGW process; skipping for now 2024-09-22T09:07:25.075 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.074+0000 7f64e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:25.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.078+0000 7f6635140800 20 remove_watcher() i=0 2024-09-22T09:07:25.079 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.078+0000 7f6635140800 2 removed watcher, disabling cache 2024-09-22T09:07:25.080 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.079+0000 7f6635140800 20 remove_watcher() i=1 2024-09-22T09:07:25.081 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.080+0000 7f6635140800 20 remove_watcher() i=2 2024-09-22T09:07:25.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.082+0000 7f6635140800 20 remove_watcher() i=3 2024-09-22T09:07:25.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.084+0000 7f6635140800 20 remove_watcher() i=4 2024-09-22T09:07:25.086 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.085+0000 7f6635140800 20 remove_watcher() i=5 2024-09-22T09:07:25.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.086+0000 7f6635140800 20 remove_watcher() i=6 2024-09-22T09:07:25.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:25.087+0000 7f6635140800 20 remove_watcher() i=7 2024-09-22T09:07:25.099 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:07:55.112 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:07:55.149 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:55.150 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:55.195 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.194+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 20 realm 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.196+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.197+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.197+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.198+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:55.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.198+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.198+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:55.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.199+0000 7f501f087800 20 searching for the correct realm 2024-09-22T09:07:55.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.201+0000 7f501d379640 0 -- 172.21.15.39:0/4024156299 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f501009a930 msgr2=0x7f5010064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:55.410 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.409+0000 7f501c377640 0 -- 172.21.15.39:0/4024156299 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5014043410 msgr2=0x7f5014043890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:55.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:55.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:55.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:55.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.618+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 zone default found 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 4 Realm: () 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 zonegroup default 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.619+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.620+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.620+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.620+0000 7f501f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.620+0000 7f501f087800 20 started sync module instance, tier type = 2024-09-22T09:07:55.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.620+0000 7f501f087800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:55.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=0 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=1 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=2 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=3 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=4 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=5 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.631+0000 7f501f087800 20 add_watcher() i=6 2024-09-22T09:07:55.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.632+0000 7f501f087800 20 add_watcher() i=7 2024-09-22T09:07:55.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.632+0000 7f501f087800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:55.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.634+0000 7f4ed2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:55.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.635+0000 7f501f087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:55.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.635+0000 7f501f087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:55.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.635+0000 7f501f087800 5 note: GC not initialized 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.635+0000 7f4ed1fe3640 20 reqs_thread_entry: start 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.635+0000 7f501f087800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.636+0000 7f501f087800 20 Filter name: none 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.636+0000 7f4e437fe640 20 reqs_thread_entry: start 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.636+0000 7f501f087800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-22T09:07:55.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.636+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.636+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:55.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-22T09:07:55.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-22T09:07:55.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : miss 2024-09-22T09:07:55.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 20 rados_obj.operate() r=0 bl.length=441 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.637+0000 7f501f087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:55.640 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.639+0000 7f501f087800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.643+0000 7f501f087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.643+0000 7f501f087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.643+0000 7f501f087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.643+0000 7f501f087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.644+0000 7f4ef3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94687797421104 notifier 7617 bl.length()=911 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.644+0000 7f4ef3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.644+0000 7f4ef3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.644+0000 7f4ef3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.646+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:55.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.646+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:55.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.646+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:55.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.646+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:55.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.650+0000 7f501f087800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.2.0 2024-09-22T09:07:55.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.650+0000 7f501f087800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.2.0 2024-09-22T09:07:55.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.650+0000 7f501f087800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.2.1 2024-09-22T09:07:55.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.650+0000 7f501f087800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.2.1 2024-09-22T09:07:55.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.650+0000 7f501f087800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.0 2024-09-22T09:07:55.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.652+0000 7f501f087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:55.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.652+0000 7f501f087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:55.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f501f087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f501f087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f501f087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f501f087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:55.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f4ef37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 94687797421104 notifier 7617 bl.length()=911 2024-09-22T09:07:55.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f4ef37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f4ef37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.656 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.654+0000 7f4ef37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.656+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:55.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.656+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:55.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.656+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:55.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.656+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:55.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.658+0000 7f501f087800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.34.0 2024-09-22T09:07:55.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.658+0000 7f501f087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:55.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.658+0000 7f501f087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f501f087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f501f087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f501f087800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f501f087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34, ofs0, ns] 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f4ef3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529728 cookie 94687797421104 notifier 7617 bl.length()=879 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f4ef3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 info.flags=0x17 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f4ef3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 to cache LRU end 2024-09-22T09:07:55.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.660+0000 7f4ef3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:55.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.661+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_sources= new_sources= 2024-09-22T09:07:55.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.661+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential sources added=[] removed=[] 2024-09-22T09:07:55.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.661+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): orig_dests= new_dests= 2024-09-22T09:07:55.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.661+0000 7f501f087800 20 handle_bi_update(): bucket=:abort-at-do-reshard[530e834e-7701-4a35-ad82-1b0744ba8777.4617.34]): potential dests added=[] removed=[] 2024-09-22T09:07:55.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.663+0000 7f501f087800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-22T09:07:55.666 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.665+0000 7f4ed2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:55.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.668+0000 7f501f087800 20 remove_watcher() i=0 2024-09-22T09:07:55.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.668+0000 7f501f087800 2 removed watcher, disabling cache 2024-09-22T09:07:55.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.669+0000 7f501f087800 20 remove_watcher() i=1 2024-09-22T09:07:55.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.670+0000 7f501f087800 20 remove_watcher() i=2 2024-09-22T09:07:55.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.672+0000 7f501f087800 20 remove_watcher() i=3 2024-09-22T09:07:55.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.673+0000 7f501f087800 20 remove_watcher() i=4 2024-09-22T09:07:55.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.674+0000 7f501f087800 20 remove_watcher() i=5 2024-09-22T09:07:55.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.675+0000 7f501f087800 20 remove_watcher() i=6 2024-09-22T09:07:55.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.676+0000 7f501f087800 20 remove_watcher() i=7 2024-09-22T09:07:55.692 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-22T09:07:55.723 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:55.723 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:55.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.764+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 realm 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:55.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.766+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.767+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:55.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.767+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:55.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.768+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:55.769 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.768+0000 7f88efe0f800 20 searching for the correct realm 2024-09-22T09:07:55.771 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.770+0000 7f88ebd23640 0 -- 172.21.15.39:0/2368143999 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f88d4049040 msgr2=0x7f88d4019420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:55.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:55.977+0000 7f88ead21640 0 -- 172.21.15.39:0/2368143999 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f88e406c040 msgr2=0x7f88e402c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:56.186 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:56.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.185+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 zone default found 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 4 Realm: () 2024-09-22T09:07:56.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 zonegroup default 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.186+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.187+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.187+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.187+0000 7f88efe0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:56.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.187+0000 7f88efe0f800 20 started sync module instance, tier type = 2024-09-22T09:07:56.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.187+0000 7f88efe0f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:56.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=0 2024-09-22T09:07:56.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=1 2024-09-22T09:07:56.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=2 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=3 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=4 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=5 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.198+0000 7f88efe0f800 20 add_watcher() i=6 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.199+0000 7f88efe0f800 20 add_watcher() i=7 2024-09-22T09:07:56.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.199+0000 7f88efe0f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:56.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.201+0000 7f87a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 5 note: GC not initialized 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f87a0fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:56.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 20 Filter name: none 2024-09-22T09:07:56.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f871a7fc640 20 reqs_thread_entry: start 2024-09-22T09:07:56.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.202+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.203+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:56.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.203+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.204+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:56.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.204+0000 7f88efe0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:56.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.204+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.204+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-22T09:07:56.205 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.204+0000 7f88efe0f800 20 rados->read ofs=0 len=0 2024-09-22T09:07:56.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.205+0000 7f88efe0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-22T09:07:56.206 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.205+0000 7f88efe0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:56.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.206+0000 7f87a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:56.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.209+0000 7f88efe0f800 20 remove_watcher() i=0 2024-09-22T09:07:56.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.209+0000 7f88efe0f800 2 removed watcher, disabling cache 2024-09-22T09:07:56.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.210+0000 7f88efe0f800 20 remove_watcher() i=1 2024-09-22T09:07:56.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.211+0000 7f88efe0f800 20 remove_watcher() i=2 2024-09-22T09:07:56.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.212+0000 7f88efe0f800 20 remove_watcher() i=3 2024-09-22T09:07:56.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.213+0000 7f88efe0f800 20 remove_watcher() i=4 2024-09-22T09:07:56.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.215+0000 7f88efe0f800 20 remove_watcher() i=5 2024-09-22T09:07:56.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.216+0000 7f88efe0f800 20 remove_watcher() i=6 2024-09-22T09:07:56.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:56.217+0000 7f88efe0f800 20 remove_watcher() i=7 2024-09-22T09:07:56.230 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:56.231 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:56.231 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-do-reshard id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:07:56.231 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:56.232 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.233 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.254 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.254 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.445 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.445 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.509 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-22T09:07:56.509 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:56.511 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.511 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.552 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.552 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.610 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.610 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.646 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.646 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.680 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.680 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.713 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.713 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.746 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.746 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.780 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.780 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.813 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.813 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.848 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.848 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.882 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.882 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.917 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.917 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.950 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.950 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:56.983 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:56.983 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.017 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.017 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.051 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.051 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.084 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.085 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.118 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.119 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.152 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.152 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.186 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.186 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.220 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.220 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.253 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:57.253 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:57.286 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T09:07:57.316 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:57.316 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:57.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.354+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 realm 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:57.357 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.356+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.357+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:57.358 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.357+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.358+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:57.359 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.358+0000 7f19a6d0c800 20 searching for the correct realm 2024-09-22T09:07:57.360 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.359+0000 7f19a4ff7640 0 -- 172.21.15.39:0/2337855396 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f198c03d020 msgr2=0x7f198c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:57.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.565+0000 7f19a3ff5640 0 -- 172.21.15.39:0/2337855396 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f199c04d130 msgr2=0x7f199c066380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:57.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.772+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:57.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 zone default found 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 4 Realm: () 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 zonegroup default 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.773+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.774+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.774+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.774+0000 7f19a6d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.774+0000 7f19a6d0c800 20 started sync module instance, tier type = 2024-09-22T09:07:57.776 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.774+0000 7f19a6d0c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=0 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=1 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=2 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=3 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=4 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=5 2024-09-22T09:07:57.785 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.784+0000 7f19a6d0c800 20 add_watcher() i=6 2024-09-22T09:07:57.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.785+0000 7f19a6d0c800 20 add_watcher() i=7 2024-09-22T09:07:57.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.785+0000 7f19a6d0c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:57.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.786+0000 7f185afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:57.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f19a6d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f19a6d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f19a6d0c800 5 note: GC not initialized 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f1859fdb640 20 reqs_thread_entry: start 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f19a6d0c800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f19a6d0c800 20 Filter name: none 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.787+0000 7f17cb7fe640 20 reqs_thread_entry: start 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.788+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.788+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:57.789 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.788+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:57.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:57.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:57.790 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:57.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.789+0000 7f19a6d0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:57.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.791+0000 7f185afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:57.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.793+0000 7f19a6d0c800 20 remove_watcher() i=0 2024-09-22T09:07:57.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.793+0000 7f19a6d0c800 2 removed watcher, disabling cache 2024-09-22T09:07:57.795 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.794+0000 7f19a6d0c800 20 remove_watcher() i=1 2024-09-22T09:07:57.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.795+0000 7f19a6d0c800 20 remove_watcher() i=2 2024-09-22T09:07:57.797 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.796+0000 7f19a6d0c800 20 remove_watcher() i=3 2024-09-22T09:07:57.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.797+0000 7f19a6d0c800 20 remove_watcher() i=4 2024-09-22T09:07:57.799 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.798+0000 7f19a6d0c800 20 remove_watcher() i=5 2024-09-22T09:07:57.800 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.799+0000 7f19a6d0c800 20 remove_watcher() i=6 2024-09-22T09:07:57.801 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.800+0000 7f19a6d0c800 20 remove_watcher() i=7 2024-09-22T09:07:57.812 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:57.812 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:57.812 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:57.812 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:57.814 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-22T09:07:57.849 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:57.849 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:57.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.888+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.889+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.889+0000 7f0fe3c1d800 20 realm 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.889+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.890+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.890+0000 7f0fe3c1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.890+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.890+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:57.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.890+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.891+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:57.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.891+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:57.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.892+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:57.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.892+0000 7f0fe3c1d800 20 searching for the correct realm 2024-09-22T09:07:57.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:57.892+0000 7f0fdf3eb640 0 -- 172.21.15.39:0/3213540526 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f0fd8027040 msgr2=0x7f0fd803e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:58.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.097+0000 7f0fdf3eb640 0 -- 172.21.15.39:0/3213540526 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x55c4c6741b40 msgr2=0x7f0fd8056410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:58.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:58.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:58.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:58.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.306+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:58.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:58.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 zone default found 2024-09-22T09:07:58.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 4 Realm: () 2024-09-22T09:07:58.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 zonegroup default 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.307+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 started sync module instance, tier type = 2024-09-22T09:07:58.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.308+0000 7f0fe3c1d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:58.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=0 2024-09-22T09:07:58.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=1 2024-09-22T09:07:58.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=2 2024-09-22T09:07:58.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=3 2024-09-22T09:07:58.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=4 2024-09-22T09:07:58.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=5 2024-09-22T09:07:58.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.318+0000 7f0fe3c1d800 20 add_watcher() i=6 2024-09-22T09:07:58.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.319+0000 7f0fe3c1d800 20 add_watcher() i=7 2024-09-22T09:07:58.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.319+0000 7f0fe3c1d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:58.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.321+0000 7f0e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:58.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.321+0000 7f0fe3c1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:58.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.321+0000 7f0fe3c1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:58.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.321+0000 7f0fe3c1d800 5 note: GC not initialized 2024-09-22T09:07:58.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0e94fe1640 20 reqs_thread_entry: start 2024-09-22T09:07:58.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0fe3c1d800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:58.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0fe3c1d800 20 Filter name: none 2024-09-22T09:07:58.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0e0e7fc640 20 reqs_thread_entry: start 2024-09-22T09:07:58.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0fe3c1d800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T09:07:58.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.322+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 : miss 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:58.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.323+0000 7f0fe3c1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 2024-09-22T09:07:58.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0fe3c1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:58.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0fe3c1d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:58.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0fe3c1d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:58.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0fe3c1d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35, ofs0, ns] 2024-09-22T09:07:58.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0ec2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94303633877248 notifier 7674 bl.length()=923 2024-09-22T09:07:58.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0ec2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:58.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0ec2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:58.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.327+0000 7f0ec2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:58.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.329+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_sources= new_sources= 2024-09-22T09:07:58.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.329+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential sources added=[] removed=[] 2024-09-22T09:07:58.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.329+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_dests= new_dests= 2024-09-22T09:07:58.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.329+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential dests added=[] removed=[] 2024-09-22T09:07:58.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.330+0000 7f0fe3c1d800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-22T09:07:58.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.330+0000 7f0fe3c1d800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-22T09:07:58.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.333+0000 7f0fe3c1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:58.334 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.333+0000 7f0fe3c1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 2024-09-22T09:07:58.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0fe3c1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:58.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0fe3c1d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:58.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0fe3c1d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:58.335 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0fe3c1d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35, ofs0, ns] 2024-09-22T09:07:58.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0ec2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 94303633877248 notifier 7674 bl.length()=891 2024-09-22T09:07:58.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0ec2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:58.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0ec2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:58.336 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.334+0000 7f0ec2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.336+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_sources= new_sources= 2024-09-22T09:07:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.336+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential sources added=[] removed=[] 2024-09-22T09:07:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.336+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_dests= new_dests= 2024-09-22T09:07:58.337 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.336+0000 7f0fe3c1d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential dests added=[] removed=[] 2024-09-22T09:07:58.339 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.338+0000 7f0e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:58.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.340+0000 7f0fe3c1d800 20 remove_watcher() i=0 2024-09-22T09:07:58.341 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.340+0000 7f0fe3c1d800 2 removed watcher, disabling cache 2024-09-22T09:07:58.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.341+0000 7f0fe3c1d800 20 remove_watcher() i=1 2024-09-22T09:07:58.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.342+0000 7f0fe3c1d800 20 remove_watcher() i=2 2024-09-22T09:07:58.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.343+0000 7f0fe3c1d800 20 remove_watcher() i=3 2024-09-22T09:07:58.346 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.345+0000 7f0fe3c1d800 20 remove_watcher() i=4 2024-09-22T09:07:58.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.346+0000 7f0fe3c1d800 20 remove_watcher() i=5 2024-09-22T09:07:58.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.347+0000 7f0fe3c1d800 20 remove_watcher() i=6 2024-09-22T09:07:58.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.348+0000 7f0fe3c1d800 20 remove_watcher() i=7 2024-09-22T09:07:58.362 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T09:07:58.391 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:58.392 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:58.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.430+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.431+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.431+0000 7fcd86810800 20 realm 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.431+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.432+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.432+0000 7fcd86810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.432+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.432+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.432+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.433+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:58.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.433+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.434+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:58.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.434+0000 7fcd86810800 20 searching for the correct realm 2024-09-22T09:07:58.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.436+0000 7fcd827e1640 0 -- 172.21.15.39:0/1804069281 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fcd78073c20 msgr2=0x7fcd78043040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:58.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.642+0000 7fcd817df640 0 -- 172.21.15.39:0/1804069281 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fcd7c0698f0 msgr2=0x7fcd7c06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:58.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.848+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 zone default found 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 4 Realm: () 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:58.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 zonegroup default 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.849+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 started sync module instance, tier type = 2024-09-22T09:07:58.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.850+0000 7fcd86810800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=0 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=1 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=2 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=3 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=4 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=5 2024-09-22T09:07:58.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.860+0000 7fcd86810800 20 add_watcher() i=6 2024-09-22T09:07:58.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.861+0000 7fcd86810800 20 add_watcher() i=7 2024-09-22T09:07:58.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.861+0000 7fcd86810800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:58.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcc037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcd86810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcd86810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcd86810800 5 note: GC not initialized 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcc027fc640 20 reqs_thread_entry: start 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.863+0000 7fcd86810800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.864+0000 7fcd86810800 20 Filter name: none 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.864+0000 7fcba3fff640 20 reqs_thread_entry: start 2024-09-22T09:07:58.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.864+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.865+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:58.866 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.865+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.865+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.865+0000 7fcd86810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.865+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.866+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.866+0000 7fcd86810800 20 rados->read ofs=0 len=0 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.866+0000 7fcd86810800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:58.867 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.866+0000 7fcd86810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:58.868 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.867+0000 7fcc037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:58.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.869+0000 7fcd86810800 20 remove_watcher() i=0 2024-09-22T09:07:58.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.869+0000 7fcd86810800 2 removed watcher, disabling cache 2024-09-22T09:07:58.871 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.871+0000 7fcd86810800 20 remove_watcher() i=1 2024-09-22T09:07:58.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.872+0000 7fcd86810800 20 remove_watcher() i=2 2024-09-22T09:07:58.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.873+0000 7fcd86810800 20 remove_watcher() i=3 2024-09-22T09:07:58.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.874+0000 7fcd86810800 20 remove_watcher() i=4 2024-09-22T09:07:58.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.875+0000 7fcd86810800 20 remove_watcher() i=5 2024-09-22T09:07:58.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.876+0000 7fcd86810800 20 remove_watcher() i=6 2024-09-22T09:07:58.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:58.877+0000 7fcd86810800 20 remove_watcher() i=7 2024-09-22T09:07:58.889 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:58.889 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:58.889 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:07:58.889 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:58.891 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:58.891 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:58.920 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:58.920 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:58.979 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:07:59.011 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:59.011 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:59.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.050+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 realm 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.052+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.053+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:59.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.053+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.054+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:59.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.054+0000 7fdf25f26800 20 searching for the correct realm 2024-09-22T09:07:59.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.056+0000 7fdf2244c640 0 -- 172.21.15.39:0/1728095239 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fdf180abac0 msgr2=0x7fdf180b5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:59.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.262+0000 7fdf2144a640 0 -- 172.21.15.39:0/1728095239 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fdf1c0940b0 msgr2=0x7fdf1c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:59.471 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.469+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 zone default found 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 4 Realm: () 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 zonegroup default 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.470+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.471+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.471+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.471+0000 7fdf25f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.471+0000 7fdf25f26800 20 started sync module instance, tier type = 2024-09-22T09:07:59.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.471+0000 7fdf25f26800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=0 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=1 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=2 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=3 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=4 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=5 2024-09-22T09:07:59.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.481+0000 7fdf25f26800 20 add_watcher() i=6 2024-09-22T09:07:59.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.482+0000 7fdf25f26800 20 add_watcher() i=7 2024-09-22T09:07:59.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.482+0000 7fdf25f26800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.484+0000 7fddd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.484+0000 7fdf25f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:59.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.484+0000 7fdf25f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:59.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdf25f26800 5 note: GC not initialized 2024-09-22T09:07:59.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fddd27fc640 20 reqs_thread_entry: start 2024-09-22T09:07:59.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdf25f26800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdf25f26800 20 Filter name: none 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdd47fff640 20 reqs_thread_entry: start 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdf25f26800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.485+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:59.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 : miss 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.486+0000 7fdf25f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 2024-09-22T09:07:59.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.490+0000 7fdf25f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.490+0000 7fdf25f26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.490+0000 7fdf25f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.490+0000 7fdf25f26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35, ofs0, ns] 2024-09-22T09:07:59.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.491+0000 7fde057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529728 cookie 94530144032288 notifier 7199 bl.length()=923 2024-09-22T09:07:59.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.491+0000 7fde057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.491+0000 7fde057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.491+0000 7fde057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.492+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_sources= new_sources= 2024-09-22T09:07:59.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.492+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential sources added=[] removed=[] 2024-09-22T09:07:59.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.492+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_dests= new_dests= 2024-09-22T09:07:59.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.492+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential dests added=[] removed=[] 2024-09-22T09:07:59.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.495+0000 7fdf25f26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.1.0 2024-09-22T09:07:59.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.495+0000 7fdf25f26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.1.0 2024-09-22T09:07:59.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.495+0000 7fdf25f26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.1.1 2024-09-22T09:07:59.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.495+0000 7fdf25f26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.1.1 2024-09-22T09:07:59.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.495+0000 7fdf25f26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.0 2024-09-22T09:07:59.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.497+0000 7fdf25f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:59.498 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.497+0000 7fdf25f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fdf25f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fdf25f26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fdf25f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fdf25f26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35, ofs0, ns] 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fde04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529729 cookie 94530144032288 notifier 7199 bl.length()=923 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fde04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fde04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.499+0000 7fde04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.500+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_sources= new_sources= 2024-09-22T09:07:59.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.500+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential sources added=[] removed=[] 2024-09-22T09:07:59.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.500+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_dests= new_dests= 2024-09-22T09:07:59.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.500+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential dests added=[] removed=[] 2024-09-22T09:07:59.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.502+0000 7fdf25f26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.35.0 2024-09-22T09:07:59.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.502+0000 7fdf25f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 : hit (requested=0x17, cached=0x17) 2024-09-22T09:07:59.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.502+0000 7fdf25f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.503+0000 7fdf25f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.503+0000 7fdf25f26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.503+0000 7fdf25f26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.503+0000 7fdf25f26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35, ofs0, ns] 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.504+0000 7fde057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529730 cookie 94530144032288 notifier 7199 bl.length()=891 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.504+0000 7fde057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 info.flags=0x17 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.504+0000 7fde057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 to cache LRU end 2024-09-22T09:07:59.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.504+0000 7fde057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:07:59.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.505+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_sources= new_sources= 2024-09-22T09:07:59.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.505+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential sources added=[] removed=[] 2024-09-22T09:07:59.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.505+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): orig_dests= new_dests= 2024-09-22T09:07:59.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.505+0000 7fdf25f26800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.35]): potential dests added=[] removed=[] 2024-09-22T09:07:59.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.506+0000 7fdf25f26800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-22T09:07:59.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.509+0000 7fddd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:59.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.511+0000 7fdf25f26800 20 remove_watcher() i=0 2024-09-22T09:07:59.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.511+0000 7fdf25f26800 2 removed watcher, disabling cache 2024-09-22T09:07:59.513 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.512+0000 7fdf25f26800 20 remove_watcher() i=1 2024-09-22T09:07:59.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.513+0000 7fdf25f26800 20 remove_watcher() i=2 2024-09-22T09:07:59.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.515+0000 7fdf25f26800 20 remove_watcher() i=3 2024-09-22T09:07:59.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.516+0000 7fdf25f26800 20 remove_watcher() i=4 2024-09-22T09:07:59.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.518+0000 7fdf25f26800 20 remove_watcher() i=5 2024-09-22T09:07:59.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.520+0000 7fdf25f26800 20 remove_watcher() i=6 2024-09-22T09:07:59.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.521+0000 7fdf25f26800 20 remove_watcher() i=7 2024-09-22T09:07:59.535 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-22T09:07:59.565 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:07:59.565 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:07:59.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.605+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 realm 2024-09-22T09:07:59.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.607+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.608+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:59.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.608+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.609+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:07:59.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.609+0000 7fdeb532e800 20 searching for the correct realm 2024-09-22T09:07:59.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.610+0000 7fdeb0f64640 0 -- 172.21.15.39:0/3934664881 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fdea8037040 msgr2=0x7fdea8038940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:07:59.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.613+0000 7fdeb0f64640 0 -- 172.21.15.39:0/3934664881 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x5560aa17ce60 msgr2=0x7fdea802c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.823+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.825 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:07:59.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:07:59.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 zone default found 2024-09-22T09:07:59.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 4 Realm: () 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 zonegroup default 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.824+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.827 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:07:59.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 started sync module instance, tier type = 2024-09-22T09:07:59.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.825+0000 7fdeb532e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:07:59.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=0 2024-09-22T09:07:59.836 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=1 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=2 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=3 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=4 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=5 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.835+0000 7fdeb532e800 20 add_watcher() i=6 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.836+0000 7fdeb532e800 20 add_watcher() i=7 2024-09-22T09:07:59.837 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.836+0000 7fdeb532e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:07:59.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.838+0000 7fdd66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:59.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:07:59.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:07:59.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 5 note: GC not initialized 2024-09-22T09:07:59.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdd65fe3640 20 reqs_thread_entry: start 2024-09-22T09:07:59.840 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 20 init_complete bucket index max shards: 1 2024-09-22T09:07:59.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 20 Filter name: none 2024-09-22T09:07:59.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdcd77fe640 20 reqs_thread_entry: start 2024-09-22T09:07:59.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.839+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.840+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:59.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.840+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.841+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:59.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.841+0000 7fdeb532e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:59.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.841+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.841+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:07:59.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.841+0000 7fdeb532e800 20 rados->read ofs=0 len=0 2024-09-22T09:07:59.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.842+0000 7fdeb532e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:07:59.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.842+0000 7fdeb532e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:07:59.844 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.843+0000 7fdd66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:07:59.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.846+0000 7fdeb532e800 20 remove_watcher() i=0 2024-09-22T09:07:59.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.846+0000 7fdeb532e800 2 removed watcher, disabling cache 2024-09-22T09:07:59.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.847+0000 7fdeb532e800 20 remove_watcher() i=1 2024-09-22T09:07:59.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.849+0000 7fdeb532e800 20 remove_watcher() i=2 2024-09-22T09:07:59.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.850+0000 7fdeb532e800 20 remove_watcher() i=3 2024-09-22T09:07:59.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.851+0000 7fdeb532e800 20 remove_watcher() i=4 2024-09-22T09:07:59.853 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.852+0000 7fdeb532e800 20 remove_watcher() i=5 2024-09-22T09:07:59.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.853+0000 7fdeb532e800 20 remove_watcher() i=6 2024-09-22T09:07:59.855 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:07:59.854+0000 7fdeb532e800 20 remove_watcher() i=7 2024-09-22T09:07:59.866 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:59.867 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:07:59.867 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:07:59.867 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:07:59.868 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:59.869 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:07:59.886 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:07:59.887 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.086 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.086 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.150 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-22T09:08:00.150 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:00.152 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.152 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.194 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.194 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.251 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.251 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.288 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.288 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.321 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.321 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.356 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.356 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.387 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.387 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.423 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.423 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.458 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.458 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.492 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.492 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.529 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.530 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.566 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.567 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.600 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.600 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.635 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.635 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.668 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.668 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.700 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.700 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.734 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.735 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.768 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.768 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.801 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.801 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.835 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.835 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.870 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.870 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.903 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:00.903 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:00.937 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T09:08:00.966 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:00.966 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:01.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.005+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 realm 2024-09-22T09:08:01.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:01.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.007+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.008+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.008+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.009+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:01.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.009+0000 7f2b71d2c800 20 searching for the correct realm 2024-09-22T09:08:01.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.012+0000 7f2b6e13f640 0 -- 172.21.15.39:0/2068314762 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f2b6401f040 msgr2=0x7f2b6401f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.218+0000 7f2b6d13d640 0 -- 172.21.15.39:0/2068314762 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f2b68061070 msgr2=0x7f2b680c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.424+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 zone default found 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 4 Realm: () 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 zonegroup default 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.425+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 started sync module instance, tier type = 2024-09-22T09:08:01.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.426+0000 7f2b71d2c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:01.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=0 2024-09-22T09:08:01.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=1 2024-09-22T09:08:01.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=2 2024-09-22T09:08:01.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=3 2024-09-22T09:08:01.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=4 2024-09-22T09:08:01.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=5 2024-09-22T09:08:01.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.437+0000 7f2b71d2c800 20 add_watcher() i=6 2024-09-22T09:08:01.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.438+0000 7f2b71d2c800 20 add_watcher() i=7 2024-09-22T09:08:01.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.438+0000 7f2b71d2c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:01.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2a1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2b71d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2b71d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2b71d2c800 5 note: GC not initialized 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2a1e7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2b71d2c800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f2b71d2c800 20 Filter name: none 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.441+0000 7f298ffff640 20 reqs_thread_entry: start 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.442+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.442+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:01.443 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.442+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.443+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:01.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.443+0000 7f2b71d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:01.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.443+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.443+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:01.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.443+0000 7f2b71d2c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.444+0000 7f2b71d2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:01.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.444+0000 7f2b71d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:01.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.445+0000 7f2a1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.448+0000 7f2b71d2c800 20 remove_watcher() i=0 2024-09-22T09:08:01.449 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.448+0000 7f2b71d2c800 2 removed watcher, disabling cache 2024-09-22T09:08:01.450 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.449+0000 7f2b71d2c800 20 remove_watcher() i=1 2024-09-22T09:08:01.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.451+0000 7f2b71d2c800 20 remove_watcher() i=2 2024-09-22T09:08:01.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.452+0000 7f2b71d2c800 20 remove_watcher() i=3 2024-09-22T09:08:01.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.453+0000 7f2b71d2c800 20 remove_watcher() i=4 2024-09-22T09:08:01.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.454+0000 7f2b71d2c800 20 remove_watcher() i=5 2024-09-22T09:08:01.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.455+0000 7f2b71d2c800 20 remove_watcher() i=6 2024-09-22T09:08:01.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.456+0000 7f2b71d2c800 20 remove_watcher() i=7 2024-09-22T09:08:01.469 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.469 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:01.469 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:01.469 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.470 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T09:08:01.506 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:01.506 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:01.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.546+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 realm 2024-09-22T09:08:01.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.550+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:01.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.550+0000 7fe68ec40800 20 searching for the correct realm 2024-09-22T09:08:01.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.553+0000 7fe68c72a640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fe684033040 msgr2=0x7fe6840275e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.557+0000 7fe68bf29640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe684056040 msgr2=0x7fe684033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.765 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.766 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zone default found 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Realm: () 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:01.767 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zonegroup default 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started sync module instance, tier type = 2024-09-22T09:08:01.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=0 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=1 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=2 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=3 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=4 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=5 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=6 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=7 2024-09-22T09:08:01.777 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.776+0000 7fe68ec40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:01.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.778+0000 7fe5437de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:01.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:01.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 5 note: GC not initialized 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe5427dc640 20 reqs_thread_entry: start 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 20 Filter name: none 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe53b7fe640 20 reqs_thread_entry: start 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T09:08:01.781 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : miss 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.780+0000 7fe68ec40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:01.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe68ec40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.786 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe68ec40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:01.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94774646001632 notifier 7764 bl.length()=923 2024-09-22T09:08:01.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.787 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:01.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:01.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:01.788 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:01.789 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe68ec40800 time 2024-09-22T09:08:01.789427+0000 2024-09-22T09:08:01.789 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe69218c748] 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.790 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fe68ec40800 thread_name:radosgw-admin 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.789+0000 7fe68ec40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe68ec40800 time 2024-09-22T09:08:01.789427+0000 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe69218c748] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.791 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.792 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:01.792 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.792 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:01.792 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:01.792 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.804 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.804 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe690e3e6f0] 2024-09-22T09:08:01.804 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe690e8b99c] 2024-09-22T09:08:01.804 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe69218c7a2] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.790+0000 7fe68ec40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fe68ec40800 thread_name:radosgw-admin 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.805 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe690e3e6f0] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe690e8b99c] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe69218c7a2] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.806 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: dump: 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.807 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:08:01.528+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7752 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:08:01.528+0000 7fe68ec40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:08:01.528+0000 7fe68ec40800 4 set_mon_vals no callback set 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:08:01.528+0000 7fe68ec40800 10 monclient: shutdown 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:08:01.528+0000 7fe68ec40800 5 asok(0x563270e9e0f0) unregister_commands rotate-key 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.808 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.809 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:08:01.529+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: starting msgr at 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: starting objecter 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests hook 0x5632710c4f30 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: setting wanted keys 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: calling monclient init 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.810 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:08:01.529+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:08:01.530+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:08:01.530+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key hook 0x5632710bf558 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.811 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x563270f6b7f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271001f60 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271005460 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.790156s 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271001f60 auth_method 0 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271005460 auth_method 0 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.812 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x563270f6b7f0 auth_method 0 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:08:01.530+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.813 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: dump: 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.814 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: dump: 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.815 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:08:01.530+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7755 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:08:01.530+0000 7fe57a60c640 4 set_mon_vals no callback set 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:08:01.530+0000 7fe68ec40800 1 librados: init done 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:08:01.533+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe574077570 auth_method 0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:08:01.533+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x563271102320 auth_method 0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:08:01.534+0000 7fe68c72a640 10 monclient: get_auth_request con 0x56327110baf0 auth_method 0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:08:01.535+0000 7fe68bf29640 10 monclient: get_auth_request con 0x56327110ffc0 auth_method 0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:08:01.536+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x56327110f400 auth_method 0 2024-09-22T09:08:01.816 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:08:01.537+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:08:01.537+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:08:01.537+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.817 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.818 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:08:01.537+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56327111bb20 EEXIST 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.819 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:08:01.538+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:08:01.538+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x5632711171c0 EEXIST 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x56327113f810 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271141ae0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327113dfe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.820 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.798617s 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271141ae0 auth_method 0 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x56327113f810 auth_method 0 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.821 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x56327113dfe0 auth_method 0 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7241 payload 824 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:08:01.539+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:08:01.539+0000 7fe68bf29640 1 monclient: found mon.noname-c 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:08:01.539+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.822 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: dump: 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.823 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: dump: 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.824 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:08:01.539+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7241 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:08:01.539+0000 7fe68d72c640 4 set_mon_vals no callback set 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:08:01.541+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe564077480 auth_method 0 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: get_monmap_and_config 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:08:01.541+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.825 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.826 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:08:01.541+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.827 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:08:01.542+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:08:01.542+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf71b70f8 EEXIST 2024-09-22T09:08:01.828 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271193cf0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271163b00 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327118f0b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.802538s 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271193cf0 auth_method 0 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.829 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271163b00 auth_method 0 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x56327118f0b0 auth_method 0 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.830 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7761 payload 274 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:08:01.542+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: dump: 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.831 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7761 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:08:01.543+0000 7fe68ec40800 4 set_mon_vals no callback set 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: dump: 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.832 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: shutdown 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:08:01.543+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.833 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.834 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:08:01.543+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: starting msgr at 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: starting objecter 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56327118d8c0 EEXIST 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: setting wanted keys 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: calling monclient init 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.835 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:08:01.544+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.836 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:08:01.544+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x563271157708 EEXIST 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271163b00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327118f0b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271193cf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.804743s 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271163b00 auth_method 0 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.837 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x563271193cf0 auth_method 0 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x56327118f0b0 auth_method 0 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.838 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:08:01.545+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: dump: 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.839 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: dump: 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.840 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:08:01.545+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7764 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:08:01.545+0000 7fe5637fe640 4 set_mon_vals no callback set 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:08:01.545+0000 7fe68ec40800 1 librados: init done 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:08:01.545+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cr dump hook 0x7fe68005d708 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:08:01.546+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.841 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:08:01.547+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe554077570 auth_method 0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:08:01.547+0000 7fe68c72a640 10 monclient: get_auth_request con 0x5632711adb20 auth_method 0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 realm 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:08:01.548+0000 7fe68ec40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:08:01.549+0000 7fe68bf29640 10 monclient: get_auth_request con 0x5632711b1db0 auth_method 0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:08:01.549+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x5632711b5610 auth_method 0 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:08:01.550+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:01.842 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:08:01.550+0000 7fe68ec40800 20 searching for the correct realm 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:08:01.550+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe684033040 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:08:01.551+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe67c057c10 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:08:01.552+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe68001e060 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:08:01.553+0000 7fe68c72a640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fe684033040 msgr2=0x7fe6840275e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:08:01.553+0000 7fe561ffb640 1 client.7764.objecter ms_handle_reset 0x7fe684033040 session 0x7fe684034130 osd.7 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:08:01.553+0000 7fe561ffb640 10 monclient: _renew_subs 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:08:01.553+0000 7fe561ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:08:01.553+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe554087c90 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:08:01.554+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe68400e040 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:08:01.556+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe684056040 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:08:01.557+0000 7fe68bf29640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe684056040 msgr2=0x7fe684033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:08:01.758+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe684056040 auth_method 0 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:01.843 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zone default found 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Realm: () 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:01.844 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:08:01.765+0000 7fe68ec40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zonegroup default 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started sync module instance, tier type = 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=0 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=1 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=2 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=3 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=4 2024-09-22T09:08:01.845 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=5 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=6 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=7 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:08:01.776+0000 7fe68ec40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.846 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:08:01.778+0000 7fe5437de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:08:01.779+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache list hook 0x56327118ed00 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache inspect hook 0x56327118ed00 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache erase hook 0x56327118ed00 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache zap hook 0x56327118ed00 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 note: GC not initialized 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:08:01.779+0000 7fe5427dc640 20 reqs_thread_entry: start 2024-09-22T09:08:01.847 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace show hook 0x7fe68400b740 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace history hook 0x7fe68400b740 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace active hook 0x7fe68400b740 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace active_short hook 0x7fe68400b740 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 Filter name: none 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:08:01.779+0000 7fe53b7fe640 20 reqs_thread_entry: start 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:08:01.779+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : miss 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.848 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94774646001632 notifier 7764 bl.length()=923 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:01.849 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:08:01.789+0000 7fe68ec40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe68ec40800 time 2024-09-22T09:08:01.789427+0000 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe69218c748] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:01.850 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:08:01.790+0000 7fe68ec40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fe68ec40800 thread_name:radosgw-admin 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe690e3e6f0] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe690e8b99c] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe69218c7a2] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.851 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:08:01.852 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:08:01.853 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:08:01.854 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:08:01.855 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:08:01.856 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:08:01.857 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe53b7fe640 / http_manager 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5427dc640 / http_manager 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5437de640 / rgw_dt_lg_renew 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe561ffb640 / ms_dispatch 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5637fe640 / io_context_pool 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe571ffb640 / ms_dispatch 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe578e09640 / ms_dispatch 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe57a60c640 / io_context_pool 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68bf29640 / msgr-worker-2 2024-09-22T09:08:01.858 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68c72a640 / msgr-worker-1 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68cf2b640 / msgr-worker-0 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68d72c640 / io_context_pool 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68ec40800 / radosgw-admin 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.133348.log 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:08:01.528+0000 7fe57a60c640 10 monclient: dump: 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.859 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:08:01.528+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7752 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:08:01.528+0000 7fe68ec40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:08:01.528+0000 7fe68ec40800 4 set_mon_vals no callback set 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:08:01.528+0000 7fe68ec40800 10 monclient: shutdown 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:08:01.528+0000 7fe68ec40800 5 asok(0x563270e9e0f0) unregister_commands rotate-key 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.860 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding auth protocol: cephx 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.861 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: crc 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710c4570) adding con mode: secure 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:08:01.529+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: starting msgr at 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: starting objecter 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests hook 0x5632710c4f30 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: setting wanted keys 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:08:01.529+0000 7fe68ec40800 1 librados: calling monclient init 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:08:01.529+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.862 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding auth protocol: cephx 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: crc 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:08:01.529+0000 7fe68ec40800 5 AuthRegistry(0x5632710bf410) adding con mode: secure 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:08:01.529+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:08:01.530+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.863 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:08:01.530+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key hook 0x5632710bf558 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x563270f6b7f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271001f60 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271005460 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.790156s 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271001f60 auth_method 0 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.864 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271005460 auth_method 0 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:08:01.530+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x563270f6b7f0 auth_method 0 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.865 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:08:01.530+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:08:01.530+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:08:01.530+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: dump: 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.866 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:08:01.530+0000 7fe578e09640 10 monclient: dump: 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.867 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:08:01.530+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7755 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:08:01.530+0000 7fe57a60c640 4 set_mon_vals no callback set 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:08:01.530+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:08:01.530+0000 7fe68ec40800 1 librados: init done 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:08:01.533+0000 7fe578e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.868 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:08:01.533+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe574077570 auth_method 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:08:01.533+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x563271102320 auth_method 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:08:01.534+0000 7fe68c72a640 10 monclient: get_auth_request con 0x56327110baf0 auth_method 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:08:01.535+0000 7fe68bf29640 10 monclient: get_auth_request con 0x56327110ffc0 auth_method 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:08:01.536+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x56327110f400 auth_method 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:08:01.537+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:08:01.537+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:08:01.537+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.869 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding auth protocol: cephx 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.870 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: crc 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 AuthRegistry(0x563271118130) adding con mode: secure 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:08:01.537+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:08:01.537+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56327111bb20 EEXIST 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding auth protocol: cephx 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.871 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: crc 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 AuthRegistry(0x563271117078) adding con mode: secure 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:08:01.538+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:08:01.538+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:08:01.538+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x5632711171c0 EEXIST 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x56327113f810 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271141ae0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327113dfe0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.872 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:08:01.538+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.798617s 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271141ae0 auth_method 0 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x56327113f810 auth_method 0 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.873 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x56327113dfe0 auth_method 0 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:08:01.538+0000 7fe68cf2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:08:01.538+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:08:01.538+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7241 payload 824 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:08:01.539+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:08:01.539+0000 7fe68bf29640 1 monclient: found mon.noname-c 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:08:01.539+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.874 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: dump: 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.875 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:08:01.539+0000 7fe571ffb640 10 monclient: dump: 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.876 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:08:01.539+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7241 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:08:01.539+0000 7fe68d72c640 4 set_mon_vals no callback set 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:08:01.539+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:08:01.541+0000 7fe571ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:08:01.541+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe564077480 auth_method 0 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: get_monmap_and_config 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:08:01.541+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:08:01.541+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.877 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding auth protocol: cephx 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.878 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: crc 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:08:01.541+0000 7fe68ec40800 5 AuthRegistry(0x56327115f650) adding con mode: secure 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:08:01.541+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding auth protocol: cephx 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.879 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: crc 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b6fb0) adding con mode: secure 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:08:01.542+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:08:01.542+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:08:01.542+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdf71b70f8 EEXIST 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.880 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271193cf0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271163b00 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327118f0b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:08:01.542+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.802538s 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271193cf0 auth_method 0 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x563271163b00 auth_method 0 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.881 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:08:01.542+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x56327118f0b0 auth_method 0 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:08:01.542+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7761 payload 274 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:08:01.542+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:08:01.542+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.882 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: dump: 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.883 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7761 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:08:01.543+0000 7fe68ec40800 4 set_mon_vals no callback set 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:08:01.543+0000 7fe5637fe640 10 monclient: dump: 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.884 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: shutdown 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: build_initial_monmap 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:08:01.543+0000 7fe68ec40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:08:01.543+0000 7fe68ec40800 10 monclient: monmap: 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.885 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding auth protocol: cephx 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: crc 2024-09-22T09:08:01.886 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:08:01.543+0000 7fe68ec40800 5 AuthRegistry(0x563271164940) adding con mode: secure 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:08:01.543+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: starting msgr at 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: starting objecter 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command objecter_requests cmddesc objecter_requests hook 0x56327118d8c0 EEXIST 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: setting wanted keys 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:08:01.544+0000 7fe68ec40800 1 librados: calling monclient init 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: init 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding auth protocol: cephx 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.887 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: crc 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 AuthRegistry(0x5632711575c0) adding con mode: secure 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:08:01.544+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:08:01.544+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:08:01.544+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command rotate-key cmddesc rotate-key hook 0x563271157708 EEXIST 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-a con 0x563271163b00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-b con 0x56327118f0b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): picked mon.noname-c con 0x563271193cf0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:01.888 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:08:01.544+0000 7fe68ec40800 10 monclient(hunting): authenticate will time out at 2379.804743s 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): get_auth_request con 0x563271163b00 auth_method 0 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): get_auth_request con 0x563271193cf0 auth_method 0 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.889 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:08:01.544+0000 7fe68bf29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:08:01.544+0000 7fe68c72a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request con 0x56327118f0b0 auth_method 0 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:08:01.544+0000 7fe68cf2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:08:01.545+0000 7fe68bf29640 1 monclient: found mon.noname-a 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:08:01.545+0000 7fe68bf29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:01.890 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: dump: 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: _finish_auth 0 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:01.891 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:08:01.545+0000 7fe561ffb640 10 monclient: dump: 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:08:01.545+0000 7fe68ec40800 5 monclient: authenticate success, global_id 7764 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:08:01.545+0000 7fe5637fe640 4 set_mon_vals no callback set 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _renew_subs 2024-09-22T09:08:01.892 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:08:01.545+0000 7fe68ec40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:08:01.545+0000 7fe68ec40800 1 librados: init done 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:08:01.545+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cr dump hook 0x7fe68005d708 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:08:01.546+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:08:01.547+0000 7fe561ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:08:01.547+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe554077570 auth_method 0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:08:01.547+0000 7fe68c72a640 10 monclient: get_auth_request con 0x5632711adb20 auth_method 0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 realm 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:08:01.548+0000 7fe68ec40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.893 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:08:01.548+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:08:01.549+0000 7fe68bf29640 10 monclient: get_auth_request con 0x5632711b1db0 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:08:01.549+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:08:01.549+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x5632711b5610 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:08:01.550+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:08:01.550+0000 7fe68ec40800 20 searching for the correct realm 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:08:01.550+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe684033040 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:08:01.551+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe67c057c10 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:08:01.552+0000 7fe68cf2b640 10 monclient: get_auth_request con 0x7fe68001e060 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:08:01.553+0000 7fe68c72a640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fe684033040 msgr2=0x7fe6840275e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:08:01.553+0000 7fe561ffb640 1 client.7764.objecter ms_handle_reset 0x7fe684033040 session 0x7fe684034130 osd.7 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:08:01.553+0000 7fe561ffb640 10 monclient: _renew_subs 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:08:01.553+0000 7fe561ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:08:01.553+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe554087c90 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:08:01.554+0000 7fe68c72a640 10 monclient: get_auth_request con 0x7fe68400e040 auth_method 0 2024-09-22T09:08:01.894 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:08:01.556+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe684056040 auth_method 0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:08:01.557+0000 7fe68bf29640 0 -- 172.21.15.39:0/2256059827 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe684056040 msgr2=0x7fe684033420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:08:01.758+0000 7fe68bf29640 10 monclient: get_auth_request con 0x7fe684056040 auth_method 0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:08:01.764+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.895 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zone default found 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Realm: () 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:08:01.765+0000 7fe68ec40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:08:01.765+0000 7fe68ec40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 zonegroup default 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:08:01.765+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started sync module instance, tier type = 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:08:01.766+0000 7fe68ec40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=0 2024-09-22T09:08:01.896 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=1 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=2 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=3 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=4 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=5 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=6 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:08:01.776+0000 7fe68ec40800 20 add_watcher() i=7 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:08:01.776+0000 7fe68ec40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding auth protocol: cephx 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.897 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:08:01.778+0000 7fe5437de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: crc 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:08:01.778+0000 7fe68ec40800 5 AuthRegistry(0x7ffdf71b7480) adding con mode: secure 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:08:01.779+0000 7fe68ec40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache list hook 0x56327118ed00 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache inspect hook 0x56327118ed00 2024-09-22T09:08:01.898 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache erase hook 0x56327118ed00 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command cache zap hook 0x56327118ed00 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 note: GC not initialized 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:08:01.779+0000 7fe5427dc640 20 reqs_thread_entry: start 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace show hook 0x7fe68400b740 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace history hook 0x7fe68400b740 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace active hook 0x7fe68400b740 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:08:01.779+0000 7fe68ec40800 5 asok(0x563270e9e0f0) register_command sync trace active_short hook 0x7fe68400b740 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 Filter name: none 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:08:01.779+0000 7fe53b7fe640 20 reqs_thread_entry: start 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:08:01.779+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:08:01.779+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : miss 2024-09-22T09:08:01.899 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:08:01.780+0000 7fe68ec40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:08:01.780+0000 7fe68ec40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:08:01.785+0000 7fe68ec40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94774646001632 notifier 7764 bl.length()=923 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:01.900 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:08:01.785+0000 7fe5637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:08:01.787+0000 7fe68ec40800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:08:01.789+0000 7fe68ec40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe68ec40800 time 2024-09-22T09:08:01.789427+0000 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe69218c748] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.901 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:08:01.790+0000 7fe68ec40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fe68ec40800 thread_name:radosgw-admin 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe690e3e6f0] 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe690e8b99c] 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe69218c7a2] 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fe69218c906] 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56326e562e01] 2024-09-22T09:08:01.902 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x56326ea7586c] 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56326e572c9d] 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe690e29590] 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:08:01.903 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:08:01.904 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:08:01.905 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:08:01.906 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:08:01.907 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:08:01.908 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe53b7fe640 / http_manager 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5427dc640 / http_manager 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5437de640 / rgw_dt_lg_renew 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe561ffb640 / ms_dispatch 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe5637fe640 / io_context_pool 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe571ffb640 / ms_dispatch 2024-09-22T09:08:01.909 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe578e09640 / ms_dispatch 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe57a60c640 / io_context_pool 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68bf29640 / msgr-worker-2 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68c72a640 / msgr-worker-1 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68cf2b640 / msgr-worker-0 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68d72c640 / io_context_pool 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: 7fe68ec40800 / radosgw-admin 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:08:01.791085Z_87f517b7-bee6-43f0-a468-95c6b00b353c/log 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:08:01.910 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.868+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 20 realm 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.870+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.871+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.871+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.872+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:01.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.872+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:01.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.872+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:01.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.872+0000 7f26f1d40800 20 searching for the correct realm 2024-09-22T09:08:01.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:01.875+0000 7f26ee2c1640 0 -- 172.21.15.39:0/3482964147 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f26e4075070 msgr2=0x7f26e400fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:02.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.082+0000 7f26ed2bf640 0 -- 172.21.15.39:0/3482964147 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f26e8082b00 msgr2=0x7f26e80821c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:02.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.289+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:02.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:02.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 zone default found 2024-09-22T09:08:02.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 4 Realm: () 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 zonegroup default 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.290+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.291+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.291+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.291+0000 7f26f1d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.291+0000 7f26f1d40800 20 started sync module instance, tier type = 2024-09-22T09:08:02.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.291+0000 7f26f1d40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:02.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=0 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=1 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=2 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=3 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=4 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=5 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.302+0000 7f26f1d40800 20 add_watcher() i=6 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.303+0000 7f26f1d40800 20 add_watcher() i=7 2024-09-22T09:08:02.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.303+0000 7f26f1d40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:02.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.305+0000 7f259f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:02.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.305+0000 7f26f1d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:02.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.305+0000 7f26f1d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:02.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.305+0000 7f26f1d40800 5 note: GC not initialized 2024-09-22T09:08:02.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.306+0000 7f259e7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:02.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.306+0000 7f26f1d40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:02.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.306+0000 7f26f1d40800 20 Filter name: none 2024-09-22T09:08:02.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.306+0000 7f250ffff640 20 reqs_thread_entry: start 2024-09-22T09:08:02.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.306+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.307+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:02.308 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.307+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.307+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T09:08:02.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.307+0000 7f26f1d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:02.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.307+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.308+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:02.309 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.308+0000 7f26f1d40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.308+0000 7f26f1d40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T09:08:02.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.309+0000 7f26f1d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:02.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.310+0000 7f259f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:02.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.312+0000 7f26f1d40800 20 remove_watcher() i=0 2024-09-22T09:08:02.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.312+0000 7f26f1d40800 2 removed watcher, disabling cache 2024-09-22T09:08:02.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.313+0000 7f26f1d40800 20 remove_watcher() i=1 2024-09-22T09:08:02.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.315+0000 7f26f1d40800 20 remove_watcher() i=2 2024-09-22T09:08:02.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.316+0000 7f26f1d40800 20 remove_watcher() i=3 2024-09-22T09:08:02.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.317+0000 7f26f1d40800 20 remove_watcher() i=4 2024-09-22T09:08:02.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.318+0000 7f26f1d40800 20 remove_watcher() i=5 2024-09-22T09:08:02.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.319+0000 7f26f1d40800 20 remove_watcher() i=6 2024-09-22T09:08:02.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.320+0000 7f26f1d40800 20 remove_watcher() i=7 2024-09-22T09:08:02.332 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:02.333 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:02.333 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:02.333 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:02.334 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:02.334 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:02.366 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:02.366 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:02.424 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:08:02.457 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:02.457 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:02.497 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.496+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 20 realm 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.498+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.499+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.500 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.499+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.500+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:02.501 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.500+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.500+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:02.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.501+0000 7f703783e800 20 searching for the correct realm 2024-09-22T09:08:02.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.503+0000 7f7035b29640 0 -- 172.21.15.39:0/1981212937 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f702c017070 msgr2=0x7f702c0623d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:02.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.709+0000 7f7034b27640 0 -- 172.21.15.39:0/1981212937 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f70300e3b90 msgr2=0x7f70300b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.915+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.916+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.916+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.916+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.916+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 zone default found 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 4 Realm: () 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:02.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 zonegroup default 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.917+0000 7f703783e800 20 started sync module instance, tier type = 2024-09-22T09:08:02.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.918+0000 7f703783e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:02.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=0 2024-09-22T09:08:03.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=1 2024-09-22T09:08:03.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=2 2024-09-22T09:08:03.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=3 2024-09-22T09:08:03.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=4 2024-09-22T09:08:03.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=5 2024-09-22T09:08:03.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.928+0000 7f703783e800 20 add_watcher() i=6 2024-09-22T09:08:03.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.929+0000 7f703783e800 20 add_watcher() i=7 2024-09-22T09:08:03.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.929+0000 7f703783e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:03.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.930+0000 7f6eebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 5 note: GC not initialized 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f6eeafe5640 20 reqs_thread_entry: start 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 20 Filter name: none 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f6ee8fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.931+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : miss 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:03.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.932+0000 7f703783e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.934+0000 7f703783e800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to be held by another RGW process; skipping for now 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.934+0000 7f6eebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.937+0000 7f703783e800 20 remove_watcher() i=0 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.937+0000 7f703783e800 2 removed watcher, disabling cache 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.938+0000 7f703783e800 20 remove_watcher() i=1 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.939+0000 7f703783e800 20 remove_watcher() i=2 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.940+0000 7f703783e800 20 remove_watcher() i=3 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.941+0000 7f703783e800 20 remove_watcher() i=4 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.942+0000 7f703783e800 20 remove_watcher() i=5 2024-09-22T09:08:03.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.944+0000 7f703783e800 20 remove_watcher() i=6 2024-09-22T09:08:03.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:02.944+0000 7f703783e800 20 remove_watcher() i=7 2024-09-22T09:08:03.031 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:08:32.963 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:08:33.000 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:33.000 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:33.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.043+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 20 realm 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.045+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.046+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.046+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.047+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:33.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.047+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.047+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:33.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.047+0000 7f90c7332800 20 searching for the correct realm 2024-09-22T09:08:33.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.050+0000 7f90c37bd640 0 -- 172.21.15.39:0/3717348546 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f90b8062690 msgr2=0x7f90b806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:33.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.256+0000 7f90c27bb640 0 -- 172.21.15.39:0/3717348546 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f90bc0e6040 msgr2=0x7f90bc0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:33.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:33.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.463+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.464+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.464+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.464+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.464+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 zone default found 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 4 Realm: () 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:33.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 zonegroup default 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.465+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.466+0000 7f90c7332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.468 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.466+0000 7f90c7332800 20 started sync module instance, tier type = 2024-09-22T09:08:33.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.466+0000 7f90c7332800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=0 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=1 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=2 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=3 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=4 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.477+0000 7f90c7332800 20 add_watcher() i=5 2024-09-22T09:08:33.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.478+0000 7f90c7332800 20 add_watcher() i=6 2024-09-22T09:08:33.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.479+0000 7f90c7332800 20 add_watcher() i=7 2024-09-22T09:08:33.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.479+0000 7f90c7332800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:33.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.482+0000 7f8f797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:33.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.482+0000 7f90c7332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:33.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.482+0000 7f90c7332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:33.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.482+0000 7f90c7332800 5 note: GC not initialized 2024-09-22T09:08:33.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.482+0000 7f8ef3fff640 20 reqs_thread_entry: start 2024-09-22T09:08:33.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.483+0000 7f90c7332800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:33.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.483+0000 7f90c7332800 20 Filter name: none 2024-09-22T09:08:33.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.483+0000 7f8ef1ffb640 20 reqs_thread_entry: start 2024-09-22T09:08:33.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.483+0000 7f90c7332800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-22T09:08:33.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.483+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : miss 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 20 rados_obj.operate() r=0 bl.length=447 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.484+0000 7f90c7332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:33.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.486+0000 7f90c7332800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.491+0000 7f90c7332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.491+0000 7f90c7332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.491+0000 7f90c7332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.491+0000 7f90c7332800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.492+0000 7f8fa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94364647554768 notifier 7824 bl.length()=923 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.492+0000 7f8fa67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.492+0000 7f8fa67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.492+0000 7f8fa67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.494+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:33.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.494+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:33.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.494+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:33.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.494+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:33.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.497+0000 7f90c7332800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.2.0 2024-09-22T09:08:33.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.497+0000 7f90c7332800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.2.0 2024-09-22T09:08:33.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.497+0000 7f90c7332800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.2.1 2024-09-22T09:08:33.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.497+0000 7f90c7332800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.2.1 2024-09-22T09:08:33.499 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.497+0000 7f90c7332800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.0 2024-09-22T09:08:33.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.500+0000 7f90c7332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:33.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.500+0000 7f90c7332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:33.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f90c7332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f90c7332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f90c7332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.503 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f90c7332800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:33.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f8fa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94364647554768 notifier 7824 bl.length()=923 2024-09-22T09:08:33.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f8fa67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f8fa67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.501+0000 7f8fa67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.505 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.503+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:33.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.503+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:33.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.503+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:33.506 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.503+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:33.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.505+0000 7f90c7332800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.36.0 2024-09-22T09:08:33.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.505+0000 7f90c7332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:33.507 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.505+0000 7f90c7332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 2024-09-22T09:08:33.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.506+0000 7f90c7332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.508 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.506+0000 7f90c7332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.506+0000 7f90c7332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.506+0000 7f90c7332800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36, ofs0, ns] 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.507+0000 7f8fa5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529721 cookie 94364647554768 notifier 7824 bl.length()=891 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.507+0000 7f8fa5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 info.flags=0x17 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.507+0000 7f8fa5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 to cache LRU end 2024-09-22T09:08:33.509 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.507+0000 7f8fa5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:33.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.508+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_sources= new_sources= 2024-09-22T09:08:33.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.508+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential sources added=[] removed=[] 2024-09-22T09:08:33.510 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.508+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): orig_dests= new_dests= 2024-09-22T09:08:33.511 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.508+0000 7f90c7332800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[530e834e-7701-4a35-ad82-1b0744ba8777.4617.36]): potential dests added=[] removed=[] 2024-09-22T09:08:33.512 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.509+0000 7f90c7332800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-22T09:08:33.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.512+0000 7f8f797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:33.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.515+0000 7f90c7332800 20 remove_watcher() i=0 2024-09-22T09:08:33.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.515+0000 7f90c7332800 2 removed watcher, disabling cache 2024-09-22T09:08:33.518 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.516+0000 7f90c7332800 20 remove_watcher() i=1 2024-09-22T09:08:33.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.517+0000 7f90c7332800 20 remove_watcher() i=2 2024-09-22T09:08:33.521 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.519+0000 7f90c7332800 20 remove_watcher() i=3 2024-09-22T09:08:33.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.520+0000 7f90c7332800 20 remove_watcher() i=4 2024-09-22T09:08:33.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.521+0000 7f90c7332800 20 remove_watcher() i=5 2024-09-22T09:08:33.525 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.523+0000 7f90c7332800 20 remove_watcher() i=6 2024-09-22T09:08:33.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.524+0000 7f90c7332800 20 remove_watcher() i=7 2024-09-22T09:08:33.540 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-22T09:08:33.572 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:33.572 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:33.613 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.611+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 20 realm 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.613+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.614+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:33.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.614+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.614+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:33.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.615+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:33.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.615+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:33.617 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.615+0000 7fd48d132800 20 searching for the correct realm 2024-09-22T09:08:33.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.617+0000 7fd4895bd640 0 -- 172.21.15.39:0/3861012839 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd47c06d060 msgr2=0x7fd47c0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:33.826 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:33.823+0000 7fd4885bb640 0 -- 172.21.15.39:0/3861012839 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd480031070 msgr2=0x7fd480067410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:34.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:34.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:34.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:34.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:34.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:34.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:34.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.030+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.031+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:34.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.031+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.031+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.031+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 zone default found 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 4 Realm: () 2024-09-22T09:08:34.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 zonegroup default 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:34.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:34.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.032+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.033+0000 7fd48d132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:34.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.033+0000 7fd48d132800 20 started sync module instance, tier type = 2024-09-22T09:08:34.045 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.033+0000 7fd48d132800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:34.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=0 2024-09-22T09:08:34.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=1 2024-09-22T09:08:34.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=2 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=3 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=4 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=5 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.044+0000 7fd48d132800 20 add_watcher() i=6 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.045+0000 7fd48d132800 20 add_watcher() i=7 2024-09-22T09:08:34.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.045+0000 7fd48d132800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:34.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.047+0000 7fd33efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:34.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.047+0000 7fd48d132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:34.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.047+0000 7fd48d132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:34.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.047+0000 7fd48d132800 5 note: GC not initialized 2024-09-22T09:08:34.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd33dfe3640 20 reqs_thread_entry: start 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd48d132800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd48d132800 20 Filter name: none 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd2af7fe640 20 reqs_thread_entry: start 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.048+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.049+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.049+0000 7fd48d132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.049+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.050+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=193 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.050+0000 7fd48d132800 20 rados->read ofs=0 len=0 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.050+0000 7fd48d132800 20 rados_obj.operate() r=0 bl.length=415 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.050+0000 7fd48d132800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:34.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.051+0000 7fd33efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:34.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.054+0000 7fd48d132800 20 remove_watcher() i=0 2024-09-22T09:08:34.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.054+0000 7fd48d132800 2 removed watcher, disabling cache 2024-09-22T09:08:34.057 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.055+0000 7fd48d132800 20 remove_watcher() i=1 2024-09-22T09:08:34.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.057+0000 7fd48d132800 20 remove_watcher() i=2 2024-09-22T09:08:34.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.058+0000 7fd48d132800 20 remove_watcher() i=3 2024-09-22T09:08:34.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.059+0000 7fd48d132800 20 remove_watcher() i=4 2024-09-22T09:08:34.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.060+0000 7fd48d132800 20 remove_watcher() i=5 2024-09-22T09:08:34.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.061+0000 7fd48d132800 20 remove_watcher() i=6 2024-09-22T09:08:34.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:34.062+0000 7fd48d132800 20 remove_watcher() i=7 2024-09-22T09:08:34.077 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:34.077 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:34.077 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-logrecord-writes id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:08:34.077 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:34.079 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.079 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.098 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.098 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.294 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.294 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.359 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-22T09:08:34.359 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:34.360 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.360 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.401 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.401 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.458 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.458 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.495 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.495 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.529 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.529 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.564 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.564 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.599 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.600 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.634 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.634 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.668 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.668 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.701 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.701 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.735 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.735 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.769 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.769 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.802 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.803 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.837 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.838 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.871 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.871 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.905 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.905 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.938 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.938 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:34.972 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:34.973 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:35.008 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:35.008 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:35.042 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:35.043 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:35.077 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:35.077 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:35.111 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:35.111 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:35.146 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T09:08:35.176 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:35.176 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:35.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.213+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 realm 2024-09-22T09:08:35.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.215+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.216+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:35.218 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.216+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.217+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:35.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.217+0000 7f3d92940800 20 searching for the correct realm 2024-09-22T09:08:35.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.219+0000 7f3d8eec1640 0 -- 172.21.15.39:0/1577790542 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f3d8404d040 msgr2=0x7f3d8403e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:35.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.426+0000 7f3d8debf640 0 -- 172.21.15.39:0/1577790542 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f3d880a6930 msgr2=0x7f3d88068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:35.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:35.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:35.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.636 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.633+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 zone default found 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 4 Realm: () 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 zonegroup default 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.637 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.634+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.635+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.635+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.635+0000 7f3d92940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.635+0000 7f3d92940800 20 started sync module instance, tier type = 2024-09-22T09:08:35.638 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.635+0000 7f3d92940800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=0 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=1 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=2 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=3 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=4 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=5 2024-09-22T09:08:35.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.645+0000 7f3d92940800 20 add_watcher() i=6 2024-09-22T09:08:35.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.646+0000 7f3d92940800 20 add_watcher() i=7 2024-09-22T09:08:35.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.646+0000 7f3d92940800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:35.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3c44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:35.650 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 5 note: GC not initialized 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3bbf7fe640 20 reqs_thread_entry: start 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 20 Filter name: none 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3bbd7fa640 20 reqs_thread_entry: start 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.648+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.649+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:35.651 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.649+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.650+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:35.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.650+0000 7f3d92940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:35.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.650+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.650+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:35.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.650+0000 7f3d92940800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.651+0000 7f3d92940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:35.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.651+0000 7f3d92940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:35.654 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.652+0000 7f3c44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:35.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.655+0000 7f3d92940800 20 remove_watcher() i=0 2024-09-22T09:08:35.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.655+0000 7f3d92940800 2 removed watcher, disabling cache 2024-09-22T09:08:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.656+0000 7f3d92940800 20 remove_watcher() i=1 2024-09-22T09:08:35.659 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.657+0000 7f3d92940800 20 remove_watcher() i=2 2024-09-22T09:08:35.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.658+0000 7f3d92940800 20 remove_watcher() i=3 2024-09-22T09:08:35.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.659+0000 7f3d92940800 20 remove_watcher() i=4 2024-09-22T09:08:35.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.660+0000 7f3d92940800 20 remove_watcher() i=5 2024-09-22T09:08:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.661+0000 7f3d92940800 20 remove_watcher() i=6 2024-09-22T09:08:35.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.662+0000 7f3d92940800 20 remove_watcher() i=7 2024-09-22T09:08:35.675 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:35.675 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:35.676 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:35.676 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:35.677 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-22T09:08:35.711 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:35.712 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:35.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.749+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.753 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 20 realm 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.751+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.752+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:35.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.752+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.752+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:35.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.753+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:35.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.753+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:35.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.753+0000 7fc6d0f2e800 20 searching for the correct realm 2024-09-22T09:08:35.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:35.756+0000 7fc6cd4de640 0 -- 172.21.15.39:0/679565903 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc6c004dac0 msgr2=0x7fc6c008f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:36.366 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.363+0000 7fc6cc4dc640 0 -- 172.21.15.39:0/679565903 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc6c4017400 msgr2=0x7fc6c4017860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:36.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.572+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 zone default found 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 4 Realm: () 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 zonegroup default 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.573+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.574+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.574+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.574+0000 7fc6d0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.574+0000 7fc6d0f2e800 20 started sync module instance, tier type = 2024-09-22T09:08:36.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.574+0000 7fc6d0f2e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=0 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=1 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=2 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=3 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=4 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=5 2024-09-22T09:08:36.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.586+0000 7fc6d0f2e800 20 add_watcher() i=6 2024-09-22T09:08:36.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.587+0000 7fc6d0f2e800 20 add_watcher() i=7 2024-09-22T09:08:36.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.587+0000 7fc6d0f2e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:36.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.589+0000 7fc5837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:36.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.589+0000 7fc6d0f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:36.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.589+0000 7fc6d0f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:36.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.589+0000 7fc6d0f2e800 5 note: GC not initialized 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.589+0000 7fc5827e4640 20 reqs_thread_entry: start 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 20 Filter name: none 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc57bfff640 20 reqs_thread_entry: start 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T09:08:36.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 : miss 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.590+0000 7fc6d0f2e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:36.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:36.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:36.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.591+0000 7fc6d0f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 2024-09-22T09:08:36.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc6d0f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:36.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc6d0f2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:36.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc6d0f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:36.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc6d0f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37, ofs0, ns] 2024-09-22T09:08:36.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc5a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529735 cookie 93988501098240 notifier 7878 bl.length()=931 2024-09-22T09:08:36.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc5a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:36.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc5a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:36.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.596+0000 7fc5a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:36.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.598+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_sources= new_sources= 2024-09-22T09:08:36.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.598+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential sources added=[] removed=[] 2024-09-22T09:08:36.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.598+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_dests= new_dests= 2024-09-22T09:08:36.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.598+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential dests added=[] removed=[] 2024-09-22T09:08:36.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.601+0000 7fc6d0f2e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.0 2024-09-22T09:08:36.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.601+0000 7fc6d0f2e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.0 2024-09-22T09:08:36.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.601+0000 7fc6d0f2e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.1 2024-09-22T09:08:36.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.601+0000 7fc6d0f2e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.1 2024-09-22T09:08:36.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.601+0000 7fc6d0f2e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.0 2024-09-22T09:08:36.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.604+0000 7fc6d0f2e800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-22T09:08:36.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.604+0000 7fc6d0f2e800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-22T09:08:36.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.610+0000 7fc6d0f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:36.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.610+0000 7fc6d0f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.611+0000 7fc6d0f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc6d0f2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc6d0f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc6d0f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37, ofs0, ns] 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc5a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529736 cookie 93988501098240 notifier 7878 bl.length()=899 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc5a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc5a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:36.614 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.612+0000 7fc5a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:36.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.614+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_sources= new_sources= 2024-09-22T09:08:36.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.614+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential sources added=[] removed=[] 2024-09-22T09:08:36.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.614+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_dests= new_dests= 2024-09-22T09:08:36.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.614+0000 7fc6d0f2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential dests added=[] removed=[] 2024-09-22T09:08:36.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.614+0000 7fc6d0f2e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-22T09:08:36.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.616+0000 7fc5837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:36.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.618+0000 7fc6d0f2e800 20 remove_watcher() i=0 2024-09-22T09:08:36.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.618+0000 7fc6d0f2e800 2 removed watcher, disabling cache 2024-09-22T09:08:36.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.620+0000 7fc6d0f2e800 20 remove_watcher() i=1 2024-09-22T09:08:36.623 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.621+0000 7fc6d0f2e800 20 remove_watcher() i=2 2024-09-22T09:08:36.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.622+0000 7fc6d0f2e800 20 remove_watcher() i=3 2024-09-22T09:08:36.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.624+0000 7fc6d0f2e800 20 remove_watcher() i=4 2024-09-22T09:08:36.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.625+0000 7fc6d0f2e800 20 remove_watcher() i=5 2024-09-22T09:08:36.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.626+0000 7fc6d0f2e800 20 remove_watcher() i=6 2024-09-22T09:08:36.629 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.627+0000 7fc6d0f2e800 20 remove_watcher() i=7 2024-09-22T09:08:36.643 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T09:08:36.674 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:36.675 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:36.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.714+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.716+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.716+0000 7f3940d19800 20 realm 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.716+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.717+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.717+0000 7f3940d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.717+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.717+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.719 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.717+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.718+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:36.720 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.718+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.718+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:36.721 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.719+0000 7f3940d19800 20 searching for the correct realm 2024-09-22T09:08:36.722 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.720+0000 7f393e009640 0 -- 172.21.15.39:0/1919567890 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f39300ba040 msgr2=0x7f39300a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:36.927 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.925+0000 7f393e80a640 0 -- 172.21.15.39:0/1919567890 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f3938075060 msgr2=0x7f393806aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:36.934 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.935 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.932+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 zone default found 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 4 Realm: () 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 zonegroup default 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.933+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.934+0000 7f3940d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:36.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.934+0000 7f3940d19800 20 started sync module instance, tier type = 2024-09-22T09:08:36.937 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.934+0000 7f3940d19800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=0 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=1 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=2 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=3 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=4 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=5 2024-09-22T09:08:36.946 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.944+0000 7f3940d19800 20 add_watcher() i=6 2024-09-22T09:08:36.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.945+0000 7f3940d19800 20 add_watcher() i=7 2024-09-22T09:08:36.947 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.945+0000 7f3940d19800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:36.948 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.946+0000 7f37f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:36.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:36.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:36.949 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 5 note: GC not initialized 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f376ffff640 20 reqs_thread_entry: start 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 20 Filter name: none 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f376dffb640 20 reqs_thread_entry: start 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.947+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.948+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:36.950 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.948+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:36.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:36.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:36.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:36.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:36.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.949+0000 7f3940d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:36.952 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.950+0000 7f37f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:36.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.953+0000 7f3940d19800 20 remove_watcher() i=0 2024-09-22T09:08:36.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.953+0000 7f3940d19800 2 removed watcher, disabling cache 2024-09-22T09:08:36.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.954+0000 7f3940d19800 20 remove_watcher() i=1 2024-09-22T09:08:36.957 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.955+0000 7f3940d19800 20 remove_watcher() i=2 2024-09-22T09:08:36.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.956+0000 7f3940d19800 20 remove_watcher() i=3 2024-09-22T09:08:36.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.958+0000 7f3940d19800 20 remove_watcher() i=4 2024-09-22T09:08:36.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.959+0000 7f3940d19800 20 remove_watcher() i=5 2024-09-22T09:08:36.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.960+0000 7f3940d19800 20 remove_watcher() i=6 2024-09-22T09:08:36.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:36.961+0000 7f3940d19800 20 remove_watcher() i=7 2024-09-22T09:08:36.974 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:36.974 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:36.974 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:36.974 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:36.976 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:36.976 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:37.005 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:37.005 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:37.065 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:08:37.097 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:37.097 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:37.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.135+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 realm 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.137+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.138+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:37.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.138+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.139+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:37.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.139+0000 7fa8b2d19800 20 searching for the correct realm 2024-09-22T09:08:37.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.142+0000 7fa8b100b640 0 -- 172.21.15.39:0/1102229696 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa8a4039070 msgr2=0x7fa8a4075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:37.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.349+0000 7fa8b0009640 0 -- 172.21.15.39:0/1102229696 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa8a801d900 msgr2=0x7fa8a802e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:37.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.555+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 zone default found 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 4 Realm: () 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:37.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 zonegroup default 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.556+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 started sync module instance, tier type = 2024-09-22T09:08:37.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.557+0000 7fa8b2d19800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=0 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=1 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=2 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=3 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=4 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=5 2024-09-22T09:08:37.571 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.569+0000 7fa8b2d19800 20 add_watcher() i=6 2024-09-22T09:08:37.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.570+0000 7fa8b2d19800 20 add_watcher() i=7 2024-09-22T09:08:37.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.570+0000 7fa8b2d19800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:37.574 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.572+0000 7fa766fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.572+0000 7fa8b2d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.572+0000 7fa8b2d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa8b2d19800 5 note: GC not initialized 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa765fe3640 20 reqs_thread_entry: start 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa8b2d19800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa8b2d19800 20 Filter name: none 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa6d77fe640 20 reqs_thread_entry: start 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa8b2d19800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T09:08:37.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.573+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:37.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:37.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T09:08:37.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 : miss 2024-09-22T09:08:37.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.574+0000 7fa8b2d19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 2024-09-22T09:08:37.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa8b2d19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa8b2d19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa8b2d19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa8b2d19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37, ofs0, ns] 2024-09-22T09:08:37.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa787fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94268319719856 notifier 7917 bl.length()=931 2024-09-22T09:08:37.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa787fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa787fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.578+0000 7fa787fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.580+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_sources= new_sources= 2024-09-22T09:08:37.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.580+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential sources added=[] removed=[] 2024-09-22T09:08:37.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.580+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_dests= new_dests= 2024-09-22T09:08:37.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.580+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential dests added=[] removed=[] 2024-09-22T09:08:37.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.582+0000 7fa8b2d19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.0 2024-09-22T09:08:37.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.582+0000 7fa8b2d19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.0 2024-09-22T09:08:37.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.582+0000 7fa8b2d19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.1 2024-09-22T09:08:37.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.582+0000 7fa8b2d19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.1.1 2024-09-22T09:08:37.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.582+0000 7fa8b2d19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.0 2024-09-22T09:08:37.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.584+0000 7fa8b2d19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:37.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.584+0000 7fa8b2d19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa8b2d19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa8b2d19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa8b2d19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa8b2d19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37, ofs0, ns] 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa787fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94268319719856 notifier 7917 bl.length()=931 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa787fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa787fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.586+0000 7fa787fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.587+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_sources= new_sources= 2024-09-22T09:08:37.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.587+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential sources added=[] removed=[] 2024-09-22T09:08:37.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.587+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_dests= new_dests= 2024-09-22T09:08:37.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.587+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential dests added=[] removed=[] 2024-09-22T09:08:37.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.589+0000 7fa8b2d19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.37.0 2024-09-22T09:08:37.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.589+0000 7fa8b2d19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:37.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.589+0000 7fa8b2d19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.590+0000 7fa8b2d19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.590+0000 7fa8b2d19800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.590+0000 7fa8b2d19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.590+0000 7fa8b2d19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37, ofs0, ns] 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.591+0000 7fa787fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94268319719856 notifier 7917 bl.length()=899 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.591+0000 7fa787fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 info.flags=0x17 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.591+0000 7fa787fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 to cache LRU end 2024-09-22T09:08:37.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.591+0000 7fa787fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:37.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.592+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_sources= new_sources= 2024-09-22T09:08:37.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.592+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential sources added=[] removed=[] 2024-09-22T09:08:37.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.592+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): orig_dests= new_dests= 2024-09-22T09:08:37.594 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.592+0000 7fa8b2d19800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.37]): potential dests added=[] removed=[] 2024-09-22T09:08:37.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.593+0000 7fa8b2d19800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-22T09:08:37.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.595+0000 7fa766fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:37.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.597+0000 7fa8b2d19800 20 remove_watcher() i=0 2024-09-22T09:08:37.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.597+0000 7fa8b2d19800 2 removed watcher, disabling cache 2024-09-22T09:08:37.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.598+0000 7fa8b2d19800 20 remove_watcher() i=1 2024-09-22T09:08:37.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.599+0000 7fa8b2d19800 20 remove_watcher() i=2 2024-09-22T09:08:37.603 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.601+0000 7fa8b2d19800 20 remove_watcher() i=3 2024-09-22T09:08:37.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.602+0000 7fa8b2d19800 20 remove_watcher() i=4 2024-09-22T09:08:37.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.603+0000 7fa8b2d19800 20 remove_watcher() i=5 2024-09-22T09:08:37.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.604+0000 7fa8b2d19800 20 remove_watcher() i=6 2024-09-22T09:08:37.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.605+0000 7fa8b2d19800 20 remove_watcher() i=7 2024-09-22T09:08:37.619 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T09:08:37.649 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:37.649 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:37.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.889+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.891+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.891+0000 7f91f981d800 20 realm 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:37.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.892+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.893+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:37.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.893+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:37.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.894+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:37.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.894+0000 7f91f981d800 20 searching for the correct realm 2024-09-22T09:08:37.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:37.894+0000 7f91f4feb640 0 -- 172.21.15.39:0/1607114987 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x55e37ba398a0 msgr2=0x7f91f002a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:38.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.099+0000 7f91f4feb640 0 -- 172.21.15.39:0/1607114987 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x55e37bad3320 msgr2=0x7f91f003f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.711+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:38.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.712+0000 7f91f981d800 20 zone default found 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 4 Realm: () 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 zonegroup default 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:38.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:38.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.713+0000 7f91f981d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:38.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.714+0000 7f91f981d800 20 started sync module instance, tier type = 2024-09-22T09:08:38.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.714+0000 7f91f981d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:38.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=0 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=1 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=2 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=3 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=4 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=5 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.724+0000 7f91f981d800 20 add_watcher() i=6 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.725+0000 7f91f981d800 20 add_watcher() i=7 2024-09-22T09:08:38.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.725+0000 7f91f981d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.727+0000 7f90ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 5 note: GC not initialized 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f90aa7e4640 20 reqs_thread_entry: start 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:38.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 20 Filter name: none 2024-09-22T09:08:38.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f90a37fe640 20 reqs_thread_entry: start 2024-09-22T09:08:38.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.728+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.729+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:38.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.729+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.730+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:38.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.730+0000 7f91f981d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:38.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.730+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.730+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:38.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.730+0000 7f91f981d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:38.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.731+0000 7f91f981d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:38.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.731+0000 7f91f981d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:38.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.732+0000 7f90ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:38.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.735+0000 7f91f981d800 20 remove_watcher() i=0 2024-09-22T09:08:38.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.735+0000 7f91f981d800 2 removed watcher, disabling cache 2024-09-22T09:08:38.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.736+0000 7f91f981d800 20 remove_watcher() i=1 2024-09-22T09:08:38.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.737+0000 7f91f981d800 20 remove_watcher() i=2 2024-09-22T09:08:38.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.738+0000 7f91f981d800 20 remove_watcher() i=3 2024-09-22T09:08:38.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.739+0000 7f91f981d800 20 remove_watcher() i=4 2024-09-22T09:08:38.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.741+0000 7f91f981d800 20 remove_watcher() i=5 2024-09-22T09:08:38.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.742+0000 7f91f981d800 20 remove_watcher() i=6 2024-09-22T09:08:38.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:38.743+0000 7f91f981d800 20 remove_watcher() i=7 2024-09-22T09:08:38.757 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:38.757 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:38.757 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:08:38.758 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:38.759 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:38.760 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:38.781 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:38.781 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:38.981 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:38.981 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.047 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-22T09:08:39.047 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:39.048 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.048 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.090 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.090 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.146 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.146 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.179 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.179 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.212 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.213 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.246 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.246 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.281 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.281 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.314 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.314 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.350 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.350 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.384 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.384 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.416 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.417 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.451 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.452 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.486 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.486 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.520 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.520 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.554 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.554 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.589 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.589 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.622 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.623 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.655 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.656 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.689 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.689 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.721 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.721 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.754 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.754 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.789 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:39.789 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:39.822 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T09:08:39.851 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:39.852 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:39.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.889+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 realm 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.891+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.892+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:39.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.892+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.893+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:39.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.893+0000 7fe1dd70c800 20 searching for the correct realm 2024-09-22T09:08:39.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.894+0000 7fe1da9f5640 0 -- 172.21.15.39:0/1800152684 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fe1cc0b0020 msgr2=0x7fe1cc0c1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:39.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.898+0000 7fe1da9f5640 0 -- 172.21.15.39:0/1800152684 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fe0a4087c10 msgr2=0x7fe0a408a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.902+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:39.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 zone default found 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 4 Realm: () 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 zonegroup default 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.903+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.907 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:39.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 started sync module instance, tier type = 2024-09-22T09:08:39.908 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.904+0000 7fe1dd70c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:39.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=0 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=1 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=2 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=3 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=4 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=5 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.913+0000 7fe1dd70c800 20 add_watcher() i=6 2024-09-22T09:08:39.916 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.914+0000 7fe1dd70c800 20 add_watcher() i=7 2024-09-22T09:08:39.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.914+0000 7fe1dd70c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:39.918 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.916+0000 7fe091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.916+0000 7fe1dd70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.916+0000 7fe1dd70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.916+0000 7fe1dd70c800 5 note: GC not initialized 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.917+0000 7fe090fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.917+0000 7fe1dd70c800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.917+0000 7fe1dd70c800 20 Filter name: none 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.917+0000 7fe00a7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:39.919 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.917+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:39.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:39.920 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:39.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.918+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:39.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.919+0000 7fe1dd70c800 20 rados->read ofs=0 len=0 2024-09-22T09:08:39.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.919+0000 7fe1dd70c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:39.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.919+0000 7fe1dd70c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:39.922 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.920+0000 7fe091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:39.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.922+0000 7fe1dd70c800 20 remove_watcher() i=0 2024-09-22T09:08:39.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.922+0000 7fe1dd70c800 2 removed watcher, disabling cache 2024-09-22T09:08:39.925 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.923+0000 7fe1dd70c800 20 remove_watcher() i=1 2024-09-22T09:08:39.926 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.924+0000 7fe1dd70c800 20 remove_watcher() i=2 2024-09-22T09:08:39.928 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.926+0000 7fe1dd70c800 20 remove_watcher() i=3 2024-09-22T09:08:39.929 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.927+0000 7fe1dd70c800 20 remove_watcher() i=4 2024-09-22T09:08:39.930 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.928+0000 7fe1dd70c800 20 remove_watcher() i=5 2024-09-22T09:08:39.931 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.929+0000 7fe1dd70c800 20 remove_watcher() i=6 2024-09-22T09:08:39.932 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:39.930+0000 7fe1dd70c800 20 remove_watcher() i=7 2024-09-22T09:08:39.943 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:39.943 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:39.943 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:39.943 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:39.944 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-22T09:08:39.981 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:39.981 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:40.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.222+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 realm 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.224+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.225+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:40.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.225+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.226+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:40.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.226+0000 7f2eab5ad800 20 searching for the correct realm 2024-09-22T09:08:40.228 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.226+0000 7f2ea9898640 0 -- 172.21.15.39:0/1296321884 >> [v2:172.21.15.39:6816/2957971359,v1:172.21.15.39:6817/2957971359] conn(0x55b3307de4a0 msgr2=0x55b3307e08b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:40.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.229+0000 7f2ea9097640 0 -- 172.21.15.39:0/1296321884 >> [v2:172.21.15.39:6800/1561628689,v1:172.21.15.39:6801/1561628689] conn(0x55b3307d69f0 msgr2=0x55b3307d8e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:40.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:40.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:40.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:40.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.237+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:40.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 zone default found 2024-09-22T09:08:40.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 4 Realm: () 2024-09-22T09:08:40.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 zonegroup default 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.238+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.239+0000 7f2eab5ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.239+0000 7f2eab5ad800 20 started sync module instance, tier type = 2024-09-22T09:08:40.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.239+0000 7f2eab5ad800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=0 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=1 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=2 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=3 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=4 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=5 2024-09-22T09:08:40.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.249+0000 7f2eab5ad800 20 add_watcher() i=6 2024-09-22T09:08:40.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.250+0000 7f2eab5ad800 20 add_watcher() i=7 2024-09-22T09:08:40.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.250+0000 7f2eab5ad800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:40.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.251+0000 7f2d5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.251+0000 7f2eab5ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.251+0000 7f2eab5ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.251+0000 7f2eab5ad800 5 note: GC not initialized 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2d5efe5640 20 reqs_thread_entry: start 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 20 Filter name: none 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2d5cfe1640 20 reqs_thread_entry: start 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-22T09:08:40.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:40.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:40.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.252+0000 7f2eab5ad800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-22T09:08:40.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 : miss 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.253+0000 7f2eab5ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2eab5ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2eab5ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2eab5ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2eab5ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38, ofs0, ns] 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2d8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94228101087392 notifier 7433 bl.length()=931 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2d8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2d8cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.257+0000 7f2d8cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.259+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_sources= new_sources= 2024-09-22T09:08:40.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.259+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential sources added=[] removed=[] 2024-09-22T09:08:40.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.259+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_dests= new_dests= 2024-09-22T09:08:40.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.259+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential dests added=[] removed=[] 2024-09-22T09:08:40.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.261+0000 7f2eab5ad800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.1.0 2024-09-22T09:08:40.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.261+0000 7f2eab5ad800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.1.0 2024-09-22T09:08:40.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.261+0000 7f2eab5ad800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.1.1 2024-09-22T09:08:40.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.261+0000 7f2eab5ad800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.1.1 2024-09-22T09:08:40.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.261+0000 7f2eab5ad800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.0 2024-09-22T09:08:40.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.264+0000 7f2eab5ad800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-22T09:08:40.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.264+0000 7f2eab5ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:40.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.264+0000 7f2eab5ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2eab5ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2eab5ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2eab5ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2eab5ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38, ofs0, ns] 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2d8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529743 cookie 94228101087392 notifier 7433 bl.length()=931 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2d8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2d8cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.265+0000 7f2d8cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.267+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_sources= new_sources= 2024-09-22T09:08:40.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.267+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential sources added=[] removed=[] 2024-09-22T09:08:40.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.267+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_dests= new_dests= 2024-09-22T09:08:40.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.267+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential dests added=[] removed=[] 2024-09-22T09:08:40.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.268+0000 7f2eab5ad800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.38.0 2024-09-22T09:08:40.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.268+0000 7f2eab5ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 : hit (requested=0x17, cached=0x17) 2024-09-22T09:08:40.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.268+0000 7f2eab5ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 2024-09-22T09:08:40.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2eab5ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2eab5ad800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2eab5ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2eab5ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38, ofs0, ns] 2024-09-22T09:08:40.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2d8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94228101087392 notifier 7433 bl.length()=899 2024-09-22T09:08:40.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2d8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 info.flags=0x17 2024-09-22T09:08:40.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2d8cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 to cache LRU end 2024-09-22T09:08:40.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.269+0000 7f2d8cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:40.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.271+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_sources= new_sources= 2024-09-22T09:08:40.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.271+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential sources added=[] removed=[] 2024-09-22T09:08:40.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.271+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): orig_dests= new_dests= 2024-09-22T09:08:40.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.271+0000 7f2eab5ad800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.38]): potential dests added=[] removed=[] 2024-09-22T09:08:40.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.272+0000 7f2eab5ad800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-22T09:08:40.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.274+0000 7f2d5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:40.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.276+0000 7f2eab5ad800 20 remove_watcher() i=0 2024-09-22T09:08:40.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.276+0000 7f2eab5ad800 2 removed watcher, disabling cache 2024-09-22T09:08:40.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.277+0000 7f2eab5ad800 20 remove_watcher() i=1 2024-09-22T09:08:40.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.279+0000 7f2eab5ad800 20 remove_watcher() i=2 2024-09-22T09:08:40.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.280+0000 7f2eab5ad800 20 remove_watcher() i=3 2024-09-22T09:08:40.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.281+0000 7f2eab5ad800 20 remove_watcher() i=4 2024-09-22T09:08:40.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.282+0000 7f2eab5ad800 20 remove_watcher() i=5 2024-09-22T09:08:40.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.283+0000 7f2eab5ad800 20 remove_watcher() i=6 2024-09-22T09:08:40.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.284+0000 7f2eab5ad800 20 remove_watcher() i=7 2024-09-22T09:08:40.299 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-22T09:08:40.328 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:40.328 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:40.368 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.365+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 realm 2024-09-22T09:08:40.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.369 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:40.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.367+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.370 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.370+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:40.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.370+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.370+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:40.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.370+0000 7f4e6992e800 20 searching for the correct realm 2024-09-22T09:08:40.374 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.372+0000 7f4e65ede640 0 -- 172.21.15.39:0/1429035628 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f4e5c02b070 msgr2=0x7f4e5c06bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:40.378 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.376+0000 7f4e64edc640 0 -- 172.21.15.39:0/1429035628 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f4e60027b80 msgr2=0x7f4e600583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:40.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:40.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.581+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 zone default found 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 4 Realm: () 2024-09-22T09:08:40.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 zonegroup default 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.582+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.583+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.583+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.583+0000 7f4e6992e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.583+0000 7f4e6992e800 20 started sync module instance, tier type = 2024-09-22T09:08:40.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.583+0000 7f4e6992e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=0 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=1 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=2 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=3 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=4 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=5 2024-09-22T09:08:40.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.593+0000 7f4e6992e800 20 add_watcher() i=6 2024-09-22T09:08:40.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.594+0000 7f4e6992e800 20 add_watcher() i=7 2024-09-22T09:08:40.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.594+0000 7f4e6992e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:40.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4d1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:40.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 5 note: GC not initialized 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4d1a7e4640 20 reqs_thread_entry: start 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 20 Filter name: none 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4c8bfff640 20 reqs_thread_entry: start 2024-09-22T09:08:40.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.596+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.597+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.597+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.600 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:40.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 rados->read ofs=0 len=0 2024-09-22T09:08:40.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:40.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.598+0000 7f4e6992e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:40.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.600+0000 7f4d1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:40.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.602+0000 7f4e6992e800 20 remove_watcher() i=0 2024-09-22T09:08:40.604 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.602+0000 7f4e6992e800 2 removed watcher, disabling cache 2024-09-22T09:08:40.605 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.603+0000 7f4e6992e800 20 remove_watcher() i=1 2024-09-22T09:08:40.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.605+0000 7f4e6992e800 20 remove_watcher() i=2 2024-09-22T09:08:40.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.605+0000 7f4e6992e800 20 remove_watcher() i=3 2024-09-22T09:08:40.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.607+0000 7f4e6992e800 20 remove_watcher() i=4 2024-09-22T09:08:40.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.608+0000 7f4e6992e800 20 remove_watcher() i=5 2024-09-22T09:08:40.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.609+0000 7f4e6992e800 20 remove_watcher() i=6 2024-09-22T09:08:40.612 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:40.610+0000 7f4e6992e800 20 remove_watcher() i=7 2024-09-22T09:08:40.623 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:40.623 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:40.623 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: error-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-22T09:08:40.624 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:40.626 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:40.626 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:40.643 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:40.643 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:40.839 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:40.840 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:40.904 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-22T09:08:40.905 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:40.906 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:40.906 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:40.947 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:40.947 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.004 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.004 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.040 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.041 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.074 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.074 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.107 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.108 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.141 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.141 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.174 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.174 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.208 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.208 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.243 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.243 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.277 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.277 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.311 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.311 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.346 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.347 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.380 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.380 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.416 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.416 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.450 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.450 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.485 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.485 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.519 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.519 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.552 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.552 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.587 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.587 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.621 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.621 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.653 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:41.653 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:41.688 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T09:08:41.717 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:41.717 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:41.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.755+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 realm 2024-09-22T09:08:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:41.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:41.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:41.761 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:41.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.757+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:41.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.758+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:41.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.758+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:41.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.759+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:41.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.759+0000 7f6160a1d800 20 searching for the correct realm 2024-09-22T09:08:41.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.761+0000 7f615c9ec640 0 -- 172.21.15.39:0/1579945173 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6144028040 msgr2=0x7f614405e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:41.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:41.967+0000 7f6153fff640 0 -- 172.21.15.39:0/1579945173 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f61540543c0 msgr2=0x7f6154054820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.177 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.174+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 zone default found 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 4 Realm: () 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 zonegroup default 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.178 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.175+0000 7f6160a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.176+0000 7f6160a1d800 20 started sync module instance, tier type = 2024-09-22T09:08:42.179 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.176+0000 7f6160a1d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=0 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=1 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=2 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=3 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=4 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=5 2024-09-22T09:08:42.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.186+0000 7f6160a1d800 20 add_watcher() i=6 2024-09-22T09:08:42.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.187+0000 7f6160a1d800 20 add_watcher() i=7 2024-09-22T09:08:42.188 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.187+0000 7f6160a1d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:42.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.188+0000 7f6012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:42.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 5 note: GC not initialized 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6011fdb640 20 reqs_thread_entry: start 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 20 Filter name: none 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f5f837fe640 20 reqs_thread_entry: start 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.189+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.190+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:42.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.190+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:42.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:42.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:42.192 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:42.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.191+0000 7f6160a1d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:42.194 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.193+0000 7f6012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:42.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.195+0000 7f6160a1d800 20 remove_watcher() i=0 2024-09-22T09:08:42.196 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.195+0000 7f6160a1d800 2 removed watcher, disabling cache 2024-09-22T09:08:42.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.196+0000 7f6160a1d800 20 remove_watcher() i=1 2024-09-22T09:08:42.198 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.197+0000 7f6160a1d800 20 remove_watcher() i=2 2024-09-22T09:08:42.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.198+0000 7f6160a1d800 20 remove_watcher() i=3 2024-09-22T09:08:42.201 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.200+0000 7f6160a1d800 20 remove_watcher() i=4 2024-09-22T09:08:42.202 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.201+0000 7f6160a1d800 20 remove_watcher() i=5 2024-09-22T09:08:42.203 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.202+0000 7f6160a1d800 20 remove_watcher() i=6 2024-09-22T09:08:42.204 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.203+0000 7f6160a1d800 20 remove_watcher() i=7 2024-09-22T09:08:42.215 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.216 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:42.216 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:42.216 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.217 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T09:08:42.253 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:42.253 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:42.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.292+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 realm 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:42.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.295+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.295+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.296+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:42.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.296+0000 7f073da40800 20 searching for the correct realm 2024-09-22T09:08:42.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.297+0000 7f073bd2b640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f07300a6c20 msgr2=0x7f07300a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.504 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.503+0000 7f073ad29640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f0734060920 msgr2=0x7f0734042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 zone default found 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 4 Realm: () 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:42.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 zonegroup default 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.713+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.713+0000 7f073da40800 20 started sync module instance, tier type = 2024-09-22T09:08:42.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.713+0000 7f073da40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:42.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=0 2024-09-22T09:08:42.725 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=1 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=2 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=3 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=4 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=5 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=6 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.725+0000 7f073da40800 20 add_watcher() i=7 2024-09-22T09:08:42.726 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.725+0000 7f073da40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.727+0000 7f05f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f073da40800 5 note: GC not initialized 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f05f0fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f073da40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:42.729 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f073da40800 20 Filter name: none 2024-09-22T09:08:42.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f056a7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:42.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T09:08:42.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.728+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : miss 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.729+0000 7f073da40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:08:42.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.733+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.733+0000 7f073da40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.733+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.733+0000 7f073da40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:08:42.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 93948208046784 notifier 8025 bl.length()=931 2024-09-22T09:08:42.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:08:42.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:08:42.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:08:42.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:08:42.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.0 2024-09-22T09:08:42.741 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073da40800 time 2024-09-22T09:08:42.741324+0000 2024-09-22T09:08:42.741 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:42.742 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.742 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0740f8c748] 2024-09-22T09:08:42.742 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.742 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.742 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.741+0000 7f073da40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073da40800 time 2024-09-22T09:08:42.741324+0000 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.743 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0740f8c748] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:08:42.744 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f073da40800 thread_name:radosgw-admin 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073fc3e6f0] 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073fc8b99c] 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:42.762 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0740f8c7a2] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.742+0000 7f073da40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f073da40800 thread_name:radosgw-admin 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073fc3e6f0] 2024-09-22T09:08:42.763 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073fc8b99c] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0740f8c7a2] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.764 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:08:42.274+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.765 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: starting msgr at 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: starting objecter 2024-09-22T09:08:42.766 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:08:42.275+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests hook 0x557205844340 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: setting wanted keys 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: calling monclient init 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.767 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:08:42.275+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key hook 0x557205816538 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572056cc420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x557205758ae0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x55720575ea50 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.768 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.535786s 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x557205758ae0 auth_method 0 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x55720575ea50 auth_method 0 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572056cc420 auth_method 0 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.769 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_done global_id 8016 payload 824 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:08:42.276+0000 7f073ad29640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.770 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: dump: 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.771 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: dump: 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:08:42.276+0000 7f073da40800 5 monclient: authenticate success, global_id 8016 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:08:42.276+0000 7f062960a640 4 set_mon_vals no callback set 2024-09-22T09:08:42.772 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:08:42.276+0000 7f073da40800 1 librados: init done 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:08:42.278+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f0620077570 auth_method 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:08:42.279+0000 7f073bd2b640 10 monclient: get_auth_request con 0x557205852810 auth_method 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:08:42.280+0000 7f073b52a640 10 monclient: get_auth_request con 0x557205862a40 auth_method 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:08:42.280+0000 7f073ad29640 10 monclient: get_auth_request con 0x557205866e70 auth_method 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:08:42.282+0000 7f073bd2b640 10 monclient: get_auth_request con 0x557205866370 auth_method 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:08:42.282+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:08:42.282+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:08:42.282+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.773 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.774 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:08:42.283+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests cmddesc objecter_requests hook 0x557205872640 EEXIST 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.775 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:08:42.283+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x55720586e100 EEXIST 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x557205896960 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x557205896d40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.776 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x557205895670 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.543923s 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x557205896960 auth_method 0 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x557205895670 auth_method 0 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.777 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x557205896d40 auth_method 0 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:08:42.284+0000 7f073ad29640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.778 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: dump: 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.779 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: dump: 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.781 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:08:42.284+0000 7f073da40800 5 monclient: authenticate success, global_id 8019 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:08:42.284+0000 7f073c52c640 4 set_mon_vals no callback set 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.782 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:08:42.286+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f0614077480 auth_method 0 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: get_monmap_and_config 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:08:42.286+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.783 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.784 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.785 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:08:42.287+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x7fffff822ce8 EEXIST 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x5572058eac00 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.786 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x5572058bbb50 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572058e64a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.547706s 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x5572058bbb50 auth_method 0 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x5572058eac00 auth_method 0 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.787 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572058e64a0 auth_method 0 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient(hunting): handle_auth_done global_id 8022 payload 274 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:08:42.288+0000 7f073bd2b640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.788 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: dump: 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.789 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: dump: 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:08:42.288+0000 7f073da40800 5 monclient: authenticate success, global_id 8022 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:08:42.288+0000 7f073da40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:42.790 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:08:42.288+0000 7f073da40800 4 set_mon_vals no callback set 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:08:42.288+0000 7f073da40800 10 monclient: shutdown 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:08:42.289+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.791 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.792 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: starting msgr at 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: starting objecter 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:08:42.289+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55720589bac0 EEXIST 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: setting wanted keys 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: calling monclient init 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.793 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:08:42.289+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x5572058ab368 EEXIST 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572058bbb50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x5572058e64a0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x5572058eac00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.794 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.550073s 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x5572058e64a0 auth_method 0 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572058eac00 auth_method 0 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x5572058bbb50 auth_method 0 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.795 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:08:42.290+0000 7f073b52a640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.796 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: dump: 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:08:42.290+0000 7f073da40800 5 monclient: authenticate success, global_id 8025 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.797 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: dump: 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.798 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:08:42.290+0000 7f061effd640 4 set_mon_vals no callback set 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:08:42.290+0000 7f073da40800 1 librados: init done 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:08:42.290+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cr dump hook 0x5572058d9dd8 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:08:42.292+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:08:42.293+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0604077570 auth_method 0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:08:42.293+0000 7f073bd2b640 10 monclient: get_auth_request con 0x5572059048e0 auth_method 0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:08:42.294+0000 7f073da40800 20 realm 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:08:42.294+0000 7f073da40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.799 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:08:42.294+0000 7f073ad29640 10 monclient: get_auth_request con 0x557205908ba0 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:08:42.295+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:08:42.295+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:08:42.295+0000 7f073bd2b640 10 monclient: get_auth_request con 0x55720590c400 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:08:42.296+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:08:42.296+0000 7f073da40800 20 searching for the correct realm 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:08:42.296+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f073402c070 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:08:42.297+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f072c01f070 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:08:42.297+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f07300a6c20 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:08:42.297+0000 7f073bd2b640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f07300a6c20 msgr2=0x7f07300a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:08:42.498+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f07300a6c20 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:08:42.500+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f07340413f0 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:08:42.503+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0734060920 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:08:42.503+0000 7f073ad29640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f0734060920 msgr2=0x7f0734042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:08:42.704+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0734060920 auth_method 0 2024-09-22T09:08:42.800 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:08:42.712+0000 7f073da40800 20 zone default found 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:08:42.712+0000 7f073da40800 4 Realm: () 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:08:42.712+0000 7f073da40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:08:42.712+0000 7f073da40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:08:42.712+0000 7f073da40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:42.801 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:08:42.712+0000 7f073da40800 20 zonegroup default 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:08:42.713+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:08:42.713+0000 7f073da40800 20 started sync module instance, tier type = 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:08:42.713+0000 7f073da40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=0 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=1 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=2 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=3 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=4 2024-09-22T09:08:42.802 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=5 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=6 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:08:42.725+0000 7f073da40800 20 add_watcher() i=7 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:08:42.725+0000 7f073da40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.803 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:08:42.727+0000 7f05f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:08:42.727+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache list hook 0x5572058e4170 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache inspect hook 0x5572058e4170 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache erase hook 0x5572058e4170 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache zap hook 0x5572058e4170 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:08:42.728+0000 7f073da40800 5 note: GC not initialized 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:08:42.728+0000 7f05f0fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace show hook 0x7f07340189a0 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace history hook 0x7f07340189a0 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace active hook 0x7f07340189a0 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace active_short hook 0x7f07340189a0 2024-09-22T09:08:42.804 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:08:42.728+0000 7f073da40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:08:42.728+0000 7f073da40800 20 Filter name: none 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:08:42.728+0000 7f056a7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:08:42.728+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:08:42.728+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : miss 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.805 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:08:42.729+0000 7f073da40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:08:42.733+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:08:42.733+0000 7f073da40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:08:42.733+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:08:42.733+0000 7f073da40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 93948208046784 notifier 8025 bl.length()=931 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:08:42.806 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.0 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:08:42.741+0000 7f073da40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073da40800 time 2024-09-22T09:08:42.741324+0000 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0740f8c748] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.807 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:08:42.742+0000 7f073da40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f073da40800 thread_name:radosgw-admin 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073fc3e6f0] 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073fc8b99c] 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0740f8c7a2] 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.808 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:08:42.809 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:08:42.810 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:08:42.811 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:08:42.812 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:08:42.813 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:08:42.814 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f056a7fc640 / http_manager 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f05f0fe1640 / http_manager 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f05f1fe3640 / rgw_dt_lg_renew 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f061d7fa640 / ms_dispatch 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f061effd640 / io_context_pool 2024-09-22T09:08:42.815 INFO:tasks.workunit.client.0.smithi039.stderr: 7f0625602640 / ms_dispatch 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f0627e07640 / ms_dispatch 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f062960a640 / io_context_pool 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073ad29640 / msgr-worker-2 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073b52a640 / msgr-worker-1 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073bd2b640 / msgr-worker-0 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073c52c640 / io_context_pool 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073da40800 / radosgw-admin 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.141596.log 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:08:42.274+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.816 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding auth protocol: cephx 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.817 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: crc 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:08:42.274+0000 7f073da40800 5 AuthRegistry(0x55720581bbd0) adding con mode: secure 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: starting msgr at 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: starting objecter 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:08:42.275+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests hook 0x557205844340 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: setting wanted keys 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:08:42.275+0000 7f073da40800 1 librados: calling monclient init 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.818 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding auth protocol: cephx 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: crc 2024-09-22T09:08:42.819 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:08:42.275+0000 7f073da40800 5 AuthRegistry(0x5572058163f0) adding con mode: secure 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:08:42.275+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:08:42.275+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key hook 0x557205816538 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572056cc420 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x557205758ae0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x55720575ea50 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:08:42.275+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.535786s 2024-09-22T09:08:42.820 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x557205758ae0 auth_method 0 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x55720575ea50 auth_method 0 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:08:42.275+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572056cc420 auth_method 0 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:08:42.275+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:08:42.275+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.821 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:08:42.276+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:08:42.276+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient(hunting): handle_auth_done global_id 8016 payload 824 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:08:42.276+0000 7f073ad29640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:08:42.276+0000 7f073ad29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: dump: 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.822 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:08:42.276+0000 7f0627e07640 10 monclient: dump: 2024-09-22T09:08:42.823 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:08:42.276+0000 7f073da40800 5 monclient: authenticate success, global_id 8016 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:08:42.276+0000 7f062960a640 4 set_mon_vals no callback set 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:08:42.276+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.824 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:08:42.276+0000 7f073da40800 1 librados: init done 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:08:42.278+0000 7f0627e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:08:42.278+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f0620077570 auth_method 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:08:42.279+0000 7f073bd2b640 10 monclient: get_auth_request con 0x557205852810 auth_method 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:08:42.280+0000 7f073b52a640 10 monclient: get_auth_request con 0x557205862a40 auth_method 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:08:42.280+0000 7f073ad29640 10 monclient: get_auth_request con 0x557205866e70 auth_method 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:08:42.282+0000 7f073bd2b640 10 monclient: get_auth_request con 0x557205866370 auth_method 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:08:42.282+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:08:42.282+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:08:42.282+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.825 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding auth protocol: cephx 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.826 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: crc 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:08:42.282+0000 7f073da40800 5 AuthRegistry(0x55720586f1b0) adding con mode: secure 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:08:42.283+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests cmddesc objecter_requests hook 0x557205872640 EEXIST 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding auth protocol: cephx 2024-09-22T09:08:42.827 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: crc 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:08:42.283+0000 7f073da40800 5 AuthRegistry(0x55720586dfb8) adding con mode: secure 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.828 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:08:42.283+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:08:42.283+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x55720586e100 EEXIST 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x557205896960 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x557205896d40 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x557205895670 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:08:42.283+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.543923s 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x557205896960 auth_method 0 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.829 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x557205895670 auth_method 0 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x557205896d40 auth_method 0 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:08:42.284+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.830 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:08:42.284+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:08:42.284+0000 7f073ad29640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:08:42.284+0000 7f073ad29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: dump: 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.831 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.832 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:08:42.284+0000 7f0625602640 10 monclient: dump: 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:08:42.284+0000 7f073da40800 5 monclient: authenticate success, global_id 8019 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:08:42.284+0000 7f073c52c640 4 set_mon_vals no callback set 2024-09-22T09:08:42.833 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:08:42.284+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:08:42.286+0000 7f0625602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:08:42.286+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f0614077480 auth_method 0 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: get_monmap_and_config 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:08:42.286+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:08:42.286+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.834 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding auth protocol: cephx 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.835 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: crc 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:08:42.286+0000 7f073da40800 5 AuthRegistry(0x5572058b6540) adding con mode: secure 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding auth protocol: cephx 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.836 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: crc 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:08:42.287+0000 7f073da40800 5 AuthRegistry(0x7fffff822ba0) adding con mode: secure 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:08:42.287+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:08:42.287+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x7fffff822ce8 EEXIST 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.837 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x5572058eac00 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x5572058bbb50 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572058e64a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:08:42.287+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.547706s 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x5572058bbb50 auth_method 0 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x5572058eac00 auth_method 0 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.838 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:08:42.287+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:08:42.287+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572058e64a0 auth_method 0 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:08:42.288+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient(hunting): handle_auth_done global_id 8022 payload 274 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:08:42.288+0000 7f073bd2b640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:08:42.288+0000 7f073bd2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.839 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: dump: 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.840 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:08:42.288+0000 7f061effd640 10 monclient: dump: 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:08:42.288+0000 7f073da40800 5 monclient: authenticate success, global_id 8022 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:08:42.288+0000 7f073da40800 10 monclient: get_monmap_and_config success 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:08:42.288+0000 7f073da40800 4 set_mon_vals no callback set 2024-09-22T09:08:42.841 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:08:42.288+0000 7f073da40800 10 monclient: shutdown 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: build_initial_monmap 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:08:42.289+0000 7f073da40800 1 build_initial for_mkfs: 0 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: monmap: 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.842 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding auth protocol: cephx 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: crc 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058e6dd0) adding con mode: secure 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.843 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: starting msgr at 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: starting objecter 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:08:42.289+0000 7f073da40800 5 asok(0x5572055f50f0) register_command objecter_requests cmddesc objecter_requests hook 0x55720589bac0 EEXIST 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: setting wanted keys 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:08:42.289+0000 7f073da40800 1 librados: calling monclient init 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: init 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding auth protocol: cephx 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.844 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: crc 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:08:42.289+0000 7f073da40800 5 AuthRegistry(0x5572058ab220) adding con mode: secure 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:08:42.289+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:08:42.289+0000 7f073da40800 5 asok(0x5572055f50f0) register_command rotate-key cmddesc rotate-key hook 0x5572058ab368 EEXIST 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:08:42.289+0000 7f073da40800 10 monclient: _reopen_session rank -1 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-b con 0x5572058bbb50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-c con 0x5572058e64a0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): picked mon.noname-a con 0x5572058eac00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.845 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): start opening mon connection 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): _renew_subs 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient(hunting): authenticate will time out at 2420.550073s 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): get_auth_request con 0x5572058e64a0 auth_method 0 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): get_auth_request con 0x5572058eac00 auth_method 0 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): get_auth_request con 0x5572058bbb50 auth_method 0 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:08:42.846 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:08:42.290+0000 7f073bd2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:08:42.290+0000 7f073ad29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient: _finish_hunting 0 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:08:42.290+0000 7f073b52a640 1 monclient: found mon.noname-a 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:08:42.290+0000 7f073b52a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.847 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: dump: 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: _finish_auth 0 2024-09-22T09:08:42.848 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: _check_auth_tickets 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:08:42.290+0000 7f073da40800 5 monclient: authenticate success, global_id 8025 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:08:42.290+0000 7f061d7fa640 10 monclient: dump: 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:08:42.849 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:08:42.290+0000 7f061effd640 4 set_mon_vals no callback set 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _renew_subs 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:08:42.290+0000 7f073da40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:08:42.290+0000 7f073da40800 1 librados: init done 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:08:42.290+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cr dump hook 0x5572058d9dd8 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:08:42.292+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:08:42.293+0000 7f061d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:08:42.293+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0604077570 auth_method 0 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:08:42.293+0000 7f073bd2b640 10 monclient: get_auth_request con 0x5572059048e0 auth_method 0 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.850 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:08:42.294+0000 7f073da40800 20 realm 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:08:42.294+0000 7f073da40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:08:42.294+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:08:42.294+0000 7f073ad29640 10 monclient: get_auth_request con 0x557205908ba0 auth_method 0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:08:42.295+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:08:42.295+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:08:42.295+0000 7f073bd2b640 10 monclient: get_auth_request con 0x55720590c400 auth_method 0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:08:42.296+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:08:42.296+0000 7f073da40800 20 searching for the correct realm 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:08:42.296+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f073402c070 auth_method 0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:08:42.297+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f072c01f070 auth_method 0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:08:42.297+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f07300a6c20 auth_method 0 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:08:42.297+0000 7f073bd2b640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f07300a6c20 msgr2=0x7f07300a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.851 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:08:42.498+0000 7f073bd2b640 10 monclient: get_auth_request con 0x7f07300a6c20 auth_method 0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:08:42.500+0000 7f073b52a640 10 monclient: get_auth_request con 0x7f07340413f0 auth_method 0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:08:42.503+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0734060920 auth_method 0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:08:42.503+0000 7f073ad29640 0 -- 172.21.15.39:0/2553960241 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f0734060920 msgr2=0x7f0734042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:08:42.704+0000 7f073ad29640 10 monclient: get_auth_request con 0x7f0734060920 auth_method 0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:08:42.711+0000 7f073da40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.852 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:08:42.711+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:08:42.712+0000 7f073da40800 20 zone default found 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:08:42.712+0000 7f073da40800 4 Realm: () 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:08:42.712+0000 7f073da40800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:08:42.712+0000 7f073da40800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:08:42.712+0000 7f073da40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:08:42.712+0000 7f073da40800 20 zonegroup default 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:08:42.712+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:08:42.713+0000 7f073da40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:08:42.713+0000 7f073da40800 20 started sync module instance, tier type = 2024-09-22T09:08:42.853 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:08:42.713+0000 7f073da40800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=0 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=1 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=2 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=3 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=4 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=5 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:08:42.724+0000 7f073da40800 20 add_watcher() i=6 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:08:42.725+0000 7f073da40800 20 add_watcher() i=7 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:08:42.725+0000 7f073da40800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding auth protocol: cephx 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.854 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: crc 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:08:42.727+0000 7f073da40800 5 AuthRegistry(0x7fffff823070) adding con mode: secure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:08:42.727+0000 7f05f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:08:42.727+0000 7f073da40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:08:42.727+0000 7f073da40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache list hook 0x5572058e4170 2024-09-22T09:08:42.855 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache inspect hook 0x5572058e4170 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache erase hook 0x5572058e4170 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:08:42.727+0000 7f073da40800 5 asok(0x5572055f50f0) register_command cache zap hook 0x5572058e4170 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:08:42.728+0000 7f073da40800 5 note: GC not initialized 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:08:42.728+0000 7f05f0fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace show hook 0x7f07340189a0 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace history hook 0x7f07340189a0 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace active hook 0x7f07340189a0 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:08:42.728+0000 7f073da40800 5 asok(0x5572055f50f0) register_command sync trace active_short hook 0x7f07340189a0 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:08:42.728+0000 7f073da40800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:08:42.728+0000 7f073da40800 20 Filter name: none 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:08:42.728+0000 7f056a7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:08:42.728+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:08:42.728+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:42.856 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : miss 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:08:42.729+0000 7f073da40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:08:42.729+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:08:42.729+0000 7f073da40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:08:42.729+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:08:42.729+0000 7f073da40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:08:42.733+0000 7f073da40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:08:42.733+0000 7f073da40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:08:42.733+0000 7f073da40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:08:42.733+0000 7f073da40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 93948208046784 notifier 8025 bl.length()=931 2024-09-22T09:08:42.857 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:08:42.734+0000 7f061effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:08:42.735+0000 7f073da40800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.0 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:08:42.738+0000 7f073da40800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.1.1 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:08:42.738+0000 7f073da40800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.0 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:08:42.741+0000 7f073da40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f073da40800 time 2024-09-22T09:08:42.741324+0000 2024-09-22T09:08:42.858 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0740f8c748] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:08:42.742+0000 7f073da40800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f073da40800 thread_name:radosgw-admin 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.859 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f073fc3e6f0] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f073fc8b99c] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0740f8c7a2] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f0740f8c906] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557204239e01] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x557204248e9b] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557204249d64] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f073fc29590] 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:08:42.860 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:08:42.861 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:08:42.862 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:08:42.863 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:08:42.864 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:08:42.865 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:08:42.866 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f056a7fc640 / http_manager 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f05f0fe1640 / http_manager 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f05f1fe3640 / rgw_dt_lg_renew 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f061d7fa640 / ms_dispatch 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f061effd640 / io_context_pool 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f0625602640 / ms_dispatch 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f0627e07640 / ms_dispatch 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f062960a640 / io_context_pool 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073ad29640 / msgr-worker-2 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073b52a640 / msgr-worker-1 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073bd2b640 / msgr-worker-0 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073c52c640 / io_context_pool 2024-09-22T09:08:42.867 INFO:tasks.workunit.client.0.smithi039.stderr: 7f073da40800 / radosgw-admin 2024-09-22T09:08:42.868 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:08:42.868 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:08:42.868 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:08:42.742978Z_06627920-a59d-439c-8615-c35a5d5ea27f/log 2024-09-22T09:08:42.868 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:08:42.868 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.824+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 realm 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:42.869 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.826+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.827+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:42.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.827+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:42.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.828+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:42.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.828+0000 7f6c3ec92800 20 searching for the correct realm 2024-09-22T09:08:42.870 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:42.830+0000 7f6c3cf7d640 0 -- 172.21.15.39:0/2599408463 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f6c300af030 msgr2=0x7f6c300a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:08:43.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.037+0000 7f6c3bf7b640 0 -- 172.21.15.39:0/2599408463 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f6c34078800 msgr2=0x7f6c34060ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:43.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.245+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 zone default found 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 4 Realm: () 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 zonegroup default 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 started sync module instance, tier type = 2024-09-22T09:08:43.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.246+0000 7f6c3ec92800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=0 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=1 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=2 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=3 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=4 2024-09-22T09:08:43.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=5 2024-09-22T09:08:43.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.257+0000 7f6c3ec92800 20 add_watcher() i=6 2024-09-22T09:08:43.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.258+0000 7f6c3ec92800 20 add_watcher() i=7 2024-09-22T09:08:43.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.258+0000 7f6c3ec92800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:43.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.260+0000 7f6af2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:43.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.260+0000 7f6c3ec92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:43.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.260+0000 7f6c3ec92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:43.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.260+0000 7f6c3ec92800 5 note: GC not initialized 2024-09-22T09:08:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.260+0000 7f6af1fdb640 20 reqs_thread_entry: start 2024-09-22T09:08:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6c3ec92800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6c3ec92800 20 Filter name: none 2024-09-22T09:08:43.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6a637fe640 20 reqs_thread_entry: start 2024-09-22T09:08:43.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:43.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.261+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.262+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:08:43.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.262+0000 7f6c3ec92800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:43.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.262+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.262+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:43.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.262+0000 7f6c3ec92800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.263+0000 7f6c3ec92800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:08:43.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.263+0000 7f6c3ec92800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:08:43.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.264+0000 7f6af2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:43.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.266+0000 7f6c3ec92800 20 remove_watcher() i=0 2024-09-22T09:08:43.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.266+0000 7f6c3ec92800 2 removed watcher, disabling cache 2024-09-22T09:08:43.268 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.267+0000 7f6c3ec92800 20 remove_watcher() i=1 2024-09-22T09:08:43.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.269+0000 7f6c3ec92800 20 remove_watcher() i=2 2024-09-22T09:08:43.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.270+0000 7f6c3ec92800 20 remove_watcher() i=3 2024-09-22T09:08:43.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.271+0000 7f6c3ec92800 20 remove_watcher() i=4 2024-09-22T09:08:43.273 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.272+0000 7f6c3ec92800 20 remove_watcher() i=5 2024-09-22T09:08:43.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.273+0000 7f6c3ec92800 20 remove_watcher() i=6 2024-09-22T09:08:43.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.275+0000 7f6c3ec92800 20 remove_watcher() i=7 2024-09-22T09:08:43.287 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:43.287 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:08:43.287 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-22T09:08:43.287 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:08:43.289 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:43.290 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:43.320 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:08:43.320 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:08:43.379 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:08:43.413 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:08:43.413 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:08:43.454 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.453+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.454+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.454+0000 7f269f732800 20 realm 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.454+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.455+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.455+0000 7f269f732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.455+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.455+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.455+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.456+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:43.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.456+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.456+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:08:43.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.456+0000 7f269f732800 20 searching for the correct realm 2024-09-22T09:08:43.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.459+0000 7f269bbbd640 0 -- 172.21.15.39:0/3712857906 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f2690074a60 msgr2=0x7f2690037460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:43.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.666+0000 7f269abbb640 0 -- 172.21.15.39:0/3712857906 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f26940433d0 msgr2=0x7f2694043830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.873+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:08:43.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 zone default found 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 4 Realm: () 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 zonegroup default 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.874+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:08:43.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 started sync module instance, tier type = 2024-09-22T09:08:43.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.875+0000 7f269f732800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=0 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=1 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=2 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=3 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=4 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=5 2024-09-22T09:08:43.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.886+0000 7f269f732800 20 add_watcher() i=6 2024-09-22T09:08:43.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.888+0000 7f269f732800 20 add_watcher() i=7 2024-09-22T09:08:43.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.888+0000 7f269f732800 2 all 8 watchers are set, enabling cache 2024-09-22T09:08:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.889+0000 7f2551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:08:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:08:43.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 5 note: GC not initialized 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f2550fe1640 20 reqs_thread_entry: start 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 20 init_complete bucket index max shards: 1 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 20 Filter name: none 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f24ca7fc640 20 reqs_thread_entry: start 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.890+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : miss 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 20 rados->read ofs=0 len=0 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:08:43.893 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.891+0000 7f269f732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:08:43.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.892+0000 7f269f732800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to be held by another RGW process; skipping for now 2024-09-22T09:08:43.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.893+0000 7f2551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:08:43.896 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.895+0000 7f269f732800 20 remove_watcher() i=0 2024-09-22T09:08:43.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.895+0000 7f269f732800 2 removed watcher, disabling cache 2024-09-22T09:08:43.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.897+0000 7f269f732800 20 remove_watcher() i=1 2024-09-22T09:08:43.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.898+0000 7f269f732800 20 remove_watcher() i=2 2024-09-22T09:08:43.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.899+0000 7f269f732800 20 remove_watcher() i=3 2024-09-22T09:08:43.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.900+0000 7f269f732800 20 remove_watcher() i=4 2024-09-22T09:08:43.902 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.902+0000 7f269f732800 20 remove_watcher() i=5 2024-09-22T09:08:43.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.903+0000 7f269f732800 20 remove_watcher() i=6 2024-09-22T09:08:43.905 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:08:43.904+0000 7f269f732800 20 remove_watcher() i=7 2024-09-22T09:08:43.916 INFO:tasks.workunit.client.0.smithi039.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-22T09:09:13.935 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-22T09:09:13.971 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:13.971 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:14.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.016+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.018+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.018+0000 7f8428536800 20 realm 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.018+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.019+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.019+0000 7f8428536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.019+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.019+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.019+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.020+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:14.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.020+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.021+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:14.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.021+0000 7f8428536800 20 searching for the correct realm 2024-09-22T09:09:14.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.023+0000 7f8424ab8640 0 -- 172.21.15.39:0/1306644457 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f841804b040 msgr2=0x7f841804b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:14.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.229+0000 7f8423ab6640 0 -- 172.21.15.39:0/1306644457 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f841c0694f0 msgr2=0x7f841c08b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:14.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.436+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.437+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.437+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.437+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.437+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 zone default found 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 4 Realm: () 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 zonegroup default 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.440 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.438+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.439+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.439+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.439+0000 7f8428536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.439+0000 7f8428536800 20 started sync module instance, tier type = 2024-09-22T09:09:14.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.439+0000 7f8428536800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:14.451 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=0 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=1 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=2 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=3 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=4 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=5 2024-09-22T09:09:14.452 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.450+0000 7f8428536800 20 add_watcher() i=6 2024-09-22T09:09:14.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.452+0000 7f8428536800 20 add_watcher() i=7 2024-09-22T09:09:14.453 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.452+0000 7f8428536800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:14.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.454+0000 7f82dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:14.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.454+0000 7f8428536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:14.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.454+0000 7f8428536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:14.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.454+0000 7f8428536800 5 note: GC not initialized 2024-09-22T09:09:14.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.454+0000 7f82d9fdb640 20 reqs_thread_entry: start 2024-09-22T09:09:14.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:14.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 20 Filter name: none 2024-09-22T09:09:14.456 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f824b7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : miss 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.455+0000 7f8428536800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 20 rados_obj.operate() r=0 bl.length=451 2024-09-22T09:09:14.457 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:14.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.456+0000 7f8428536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:09:14.458 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.458+0000 7f8428536800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:09:14.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f8428536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f8428536800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f8428536800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f8428536800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:09:14.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f82faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529725 cookie 94097790848576 notifier 8082 bl.length()=931 2024-09-22T09:09:14.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f82faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f82faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.462+0000 7f82faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.464+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:09:14.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.464+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:09:14.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.464+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:09:14.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.464+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:09:14.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.468+0000 7f8428536800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.2.0 2024-09-22T09:09:14.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.468+0000 7f8428536800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.2.0 2024-09-22T09:09:14.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.468+0000 7f8428536800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.2.1 2024-09-22T09:09:14.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.468+0000 7f8428536800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.2.1 2024-09-22T09:09:14.470 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.468+0000 7f8428536800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.0 2024-09-22T09:09:14.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.471+0000 7f8428536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : hit (requested=0x17, cached=0x17) 2024-09-22T09:09:14.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.471+0000 7f8428536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f8428536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f8428536800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f8428536800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f8428536800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f82fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529726 cookie 94097790848576 notifier 8082 bl.length()=931 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f82fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f82fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.474 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.473+0000 7f82fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.475+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:09:14.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.475+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:09:14.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.475+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:09:14.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.475+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:09:14.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.476+0000 7f8428536800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.39.0 2024-09-22T09:09:14.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.477+0000 7f8428536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 : hit (requested=0x17, cached=0x17) 2024-09-22T09:09:14.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.477+0000 7f8428536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 2024-09-22T09:09:14.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.478+0000 7f8428536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.478+0000 7f8428536800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.478+0000 7f8428536800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.478+0000 7f8428536800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39, ofs0, ns] 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.479+0000 7f82fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529727 cookie 94097790848576 notifier 8082 bl.length()=899 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.479+0000 7f82fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 info.flags=0x17 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.479+0000 7f82fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 to cache LRU end 2024-09-22T09:09:14.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.479+0000 7f82fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-22T09:09:14.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.480+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_sources= new_sources= 2024-09-22T09:09:14.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.480+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential sources added=[] removed=[] 2024-09-22T09:09:14.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.480+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): orig_dests= new_dests= 2024-09-22T09:09:14.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.480+0000 7f8428536800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[530e834e-7701-4a35-ad82-1b0744ba8777.4617.39]): potential dests added=[] removed=[] 2024-09-22T09:09:14.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.482+0000 7f8428536800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-22T09:09:14.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.484+0000 7f82dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:14.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.486+0000 7f8428536800 20 remove_watcher() i=0 2024-09-22T09:09:14.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.486+0000 7f8428536800 2 removed watcher, disabling cache 2024-09-22T09:09:14.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.487+0000 7f8428536800 20 remove_watcher() i=1 2024-09-22T09:09:14.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.489+0000 7f8428536800 20 remove_watcher() i=2 2024-09-22T09:09:14.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.490+0000 7f8428536800 20 remove_watcher() i=3 2024-09-22T09:09:14.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.491+0000 7f8428536800 20 remove_watcher() i=4 2024-09-22T09:09:14.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.493+0000 7f8428536800 20 remove_watcher() i=5 2024-09-22T09:09:14.495 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.494+0000 7f8428536800 20 remove_watcher() i=6 2024-09-22T09:09:14.496 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.495+0000 7f8428536800 20 remove_watcher() i=7 2024-09-22T09:09:14.510 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-22T09:09:14.541 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:14.541 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:14.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.585+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.586+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.586+0000 7f779452c800 20 realm 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.586+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.587+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.587+0000 7f779452c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.587+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.587+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:14.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.587+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.588+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:14.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.588+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:14.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.589+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:14.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.589+0000 7f779452c800 20 searching for the correct realm 2024-09-22T09:09:14.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.591+0000 7f7790946640 0 -- 172.21.15.39:0/2503684055 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f778404d040 msgr2=0x7f7784024930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:14.798 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:14.797+0000 7f778f944640 0 -- 172.21.15.39:0/2503684055 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f7788073980 msgr2=0x7f778809f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:15.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:15.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:15.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.003+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.004+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:15.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.004+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 zone default found 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 4 Realm: () 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 zonegroup default 2024-09-22T09:09:15.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.005+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.006+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.006+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.006+0000 7f779452c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.006+0000 7f779452c800 20 started sync module instance, tier type = 2024-09-22T09:09:15.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.006+0000 7f779452c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:15.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=0 2024-09-22T09:09:15.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=1 2024-09-22T09:09:15.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=2 2024-09-22T09:09:15.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=3 2024-09-22T09:09:15.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=4 2024-09-22T09:09:15.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=5 2024-09-22T09:09:15.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.016+0000 7f779452c800 20 add_watcher() i=6 2024-09-22T09:09:15.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.017+0000 7f779452c800 20 add_watcher() i=7 2024-09-22T09:09:15.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.017+0000 7f779452c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:15.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.019+0000 7f76467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:15.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 5 note: GC not initialized 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f76457e2640 20 reqs_thread_entry: start 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 20 Filter name: none 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f75b6ffd640 20 reqs_thread_entry: start 2024-09-22T09:09:15.022 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.020+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.021+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.021+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.021+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.021+0000 7f779452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.021+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.022+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.022+0000 7f779452c800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.022+0000 7f779452c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-22T09:09:15.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.022+0000 7f779452c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.023+0000 7f76467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.026+0000 7f779452c800 20 remove_watcher() i=0 2024-09-22T09:09:15.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.026+0000 7f779452c800 2 removed watcher, disabling cache 2024-09-22T09:09:15.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.027+0000 7f779452c800 20 remove_watcher() i=1 2024-09-22T09:09:15.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.029+0000 7f779452c800 20 remove_watcher() i=2 2024-09-22T09:09:15.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.030+0000 7f779452c800 20 remove_watcher() i=3 2024-09-22T09:09:15.032 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.031+0000 7f779452c800 20 remove_watcher() i=4 2024-09-22T09:09:15.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.032+0000 7f779452c800 20 remove_watcher() i=5 2024-09-22T09:09:15.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.033+0000 7f779452c800 20 remove_watcher() i=6 2024-09-22T09:09:15.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.034+0000 7f779452c800 20 remove_watcher() i=7 2024-09-22T09:09:15.046 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:15.046 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:09:15.047 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: abort-at-change-reshard-state id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-22T09:09:15.047 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:15.049 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:15.049 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:15.070 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:15.071 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:15.257 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:15.258 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:15.322 INFO:tasks.workunit.client.0.smithi039.stderr: test: logrecord could be stopped after reshard failed 2024-09-22T09:09:15.323 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:15.352 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:15.352 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:15.392 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.390+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 realm 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.394 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.393+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.394+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:15.395 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.394+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.395+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:15.396 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.395+0000 7f979191f800 20 searching for the correct realm 2024-09-22T09:09:15.397 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.396+0000 7f978cea1640 0 -- 172.21.15.39:0/1699639766 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f9780061040 msgr2=0x7f978008e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:15.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.400+0000 7f978d6a2640 0 -- 172.21.15.39:0/1699639766 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f9788008070 msgr2=0x7f9788061e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.405+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:15.407 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 zone default found 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 4 Realm: () 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:15.408 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 zonegroup default 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.406+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 started sync module instance, tier type = 2024-09-22T09:09:15.409 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.407+0000 7f979191f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=0 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=1 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=2 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=3 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=4 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=5 2024-09-22T09:09:15.418 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.417+0000 7f979191f800 20 add_watcher() i=6 2024-09-22T09:09:15.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.418+0000 7f979191f800 20 add_watcher() i=7 2024-09-22T09:09:15.419 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.418+0000 7f979191f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:15.421 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f96437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f979191f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f979191f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f979191f800 5 note: GC not initialized 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f96427e4640 20 reqs_thread_entry: start 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f979191f800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f979191f800 20 Filter name: none 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.420+0000 7f95b3fff640 20 reqs_thread_entry: start 2024-09-22T09:09:15.422 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:15.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:15.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.421+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.422+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.422+0000 7f979191f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.422+0000 7f979191f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.422+0000 7f979191f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.424 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.423+0000 7f96437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.426 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.426+0000 7f979191f800 20 remove_watcher() i=0 2024-09-22T09:09:15.427 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.426+0000 7f979191f800 2 removed watcher, disabling cache 2024-09-22T09:09:15.428 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.427+0000 7f979191f800 20 remove_watcher() i=1 2024-09-22T09:09:15.429 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.428+0000 7f979191f800 20 remove_watcher() i=2 2024-09-22T09:09:15.430 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.429+0000 7f979191f800 20 remove_watcher() i=3 2024-09-22T09:09:15.431 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.430+0000 7f979191f800 20 remove_watcher() i=4 2024-09-22T09:09:15.432 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.431+0000 7f979191f800 20 remove_watcher() i=5 2024-09-22T09:09:15.433 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.432+0000 7f979191f800 20 remove_watcher() i=6 2024-09-22T09:09:15.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.433+0000 7f979191f800 20 remove_watcher() i=7 2024-09-22T09:09:15.445 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:15.445 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:09:15.445 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-22T09:09:15.445 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:15.447 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:15.476 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:15.476 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:15.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.515+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 20 realm 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.517+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.518+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.519 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.518+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.519+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:15.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.519+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.519+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:15.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.519+0000 7fef54440800 20 searching for the correct realm 2024-09-22T09:09:15.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.521+0000 7fef51729640 0 -- 172.21.15.39:0/166997434 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fee1c087c90 msgr2=0x7fee1c08a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:15.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.726+0000 7fef51f2a640 0 -- 172.21.15.39:0/166997434 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fef4c090030 msgr2=0x7fef4c0b7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:15.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:15.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:15.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:15.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:15.734 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.732+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 zone default found 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 4 Realm: () 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:15.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 zonegroup default 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.733+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.734+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.734+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.734+0000 7fef54440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.734+0000 7fef54440800 20 started sync module instance, tier type = 2024-09-22T09:09:15.736 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.734+0000 7fef54440800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=0 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=1 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=2 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=3 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=4 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=5 2024-09-22T09:09:15.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.744+0000 7fef54440800 20 add_watcher() i=6 2024-09-22T09:09:15.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.745+0000 7fef54440800 20 add_watcher() i=7 2024-09-22T09:09:15.746 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.745+0000 7fef54440800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:15.748 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fee07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fef54440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fef54440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fef54440800 5 note: GC not initialized 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fee06fe5640 20 reqs_thread_entry: start 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fef54440800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.747+0000 7fef54440800 20 Filter name: none 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.748+0000 7fee04fe1640 20 reqs_thread_entry: start 2024-09-22T09:09:15.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.748+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.748+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.748+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.750 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:15.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:15.751 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.749+0000 7fef54440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:15.752 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.751+0000 7fee07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:15.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.753+0000 7fef54440800 20 remove_watcher() i=0 2024-09-22T09:09:15.754 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.753+0000 7fef54440800 2 removed watcher, disabling cache 2024-09-22T09:09:15.755 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.754+0000 7fef54440800 20 remove_watcher() i=1 2024-09-22T09:09:15.756 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.755+0000 7fef54440800 20 remove_watcher() i=2 2024-09-22T09:09:15.757 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.756+0000 7fef54440800 20 remove_watcher() i=3 2024-09-22T09:09:15.758 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.757+0000 7fef54440800 20 remove_watcher() i=4 2024-09-22T09:09:15.759 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.759+0000 7fef54440800 20 remove_watcher() i=5 2024-09-22T09:09:15.760 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.760+0000 7fef54440800 20 remove_watcher() i=6 2024-09-22T09:09:15.762 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.761+0000 7fef54440800 20 remove_watcher() i=7 2024-09-22T09:09:15.775 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-22T09:09:15.809 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:15.809 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:15.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.847+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 realm 2024-09-22T09:09:15.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.850 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:15.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:15.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:15.851 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.053+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:16.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.053+0000 7f47d3725800 20 searching for the correct realm 2024-09-22T09:09:16.056 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.054+0000 7f47cebad640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f47c0031040 msgr2=0x7f47c0031aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.259+0000 7f47cf3ae640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f47c8058070 msgr2=0x7f47c80aaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:16.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:16.269 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.265+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.270 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 zone default found 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 4 Realm: () 2024-09-22T09:09:16.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 zonegroup default 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 started sync module instance, tier type = 2024-09-22T09:09:16.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.267+0000 7f47d3725800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=0 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=1 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=2 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=3 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=4 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=5 2024-09-22T09:09:16.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=6 2024-09-22T09:09:16.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.279+0000 7f47d3725800 20 add_watcher() i=7 2024-09-22T09:09:16.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.279+0000 7f47d3725800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:16.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.281+0000 7f4685fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:16.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:16.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.281+0000 7f47d3725800 5 note: GC not initialized 2024-09-22T09:09:16.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.281+0000 7f4684fe1640 20 reqs_thread_entry: start 2024-09-22T09:09:16.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:16.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 20 Filter name: none 2024-09-22T09:09:16.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f45fe7fc640 20 reqs_thread_entry: start 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:16.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:16.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.283+0000 7f47d3725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:16.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.287+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.287+0000 7f47d3725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.287+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.287+0000 7f47d3725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:16.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529748 cookie 94569851308016 notifier 7601 bl.length()=827 2024-09-22T09:09:16.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:16.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:16.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:16.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:16.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.296 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47d3725800 time 2024-09-22T09:09:16.296656+0000 2024-09-22T09:09:16.297 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:16.297 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.297 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d4d8c748] 2024-09-22T09:09:16.297 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.297 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f47d3725800 thread_name:radosgw-admin 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.296+0000 7f47d3725800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47d3725800 time 2024-09-22T09:09:16.296656+0000 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.298 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d4d8c748] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:09:16.299 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d3a3e6f0] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d3a8b99c] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d4d8c7a2] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.314 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.297+0000 7f47d3725800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f47d3725800 thread_name:radosgw-admin 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d3a3e6f0] 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d3a8b99c] 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d4d8c7a2] 2024-09-22T09:09:16.315 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.316 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: starting msgr at 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: starting objecter 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests hook 0x5602c2552af0 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: setting wanted keys 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: calling monclient init 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.317 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.318 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key hook 0x5602c254c428 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c23f8c60 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2401c30 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2492790 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.091867s 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c23f8c60 auth_method 0 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.319 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2492790 auth_method 0 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2401c30 auth_method 0 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.320 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7592 payload 824 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: dump: 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.321 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: dump: 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.322 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:09:15.832+0000 7f47d3725800 5 monclient: authenticate success, global_id 7592 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:09:15.832+0000 7f46bd60a640 4 set_mon_vals no callback set 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:09:15.832+0000 7f47d3725800 1 librados: init done 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.323 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:09:15.834+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f46b4077570 auth_method 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:09:15.835+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c258f1b0 auth_method 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:09:15.835+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x5602c25988b0 auth_method 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:09:15.836+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c259cf50 auth_method 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:09:15.837+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x5602c259c5c0 auth_method 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:09:15.838+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.324 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.325 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:09:15.838+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602c25a8930 EEXIST 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.326 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:09:15.839+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:09:15.839+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x5602c25a3fd0 EEXIST 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.327 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c25cc620 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c25ce8f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c25cadf0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.099572s 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c25ce8f0 auth_method 0 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.328 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c25cadf0 auth_method 0 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c25cc620 auth_method 0 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.329 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7595 payload 824 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: dump: 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.330 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:09:15.840+0000 7f47d3725800 5 monclient: authenticate success, global_id 7595 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: dump: 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.331 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:09:15.840+0000 7f47d03b0640 4 set_mon_vals no callback set 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.332 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:09:15.842+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f46a8077480 auth_method 0 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: get_monmap_and_config 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:09:15.842+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.333 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.334 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:09:15.842+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.335 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:09:15.843+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.336 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:09:15.843+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:09:15.843+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdcc28ef08 EEXIST 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2620750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c2620b30 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2626280 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.103486s 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2620b30 auth_method 0 2024-09-22T09:09:16.337 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c2626280 auth_method 0 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2620750 auth_method 0 2024-09-22T09:09:16.338 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 8154 payload 274 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 1 monclient: found mon.noname-a 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: dump: 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.339 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 monclient: authenticate success, global_id 8154 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:09:15.844+0000 7f47d3725800 4 set_mon_vals no callback set 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: dump: 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.340 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: shutdown 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.341 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.342 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:09:15.844+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 librados: starting msgr at 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 librados: starting objecter 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602c2553d80 EEXIST 2024-09-22T09:09:16.343 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:09:15.845+0000 7f47d3725800 1 librados: setting wanted keys 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:09:15.845+0000 7f47d3725800 1 librados: calling monclient init 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.344 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:09:15.845+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:09:15.845+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x5602c25e4518 EEXIST 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2620750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2626280 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c261ead0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.345 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.105681s 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2626280 auth_method 0 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c261ead0 auth_method 0 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.346 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2620750 auth_method 0 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:09:15.846+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7601 payload 824 2024-09-22T09:09:16.347 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: dump: 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.348 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: dump: 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.349 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:09:15.846+0000 7f47d3725800 5 monclient: authenticate success, global_id 7601 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:09:15.846+0000 7f46b2ffd640 4 set_mon_vals no callback set 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:09:15.846+0000 7f47d3725800 1 librados: init done 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:09:15.846+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cr dump hook 0x5602c25ecb18 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:09:15.847+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.350 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:09:15.848+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f46980775f0 auth_method 0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:09:15.848+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x5602c263a540 auth_method 0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 realm 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:09:15.849+0000 7f47d3725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:09:15.849+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c263e750 auth_method 0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:09:16.051+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c263e750 auth_method 0 2024-09-22T09:09:16.351 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:09:16.052+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x5602c2641fb0 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:09:16.053+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:09:16.053+0000 7f47d3725800 20 searching for the correct realm 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:09:16.053+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f47c8058070 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:09:16.054+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c0031040 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:09:16.054+0000 7f47cebad640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f47c0031040 msgr2=0x7f47c0031aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:09:16.255+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c0031040 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:09:16.256+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x7f47c4070960 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:09:16.258+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f47c8080b00 auth_method 0 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:09:16.259+0000 7f47cf3ae640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f47c8058070 msgr2=0x7f47c80aaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:09:16.259+0000 7f46b17fa640 1 client.7601.objecter ms_handle_reset 0x7f47c8058070 session 0x7f47c8005040 osd.7 2024-09-22T09:09:16.352 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:09:16.260+0000 7f46b17fa640 10 monclient: _renew_subs 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:09:16.260+0000 7f46b17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:09:16.260+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f4698087d90 auth_method 0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:09:16.261+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c8086040 auth_method 0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.353 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 zone default found 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 Realm: () 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:09:16.266+0000 7f47d3725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 zonegroup default 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.354 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 started sync module instance, tier type = 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=0 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=1 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=2 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=3 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=4 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=5 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=6 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:09:16.279+0000 7f47d3725800 20 add_watcher() i=7 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:09:16.279+0000 7f47d3725800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.355 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.356 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:09:16.281+0000 7f4685fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:09:16.281+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache list hook 0x5602c261eef0 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache inspect hook 0x5602c261eef0 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache erase hook 0x5602c261eef0 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache zap hook 0x5602c261eef0 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 note: GC not initialized 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:09:16.281+0000 7f4684fe1640 20 reqs_thread_entry: start 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace show hook 0x7f47c8087070 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace history hook 0x7f47c8087070 2024-09-22T09:09:16.357 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace active hook 0x7f47c8087070 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace active_short hook 0x7f47c8087070 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 Filter name: none 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:09:16.282+0000 7f45fe7fc640 20 reqs_thread_entry: start 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:09:16.283+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.358 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529748 cookie 94569851308016 notifier 7601 bl.length()=827 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:16.359 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.360 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:09:16.296+0000 7f47d3725800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47d3725800 time 2024-09-22T09:09:16.296656+0000 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d4d8c748] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:09:16.361 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:09:16.297+0000 7f47d3725800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f47d3725800 thread_name:radosgw-admin 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d3a3e6f0] 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d3a8b99c] 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d4d8c7a2] 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.362 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:09:16.363 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:09:16.364 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:09:16.365 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:09:16.366 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:09:16.367 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:09:16.368 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45fe7fc640 / http_manager 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4684fe1640 / http_manager 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4685fe3640 / rgw_dt_lg_renew 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b17fa640 / ms_dispatch 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b2ffd640 / io_context_pool 2024-09-22T09:09:16.369 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b9602640 / ms_dispatch 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bbe07640 / ms_dispatch 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bd60a640 / io_context_pool 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cebad640 / msgr-worker-2 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cf3ae640 / msgr-worker-1 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cfbaf640 / msgr-worker-0 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47d03b0640 / io_context_pool 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47d3725800 / radosgw-admin 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.145720.log 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.370 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: crc 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:09:15.830+0000 7f47d3725800 5 AuthRegistry(0x5602c25516e0) adding con mode: secure 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: starting msgr at 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: starting objecter 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests hook 0x5602c2552af0 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: setting wanted keys 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:09:15.831+0000 7f47d3725800 1 librados: calling monclient init 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding auth protocol: cephx 2024-09-22T09:09:16.371 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: crc 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 AuthRegistry(0x5602c254c2e0) adding con mode: secure 2024-09-22T09:09:16.372 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:09:15.831+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:09:15.831+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key hook 0x5602c254c428 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c23f8c60 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2401c30 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2492790 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:09:15.831+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.091867s 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c23f8c60 auth_method 0 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.373 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:09:15.831+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2492790 auth_method 0 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:09:15.831+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:09:15.832+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2401c30 auth_method 0 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:09:15.832+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7592 payload 824 2024-09-22T09:09:16.374 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:09:15.832+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: dump: 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.375 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:09:15.832+0000 7f46bbe07640 10 monclient: dump: 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.376 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:09:15.832+0000 7f47d3725800 5 monclient: authenticate success, global_id 7592 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:09:15.832+0000 7f46bd60a640 4 set_mon_vals no callback set 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:09:15.832+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:09:15.832+0000 7f47d3725800 1 librados: init done 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:09:15.834+0000 7f46bbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.377 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:09:15.834+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f46b4077570 auth_method 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:09:15.835+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c258f1b0 auth_method 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:09:15.835+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x5602c25988b0 auth_method 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:09:15.836+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c259cf50 auth_method 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:09:15.837+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x5602c259c5c0 auth_method 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:09:15.838+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.378 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding auth protocol: cephx 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.379 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: crc 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a4f40) adding con mode: secure 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:09:15.838+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602c25a8930 EEXIST 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:09:15.838+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:09:15.838+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding auth protocol: cephx 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.380 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: crc 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 AuthRegistry(0x5602c25a3e88) adding con mode: secure 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:09:15.839+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.381 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:09:15.839+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:09:15.839+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x5602c25a3fd0 EEXIST 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c25cc620 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c25ce8f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c25cadf0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:09:15.839+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.099572s 2024-09-22T09:09:16.382 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c25ce8f0 auth_method 0 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c25cadf0 auth_method 0 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.383 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:09:15.839+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c25cc620 auth_method 0 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:09:15.839+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:09:15.839+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7595 payload 824 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:09:15.840+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: dump: 2024-09-22T09:09:16.384 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:09:15.840+0000 7f47d3725800 5 monclient: authenticate success, global_id 7595 2024-09-22T09:09:16.385 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:09:15.840+0000 7f46b9602640 10 monclient: dump: 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.386 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:09:15.840+0000 7f47d03b0640 4 set_mon_vals no callback set 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:09:15.840+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:09:15.842+0000 7f46b9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:09:15.842+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f46a8077480 auth_method 0 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: get_monmap_and_config 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:09:15.842+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.387 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding auth protocol: cephx 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.388 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: crc 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x5602c25ec4b0) adding con mode: secure 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:09:15.842+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:09:15.842+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding auth protocol: cephx 2024-09-22T09:09:16.389 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: crc 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:09:15.842+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28edc0) adding con mode: secure 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:09:15.843+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:09:15.843+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.390 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:09:15.843+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x7ffdcc28ef08 EEXIST 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2620750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c2620b30 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2626280 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:09:15.843+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.103486s 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2620b30 auth_method 0 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.391 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c2626280 auth_method 0 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:09:15.843+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2620750 auth_method 0 2024-09-22T09:09:16.392 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:09:15.843+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 8154 payload 274 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 1 monclient: found mon.noname-a 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:09:15.843+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: dump: 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.393 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.394 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 monclient: authenticate success, global_id 8154 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:09:15.844+0000 7f47d3725800 4 set_mon_vals no callback set 2024-09-22T09:09:16.395 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:09:15.844+0000 7f46b2ffd640 10 monclient: dump: 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.396 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: shutdown 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: build_initial_monmap 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 build_initial for_mkfs: 0 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:09:15.844+0000 7f47d3725800 10 monclient: monmap: 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:16.397 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:16.398 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding auth protocol: cephx 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.399 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: crc 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:09:15.844+0000 7f47d3725800 5 AuthRegistry(0x5602c25f0420) adding con mode: secure 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:09:15.844+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 librados: starting msgr at 2024-09-22T09:09:16.400 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:09:15.844+0000 7f47d3725800 1 librados: starting objecter 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602c2553d80 EEXIST 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:09:15.845+0000 7f47d3725800 1 librados: setting wanted keys 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:09:15.845+0000 7f47d3725800 1 librados: calling monclient init 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: init 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding auth protocol: cephx 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.401 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: crc 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 AuthRegistry(0x5602c25e43d0) adding con mode: secure 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:09:15.845+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:09:15.845+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:09:15.845+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command rotate-key cmddesc rotate-key hook 0x5602c25e4518 EEXIST 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-b con 0x5602c2620750 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-c con 0x5602c2626280 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): picked mon.noname-a con 0x5602c261ead0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.402 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:09:15.845+0000 7f47d3725800 10 monclient(hunting): authenticate will time out at 2454.105681s 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request con 0x5602c2626280 auth_method 0 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request con 0x5602c261ead0 auth_method 0 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.403 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:09:15.845+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:09:15.845+0000 7f47cf3ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): get_auth_request con 0x5602c2620750 auth_method 0 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:09:15.845+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:09:15.846+0000 7f47cebad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient(hunting): handle_auth_done global_id 7601 payload 824 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient: _finish_hunting 0 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 1 monclient: found mon.noname-c 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:09:15.846+0000 7f47cfbaf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.404 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: dump: 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.405 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: _finish_auth 0 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: _check_auth_tickets 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:09:15.846+0000 7f46b17fa640 10 monclient: dump: 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:16.406 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:09:15.846+0000 7f47d3725800 5 monclient: authenticate success, global_id 7601 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:09:15.846+0000 7f46b2ffd640 4 set_mon_vals no callback set 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _renew_subs 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:09:15.846+0000 7f47d3725800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:09:15.846+0000 7f47d3725800 1 librados: init done 2024-09-22T09:09:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:09:15.846+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cr dump hook 0x5602c25ecb18 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:09:15.847+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:09:15.848+0000 7f46b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:09:15.848+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f46980775f0 auth_method 0 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:09:15.848+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x5602c263a540 auth_method 0 2024-09-22T09:09:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 realm 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:09:15.849+0000 7f47d3725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:09:15.849+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:09:15.849+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c263e750 auth_method 0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:09:16.051+0000 7f47cebad640 10 monclient: get_auth_request con 0x5602c263e750 auth_method 0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:09:16.052+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.409 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:09:16.052+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x5602c2641fb0 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:09:16.053+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:09:16.053+0000 7f47d3725800 20 searching for the correct realm 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:09:16.053+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f47c8058070 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:09:16.054+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c0031040 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:09:16.054+0000 7f47cebad640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f47c0031040 msgr2=0x7f47c0031aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:09:16.255+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c0031040 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:09:16.256+0000 7f47cfbaf640 10 monclient: get_auth_request con 0x7f47c4070960 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:09:16.258+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f47c8080b00 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:09:16.259+0000 7f47cf3ae640 0 -- 172.21.15.39:0/1910793395 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f47c8058070 msgr2=0x7f47c80aaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:09:16.259+0000 7f46b17fa640 1 client.7601.objecter ms_handle_reset 0x7f47c8058070 session 0x7f47c8005040 osd.7 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:09:16.260+0000 7f46b17fa640 10 monclient: _renew_subs 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:09:16.260+0000 7f46b17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:09:16.260+0000 7f47cf3ae640 10 monclient: get_auth_request con 0x7f4698087d90 auth_method 0 2024-09-22T09:09:16.410 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:09:16.261+0000 7f47cebad640 10 monclient: get_auth_request con 0x7f47c8086040 auth_method 0 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:09:16.265+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 zone default found 2024-09-22T09:09:16.411 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 Realm: () 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:09:16.266+0000 7f47d3725800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:09:16.266+0000 7f47d3725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 zonegroup default 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:09:16.266+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.412 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 started sync module instance, tier type = 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:09:16.267+0000 7f47d3725800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=0 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=1 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=2 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=3 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=4 2024-09-22T09:09:16.413 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=5 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:09:16.278+0000 7f47d3725800 20 add_watcher() i=6 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:09:16.279+0000 7f47d3725800 20 add_watcher() i=7 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:09:16.279+0000 7f47d3725800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding auth protocol: cephx 2024-09-22T09:09:16.414 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: crc 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 AuthRegistry(0x7ffdcc28f290) adding con mode: secure 2024-09-22T09:09:16.415 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:09:16.281+0000 7f4685fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:09:16.281+0000 7f47d3725800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:09:16.281+0000 7f47d3725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache list hook 0x5602c261eef0 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache inspect hook 0x5602c261eef0 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache erase hook 0x5602c261eef0 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command cache zap hook 0x5602c261eef0 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 note: GC not initialized 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:09:16.281+0000 7f4684fe1640 20 reqs_thread_entry: start 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace show hook 0x7f47c8087070 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace history hook 0x7f47c8087070 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace active hook 0x7f47c8087070 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:09:16.281+0000 7f47d3725800 5 asok(0x5602c232b0f0) register_command sync trace active_short hook 0x7f47c8087070 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:16.416 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 Filter name: none 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:09:16.282+0000 7f45fe7fc640 20 reqs_thread_entry: start 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:09:16.282+0000 7f47d3725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:09:16.282+0000 7f47d3725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:09:16.283+0000 7f47d3725800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.417 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:09:16.283+0000 7f47d3725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:09:16.287+0000 7f47d3725800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529748 cookie 94569851308016 notifier 7601 bl.length()=827 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:09:16.288+0000 7f46b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:09:16.289+0000 7f47d3725800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.418 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.1 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.2 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.3 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:09:16.292+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:09:16.292+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:09:16.293+0000 7f47d3725800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:09:16.293+0000 7f47d3725800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:09:16.296+0000 7f47d3725800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47d3725800 time 2024-09-22T09:09:16.296656+0000 2024-09-22T09:09:16.419 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d4d8c748] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:09:16.297+0000 7f47d3725800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f47d3725800 thread_name:radosgw-admin 2024-09-22T09:09:16.420 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d3a3e6f0] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d3a8b99c] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d4d8c7a2] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f47d4d8c906] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5602c1385e01] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5602c1394e9b] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5602c1395d64] 2024-09-22T09:09:16.421 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f47d3a29590] 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:09:16.422 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:09:16.423 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:09:16.424 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:09:16.425 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:09:16.426 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:09:16.427 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 7f45fe7fc640 / http_manager 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4684fe1640 / http_manager 2024-09-22T09:09:16.428 INFO:tasks.workunit.client.0.smithi039.stderr: 7f4685fe3640 / rgw_dt_lg_renew 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b17fa640 / ms_dispatch 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b2ffd640 / io_context_pool 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46b9602640 / ms_dispatch 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bbe07640 / ms_dispatch 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f46bd60a640 / io_context_pool 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cebad640 / msgr-worker-2 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cf3ae640 / msgr-worker-1 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47cfbaf640 / msgr-worker-0 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47d03b0640 / io_context_pool 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: 7f47d3725800 / radosgw-admin 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:09:16.298318Z_ff380375-7054-49da-93bb-37f44bfab9d0/log 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:09:16.429 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.376+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 realm 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.434 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.378+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.379+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.379+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.380+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.380+0000 7f683b615800 20 searching for the correct realm 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.383+0000 7f6837593640 0 -- 172.21.15.39:0/483003477 >> [v2:172.21.15.39:6816/2957971359,v1:172.21.15.39:6817/2957971359] conn(0x557ee96537c0 msgr2=0x557ee9655bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.386+0000 7f6836591640 0 -- 172.21.15.39:0/483003477 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f683003b920 msgr2=0x7f6830048410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:16.435 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.391+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 zone default found 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 4 Realm: () 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:16.436 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 zonegroup default 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.392+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.393+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.393+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.393+0000 7f683b615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.393+0000 7f683b615800 20 started sync module instance, tier type = 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.393+0000 7f683b615800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=0 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=1 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=2 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=3 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=4 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=5 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.402+0000 7f683b615800 20 add_watcher() i=6 2024-09-22T09:09:16.437 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.403+0000 7f683b615800 20 add_watcher() i=7 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.403+0000 7f683b615800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.405+0000 7f66ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 5 note: GC not initialized 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f6667fff640 20 reqs_thread_entry: start 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 20 Filter name: none 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f6665ffb640 20 reqs_thread_entry: start 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.406+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.407+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.407+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:16.438 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.408+0000 7f683b615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.410+0000 7f66ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.412+0000 7f683b615800 20 remove_watcher() i=0 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.412+0000 7f683b615800 2 removed watcher, disabling cache 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.413+0000 7f683b615800 20 remove_watcher() i=1 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.414+0000 7f683b615800 20 remove_watcher() i=2 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.415+0000 7f683b615800 20 remove_watcher() i=3 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.417+0000 7f683b615800 20 remove_watcher() i=4 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.418+0000 7f683b615800 20 remove_watcher() i=5 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.419+0000 7f683b615800 20 remove_watcher() i=6 2024-09-22T09:09:16.439 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.420+0000 7f683b615800 20 remove_watcher() i=7 2024-09-22T09:09:16.440 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:16.440 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:16.469 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:09:16.498 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:16.498 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:16.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.537+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.538+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.538+0000 7f1aadd26800 20 realm 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.538+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.539+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.539+0000 7f1aadd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.539+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.539+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.540 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.539+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.540+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.540+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.540+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:16.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.540+0000 7f1aadd26800 20 searching for the correct realm 2024-09-22T09:09:16.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.542+0000 7f1aaa1da640 0 -- 172.21.15.39:0/1693462229 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f1aa003bba0 msgr2=0x7f1aa0008930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:16.749 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.748+0000 7f1aa91d8640 0 -- 172.21.15.39:0/1693462229 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f1aa40ad4f0 msgr2=0x7f1aa40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.954+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 zone default found 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 4 Realm: () 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 zonegroup default 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.955+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:16.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 started sync module instance, tier type = 2024-09-22T09:09:16.959 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.956+0000 7f1aadd26800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=0 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=1 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=2 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=3 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=4 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=5 2024-09-22T09:09:16.968 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.967+0000 7f1aadd26800 20 add_watcher() i=6 2024-09-22T09:09:16.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.968+0000 7f1aadd26800 20 add_watcher() i=7 2024-09-22T09:09:16.969 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.968+0000 7f1aadd26800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:16.971 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f195b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f1aadd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f1aadd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f1aadd26800 5 note: GC not initialized 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f195a7fc640 20 reqs_thread_entry: start 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f1aadd26800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.970+0000 7f1aadd26800 20 Filter name: none 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f18cbfff640 20 reqs_thread_entry: start 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:16.972 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.971+0000 7f1aadd26800 20 rados->read ofs=0 len=0 2024-09-22T09:09:16.973 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.972+0000 7f1aadd26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:16.974 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.973+0000 7f1aadd26800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.973+0000 7f1aadd26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:16.975 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.974+0000 7f195b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:16.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.976+0000 7f1aadd26800 20 remove_watcher() i=0 2024-09-22T09:09:16.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.976+0000 7f1aadd26800 2 removed watcher, disabling cache 2024-09-22T09:09:16.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.978+0000 7f1aadd26800 20 remove_watcher() i=1 2024-09-22T09:09:16.980 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.979+0000 7f1aadd26800 20 remove_watcher() i=2 2024-09-22T09:09:16.981 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.980+0000 7f1aadd26800 20 remove_watcher() i=3 2024-09-22T09:09:16.982 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.981+0000 7f1aadd26800 20 remove_watcher() i=4 2024-09-22T09:09:16.984 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.983+0000 7f1aadd26800 20 remove_watcher() i=5 2024-09-22T09:09:16.986 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.985+0000 7f1aadd26800 20 remove_watcher() i=6 2024-09-22T09:09:16.987 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:16.986+0000 7f1aadd26800 20 remove_watcher() i=7 2024-09-22T09:09:47.013 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:47.047 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:47.047 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:47.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.091+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 realm 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.093+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.094+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:47.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.094+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.095+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:47.097 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.095+0000 7f89bea12800 20 searching for the correct realm 2024-09-22T09:09:47.099 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.098+0000 7f89ba8cc640 0 -- 172.21.15.39:0/4152092537 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f89a401f060 msgr2=0x7f89a407c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:47.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.305+0000 7f89b98ca640 0 -- 172.21.15.39:0/4152092537 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f89b40338b0 msgr2=0x7f89b40253a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:47.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:47.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:47.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:47.514 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:47.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:47.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.512+0000 7f89bea12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:47.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.513+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.513+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.515 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.513+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.513+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.513+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 zone default found 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 4 Realm: () 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:47.516 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 zonegroup default 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.514+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.515+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.515+0000 7f89bea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.515+0000 7f89bea12800 20 started sync module instance, tier type = 2024-09-22T09:09:47.517 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.515+0000 7f89bea12800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=0 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=1 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=2 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=3 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=4 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=5 2024-09-22T09:09:47.530 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.529+0000 7f89bea12800 20 add_watcher() i=6 2024-09-22T09:09:47.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.530+0000 7f89bea12800 20 add_watcher() i=7 2024-09-22T09:09:47.531 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.530+0000 7f89bea12800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:47.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.532+0000 7f8870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 5 note: GC not initialized 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f87eb7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:47.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 20 Filter name: none 2024-09-22T09:09:47.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f87e97fa640 20 reqs_thread_entry: start 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.533+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.534+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.534+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.534+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.534+0000 7f89bea12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:47.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.534+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.535+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.535+0000 7f89bea12800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.535+0000 7f89bea12800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:47.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.535+0000 7f89bea12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:47.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.537+0000 7f8870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:47.541 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.540+0000 7f89bea12800 20 remove_watcher() i=0 2024-09-22T09:09:47.542 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.540+0000 7f89bea12800 2 removed watcher, disabling cache 2024-09-22T09:09:47.543 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.542+0000 7f89bea12800 20 remove_watcher() i=1 2024-09-22T09:09:47.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.543+0000 7f89bea12800 20 remove_watcher() i=2 2024-09-22T09:09:47.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.545+0000 7f89bea12800 20 remove_watcher() i=3 2024-09-22T09:09:47.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.547+0000 7f89bea12800 20 remove_watcher() i=4 2024-09-22T09:09:47.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.548+0000 7f89bea12800 20 remove_watcher() i=5 2024-09-22T09:09:47.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.550+0000 7f89bea12800 20 remove_watcher() i=6 2024-09-22T09:09:47.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.551+0000 7f89bea12800 20 remove_watcher() i=7 2024-09-22T09:09:47.568 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:47.568 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:47.639 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:09:47.670 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:47.670 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:47.710 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.709+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.711 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 realm 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.710+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.712 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.711+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:47.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.711+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:47.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.712+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:47.713 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.712+0000 7fb345020800 20 searching for the correct realm 2024-09-22T09:09:47.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.714+0000 7fb343312640 0 -- 172.21.15.39:0/1033338726 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb338001130 msgr2=0x7fb338067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:47.921 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:47.920+0000 7fb342310640 0 -- 172.21.15.39:0/1033338726 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb33c0c8700 msgr2=0x7fb33c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:48.129 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.127+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.130 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 zone default found 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 4 Realm: () 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 zonegroup default 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.131 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.128+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.129+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.129+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.129+0000 7fb345020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.129+0000 7fb345020800 20 started sync module instance, tier type = 2024-09-22T09:09:48.132 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.129+0000 7fb345020800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=0 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=1 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=2 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=3 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=4 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=5 2024-09-22T09:09:48.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.139+0000 7fb345020800 20 add_watcher() i=6 2024-09-22T09:09:48.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.140+0000 7fb345020800 20 add_watcher() i=7 2024-09-22T09:09:48.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.140+0000 7fb345020800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:48.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.142+0000 7fb1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.142+0000 7fb345020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.142+0000 7fb345020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.142+0000 7fb345020800 5 note: GC not initialized 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb173fff640 20 reqs_thread_entry: start 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:48.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 20 Filter name: none 2024-09-22T09:09:48.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb171ffb640 20 reqs_thread_entry: start 2024-09-22T09:09:48.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:48.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:48.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:48.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.143+0000 7fb345020800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:48.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.144+0000 7fb345020800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.145+0000 7fb345020800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.145+0000 7fb345020800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.145+0000 7fb345020800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.145+0000 7fb345020800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:48.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.146+0000 7fb1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:48.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.149+0000 7fb345020800 20 remove_watcher() i=0 2024-09-22T09:09:48.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.149+0000 7fb345020800 2 removed watcher, disabling cache 2024-09-22T09:09:48.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.150+0000 7fb345020800 20 remove_watcher() i=1 2024-09-22T09:09:48.152 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.151+0000 7fb345020800 20 remove_watcher() i=2 2024-09-22T09:09:48.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.152+0000 7fb345020800 20 remove_watcher() i=3 2024-09-22T09:09:48.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.154+0000 7fb345020800 20 remove_watcher() i=4 2024-09-22T09:09:48.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.155+0000 7fb345020800 20 remove_watcher() i=5 2024-09-22T09:09:48.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.156+0000 7fb345020800 20 remove_watcher() i=6 2024-09-22T09:09:48.158 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.157+0000 7fb345020800 20 remove_watcher() i=7 2024-09-22T09:09:48.171 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:48.201 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:48.201 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:48.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.239+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 realm 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:48.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.242+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.243+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:48.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.243+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.244+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:48.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.244+0000 7f09b2b2e800 20 searching for the correct realm 2024-09-22T09:09:48.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.247+0000 7f09af0de640 0 -- 172.21.15.39:0/714951147 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f09a402a060 msgr2=0x7f09a4009a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:48.455 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.453+0000 7f09ae0dc640 0 -- 172.21.15.39:0/714951147 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f09a80a6940 msgr2=0x7f09a807b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:48.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.660+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 zone default found 2024-09-22T09:09:48.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 4 Realm: () 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 zonegroup default 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.661+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.662+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.662+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.662+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.662+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.664 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.663+0000 7f09b2b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.663+0000 7f09b2b2e800 20 started sync module instance, tier type = 2024-09-22T09:09:48.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.663+0000 7f09b2b2e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=0 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=1 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=2 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=3 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=4 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=5 2024-09-22T09:09:48.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.673+0000 7f09b2b2e800 20 add_watcher() i=6 2024-09-22T09:09:48.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.674+0000 7f09b2b2e800 20 add_watcher() i=7 2024-09-22T09:09:48.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.674+0000 7f09b2b2e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:48.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f08657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f09b2b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f09b2b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f09b2b2e800 5 note: GC not initialized 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f07dffff640 20 reqs_thread_entry: start 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.676+0000 7f09b2b2e800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.677+0000 7f09b2b2e800 20 Filter name: none 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.677+0000 7f07ddffb640 20 reqs_thread_entry: start 2024-09-22T09:09:48.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.677+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.677+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.677+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.678+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.678+0000 7f09b2b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.678+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.678+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:48.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.678+0000 7f09b2b2e800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.679+0000 7f09b2b2e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:48.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.679+0000 7f09b2b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:48.681 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.680+0000 7f08657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:48.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.683+0000 7f09b2b2e800 20 remove_watcher() i=0 2024-09-22T09:09:48.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.683+0000 7f09b2b2e800 2 removed watcher, disabling cache 2024-09-22T09:09:48.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.684+0000 7f09b2b2e800 20 remove_watcher() i=1 2024-09-22T09:09:48.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.685+0000 7f09b2b2e800 20 remove_watcher() i=2 2024-09-22T09:09:48.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.686+0000 7f09b2b2e800 20 remove_watcher() i=3 2024-09-22T09:09:48.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.687+0000 7f09b2b2e800 20 remove_watcher() i=4 2024-09-22T09:09:48.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.688+0000 7f09b2b2e800 20 remove_watcher() i=5 2024-09-22T09:09:48.690 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.689+0000 7f09b2b2e800 20 remove_watcher() i=6 2024-09-22T09:09:48.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.691+0000 7f09b2b2e800 20 remove_watcher() i=7 2024-09-22T09:09:48.703 INFO:tasks.workunit.client.0.smithi039.stderr: test: duplicated entries should be purged before reshard 2024-09-22T09:09:48.705 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:48.735 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:48.735 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:48.775 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.774+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.776+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.776+0000 7f986342f800 20 realm 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.776+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.777+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.777+0000 7f986342f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.777+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.777+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:48.778 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.777+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.778+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:48.779 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.778+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:48.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.779+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:48.780 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.779+0000 7f986342f800 20 searching for the correct realm 2024-09-22T09:09:48.782 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.781+0000 7f986171a640 0 -- 172.21.15.39:0/1236738789 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f985406d070 msgr2=0x7f98540a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:09:48.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:48.988+0000 7f9860718640 0 -- 172.21.15.39:0/1236738789 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f98580483f0 msgr2=0x7f9858048850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.195+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.197 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 zone default found 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 4 Realm: () 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 zonegroup default 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.196+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.197+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.199 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.197+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.197+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.197+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.198+0000 7f986342f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.198+0000 7f986342f800 20 started sync module instance, tier type = 2024-09-22T09:09:49.200 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.198+0000 7f986342f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=0 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=1 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=2 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=3 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=4 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=5 2024-09-22T09:09:49.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.208+0000 7f986342f800 20 add_watcher() i=6 2024-09-22T09:09:49.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.209+0000 7f986342f800 20 add_watcher() i=7 2024-09-22T09:09:49.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.209+0000 7f986342f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:49.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.211+0000 7f97177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.211+0000 7f986342f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.211+0000 7f986342f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f986342f800 5 note: GC not initialized 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f97167e4640 20 reqs_thread_entry: start 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f986342f800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f986342f800 20 Filter name: none 2024-09-22T09:09:49.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f970f7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.212+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.213+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.213+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.213+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:49.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.213+0000 7f986342f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:49.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.213+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.214+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:49.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.214+0000 7f986342f800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.214+0000 7f986342f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:49.215 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.214+0000 7f986342f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:49.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.215+0000 7f97177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:49.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.218+0000 7f986342f800 20 remove_watcher() i=0 2024-09-22T09:09:49.219 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.218+0000 7f986342f800 2 removed watcher, disabling cache 2024-09-22T09:09:49.220 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.219+0000 7f986342f800 20 remove_watcher() i=1 2024-09-22T09:09:49.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.220+0000 7f986342f800 20 remove_watcher() i=2 2024-09-22T09:09:49.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.221+0000 7f986342f800 20 remove_watcher() i=3 2024-09-22T09:09:49.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.223+0000 7f986342f800 20 remove_watcher() i=4 2024-09-22T09:09:49.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.224+0000 7f986342f800 20 remove_watcher() i=5 2024-09-22T09:09:49.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.225+0000 7f986342f800 20 remove_watcher() i=6 2024-09-22T09:09:49.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.226+0000 7f986342f800 20 remove_watcher() i=7 2024-09-22T09:09:49.238 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.238 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:09:49.238 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-22T09:09:49.239 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.240 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T09:09:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:49.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.314+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 realm 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.317+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:49.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.317+0000 7f64ee726800 20 searching for the correct realm 2024-09-22T09:09:49.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.320+0000 7f64ea3d9640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f64e4030060 msgr2=0x7f64e4066540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.324+0000 7f64e9bd8640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f64e4070cc0 msgr2=0x7f64e4070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:49.532 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.533 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 zone default found 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 4 Realm: () 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:49.534 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 zonegroup default 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.533+0000 7f64ee726800 20 started sync module instance, tier type = 2024-09-22T09:09:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.533+0000 7f64ee726800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=0 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=1 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=2 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=3 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=4 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=5 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=6 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=7 2024-09-22T09:09:49.544 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.543+0000 7f64ee726800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:49.546 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.545+0000 7f63a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.545+0000 7f64ee726800 5 note: GC not initialized 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f631b7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f64ee726800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f64ee726800 20 Filter name: none 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f63197fa640 20 reqs_thread_entry: start 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:49.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.546+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:49.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.549 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.547+0000 7f64ee726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:49.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.551+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.551+0000 7f64ee726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.551+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.551+0000 7f64ee726800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94624243419408 notifier 7718 bl.length()=827 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:49.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:49.557 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f64ee726800 time 2024-09-22T09:09:49.557261+0000 2024-09-22T09:09:49.557 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f64efd8c748] 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f64ee726800 thread_name:radosgw-admin 2024-09-22T09:09:49.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.557+0000 7f64ee726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f64ee726800 time 2024-09-22T09:09:49.557261+0000 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f64efd8c748] 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:09:49.559 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.574 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f64eea3e6f0] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f64eea8b99c] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f64efd8c7a2] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:09:49.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.557+0000 7f64ee726800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f64ee726800 thread_name:radosgw-admin 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f64eea3e6f0] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f64eea8b99c] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f64efd8c7a2] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.576 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: dump: 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.577 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: dump: 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.578 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:09:49.295+0000 7f64ee726800 5 monclient: authenticate success, global_id 8274 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:09:49.295+0000 7f64ee726800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:09:49.295+0000 7f64ee726800 4 set_mon_vals no callback set 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: shutdown 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 asok(0x560f6c3870f0) unregister_commands rotate-key 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.579 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.580 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:09:49.296+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: starting msgr at 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: starting objecter 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests hook 0x560f6c5abf80 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: setting wanted keys 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: calling monclient init 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.581 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:09:49.297+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.582 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:09:49.297+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:09:49.297+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key hook 0x560f6c5a8578 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c4547f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c4eaf60 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c4ee290 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.557441s 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c4547f0 auth_method 0 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.583 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c4eaf60 auth_method 0 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 1 monclient: found mon.noname-a 2024-09-22T09:09:49.584 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: dump: 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.585 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:09:49.298+0000 7f64ee726800 5 monclient: authenticate success, global_id 8277 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: dump: 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.586 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:09:49.298+0000 7f63d8608640 4 set_mon_vals no callback set 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:09:49.298+0000 7f64ee726800 1 librados: init done 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:09:49.300+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63d00775a0 auth_method 0 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:09:49.300+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c5d0590 auth_method 0 2024-09-22T09:09:49.587 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:09:49.301+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x560f6c5f3660 auth_method 0 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:09:49.302+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x560f6c5f7d00 auth_method 0 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:09:49.303+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c5fbbd0 auth_method 0 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:09:49.304+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.588 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.589 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:09:49.304+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests cmddesc objecter_requests hook 0x560f6c603100 EEXIST 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.590 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:09:49.304+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:09:49.305+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:09:49.305+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x560f6c5fed70 EEXIST 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c627420 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c627800 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c626130 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.591 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.565178s 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): get_auth_request con 0x560f6c627800 auth_method 0 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c627420 auth_method 0 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.592 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c626130 auth_method 0 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_done global_id 7712 payload 824 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:09:49.305+0000 7f64eabda640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: dump: 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.593 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: dump: 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.594 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:09:49.305+0000 7f64ee726800 5 monclient: authenticate success, global_id 7712 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:09:49.305+0000 7f64eb3db640 4 set_mon_vals no callback set 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:09:49.306+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:09:49.306+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.595 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:09:49.308+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63c4077480 auth_method 0 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: get_monmap_and_config 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:09:49.308+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.597 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:09:49.308+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.598 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:09:49.309+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:09:49.309+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x7fffe995c848 EEXIST 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c674c20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c64b610 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c67ba20 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.599 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.569531s 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c674c20 auth_method 0 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c67ba20 auth_method 0 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.600 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_done global_id 7715 payload 274 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:09:49.309+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c64b610 auth_method 0 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: dump: 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.601 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 monclient: authenticate success, global_id 7715 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:09:49.310+0000 7f64ee726800 4 set_mon_vals no callback set 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: dump: 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.602 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: shutdown 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:09:49.310+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.603 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.604 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: starting msgr at 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: starting objecter 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests cmddesc objecter_requests hook 0x560f6c629270 EEXIST 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: setting wanted keys 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: calling monclient init 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.605 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.606 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x560f6c63be28 EEXIST 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c64b610 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c674c20 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c67ba20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.571975s 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c67ba20 auth_method 0 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.607 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): get_auth_request con 0x560f6c674c20 auth_method 0 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c64b610 auth_method 0 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.608 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: dump: 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.609 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: dump: 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.610 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:09:49.312+0000 7f63cdffb640 4 set_mon_vals no callback set 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:09:49.312+0000 7f64ee726800 5 monclient: authenticate success, global_id 7718 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:09:49.312+0000 7f64ee726800 1 librados: init done 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:09:49.312+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cr dump hook 0x560f6c679e38 2024-09-22T09:09:49.611 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:09:49.314+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:09:49.314+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63b4077570 auth_method 0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:09:49.315+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c6965e0 auth_method 0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 realm 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:09:49.315+0000 7f64ee726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:09:49.316+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x560f6c69a820 auth_method 0 2024-09-22T09:09:49.612 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:09:49.317+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c69e080 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:09:49.317+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:09:49.317+0000 7f64ee726800 20 searching for the correct realm 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:09:49.318+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f64e4030060 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:09:49.318+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64dc063030 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:09:49.319+0000 7f64eabda640 10 monclient: get_auth_request con 0x7f64e0009040 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:09:49.320+0000 7f64ea3d9640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f64e4030060 msgr2=0x7f64e4066540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:09:49.320+0000 7f63bbfff640 1 client.7718.objecter ms_handle_reset 0x7f64e4030060 session 0x7f64e4067870 osd.7 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:09:49.320+0000 7f63bbfff640 10 monclient: _renew_subs 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:09:49.320+0000 7f63bbfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:09:49.320+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f63b4087c90 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:09:49.321+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f64e4067ad0 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:09:49.323+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64e4070cc0 auth_method 0 2024-09-22T09:09:49.613 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:09:49.324+0000 7f64e9bd8640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f64e4070cc0 msgr2=0x7f64e4070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:09:49.525+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64e4070cc0 auth_method 0 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:49.614 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 zone default found 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 Realm: () 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:09:49.532+0000 7f64ee726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 zonegroup default 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 started sync module instance, tier type = 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=0 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=1 2024-09-22T09:09:49.615 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=2 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=3 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=4 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=5 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=6 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=7 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:09:49.543+0000 7f64ee726800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.616 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:09:49.545+0000 7f63a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:09:49.545+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache list hook 0x560f6c679020 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache inspect hook 0x560f6c679020 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache erase hook 0x560f6c679020 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache zap hook 0x560f6c679020 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 note: GC not initialized 2024-09-22T09:09:49.617 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:09:49.546+0000 7f631b7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace show hook 0x7f64e00227e0 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace history hook 0x7f64e00227e0 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace active hook 0x7f64e00227e0 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace active_short hook 0x7f64e00227e0 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 Filter name: none 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:09:49.546+0000 7f63197fa640 20 reqs_thread_entry: start 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:09:49.546+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:49.618 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94624243419408 notifier 7718 bl.length()=827 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.619 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:09:49.557+0000 7f64ee726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f64ee726800 time 2024-09-22T09:09:49.557261+0000 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f64efd8c748] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.620 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:09:49.557+0000 7f64ee726800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f64ee726800 thread_name:radosgw-admin 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f64eea3e6f0] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f64eea8b99c] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f64efd8c7a2] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.621 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:09:49.622 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:09:49.623 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:09:49.624 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:09:49.625 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:09:49.626 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:09:49.627 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:09:49.628 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63197fa640 / http_manager 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f631b7fe640 / http_manager 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63a0fe1640 / rgw_dt_lg_renew 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63bbfff640 / ms_dispatch 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63cdffb640 / io_context_pool 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63cffff640 / ms_dispatch 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63d6e05640 / ms_dispatch 2024-09-22T09:09:49.629 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63d8608640 / io_context_pool 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64e9bd8640 / msgr-worker-2 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64ea3d9640 / msgr-worker-1 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64eabda640 / msgr-worker-0 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64eb3db640 / io_context_pool 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64ee726800 / radosgw-admin 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.149843.log 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:09:49.630 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: dump: 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.631 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:09:49.295+0000 7f63d8608640 10 monclient: dump: 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:09:49.295+0000 7f64ee726800 5 monclient: authenticate success, global_id 8274 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:09:49.295+0000 7f64ee726800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:49.632 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:09:49.295+0000 7f64ee726800 4 set_mon_vals no callback set 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: shutdown 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 asok(0x560f6c3870f0) unregister_commands rotate-key 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.633 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding auth protocol: cephx 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.634 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: crc 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ada40) adding con mode: secure 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:09:49.296+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: starting msgr at 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: starting objecter 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests hook 0x560f6c5abf80 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: setting wanted keys 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:09:49.296+0000 7f64ee726800 1 librados: calling monclient init 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:09:49.296+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding auth protocol: cephx 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.635 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: crc 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:09:49.296+0000 7f64ee726800 5 AuthRegistry(0x560f6c5a8430) adding con mode: secure 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:09:49.297+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:09:49.297+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:09:49.297+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key hook 0x560f6c5a8578 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c4547f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c4eaf60 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c4ee290 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:09:49.297+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.557441s 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c4547f0 auth_method 0 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c4eaf60 auth_method 0 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.637 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:09:49.297+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 1 monclient: found mon.noname-a 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:09:49.297+0000 7f64ea3d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: dump: 2024-09-22T09:09:49.638 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:09:49.298+0000 7f64ee726800 5 monclient: authenticate success, global_id 8277 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.639 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:09:49.298+0000 7f63d6e05640 10 monclient: dump: 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:09:49.298+0000 7f63d8608640 4 set_mon_vals no callback set 2024-09-22T09:09:49.640 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:09:49.298+0000 7f64ee726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:09:49.298+0000 7f64ee726800 1 librados: init done 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:09:49.300+0000 7f63d6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:09:49.300+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63d00775a0 auth_method 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:09:49.300+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c5d0590 auth_method 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:09:49.301+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x560f6c5f3660 auth_method 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:09:49.302+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x560f6c5f7d00 auth_method 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:09:49.303+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c5fbbd0 auth_method 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:09:49.304+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.641 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding auth protocol: cephx 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.642 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: crc 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5ffd30) adding con mode: secure 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:09:49.304+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests cmddesc objecter_requests hook 0x560f6c603100 EEXIST 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:09:49.304+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.643 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding auth protocol: cephx 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: crc 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:09:49.304+0000 7f64ee726800 5 AuthRegistry(0x560f6c5fec28) adding con mode: secure 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:09:49.304+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:09:49.305+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.644 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:09:49.305+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x560f6c5fed70 EEXIST 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c627420 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c627800 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c626130 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.565178s 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): get_auth_request con 0x560f6c627800 auth_method 0 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.645 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c627420 auth_method 0 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:09:49.305+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c626130 auth_method 0 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:09:49.305+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.646 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient(hunting): handle_auth_done global_id 7712 payload 824 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:09:49.305+0000 7f64eabda640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:09:49.305+0000 7f64eabda640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: dump: 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.647 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:09:49.305+0000 7f63cffff640 10 monclient: dump: 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.648 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:09:49.305+0000 7f64ee726800 5 monclient: authenticate success, global_id 7712 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:09:49.305+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:09:49.305+0000 7f64eb3db640 4 set_mon_vals no callback set 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:09:49.306+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:09:49.306+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:09:49.308+0000 7f63cffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:09:49.308+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63c4077480 auth_method 0 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: get_monmap_and_config 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.649 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:09:49.308+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:09:49.308+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.650 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding auth protocol: cephx 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: crc 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:09:49.308+0000 7f64ee726800 5 AuthRegistry(0x560f6c647150) adding con mode: secure 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:09:49.308+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.651 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding auth protocol: cephx 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: crc 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 AuthRegistry(0x7fffe995c700) adding con mode: secure 2024-09-22T09:09:49.652 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:09:49.309+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:09:49.309+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:09:49.309+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x7fffe995c848 EEXIST 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c674c20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c64b610 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c67ba20 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:09:49.309+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.569531s 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c674c20 auth_method 0 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.653 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c67ba20 auth_method 0 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:09:49.309+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_done global_id 7715 payload 274 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.654 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:09:49.309+0000 7f64e9bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:09:49.309+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c64b610 auth_method 0 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: dump: 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.655 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 monclient: authenticate success, global_id 7715 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: get_monmap_and_config success 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:09:49.310+0000 7f64ee726800 4 set_mon_vals no callback set 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:09:49.310+0000 7f63cdffb640 10 monclient: dump: 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.656 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: shutdown 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: build_initial_monmap 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:09:49.310+0000 7f64ee726800 1 build_initial for_mkfs: 0 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:09:49.310+0000 7f64ee726800 10 monclient: monmap: 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.657 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding auth protocol: cephx 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:09:49.310+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.658 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: crc 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c648aa0) adding con mode: secure 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: starting msgr at 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: starting objecter 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command objecter_requests cmddesc objecter_requests hook 0x560f6c629270 EEXIST 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: setting wanted keys 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:09:49.311+0000 7f64ee726800 1 librados: calling monclient init 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: init 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding auth protocol: cephx 2024-09-22T09:09:49.659 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: crc 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 AuthRegistry(0x560f6c63bce0) adding con mode: secure 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:09:49.311+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:09:49.311+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command rotate-key cmddesc rotate-key hook 0x560f6c63be28 EEXIST 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: _reopen_session rank -1 2024-09-22T09:09:49.660 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-b con 0x560f6c64b610 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-a con 0x560f6c674c20 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): picked mon.noname-c con 0x560f6c67ba20 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): start opening mon connection 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): _renew_subs 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:09:49.311+0000 7f64ee726800 10 monclient(hunting): authenticate will time out at 2487.571975s 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request con 0x560f6c67ba20 auth_method 0 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): get_auth_request con 0x560f6c674c20 auth_method 0 2024-09-22T09:09:49.661 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request con 0x560f6c64b610 auth_method 0 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:09:49.312+0000 7f64eabda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:09:49.662 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:09:49.312+0000 7f64e9bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient: _finish_hunting 0 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 1 monclient: found mon.noname-c 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:09:49.312+0000 7f64ea3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: dump: 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: _finish_auth 0 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: _check_auth_tickets 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_config config(0 keys) 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:09:49.312+0000 7f63bbfff640 10 monclient: dump: 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:09:49.664 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:09:49.312+0000 7f63cdffb640 4 set_mon_vals no callback set 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:09:49.312+0000 7f64ee726800 5 monclient: authenticate success, global_id 7718 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _renew_subs 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:09:49.312+0000 7f64ee726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:09:49.312+0000 7f64ee726800 1 librados: init done 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:09:49.312+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cr dump hook 0x560f6c679e38 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:09:49.314+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.665 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:09:49.314+0000 7f63bbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:09:49.314+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f63b4077570 auth_method 0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:09:49.315+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c6965e0 auth_method 0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 realm 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:09:49.315+0000 7f64ee726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:09:49.315+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:09:49.316+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x560f6c69a820 auth_method 0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:09:49.316+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:09:49.317+0000 7f64eabda640 10 monclient: get_auth_request con 0x560f6c69e080 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:09:49.317+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:09:49.317+0000 7f64ee726800 20 searching for the correct realm 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:09:49.318+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f64e4030060 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:09:49.318+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64dc063030 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:09:49.319+0000 7f64eabda640 10 monclient: get_auth_request con 0x7f64e0009040 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:09:49.320+0000 7f64ea3d9640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f64e4030060 msgr2=0x7f64e4066540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:09:49.320+0000 7f63bbfff640 1 client.7718.objecter ms_handle_reset 0x7f64e4030060 session 0x7f64e4067870 osd.7 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:09:49.320+0000 7f63bbfff640 10 monclient: _renew_subs 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:09:49.320+0000 7f63bbfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:09:49.320+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f63b4087c90 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:09:49.321+0000 7f64ea3d9640 10 monclient: get_auth_request con 0x7f64e4067ad0 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:09:49.323+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64e4070cc0 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:09:49.324+0000 7f64e9bd8640 0 -- 172.21.15.39:0/390578130 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f64e4070cc0 msgr2=0x7f64e4070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:09:49.525+0000 7f64e9bd8640 10 monclient: get_auth_request con 0x7f64e4070cc0 auth_method 0 2024-09-22T09:09:49.667 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:09:49.531+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 zone default found 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 Realm: () 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:49.668 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:09:49.532+0000 7f64ee726800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:09:49.532+0000 7f64ee726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 zonegroup default 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:09:49.532+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 started sync module instance, tier type = 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:09:49.533+0000 7f64ee726800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=0 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=1 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=2 2024-09-22T09:09:49.669 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=3 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=4 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=5 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=6 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:09:49.543+0000 7f64ee726800 20 add_watcher() i=7 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:09:49.543+0000 7f64ee726800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding auth protocol: cephx 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.670 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: crc 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 AuthRegistry(0x7fffe995cbd0) adding con mode: secure 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:09:49.545+0000 7f63a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:09:49.545+0000 7f64ee726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:09:49.545+0000 7f64ee726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache list hook 0x560f6c679020 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache inspect hook 0x560f6c679020 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache erase hook 0x560f6c679020 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command cache zap hook 0x560f6c679020 2024-09-22T09:09:49.671 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:09:49.545+0000 7f64ee726800 5 note: GC not initialized 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:09:49.546+0000 7f631b7fe640 20 reqs_thread_entry: start 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace show hook 0x7f64e00227e0 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace history hook 0x7f64e00227e0 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace active hook 0x7f64e00227e0 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:09:49.546+0000 7f64ee726800 5 asok(0x560f6c3870f0) register_command sync trace active_short hook 0x7f64e00227e0 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 Filter name: none 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:09:49.546+0000 7f63197fa640 20 reqs_thread_entry: start 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:09:49.546+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:09:49.546+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:49.672 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:09:49.547+0000 7f64ee726800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:09:49.547+0000 7f64ee726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:09:49.551+0000 7f64ee726800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529750 cookie 94624243419408 notifier 7718 bl.length()=827 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:49.673 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:09:49.552+0000 7f63cdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:09:49.553+0000 7f64ee726800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:09:49.557+0000 7f64ee726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f64ee726800 time 2024-09-22T09:09:49.557261+0000 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f64efd8c748] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:09:49.674 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:09:49.557+0000 7f64ee726800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7f64ee726800 thread_name:radosgw-admin 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f64eea3e6f0] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f64eea8b99c] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f64efd8c7a2] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7f64efd8c906] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560f6aa87e01] 2024-09-22T09:09:49.675 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560f6aa97d0a] 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f64eea29590] 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:09:49.676 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:09:49.677 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:09:49.678 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:09:49.679 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:09:49.680 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:09:49.681 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63197fa640 / http_manager 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f631b7fe640 / http_manager 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63a0fe1640 / rgw_dt_lg_renew 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63bbfff640 / ms_dispatch 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63cdffb640 / io_context_pool 2024-09-22T09:09:49.682 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63cffff640 / ms_dispatch 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63d6e05640 / ms_dispatch 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f63d8608640 / io_context_pool 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64e9bd8640 / msgr-worker-2 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64ea3d9640 / msgr-worker-1 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64eabda640 / msgr-worker-0 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64eb3db640 / io_context_pool 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: 7f64ee726800 / radosgw-admin 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:09:49.558657Z_5eb751a0-1a54-4c7d-987f-885a637aad5e/log 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:09:49.683 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.636+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.638+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.638+0000 7fa5ba725800 20 realm 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.638+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.639+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.639+0000 7fa5ba725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.639+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.639+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.639+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.640+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.640+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.640+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:49.685 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.640+0000 7fa5ba725800 20 searching for the correct realm 2024-09-22T09:09:49.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.642+0000 7fa5b6baf640 0 -- 172.21.15.39:0/3543455397 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa5ac02e950 msgr2=0x7fa5ac008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:09:49.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:49.848+0000 7fa5b5bad640 0 -- 172.21.15.39:0/3543455397 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa5b00e9160 msgr2=0x7fa5b0007220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.458+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.460 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.459+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.459+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.459+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.459+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 zone default found 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 4 Realm: () 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 zonegroup default 2024-09-22T09:09:50.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.460+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.461+0000 7fa5ba725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.461+0000 7fa5ba725800 20 started sync module instance, tier type = 2024-09-22T09:09:50.463 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.461+0000 7fa5ba725800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:50.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=0 2024-09-22T09:09:50.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=1 2024-09-22T09:09:50.472 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=2 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=3 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=4 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=5 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.471+0000 7fa5ba725800 20 add_watcher() i=6 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.472+0000 7fa5ba725800 20 add_watcher() i=7 2024-09-22T09:09:50.473 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.472+0000 7fa5ba725800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:50.475 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.474+0000 7fa46cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:50.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:50.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 5 note: GC not initialized 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa3e77fe640 20 reqs_thread_entry: start 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 20 Filter name: none 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa3e57fa640 20 reqs_thread_entry: start 2024-09-22T09:09:50.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.475+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.476+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.476+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.476+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.476+0000 7fa5ba725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.476+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.477+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:50.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.477+0000 7fa5ba725800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.477+0000 7fa5ba725800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:50.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.477+0000 7fa5ba725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:09:50.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.479+0000 7fa46cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:50.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.482+0000 7fa5ba725800 20 remove_watcher() i=0 2024-09-22T09:09:50.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.482+0000 7fa5ba725800 2 removed watcher, disabling cache 2024-09-22T09:09:50.484 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.483+0000 7fa5ba725800 20 remove_watcher() i=1 2024-09-22T09:09:50.485 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.485+0000 7fa5ba725800 20 remove_watcher() i=2 2024-09-22T09:09:50.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.486+0000 7fa5ba725800 20 remove_watcher() i=3 2024-09-22T09:09:50.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.487+0000 7fa5ba725800 20 remove_watcher() i=4 2024-09-22T09:09:50.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.488+0000 7fa5ba725800 20 remove_watcher() i=5 2024-09-22T09:09:50.490 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.489+0000 7fa5ba725800 20 remove_watcher() i=6 2024-09-22T09:09:50.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.491+0000 7fa5ba725800 20 remove_watcher() i=7 2024-09-22T09:09:50.507 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:09:50.507 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:09:50.545 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:09:50.575 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:09:50.575 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:09:50.616 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.615+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 realm 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.618 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:50.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.617+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.618+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:50.619 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.618+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:50.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.619+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:09:50.620 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.619+0000 7f12c9d2a800 20 searching for the correct realm 2024-09-22T09:09:50.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.621+0000 7f12c62ae640 0 -- 172.21.15.39:0/3948978288 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f12bc01b040 msgr2=0x7f12bc038430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:09:50.828 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:50.827+0000 7f12c52ac640 0 -- 172.21.15.39:0/3948978288 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f12c0073d70 msgr2=0x7f12c00a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.033+0000 7f12c9d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:09:51.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.034+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.034+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:51.036 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.034+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.034+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.034+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 zone default found 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 4 Realm: () 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 zonegroup default 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.037 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.035+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.036+0000 7f12c9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.036+0000 7f12c9d2a800 20 started sync module instance, tier type = 2024-09-22T09:09:51.038 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.036+0000 7f12c9d2a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=0 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=1 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=2 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=3 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=4 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=5 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.046+0000 7f12c9d2a800 20 add_watcher() i=6 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.047+0000 7f12c9d2a800 20 add_watcher() i=7 2024-09-22T09:09:51.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.047+0000 7f12c9d2a800 2 all 8 watchers are set, enabling cache 2024-09-22T09:09:51.050 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.049+0000 7f11777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:51.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:09:51.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:09:51.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 5 note: GC not initialized 2024-09-22T09:09:51.051 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f11767fc640 20 reqs_thread_entry: start 2024-09-22T09:09:51.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 20 init_complete bucket index max shards: 1 2024-09-22T09:09:51.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 20 Filter name: none 2024-09-22T09:09:51.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f10e7fff640 20 reqs_thread_entry: start 2024-09-22T09:09:51.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:09:51.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.050+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 20 rados->read ofs=0 len=0 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.051+0000 7f12c9d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:09:51.053 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.052+0000 7f12c9d2a800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.052+0000 7f12c9d2a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:09:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.052+0000 7f12c9d2a800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.052+0000 7f12c9d2a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:09:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.053+0000 7f12c9d2a800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:51.054 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.053+0000 7f12c9d2a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:09:51.055 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.054+0000 7f11777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:09:51.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.057+0000 7f12c9d2a800 20 remove_watcher() i=0 2024-09-22T09:09:51.058 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.057+0000 7f12c9d2a800 2 removed watcher, disabling cache 2024-09-22T09:09:51.059 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.058+0000 7f12c9d2a800 20 remove_watcher() i=1 2024-09-22T09:09:51.060 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.059+0000 7f12c9d2a800 20 remove_watcher() i=2 2024-09-22T09:09:51.061 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.060+0000 7f12c9d2a800 20 remove_watcher() i=3 2024-09-22T09:09:51.062 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.062+0000 7f12c9d2a800 20 remove_watcher() i=4 2024-09-22T09:09:51.063 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.063+0000 7f12c9d2a800 20 remove_watcher() i=5 2024-09-22T09:09:51.064 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.064+0000 7f12c9d2a800 20 remove_watcher() i=6 2024-09-22T09:09:51.066 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:09:51.065+0000 7f12c9d2a800 20 remove_watcher() i=7 2024-09-22T09:10:21.103 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-22T09:10:21.142 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:21.142 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:21.187 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.185+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 realm 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:21.189 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.190 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.189+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:21.191 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.189+0000 7fc5d473e800 20 searching for the correct realm 2024-09-22T09:10:21.193 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.192+0000 7fc5d0cc1640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc5c4074040 msgr2=0x7fc5c4087990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:21.401 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.399+0000 7fc5cfcbf640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc5c802d420 msgr2=0x7fc5c802d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:21.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zone default found 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Realm: () 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zonegroup default 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.610 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started sync module instance, tier type = 2024-09-22T09:10:21.611 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:21.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=0 2024-09-22T09:10:21.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=1 2024-09-22T09:10:21.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=2 2024-09-22T09:10:21.621 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=3 2024-09-22T09:10:21.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=4 2024-09-22T09:10:21.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=5 2024-09-22T09:10:21.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=6 2024-09-22T09:10:21.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.620+0000 7fc5d473e800 20 add_watcher() i=7 2024-09-22T09:10:21.622 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.620+0000 7fc5d473e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:21.624 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.622+0000 7fc486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 5 note: GC not initialized 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc485fdb640 20 reqs_thread_entry: start 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:21.625 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 20 Filter name: none 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc3f77fe640 20 reqs_thread_entry: start 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:21.626 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.627 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.624+0000 7fc5d473e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:21.628 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.626+0000 7fc5d473e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc5d473e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc5d473e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94194022328864 notifier 7772 bl.length()=827 2024-09-22T09:10:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.634 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:21.635 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:21.637 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d473e800 time 2024-09-22T09:10:21.637778+0000 2024-09-22T09:10:21.638 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:21.638 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.638 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d5f8c748] 2024-09-22T09:10:21.638 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fc5d473e800 thread_name:radosgw-admin 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.636+0000 7fc5d473e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d473e800 time 2024-09-22T09:10:21.637778+0000 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.639 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d5f8c748] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:10:21.640 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d4c3e6f0] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d4c8b99c] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d5f8c7a2] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.656 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.637+0000 7fc5d473e800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fc5d473e800 thread_name:radosgw-admin 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d4c3e6f0] 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d4c8b99c] 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d5f8c7a2] 2024-09-22T09:10:21.657 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: dump: 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.658 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:10:21.165+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7760 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:10:21.165+0000 7fc5d473e800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:10:21.165+0000 7fc5d473e800 4 set_mon_vals no callback set 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:10:21.165+0000 7fc5d473e800 10 monclient: shutdown 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:10:21.165+0000 7fc5d473e800 5 asok(0x55ab410b70f0) unregister_commands rotate-key 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.659 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.660 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:10:21.166+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.661 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: starting msgr at 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: starting objecter 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests hook 0x55ab412e0490 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: setting wanted keys 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: calling monclient init 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.662 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:10:21.166+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:10:21.167+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:10:21.167+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key hook 0x55ab412db388 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:10:21.663 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab4118fa80 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4121dde0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab41220ea0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.428325s 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4121dde0 auth_method 0 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab4118fa80 auth_method 0 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.664 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:10:21.167+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab41220ea0 auth_method 0 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.665 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: dump: 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:10:21.168+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7763 2024-09-22T09:10:21.666 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: dump: 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.667 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:10:21.168+0000 7fc4be60c640 4 set_mon_vals no callback set 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:10:21.168+0000 7fc5d473e800 1 librados: init done 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:10:21.170+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc4b8077570 auth_method 0 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:10:21.170+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab4131cf90 auth_method 0 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:10:21.171+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x55ab41326420 auth_method 0 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:10:21.173+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x55ab4132aac0 auth_method 0 2024-09-22T09:10:21.668 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:10:21.174+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab4132a140 auth_method 0 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:10:21.175+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.669 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.670 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:10:21.175+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55ab41335fb0 EEXIST 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.671 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:10:21.175+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:10:21.176+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:10:21.176+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x55ab41331a70 EEXIST 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4135a2d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab4135a6b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab41358fe0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.672 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.437349s 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab41358fe0 auth_method 0 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4135a2d0 auth_method 0 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.673 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab4135a6b0 auth_method 0 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_done global_id 8331 payload 824 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 1 monclient: found mon.noname-a 2024-09-22T09:10:21.674 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: dump: 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.675 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: dump: 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.676 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:10:21.177+0000 7fc5d473e800 5 monclient: authenticate success, global_id 8331 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:10:21.177+0000 7fc5d14c2640 4 set_mon_vals no callback set 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:10:21.179+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc4a8077480 auth_method 0 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: get_monmap_and_config 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:10:21.179+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.677 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.678 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.679 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.680 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed0fa5f08 EEXIST 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4137e0e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab413a8b50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab413a9f00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.441815s 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4137e0e0 auth_method 0 2024-09-22T09:10:21.681 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab413a9f00 auth_method 0 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:10:21.180+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab413a8b50 auth_method 0 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.682 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.683 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: dump: 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.684 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: dump: 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:10:21.181+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7769 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:10:21.181+0000 7fc5d473e800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:21.685 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:10:21.181+0000 7fc5d473e800 4 set_mon_vals no callback set 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: shutdown 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.686 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.687 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:10:21.182+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: starting msgr at 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: starting objecter 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55ab4137e6d0 EEXIST 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: setting wanted keys 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: calling monclient init 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.688 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:10:21.183+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:10:21.183+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:10:21.183+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x55ab4136ecd8 EEXIST 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab4137e0e0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab413a9f00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab413a6840 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.689 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.444398s 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab413a6840 auth_method 0 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab413a9f00 auth_method 0 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4137e0e0 auth_method 0 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.690 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.691 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: dump: 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.692 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: dump: 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:10:21.184+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7772 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.693 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:10:21.184+0000 7fc4a77fe640 4 set_mon_vals no callback set 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:10:21.184+0000 7fc5d473e800 1 librados: init done 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:10:21.184+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cr dump hook 0x55ab413a74f8 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:10:21.185+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:10:21.186+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc4980775a0 auth_method 0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:10:21.186+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab413c8db0 auth_method 0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 realm 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.694 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:10:21.187+0000 7fc5d473e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:10:21.188+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x55ab413ccff0 auth_method 0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:10:21.188+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab413d0850 auth_method 0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:10:21.189+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:10:21.189+0000 7fc5d473e800 20 searching for the correct realm 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:10:21.189+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc5c801a040 auth_method 0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:10:21.191+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c0089060 auth_method 0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:10:21.191+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x7fc5c4074040 auth_method 0 2024-09-22T09:10:21.695 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:10:21.192+0000 7fc5d0cc1640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc5c4074040 msgr2=0x7fc5c4087990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:10:21.393+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x7fc5c4074040 auth_method 0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:10:21.396+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc5c8040950 auth_method 0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:10:21.399+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c802d420 auth_method 0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:10:21.399+0000 7fc5cfcbf640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc5c802d420 msgr2=0x7fc5c802d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:10:21.600+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c802d420 auth_method 0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.696 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zone default found 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Realm: () 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:10:21.607+0000 7fc5d473e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zonegroup default 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.697 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started sync module instance, tier type = 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=0 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=1 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=2 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=3 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=4 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=5 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=6 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:10:21.620+0000 7fc5d473e800 20 add_watcher() i=7 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:10:21.620+0000 7fc5d473e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:21.698 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.699 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:10:21.622+0000 7fc486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:10:21.623+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache list hook 0x55ab4137c620 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache inspect hook 0x55ab4137c620 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache erase hook 0x55ab4137c620 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache zap hook 0x55ab4137c620 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 note: GC not initialized 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:10:21.623+0000 7fc485fdb640 20 reqs_thread_entry: start 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace show hook 0x7fc5c8001690 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace history hook 0x7fc5c8001690 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace active hook 0x7fc5c8001690 2024-09-22T09:10:21.700 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace active_short hook 0x7fc5c8001690 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 Filter name: none 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:10:21.623+0000 7fc3f77fe640 20 reqs_thread_entry: start 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:10:21.623+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.701 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:10:21.626+0000 7fc5d473e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94194022328864 notifier 7772 bl.length()=827 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:21.702 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:10:21.636+0000 7fc5d473e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d473e800 time 2024-09-22T09:10:21.637778+0000 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d5f8c748] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.703 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:10:21.637+0000 7fc5d473e800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fc5d473e800 thread_name:radosgw-admin 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d4c3e6f0] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d4c8b99c] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d5f8c7a2] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.704 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:10:21.705 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:10:21.706 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:10:21.707 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:10:21.708 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:10:21.709 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:10:21.710 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc3f77fe640 / http_manager 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc485fdb640 / http_manager 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc486fdd640 / rgw_dt_lg_renew 2024-09-22T09:10:21.711 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4a5ffb640 / ms_dispatch 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4a77fe640 / io_context_pool 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4b5ffb640 / ms_dispatch 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4bce09640 / ms_dispatch 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4be60c640 / io_context_pool 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5cfcbf640 / msgr-worker-2 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d04c0640 / msgr-worker-1 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d0cc1640 / msgr-worker-0 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d14c2640 / io_context_pool 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d473e800 / radosgw-admin 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:10:21.712 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.151614.log 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:10:21.165+0000 7fc4be60c640 10 monclient: dump: 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.713 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:10:21.165+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7760 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:10:21.165+0000 7fc5d473e800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:10:21.165+0000 7fc5d473e800 4 set_mon_vals no callback set 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:10:21.165+0000 7fc5d473e800 10 monclient: shutdown 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:10:21.165+0000 7fc5d473e800 5 asok(0x55ab410b70f0) unregister_commands rotate-key 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.714 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding auth protocol: cephx 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.715 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: crc 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412dd010) adding con mode: secure 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:10:21.166+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: starting msgr at 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: starting objecter 2024-09-22T09:10:21.716 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests hook 0x55ab412e0490 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: setting wanted keys 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:10:21.166+0000 7fc5d473e800 1 librados: calling monclient init 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:10:21.166+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding auth protocol: cephx 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.717 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: crc 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:10:21.166+0000 7fc5d473e800 5 AuthRegistry(0x55ab412db240) adding con mode: secure 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:10:21.166+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:10:21.167+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:10:21.167+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key hook 0x55ab412db388 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab4118fa80 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.718 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4121dde0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab41220ea0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:10:21.167+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.428325s 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4121dde0 auth_method 0 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab4118fa80 auth_method 0 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.719 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:10:21.167+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_done global_id 7763 payload 824 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:10:21.167+0000 7fc5cfcbf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:10:21.167+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab41220ea0 auth_method 0 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.720 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: dump: 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:10:21.168+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7763 2024-09-22T09:10:21.721 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:10:21.168+0000 7fc4bce09640 10 monclient: dump: 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.722 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:10:21.168+0000 7fc4be60c640 4 set_mon_vals no callback set 2024-09-22T09:10:21.723 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:10:21.168+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:10:21.168+0000 7fc5d473e800 1 librados: init done 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:10:21.170+0000 7fc4bce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:10:21.170+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc4b8077570 auth_method 0 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:10:21.170+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab4131cf90 auth_method 0 2024-09-22T09:10:21.724 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:10:21.171+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x55ab41326420 auth_method 0 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:10:21.173+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x55ab4132aac0 auth_method 0 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:10:21.174+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab4132a140 auth_method 0 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:10:21.175+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.725 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.726 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding auth protocol: cephx 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: crc 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41332b20) adding con mode: secure 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:10:21.175+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.727 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55ab41335fb0 EEXIST 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:10:21.175+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding auth protocol: cephx 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.728 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: crc 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:10:21.175+0000 7fc5d473e800 5 AuthRegistry(0x55ab41331928) adding con mode: secure 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:10:21.175+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:10:21.176+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:10:21.176+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x55ab41331a70 EEXIST 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4135a2d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab4135a6b0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab41358fe0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.729 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:10:21.176+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.437349s 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab41358fe0 auth_method 0 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4135a2d0 auth_method 0 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.730 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:10:21.176+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab4135a6b0 auth_method 0 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:10:21.176+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_done global_id 8331 payload 824 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 1 monclient: found mon.noname-a 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:10:21.176+0000 7fc5d04c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:21.731 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: dump: 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.732 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:10:21.177+0000 7fc4b5ffb640 10 monclient: dump: 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.733 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:10:21.177+0000 7fc5d473e800 5 monclient: authenticate success, global_id 8331 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:10:21.177+0000 7fc5d14c2640 4 set_mon_vals no callback set 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:10:21.177+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:10:21.179+0000 7fc4b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:10:21.179+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc4a8077480 auth_method 0 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: get_monmap_and_config 2024-09-22T09:10:21.734 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:10:21.179+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:10:21.179+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.735 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding auth protocol: cephx 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: crc 2024-09-22T09:10:21.736 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:10:21.179+0000 7fc5d473e800 5 AuthRegistry(0x55ab41379f50) adding con mode: secure 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding auth protocol: cephx 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.737 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: crc 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa5dc0) adding con mode: secure 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:10:21.180+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:10:21.180+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x7ffed0fa5f08 EEXIST 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab4137e0e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab413a8b50 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab413a9f00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.738 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:10:21.180+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.441815s 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4137e0e0 auth_method 0 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:10:21.180+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab413a9f00 auth_method 0 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:10:21.180+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:10:21.180+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab413a8b50 auth_method 0 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.739 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:10:21.181+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:10:21.181+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:10:21.181+0000 7fc5cfcbf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.740 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: dump: 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.741 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:10:21.181+0000 7fc4a77fe640 10 monclient: dump: 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.742 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:10:21.181+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7769 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:10:21.181+0000 7fc5d473e800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:10:21.181+0000 7fc5d473e800 4 set_mon_vals no callback set 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: shutdown 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: build_initial_monmap 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 build_initial for_mkfs: 0 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: monmap: 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:21.743 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding auth protocol: cephx 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.744 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: crc 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4137ecc0) adding con mode: secure 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:10:21.182+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: starting msgr at 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: starting objecter 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command objecter_requests cmddesc objecter_requests hook 0x55ab4137e6d0 EEXIST 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: setting wanted keys 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:10:21.182+0000 7fc5d473e800 1 librados: calling monclient init 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:10:21.182+0000 7fc5d473e800 10 monclient: init 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding auth protocol: cephx 2024-09-22T09:10:21.745 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: crc 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:10:21.182+0000 7fc5d473e800 5 AuthRegistry(0x55ab4136eb90) adding con mode: secure 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:10:21.183+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:10:21.183+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.746 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:10:21.183+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command rotate-key cmddesc rotate-key hook 0x55ab4136ecd8 EEXIST 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-b con 0x55ab4137e0e0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-a con 0x55ab413a9f00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): picked mon.noname-c con 0x55ab413a6840 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:10:21.183+0000 7fc5d473e800 10 monclient(hunting): authenticate will time out at 2519.444398s 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request con 0x55ab413a6840 auth_method 0 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.747 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request con 0x55ab413a9f00 auth_method 0 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request con 0x55ab4137e0e0 auth_method 0 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:10:21.183+0000 7fc5d0cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.748 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:10:21.183+0000 7fc5cfcbf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient: _finish_hunting 0 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 1 monclient: found mon.noname-c 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:10:21.183+0000 7fc5d04c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: dump: 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.749 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: _finish_auth 0 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: _check_auth_tickets 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:21.750 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:10:21.184+0000 7fc4a5ffb640 10 monclient: dump: 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:10:21.184+0000 7fc5d473e800 5 monclient: authenticate success, global_id 7772 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:10:21.184+0000 7fc4a77fe640 4 set_mon_vals no callback set 2024-09-22T09:10:21.751 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _renew_subs 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:10:21.184+0000 7fc5d473e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:10:21.184+0000 7fc5d473e800 1 librados: init done 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:10:21.184+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cr dump hook 0x55ab413a74f8 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:10:21.185+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:10:21.186+0000 7fc4a5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:10:21.186+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc4980775a0 auth_method 0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:10:21.186+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab413c8db0 auth_method 0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 realm 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.752 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:10:21.187+0000 7fc5d473e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:10:21.187+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:10:21.188+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x55ab413ccff0 auth_method 0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:10:21.188+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:10:21.188+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x55ab413d0850 auth_method 0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:10:21.189+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:10:21.189+0000 7fc5d473e800 20 searching for the correct realm 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:10:21.189+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc5c801a040 auth_method 0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:10:21.191+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c0089060 auth_method 0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:10:21.191+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x7fc5c4074040 auth_method 0 2024-09-22T09:10:21.753 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:10:21.192+0000 7fc5d0cc1640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fc5c4074040 msgr2=0x7fc5c4087990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:10:21.393+0000 7fc5d0cc1640 10 monclient: get_auth_request con 0x7fc5c4074040 auth_method 0 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:10:21.396+0000 7fc5d04c0640 10 monclient: get_auth_request con 0x7fc5c8040950 auth_method 0 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:10:21.399+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c802d420 auth_method 0 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:10:21.399+0000 7fc5cfcbf640 0 -- 172.21.15.39:0/3579173847 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fc5c802d420 msgr2=0x7fc5c802d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:10:21.600+0000 7fc5cfcbf640 10 monclient: get_auth_request con 0x7fc5c802d420 auth_method 0 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.754 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:10:21.606+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zone default found 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Realm: () 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:10:21.607+0000 7fc5d473e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:10:21.607+0000 7fc5d473e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 zonegroup default 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:10:21.607+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.755 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started sync module instance, tier type = 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:10:21.608+0000 7fc5d473e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=0 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=1 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=2 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=3 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=4 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=5 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:10:21.619+0000 7fc5d473e800 20 add_watcher() i=6 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:10:21.620+0000 7fc5d473e800 20 add_watcher() i=7 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:10:21.620+0000 7fc5d473e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.756 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding auth protocol: cephx 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: crc 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:10:21.622+0000 7fc5d473e800 5 AuthRegistry(0x7ffed0fa6290) adding con mode: secure 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:10:21.622+0000 7fc486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:21.757 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:10:21.623+0000 7fc5d473e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache list hook 0x55ab4137c620 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache inspect hook 0x55ab4137c620 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache erase hook 0x55ab4137c620 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command cache zap hook 0x55ab4137c620 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 note: GC not initialized 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:10:21.623+0000 7fc485fdb640 20 reqs_thread_entry: start 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace show hook 0x7fc5c8001690 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace history hook 0x7fc5c8001690 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace active hook 0x7fc5c8001690 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:10:21.623+0000 7fc5d473e800 5 asok(0x55ab410b70f0) register_command sync trace active_short hook 0x7fc5c8001690 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:21.758 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 Filter name: none 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:10:21.623+0000 7fc3f77fe640 20 reqs_thread_entry: start 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:10:21.623+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:10:21.623+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:10:21.624+0000 7fc5d473e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.759 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:10:21.624+0000 7fc5d473e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:10:21.626+0000 7fc5d473e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:10:21.631+0000 7fc5d473e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529751 cookie 94194022328864 notifier 7772 bl.length()=827 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:10:21.631+0000 7fc4a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:10:21.633+0000 7fc5d473e800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:21.760 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:10:21.636+0000 7fc5d473e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5d473e800 time 2024-09-22T09:10:21.637778+0000 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5d5f8c748] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 4: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 6: main() 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 8: __libc_start_main() 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 9: _start() 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.761 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:10:21.637+0000 7fc5d473e800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fc5d473e800 thread_name:radosgw-admin 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5d4c3e6f0] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5d4c8b99c] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5d5f8c7a2] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fc5d5f8c906] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ab40455e01] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 8: radosgw-admin(+0xd8186c) [0x55ab4096886c] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ab40465c9d] 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 10: main() 2024-09-22T09:10:21.762 INFO:tasks.workunit.client.0.smithi039.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5d4c29590] 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 12: __libc_start_main() 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 13: _start() 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:10:21.763 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:10:21.764 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:10:21.765 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:10:21.766 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:10:21.767 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:10:21.768 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc3f77fe640 / http_manager 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc485fdb640 / http_manager 2024-09-22T09:10:21.769 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc486fdd640 / rgw_dt_lg_renew 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4a5ffb640 / ms_dispatch 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4a77fe640 / io_context_pool 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4b5ffb640 / ms_dispatch 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4bce09640 / ms_dispatch 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc4be60c640 / io_context_pool 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5cfcbf640 / msgr-worker-2 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d04c0640 / msgr-worker-1 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d0cc1640 / msgr-worker-0 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d14c2640 / io_context_pool 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: 7fc5d473e800 / radosgw-admin 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:10:21.770 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:10:21.639464Z_c22e56a3-d5be-4d48-b1e0-52c4826140e4/log 2024-09-22T09:10:21.771 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:10:21.771 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:10:21.772 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:21.772 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:21.772 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.722+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.723+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.723+0000 7f38a4298800 20 realm 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.723+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.724+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.724+0000 7f38a4298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.724+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.724+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.724+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.773 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.725+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:21.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.725+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:21.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.725+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:21.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.725+0000 7f38a4298800 20 searching for the correct realm 2024-09-22T09:10:21.774 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.727+0000 7f38a2583640 0 -- 172.21.15.39:0/286102414 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f3898021070 msgr2=0x7f3898030400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:10:21.936 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:21.934+0000 7f38a1581640 0 -- 172.21.15.39:0/286102414 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f389c055920 msgr2=0x7f389c084430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:22.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:22.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:22.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:22.143 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.140+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.144 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:22.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:22.146 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 zone default found 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 4 Realm: () 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 zonegroup default 2024-09-22T09:10:22.147 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.141+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.142+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.142+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.142+0000 7f38a4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:22.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.142+0000 7f38a4298800 20 started sync module instance, tier type = 2024-09-22T09:10:22.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.142+0000 7f38a4298800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:22.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=0 2024-09-22T09:10:22.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=1 2024-09-22T09:10:22.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=2 2024-09-22T09:10:22.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=3 2024-09-22T09:10:22.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=4 2024-09-22T09:10:22.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=5 2024-09-22T09:10:22.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.152+0000 7f38a4298800 20 add_watcher() i=6 2024-09-22T09:10:22.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.153+0000 7f38a4298800 20 add_watcher() i=7 2024-09-22T09:10:22.157 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.153+0000 7f38a4298800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:22.159 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f37537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f38a4298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f38a4298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f38a4298800 5 note: GC not initialized 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f37527fc640 20 reqs_thread_entry: start 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f38a4298800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:22.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.156+0000 7f38a4298800 20 Filter name: none 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f36c3fff640 20 reqs_thread_entry: start 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:22.161 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.157+0000 7f38a4298800 20 rados->read ofs=0 len=0 2024-09-22T09:10:22.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.158+0000 7f38a4298800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.159+0000 7f38a4298800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:10:22.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.159+0000 7f38a4298800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:10:22.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.160+0000 7f37537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.163+0000 7f38a4298800 20 remove_watcher() i=0 2024-09-22T09:10:22.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.163+0000 7f38a4298800 2 removed watcher, disabling cache 2024-09-22T09:10:22.166 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.164+0000 7f38a4298800 20 remove_watcher() i=1 2024-09-22T09:10:22.167 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.165+0000 7f38a4298800 20 remove_watcher() i=2 2024-09-22T09:10:22.169 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.167+0000 7f38a4298800 20 remove_watcher() i=3 2024-09-22T09:10:22.170 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.168+0000 7f38a4298800 20 remove_watcher() i=4 2024-09-22T09:10:22.171 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.169+0000 7f38a4298800 20 remove_watcher() i=5 2024-09-22T09:10:22.172 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.170+0000 7f38a4298800 20 remove_watcher() i=6 2024-09-22T09:10:22.173 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:22.171+0000 7f38a4298800 20 remove_watcher() i=7 2024-09-22T09:10:22.185 INFO:tasks.workunit.client.0.smithi039.stderr: test: duplicated entries can be purged manually 2024-09-22T09:10:52.212 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:10:52.245 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:52.245 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:52.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.290+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 20 realm 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.292+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.293+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.293+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.294+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:52.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.294+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.294+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:52.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.295+0000 7fc389020800 20 searching for the correct realm 2024-09-22T09:10:52.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.295+0000 7fc386b0a640 0 -- 172.21.15.39:0/2980541602 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fc38002d070 msgr2=0x7fc380047430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:52.502 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.501+0000 7fc386b0a640 0 -- 172.21.15.39:0/2980541602 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x557fe0ef23e0 msgr2=0x7fc380055910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.712+0000 7fc389020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.713+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.713+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.713+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.713+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:52.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.713+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:52.715 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 zone default found 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 4 Realm: () 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 zonegroup default 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.714+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.715+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.716 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.715+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.715+0000 7fc389020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.715+0000 7fc389020800 20 started sync module instance, tier type = 2024-09-22T09:10:52.717 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.715+0000 7fc389020800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=0 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=1 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=2 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=3 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=4 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=5 2024-09-22T09:10:52.727 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.726+0000 7fc389020800 20 add_watcher() i=6 2024-09-22T09:10:52.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.727+0000 7fc389020800 20 add_watcher() i=7 2024-09-22T09:10:52.728 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.727+0000 7fc389020800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:52.730 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.729+0000 7fc23d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.729+0000 7fc389020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.729+0000 7fc389020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc389020800 5 note: GC not initialized 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc1b7fff640 20 reqs_thread_entry: start 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc389020800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:52.731 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc389020800 20 Filter name: none 2024-09-22T09:10:52.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc1b5ffb640 20 reqs_thread_entry: start 2024-09-22T09:10:52.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.730+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:52.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.731+0000 7fc389020800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.732+0000 7fc389020800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:52.733 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.732+0000 7fc389020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:10:52.735 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.733+0000 7fc23d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:52.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.736+0000 7fc389020800 20 remove_watcher() i=0 2024-09-22T09:10:52.737 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.736+0000 7fc389020800 2 removed watcher, disabling cache 2024-09-22T09:10:52.738 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.737+0000 7fc389020800 20 remove_watcher() i=1 2024-09-22T09:10:52.739 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.738+0000 7fc389020800 20 remove_watcher() i=2 2024-09-22T09:10:52.740 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.739+0000 7fc389020800 20 remove_watcher() i=3 2024-09-22T09:10:52.741 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.740+0000 7fc389020800 20 remove_watcher() i=4 2024-09-22T09:10:52.742 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.741+0000 7fc389020800 20 remove_watcher() i=5 2024-09-22T09:10:52.744 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.743+0000 7fc389020800 20 remove_watcher() i=6 2024-09-22T09:10:52.745 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.744+0000 7fc389020800 20 remove_watcher() i=7 2024-09-22T09:10:52.758 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:52.758 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:10:52.759 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-22T09:10:52.759 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:52.760 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-22T09:10:52.797 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:52.797 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:52.839 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.838+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.841 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 realm 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:52.842 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:52.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:52.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.842+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:52.843 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.842+0000 7fbe15c13800 20 searching for the correct realm 2024-09-22T09:10:52.845 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:52.844+0000 7fbe11b93640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fbdfc09a060 msgr2=0x7fbdfc0920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.052 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.051+0000 7fbe0bfff640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fbe0c088a70 msgr2=0x7fbe0c07d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.260 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zone default found 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Realm: () 2024-09-22T09:10:53.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zonegroup default 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started sync module instance, tier type = 2024-09-22T09:10:53.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:53.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=0 2024-09-22T09:10:53.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=1 2024-09-22T09:10:53.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=2 2024-09-22T09:10:53.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=3 2024-09-22T09:10:53.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=4 2024-09-22T09:10:53.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=5 2024-09-22T09:10:53.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=6 2024-09-22T09:10:53.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.275+0000 7fbe15c13800 20 add_watcher() i=7 2024-09-22T09:10:53.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.275+0000 7fbe15c13800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:53.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.277+0000 7fbcc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbe15c13800 5 note: GC not initialized 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbcc6fe5640 20 reqs_thread_entry: start 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbe15c13800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:53.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbe15c13800 20 Filter name: none 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbcc4fe1640 20 reqs_thread_entry: start 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.278+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:53.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.280+0000 7fbe15c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:53.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.281+0000 7fbe15c13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:53.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.286+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.286+0000 7fbe15c13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.286+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.286+0000 7fbe15c13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:53.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94569278324400 notifier 8397 bl.length()=827 2024-09-22T09:10:53.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:53.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:53.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:53.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:53.292 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe15c13800 time 2024-09-22T09:10:53.292688+0000 2024-09-22T09:10:53.293 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:53.293 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.293 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe16d8c748] 2024-09-22T09:10:53.293 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.293 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.292+0000 7fbe15c13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe15c13800 time 2024-09-22T09:10:53.292688+0000 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe16d8c748] 2024-09-22T09:10:53.294 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr:*** Caught signal (Aborted) ** 2024-09-22T09:10:53.295 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fbe15c13800 thread_name:radosgw-admin 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe15a3e6f0] 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbe15a8b99c] 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe16d8c7a2] 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.311 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.293+0000 7fbe15c13800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fbe15c13800 thread_name:radosgw-admin 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe15a3e6f0] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbe15a8b99c] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe16d8c7a2] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.312 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: dump: 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.313 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: dump: 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.314 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:10:52.819+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8385 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:10:52.819+0000 7fbe15c13800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:53.315 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:10:52.819+0000 7fbe15c13800 4 set_mon_vals no callback set 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: shutdown 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) unregister_commands rotate-key 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.316 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.317 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.318 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.319 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:10:52.820+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: starting msgr at 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: starting objecter 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests hook 0x5602a02e1ee0 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: setting wanted keys 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: calling monclient init 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.320 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.321 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.322 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:10:52.821+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:10:52.821+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:10:52.821+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key hook 0x5602a02dd248 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a0166df0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a018a960 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a021c8d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.323 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.081323s 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a018a960 auth_method 0 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a021c8d0 auth_method 0 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.324 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:10:52.821+0000 7fbe11b93640 1 monclient: found mon.noname-c 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: dump: 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.325 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: dump: 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.326 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:10:52.822+0000 7fbe15c13800 5 monclient: authenticate success, global_id 7808 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:10:52.822+0000 7fbcff606640 4 set_mon_vals no callback set 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:10:52.822+0000 7fbe15c13800 1 librados: init done 2024-09-22T09:10:53.327 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:10:52.824+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbcf8077570 auth_method 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:10:52.824+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a0305200 auth_method 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:10:52.825+0000 7fbe11392640 10 monclient: get_auth_request con 0x5602a03281d0 auth_method 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:10:52.826+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a032c870 auth_method 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:10:52.827+0000 7fbe11b93640 10 monclient: get_auth_request con 0x5602a032bf10 auth_method 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:10:52.828+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:10:52.828+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:10:52.828+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.328 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.329 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:10:52.828+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602a0337dd0 EEXIST 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.330 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:10:52.829+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:10:52.829+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x5602a03339a0 EEXIST 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a035c0f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.331 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a035c4d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a035ae00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.089597s 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a035c4d0 auth_method 0 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a035ae00 auth_method 0 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.332 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a035c0f0 auth_method 0 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.333 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_done global_id 7811 payload 824 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:10:52.829+0000 7fbe11b93640 1 monclient: found mon.noname-c 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: dump: 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.334 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: dump: 2024-09-22T09:10:53.335 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:10:52.830+0000 7fbe15c13800 5 monclient: authenticate success, global_id 7811 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:10:52.830+0000 7fbe12394640 4 set_mon_vals no callback set 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.336 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:10:52.832+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbcec077480 auth_method 0 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: get_monmap_and_config 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:10:52.832+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.337 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.338 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:10:52.832+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.339 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:10:52.833+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:10:52.833+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.340 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x7fff1b3ead78 EEXIST 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a03b02e0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a03800f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a03ab6a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.341 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.093522s 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a03b02e0 auth_method 0 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.342 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a03800f0 auth_method 0 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.343 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a03ab6a0 auth_method 0 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.344 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_done global_id 8394 payload 274 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 1 monclient: found mon.noname-a 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.345 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: dump: 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.346 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.347 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: dump: 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.348 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.349 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8394 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:10:52.834+0000 7fbe15c13800 4 set_mon_vals no callback set 2024-09-22T09:10:53.350 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: shutdown 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:10:52.834+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.351 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.352 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.353 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.353 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.353 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.353 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.353 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.354 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: starting msgr at 2024-09-22T09:10:53.355 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: starting objecter 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602a03a3280 EEXIST 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: setting wanted keys 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: calling monclient init 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.356 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.357 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.358 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x5602a0370af8 EEXIST 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a03800f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.359 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a03ab6a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a03b02e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.360 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.095956s 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a03800f0 auth_method 0 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a03b02e0 auth_method 0 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.361 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.362 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a03ab6a0 auth_method 0 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-22T09:10:53.363 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 1 monclient: found mon.noname-a 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: dump: 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.364 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.365 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.366 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:10:52.836+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8397 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:10:52.836+0000 7fbcf4ff9640 4 set_mon_vals no callback set 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: dump: 2024-09-22T09:10:53.367 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.368 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.369 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:10:52.836+0000 7fbe15c13800 1 librados: init done 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:10:52.836+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cr dump hook 0x5602a03a4af8 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:10:52.838+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:10:52.839+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbcdc0775a0 auth_method 0 2024-09-22T09:10:53.370 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:10:52.839+0000 7fbe11392640 10 monclient: get_auth_request con 0x5602a03ca550 auth_method 0 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 realm 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:10:52.840+0000 7fbe15c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:53.371 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:10:52.840+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a03ce8b0 auth_method 0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:10:52.841+0000 7fbe11b93640 10 monclient: get_auth_request con 0x5602a03d1fd0 auth_method 0 2024-09-22T09:10:53.372 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:10:52.842+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:10:52.842+0000 7fbe15c13800 20 searching for the correct realm 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:10:52.842+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbe0c018070 auth_method 0 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:10:52.843+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0402c040 auth_method 0 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:10:52.844+0000 7fbe11b93640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fbdfc09a060 msgr2=0x7fbdfc0920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:10:52.844+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbdfc09a060 auth_method 0 2024-09-22T09:10:53.373 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:10:53.045+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbdfc09a060 auth_method 0 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:10:53.048+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbe0c048200 auth_method 0 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:10:53.051+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0c088a70 auth_method 0 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:10:53.051+0000 7fbe0bfff640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fbe0c088a70 msgr2=0x7fbe0c07d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:10:53.252+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0c088a70 auth_method 0 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:53.374 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zone default found 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Realm: () 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:10:53.260+0000 7fbe15c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:53.375 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zonegroup default 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started sync module instance, tier type = 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=0 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=1 2024-09-22T09:10:53.376 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=2 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=3 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=4 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=5 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=6 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:10:53.275+0000 7fbe15c13800 20 add_watcher() i=7 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:10:53.275+0000 7fbe15c13800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.377 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:10:53.277+0000 7fbcc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.378 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:10:53.277+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache list hook 0x5602a03a5f50 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache inspect hook 0x5602a03a5f50 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache erase hook 0x5602a03a5f50 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache zap hook 0x5602a03a5f50 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 note: GC not initialized 2024-09-22T09:10:53.379 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:10:53.278+0000 7fbcc6fe5640 20 reqs_thread_entry: start 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace show hook 0x7fbdfc056c40 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace history hook 0x7fbdfc056c40 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace active hook 0x7fbdfc056c40 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace active_short hook 0x7fbdfc056c40 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 Filter name: none 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:10:53.278+0000 7fbcc4fe1640 20 reqs_thread_entry: start 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:10:53.278+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:53.380 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:10:53.280+0000 7fbe15c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:10:53.281+0000 7fbe15c13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:53.381 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94569278324400 notifier 8397 bl.length()=827 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:53.382 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:10:53.292+0000 7fbe15c13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe15c13800 time 2024-09-22T09:10:53.292688+0000 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe16d8c748] 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.383 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:10:53.293+0000 7fbe15c13800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fbe15c13800 thread_name:radosgw-admin 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.384 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe15a3e6f0] 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbe15a8b99c] 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe16d8c7a2] 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.385 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:10:53.386 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:10:53.387 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:10:53.388 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:10:53.389 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:10:53.390 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:10:53.391 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:10:53.392 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:10:53.393 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:10:53.394 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:10:53.395 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:10:53.396 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:10:53.397 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:10:53.398 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc4fe1640 / http_manager 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc6fe5640 / http_manager 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc7fe7640 / rgw_dt_lg_renew 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbce2ffd640 / ms_dispatch 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcf4ff9640 / io_context_pool 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcf6ffd640 / ms_dispatch 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcfde03640 / ms_dispatch 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcff606640 / io_context_pool 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe0bfff640 / msgr-worker-2 2024-09-22T09:10:53.399 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe11392640 / msgr-worker-1 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe11b93640 / msgr-worker-0 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe12394640 / io_context_pool 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe15c13800 / radosgw-admin 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/log/ceph/ceph-client.admin.153381.log 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:--- begin dump of recent events --- 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr: -499> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: dump: 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.400 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -498> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -497> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -496> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -495> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -494> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr: -493> 2024-09-22T09:10:52.819+0000 7fbcff606640 10 monclient: dump: 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.401 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -492> 2024-09-22T09:10:52.819+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8385 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -491> 2024-09-22T09:10:52.819+0000 7fbe15c13800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -490> 2024-09-22T09:10:52.819+0000 7fbe15c13800 4 set_mon_vals no callback set 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -489> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: shutdown 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -488> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) unregister_commands rotate-key 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -487> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -486> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr: -485> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.402 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -484> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -483> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -482> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding auth protocol: cephx 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -481> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -480> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.403 INFO:tasks.workunit.client.0.smithi039.stderr: -479> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -478> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -477> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -476> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -475> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -474> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -473> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -472> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -471> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: crc 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -470> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02e2820) adding con mode: secure 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -469> 2024-09-22T09:10:52.820+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -468> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: starting msgr at 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -467> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: starting objecter 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -466> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests hook 0x5602a02e1ee0 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -465> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: setting wanted keys 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -464> 2024-09-22T09:10:52.820+0000 7fbe15c13800 1 librados: calling monclient init 2024-09-22T09:10:53.404 INFO:tasks.workunit.client.0.smithi039.stderr: -463> 2024-09-22T09:10:52.820+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -462> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -461> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -460> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding auth protocol: cephx 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -459> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -458> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -457> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -456> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -455> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -454> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -453> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -452> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -451> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -450> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -449> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: crc 2024-09-22T09:10:53.405 INFO:tasks.workunit.client.0.smithi039.stderr: -448> 2024-09-22T09:10:52.820+0000 7fbe15c13800 5 AuthRegistry(0x5602a02dd100) adding con mode: secure 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -447> 2024-09-22T09:10:52.821+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -446> 2024-09-22T09:10:52.821+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -445> 2024-09-22T09:10:52.821+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key hook 0x5602a02dd248 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -444> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -443> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -442> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a0166df0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -441> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a018a960 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -440> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a021c8d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -439> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -438> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -437> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -436> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -435> 2024-09-22T09:10:52.821+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.081323s 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -434> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a018a960 auth_method 0 2024-09-22T09:10:53.406 INFO:tasks.workunit.client.0.smithi039.stderr: -433> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -432> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -431> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -430> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a021c8d0 auth_method 0 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -429> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -428> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -427> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -426> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -425> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -424> 2024-09-22T09:10:52.821+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -423> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -422> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.407 INFO:tasks.workunit.client.0.smithi039.stderr: -421> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -420> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -419> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -418> 2024-09-22T09:10:52.821+0000 7fbe11b93640 1 monclient: found mon.noname-c 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -417> 2024-09-22T09:10:52.821+0000 7fbe11b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -416> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -415> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr: -414> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: dump: 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.408 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -413> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -412> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -411> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -410> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -409> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr: -408> 2024-09-22T09:10:52.822+0000 7fbcfde03640 10 monclient: dump: 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.409 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -407> 2024-09-22T09:10:52.822+0000 7fbe15c13800 5 monclient: authenticate success, global_id 7808 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -406> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -405> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -404> 2024-09-22T09:10:52.822+0000 7fbcff606640 4 set_mon_vals no callback set 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -403> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -402> 2024-09-22T09:10:52.822+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -401> 2024-09-22T09:10:52.822+0000 7fbe15c13800 1 librados: init done 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -400> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -399> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -398> 2024-09-22T09:10:52.824+0000 7fbcfde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -397> 2024-09-22T09:10:52.824+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbcf8077570 auth_method 0 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -396> 2024-09-22T09:10:52.824+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a0305200 auth_method 0 2024-09-22T09:10:53.410 INFO:tasks.workunit.client.0.smithi039.stderr: -395> 2024-09-22T09:10:52.825+0000 7fbe11392640 10 monclient: get_auth_request con 0x5602a03281d0 auth_method 0 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -394> 2024-09-22T09:10:52.826+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a032c870 auth_method 0 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -393> 2024-09-22T09:10:52.827+0000 7fbe11b93640 10 monclient: get_auth_request con 0x5602a032bf10 auth_method 0 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -392> 2024-09-22T09:10:52.828+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -391> 2024-09-22T09:10:52.828+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -390> 2024-09-22T09:10:52.828+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.411 INFO:tasks.workunit.client.0.smithi039.stderr: -389> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -388> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -387> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding auth protocol: cephx 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -386> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -385> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -384> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -383> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -382> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -381> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -380> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -379> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -378> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -377> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -376> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: crc 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -375> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 AuthRegistry(0x5602a03349b0) adding con mode: secure 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -374> 2024-09-22T09:10:52.828+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.412 INFO:tasks.workunit.client.0.smithi039.stderr: -373> 2024-09-22T09:10:52.828+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602a0337dd0 EEXIST 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -372> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -371> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -370> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -369> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding auth protocol: cephx 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -368> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -367> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -366> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -365> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -364> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -363> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -362> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -361> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -360> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -359> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.413 INFO:tasks.workunit.client.0.smithi039.stderr: -358> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: crc 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -357> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 AuthRegistry(0x5602a0333858) adding con mode: secure 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -356> 2024-09-22T09:10:52.829+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -355> 2024-09-22T09:10:52.829+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -354> 2024-09-22T09:10:52.829+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x5602a03339a0 EEXIST 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -353> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -352> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -351> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a035c0f0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -350> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a035c4d0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -349> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a035ae00 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -348> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -347> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -346> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.414 INFO:tasks.workunit.client.0.smithi039.stderr: -345> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -344> 2024-09-22T09:10:52.829+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.089597s 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -343> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a035c4d0 auth_method 0 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -342> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -341> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -340> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -339> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a035ae00 auth_method 0 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -338> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -337> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -336> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -335> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -334> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -333> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -332> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a035c0f0 auth_method 0 2024-09-22T09:10:53.415 INFO:tasks.workunit.client.0.smithi039.stderr: -331> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -330> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -329> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -328> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -327> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -326> 2024-09-22T09:10:52.829+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -325> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -324> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -323> 2024-09-22T09:10:52.829+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -322> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient(hunting): handle_auth_done global_id 7811 payload 824 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -321> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -320> 2024-09-22T09:10:52.829+0000 7fbe11b93640 1 monclient: found mon.noname-c 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -319> 2024-09-22T09:10:52.829+0000 7fbe11b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -318> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -317> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-22T09:10:53.416 INFO:tasks.workunit.client.0.smithi039.stderr: -316> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: dump: 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr: -315> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr: -314> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr: -313> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.417 INFO:tasks.workunit.client.0.smithi039.stderr: -312> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr: -311> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr: -310> 2024-09-22T09:10:52.830+0000 7fbcf6ffd640 10 monclient: dump: 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr: -309> 2024-09-22T09:10:52.830+0000 7fbe15c13800 5 monclient: authenticate success, global_id 7811 2024-09-22T09:10:53.418 INFO:tasks.workunit.client.0.smithi039.stderr: -308> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -307> 2024-09-22T09:10:52.830+0000 7fbe12394640 4 set_mon_vals no callback set 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -306> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -305> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -304> 2024-09-22T09:10:52.830+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.39:3301/0 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -303> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -302> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -301> 2024-09-22T09:10:52.832+0000 7fbcf6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -300> 2024-09-22T09:10:52.832+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbcec077480 auth_method 0 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -299> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: get_monmap_and_config 2024-09-22T09:10:53.419 INFO:tasks.workunit.client.0.smithi039.stderr: -298> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr: -297> 2024-09-22T09:10:52.832+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr: -296> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.420 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr: -295> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr: -294> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr: -293> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding auth protocol: cephx 2024-09-22T09:10:53.421 INFO:tasks.workunit.client.0.smithi039.stderr: -292> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -291> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -290> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -289> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -288> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -287> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -286> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -285> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -284> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -283> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -282> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: crc 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -281> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x5602a037bc60) adding con mode: secure 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -280> 2024-09-22T09:10:52.832+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.422 INFO:tasks.workunit.client.0.smithi039.stderr: -279> 2024-09-22T09:10:52.832+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -278> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -277> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -276> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding auth protocol: cephx 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -275> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -274> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -273> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -272> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -271> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -270> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -269> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -268> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.423 INFO:tasks.workunit.client.0.smithi039.stderr: -267> 2024-09-22T09:10:52.832+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -266> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -265> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: crc 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -264> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eac30) adding con mode: secure 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -263> 2024-09-22T09:10:52.833+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -262> 2024-09-22T09:10:52.833+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -261> 2024-09-22T09:10:52.833+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x7fff1b3ead78 EEXIST 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -260> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -259> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -258> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a03b02e0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -257> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a03800f0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -256> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a03ab6a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -255> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -254> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -253> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.424 INFO:tasks.workunit.client.0.smithi039.stderr: -252> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -251> 2024-09-22T09:10:52.833+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.093522s 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -250> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a03b02e0 auth_method 0 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -249> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -248> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -247> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -246> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a03800f0 auth_method 0 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -245> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -244> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -243> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -242> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -241> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -240> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -239> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.425 INFO:tasks.workunit.client.0.smithi039.stderr: -238> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -237> 2024-09-22T09:10:52.833+0000 7fbe11b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -236> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a03ab6a0 auth_method 0 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -235> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -234> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -233> 2024-09-22T09:10:52.833+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -232> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_done global_id 8394 payload 274 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -231> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -230> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 1 monclient: found mon.noname-a 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -229> 2024-09-22T09:10:52.833+0000 7fbe0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -228> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -227> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr: -226> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: dump: 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.426 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -225> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -224> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -223> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -222> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -221> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr: -220> 2024-09-22T09:10:52.834+0000 7fbcf4ff9640 10 monclient: dump: 2024-09-22T09:10:53.427 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: -219> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8394 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: -218> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: get_monmap_and_config success 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: -217> 2024-09-22T09:10:52.834+0000 7fbe15c13800 4 set_mon_vals no callback set 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: -216> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: shutdown 2024-09-22T09:10:53.428 INFO:tasks.workunit.client.0.smithi039.stderr: -215> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: build_initial_monmap 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -214> 2024-09-22T09:10:52.834+0000 7fbe15c13800 1 build_initial for_mkfs: 0 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -213> 2024-09-22T09:10:52.834+0000 7fbe15c13800 10 monclient: monmap: 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 0 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 0.000000 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:created 0.000000 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 0 (unknown) 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.noname-a 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.noname-b 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.noname-c 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -212> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -211> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -210> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding auth protocol: cephx 2024-09-22T09:10:53.429 INFO:tasks.workunit.client.0.smithi039.stderr: -209> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -208> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -207> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -206> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -205> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -204> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -203> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -202> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -201> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -200> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -199> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: crc 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -198> 2024-09-22T09:10:52.834+0000 7fbe15c13800 5 AuthRegistry(0x5602a0380f30) adding con mode: secure 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -197> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -196> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: starting msgr at 2024-09-22T09:10:53.430 INFO:tasks.workunit.client.0.smithi039.stderr: -195> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: starting objecter 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -194> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command objecter_requests cmddesc objecter_requests hook 0x5602a03a3280 EEXIST 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -193> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: setting wanted keys 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -192> 2024-09-22T09:10:52.835+0000 7fbe15c13800 1 librados: calling monclient init 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -191> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: init 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -190> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -189> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -188> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding auth protocol: cephx 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -187> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -186> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -185> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -184> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -183> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -182> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.431 INFO:tasks.workunit.client.0.smithi039.stderr: -181> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -180> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -179> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -178> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -177> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: crc 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -176> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 AuthRegistry(0x5602a03709b0) adding con mode: secure 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -175> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -174> 2024-09-22T09:10:52.835+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -173> 2024-09-22T09:10:52.835+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command rotate-key cmddesc rotate-key hook 0x5602a0370af8 EEXIST 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -172> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: _reopen_session rank -1 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -171> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -170> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-a con 0x5602a03800f0 addr [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -169> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-b con 0x5602a03ab6a0 addr [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -168> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): picked mon.noname-c con 0x5602a03b02e0 addr [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -167> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.432 INFO:tasks.workunit.client.0.smithi039.stderr: -166> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -165> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): start opening mon connection 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -164> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): _renew_subs 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -163> 2024-09-22T09:10:52.835+0000 7fbe15c13800 10 monclient(hunting): authenticate will time out at 2551.095956s 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -162> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request con 0x5602a03800f0 auth_method 0 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -161> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -160> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -159> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -158> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): get_auth_request con 0x5602a03b02e0 auth_method 0 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -157> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -156> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -155> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -154> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -153> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -152> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.433 INFO:tasks.workunit.client.0.smithi039.stderr: -151> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -150> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -149> 2024-09-22T09:10:52.836+0000 7fbe11392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -148> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): get_auth_request con 0x5602a03ab6a0 auth_method 0 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -147> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -146> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): _init_auth method 2 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -145> 2024-09-22T09:10:52.836+0000 7fbe11b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -144> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -143> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient: _finish_hunting 0 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -142> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 1 monclient: found mon.noname-a 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -141> 2024-09-22T09:10:52.836+0000 7fbe0bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -140> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.434 INFO:tasks.workunit.client.0.smithi039.stderr: -139> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: -138> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: dump: 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: -137> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: _finish_auth 0 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: -136> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: _check_auth_tickets 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: -135> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_config config(0 keys) 2024-09-22T09:10:53.435 INFO:tasks.workunit.client.0.smithi039.stderr: -134> 2024-09-22T09:10:52.836+0000 7fbe15c13800 5 monclient: authenticate success, global_id 8397 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -133> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -132> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -131> 2024-09-22T09:10:52.836+0000 7fbcf4ff9640 4 set_mon_vals no callback set 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -130> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -129> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr: -128> 2024-09-22T09:10:52.836+0000 7fbce2ffd640 10 monclient: dump: 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:epoch 1 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:fsid 83a27d2c-39d0-4c1b-857e-35a2ddf6d58a 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:last_changed 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:created 2024-09-22T08:40:56.060811+0000 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:min_mon_release 19 (squid) 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:election_strategy: 1 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-22T09:10:53.436 INFO:tasks.workunit.client.0.smithi039.stderr:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -127> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _renew_subs 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -126> 2024-09-22T09:10:52.836+0000 7fbe15c13800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.39:3300/0 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -125> 2024-09-22T09:10:52.836+0000 7fbe15c13800 1 librados: init done 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -124> 2024-09-22T09:10:52.836+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cr dump hook 0x5602a03a4af8 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -123> 2024-09-22T09:10:52.838+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -122> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-22T09:10:53.437 INFO:tasks.workunit.client.0.smithi039.stderr: -121> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -120> 2024-09-22T09:10:52.839+0000 7fbce2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.39:6832/63434186,v1:172.21.15.39:6833/63434186] 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -119> 2024-09-22T09:10:52.839+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbcdc0775a0 auth_method 0 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -118> 2024-09-22T09:10:52.839+0000 7fbe11392640 10 monclient: get_auth_request con 0x5602a03ca550 auth_method 0 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -117> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -116> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 realm 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -115> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.438 INFO:tasks.workunit.client.0.smithi039.stderr: -114> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -113> 2024-09-22T09:10:52.840+0000 7fbe15c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -112> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -111> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -110> 2024-09-22T09:10:52.840+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -109> 2024-09-22T09:10:52.840+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x5602a03ce8b0 auth_method 0 2024-09-22T09:10:53.439 INFO:tasks.workunit.client.0.smithi039.stderr: -108> 2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -107> 2024-09-22T09:10:52.841+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -106> 2024-09-22T09:10:52.841+0000 7fbe11b93640 10 monclient: get_auth_request con 0x5602a03d1fd0 auth_method 0 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -105> 2024-09-22T09:10:52.842+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -104> 2024-09-22T09:10:52.842+0000 7fbe15c13800 20 searching for the correct realm 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -103> 2024-09-22T09:10:52.842+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbe0c018070 auth_method 0 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -102> 2024-09-22T09:10:52.843+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0402c040 auth_method 0 2024-09-22T09:10:53.440 INFO:tasks.workunit.client.0.smithi039.stderr: -101> 2024-09-22T09:10:52.844+0000 7fbe11b93640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fbdfc09a060 msgr2=0x7fbdfc0920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -100> 2024-09-22T09:10:52.844+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbdfc09a060 auth_method 0 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -99> 2024-09-22T09:10:53.045+0000 7fbe11b93640 10 monclient: get_auth_request con 0x7fbdfc09a060 auth_method 0 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -98> 2024-09-22T09:10:53.048+0000 7fbe11392640 10 monclient: get_auth_request con 0x7fbe0c048200 auth_method 0 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -97> 2024-09-22T09:10:53.051+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0c088a70 auth_method 0 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -96> 2024-09-22T09:10:53.051+0000 7fbe0bfff640 0 -- 172.21.15.39:0/3530383642 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fbe0c088a70 msgr2=0x7fbe0c07d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.441 INFO:tasks.workunit.client.0.smithi039.stderr: -95> 2024-09-22T09:10:53.252+0000 7fbe0bfff640 10 monclient: get_auth_request con 0x7fbe0c088a70 auth_method 0 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -94> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -93> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -92> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -91> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -90> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:53.442 INFO:tasks.workunit.client.0.smithi039.stderr: -89> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -88> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -87> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -86> 2024-09-22T09:10:53.259+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -85> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -84> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -83> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:53.443 INFO:tasks.workunit.client.0.smithi039.stderr: -82> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zone default found 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -81> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Realm: () 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -80> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -79> 2024-09-22T09:10:53.260+0000 7fbe15c13800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -78> 2024-09-22T09:10:53.260+0000 7fbe15c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -77> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 zonegroup default 2024-09-22T09:10:53.444 INFO:tasks.workunit.client.0.smithi039.stderr: -76> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -75> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -74> 2024-09-22T09:10:53.260+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -73> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -72> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -71> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -70> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started sync module instance, tier type = 2024-09-22T09:10:53.445 INFO:tasks.workunit.client.0.smithi039.stderr: -69> 2024-09-22T09:10:53.261+0000 7fbe15c13800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -68> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=0 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -67> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=1 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -66> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=2 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -65> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=3 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -64> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=4 2024-09-22T09:10:53.446 INFO:tasks.workunit.client.0.smithi039.stderr: -63> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=5 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -62> 2024-09-22T09:10:53.274+0000 7fbe15c13800 20 add_watcher() i=6 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -61> 2024-09-22T09:10:53.275+0000 7fbe15c13800 20 add_watcher() i=7 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -60> 2024-09-22T09:10:53.275+0000 7fbe15c13800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -59> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -58> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -57> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding auth protocol: cephx 2024-09-22T09:10:53.447 INFO:tasks.workunit.client.0.smithi039.stderr: -56> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -55> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -54> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -53> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -52> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -51> 2024-09-22T09:10:53.277+0000 7fbcc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:53.448 INFO:tasks.workunit.client.0.smithi039.stderr: -50> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -49> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -48> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -47> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -46> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -45> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: crc 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -44> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 AuthRegistry(0x7fff1b3eb100) adding con mode: secure 2024-09-22T09:10:53.449 INFO:tasks.workunit.client.0.smithi039.stderr: -43> 2024-09-22T09:10:53.277+0000 7fbe15c13800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -42> 2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -41> 2024-09-22T09:10:53.277+0000 7fbe15c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -40> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache list hook 0x5602a03a5f50 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -39> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache inspect hook 0x5602a03a5f50 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -38> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache erase hook 0x5602a03a5f50 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -37> 2024-09-22T09:10:53.277+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command cache zap hook 0x5602a03a5f50 2024-09-22T09:10:53.450 INFO:tasks.workunit.client.0.smithi039.stderr: -36> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 note: GC not initialized 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -35> 2024-09-22T09:10:53.278+0000 7fbcc6fe5640 20 reqs_thread_entry: start 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -34> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace show hook 0x7fbdfc056c40 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -33> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace history hook 0x7fbdfc056c40 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -32> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace active hook 0x7fbdfc056c40 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -31> 2024-09-22T09:10:53.278+0000 7fbe15c13800 5 asok(0x5602a00bb0f0) register_command sync trace active_short hook 0x7fbdfc056c40 2024-09-22T09:10:53.451 INFO:tasks.workunit.client.0.smithi039.stderr: -30> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -29> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 Filter name: none 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -28> 2024-09-22T09:10:53.278+0000 7fbcc4fe1640 20 reqs_thread_entry: start 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -27> 2024-09-22T09:10:53.278+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -26> 2024-09-22T09:10:53.278+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -25> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:53.452 INFO:tasks.workunit.client.0.smithi039.stderr: -24> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -23> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -22> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -21> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -20> 2024-09-22T09:10:53.279+0000 7fbe15c13800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -19> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -18> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.453 INFO:tasks.workunit.client.0.smithi039.stderr: -17> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -16> 2024-09-22T09:10:53.279+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -15> 2024-09-22T09:10:53.280+0000 7fbe15c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -14> 2024-09-22T09:10:53.281+0000 7fbe15c13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -13> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -12> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.454 INFO:tasks.workunit.client.0.smithi039.stderr: -11> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -10> 2024-09-22T09:10:53.286+0000 7fbe15c13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -9> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529752 cookie 94569278324400 notifier 8397 bl.length()=827 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -8> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -7> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -6> 2024-09-22T09:10:53.287+0000 7fbcf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:53.455 INFO:tasks.workunit.client.0.smithi039.stderr: -5> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr: -4> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr: -3> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr: -2> 2024-09-22T09:10:53.288+0000 7fbe15c13800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr: -1> 2024-09-22T09:10:53.292+0000 7fbe15c13800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbe15c13800 time 2024-09-22T09:10:53.292688+0000 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5106-g8852379c/rpm/el9/BUILD/ceph-19.3.0-5106-g8852379c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-22T09:10:53.456 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbe16d8c748] 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 5: main() 2024-09-22T09:10:53.457 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.458 INFO:tasks.workunit.client.0.smithi039.stderr: 7: __libc_start_main() 2024-09-22T09:10:53.458 INFO:tasks.workunit.client.0.smithi039.stderr: 8: _start() 2024-09-22T09:10:53.458 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.458 INFO:tasks.workunit.client.0.smithi039.stderr: 0> 2024-09-22T09:10:53.293+0000 7fbe15c13800 -1 *** Caught signal (Aborted) ** 2024-09-22T09:10:53.458 INFO:tasks.workunit.client.0.smithi039.stderr: in thread 7fbe15c13800 thread_name:radosgw-admin 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: ceph version 19.3.0-5106-g8852379c (8852379c050c686f4605f33f0129009b2029ca9d) squid (dev) 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbe15a3e6f0] 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbe15a8b99c] 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 3: raise() 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 4: abort() 2024-09-22T09:10:53.459 INFO:tasks.workunit.client.0.smithi039.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbe16d8c7a2] 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c906) [0x7fbe16d8c906] 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56029d9d9e01] 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56029d9e9d0a] 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 9: main() 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fbe15a29590] 2024-09-22T09:10:53.460 INFO:tasks.workunit.client.0.smithi039.stderr: 11: __libc_start_main() 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr: 12: _start() 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr:--- logging levels --- 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 none 2024-09-22T09:10:53.461 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 lockdep 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 context 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 crush 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_balancer 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_locker 2024-09-22T09:10:53.462 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_log_expire 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mds_migrator 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 3/ 5 mds_quiesce 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 buffer 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 timer 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 filer 2024-09-22T09:10:53.463 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 striper 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 1 objecter 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rados 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_mirror 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_replay 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 rbd_pwl 2024-09-22T09:10:53.464 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 journaler 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objectcacher 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 immutable_obj_cache 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 client 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 osd 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 optracker 2024-09-22T09:10:53.465 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 objclass 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 filestore 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 journal 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 ms 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mon 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 0/10 monc 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 paxos 2024-09-22T09:10:53.466 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 tp 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 auth 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 crypto 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 finisher 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 reserver 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 heartbeatmap 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 perfcounter 2024-09-22T09:10:53.467 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_sync 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_datacache 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_access 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_dbstore 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_flight 2024-09-22T09:10:53.468 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 rgw_lifecycle 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 20/20 rgw_notification 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 javaclient 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 asok 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 1 throttle 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 0 refs 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 compressor 2024-09-22T09:10:53.469 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluestore 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 bluefs 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 3 bdev 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 kstore 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 4/ 5 rocksdb 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 fuse 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 2/ 5 mgr 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mgrc 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 dpdk 2024-09-22T09:10:53.470 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 eventtrace 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 prioritycache 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 test 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephfs_mirror 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cephsqlite 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 crimson_interrupt 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_onode 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_odata 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_omap 2024-09-22T09:10:53.471 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_tm 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_t 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cleaner 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_epm 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_lba 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_cache 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_journal 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_device 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 seastore_backref 2024-09-22T09:10:53.472 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 alienstore 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 mclock 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 cyanstore 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 ceph_exporter 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 memstore 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 1/ 5 trace 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 0/ 5 ceph_dedup 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: -2/-2 (syslog threshold) 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 99/99 (stderr threshold) 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-22T09:10:53.473 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc4fe1640 / http_manager 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc6fe5640 / http_manager 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcc7fe7640 / rgw_dt_lg_renew 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbce2ffd640 / ms_dispatch 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcf4ff9640 / io_context_pool 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcf6ffd640 / ms_dispatch 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcfde03640 / ms_dispatch 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbcff606640 / io_context_pool 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe0bfff640 / msgr-worker-2 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe11392640 / msgr-worker-1 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe11b93640 / msgr-worker-0 2024-09-22T09:10:53.474 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe12394640 / io_context_pool 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr: 7fbe15c13800 / radosgw-admin 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr: max_recent 500 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr: max_new 1000 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr: log_file /var/lib/ceph/crash/2024-09-22T09:10:53.294129Z_6b87a772-3b85-458b-9a76-3d2038e88d85/log 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr:--- end dump of recent events --- 2024-09-22T09:10:53.475 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:10:53.476 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:53.476 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:53.476 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.377+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 20 realm 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.580+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.581+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:53.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.581+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.582+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:53.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.582+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:53.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.583+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:53.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.583+0000 7f9d0e80d800 20 searching for the correct realm 2024-09-22T09:10:53.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.585+0000 7f9d0caf8640 0 -- 172.21.15.39:0/3086657998 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f9d00075070 msgr2=0x7f9d000b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:53.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.792+0000 7f9d0baf6640 0 -- 172.21.15.39:0/3086657998 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f9d04060e30 msgr2=0x7f9d040686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:53.999+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.000+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.000+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.000+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:54.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.000+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 zone default found 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 4 Realm: () 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 zonegroup default 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.001+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.002+0000 7f9d0e80d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.002+0000 7f9d0e80d800 20 started sync module instance, tier type = 2024-09-22T09:10:54.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.002+0000 7f9d0e80d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:54.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=0 2024-09-22T09:10:54.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=1 2024-09-22T09:10:54.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=2 2024-09-22T09:10:54.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=3 2024-09-22T09:10:54.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=4 2024-09-22T09:10:54.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=5 2024-09-22T09:10:54.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.013+0000 7f9d0e80d800 20 add_watcher() i=6 2024-09-22T09:10:54.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.014+0000 7f9d0e80d800 20 add_watcher() i=7 2024-09-22T09:10:54.015 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.014+0000 7f9d0e80d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:54.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.017+0000 7f9bc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:54.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.017+0000 7f9d0e80d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:54.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.017+0000 7f9d0e80d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:54.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.017+0000 7f9d0e80d800 5 note: GC not initialized 2024-09-22T09:10:54.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.017+0000 7f9bc17e2640 20 reqs_thread_entry: start 2024-09-22T09:10:54.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9d0e80d800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:54.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9d0e80d800 20 Filter name: none 2024-09-22T09:10:54.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9b32ffd640 20 reqs_thread_entry: start 2024-09-22T09:10:54.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:54.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.018+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.019+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:54.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.019+0000 7f9d0e80d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:10:54.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.019+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.020+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:54.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.020+0000 7f9d0e80d800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.020+0000 7f9d0e80d800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:54.021 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.020+0000 7f9d0e80d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:10:54.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.022+0000 7f9bc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:54.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.025+0000 7f9d0e80d800 20 remove_watcher() i=0 2024-09-22T09:10:54.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.025+0000 7f9d0e80d800 2 removed watcher, disabling cache 2024-09-22T09:10:54.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.026+0000 7f9d0e80d800 20 remove_watcher() i=1 2024-09-22T09:10:54.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.027+0000 7f9d0e80d800 20 remove_watcher() i=2 2024-09-22T09:10:54.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.029+0000 7f9d0e80d800 20 remove_watcher() i=3 2024-09-22T09:10:54.031 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.030+0000 7f9d0e80d800 20 remove_watcher() i=4 2024-09-22T09:10:54.033 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.032+0000 7f9d0e80d800 20 remove_watcher() i=5 2024-09-22T09:10:54.034 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.033+0000 7f9d0e80d800 20 remove_watcher() i=6 2024-09-22T09:10:54.035 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.034+0000 7f9d0e80d800 20 remove_watcher() i=7 2024-09-22T09:10:54.051 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:10:54.051 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:10:54.088 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:10:54.118 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:10:54.118 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:10:54.160 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.158+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 realm 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.162 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.160+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.163 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.161+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:54.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.161+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.162+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:10:54.164 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.162+0000 7f16baf75800 20 searching for the correct realm 2024-09-22T09:10:54.165 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.164+0000 7f16b9260640 0 -- 172.21.15.39:0/3896703806 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f16ac0d2040 msgr2=0x7f16ac0ae1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:54.371 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.370+0000 7f16b825e640 0 -- 172.21.15.39:0/3896703806 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f16b0041950 msgr2=0x7f16b0024420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:10:54.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:10:54.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:10:54.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:10:54.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.577+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.578+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.578+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.578+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:10:54.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.578+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 zone default found 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 4 Realm: () 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:10:54.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 zonegroup default 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.579+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.580+0000 7f16baf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.580+0000 7f16baf75800 20 started sync module instance, tier type = 2024-09-22T09:10:54.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.580+0000 7f16baf75800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:10:54.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=0 2024-09-22T09:10:54.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=1 2024-09-22T09:10:54.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=2 2024-09-22T09:10:54.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=3 2024-09-22T09:10:54.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=4 2024-09-22T09:10:54.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=5 2024-09-22T09:10:54.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.591+0000 7f16baf75800 20 add_watcher() i=6 2024-09-22T09:10:54.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.592+0000 7f16baf75800 20 add_watcher() i=7 2024-09-22T09:10:54.593 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.592+0000 7f16baf75800 2 all 8 watchers are set, enabling cache 2024-09-22T09:10:54.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f156efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:54.595 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f16baf75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f16baf75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f16baf75800 5 note: GC not initialized 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f156dfe3640 20 reqs_thread_entry: start 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f16baf75800 20 init_complete bucket index max shards: 1 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.594+0000 7f16baf75800 20 Filter name: none 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f14df7fe640 20 reqs_thread_entry: start 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:10:54.596 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.595+0000 7f16baf75800 20 rados->read ofs=0 len=0 2024-09-22T09:10:54.597 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:10:54.598 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:10:54.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.596+0000 7f16baf75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:10:54.599 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.598+0000 7f156efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:10:54.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.600+0000 7f16baf75800 20 remove_watcher() i=0 2024-09-22T09:10:54.601 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.600+0000 7f16baf75800 2 removed watcher, disabling cache 2024-09-22T09:10:54.602 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.601+0000 7f16baf75800 20 remove_watcher() i=1 2024-09-22T09:10:54.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.603+0000 7f16baf75800 20 remove_watcher() i=2 2024-09-22T09:10:54.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.604+0000 7f16baf75800 20 remove_watcher() i=3 2024-09-22T09:10:54.606 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.605+0000 7f16baf75800 20 remove_watcher() i=4 2024-09-22T09:10:54.607 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.606+0000 7f16baf75800 20 remove_watcher() i=5 2024-09-22T09:10:54.608 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.607+0000 7f16baf75800 20 remove_watcher() i=6 2024-09-22T09:10:54.609 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:10:54.608+0000 7f16baf75800 20 remove_watcher() i=7 2024-09-22T09:11:24.624 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-22T09:11:24.657 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:24.657 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:24.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.700+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:24.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:24.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 20 realm 2024-09-22T09:11:24.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:24.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:24.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:24.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.702+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:24.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.703+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:24.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.703+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:24.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.704+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:24.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.704+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:24.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.704+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:24.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.704+0000 7fdd3ff35800 20 searching for the correct realm 2024-09-22T09:11:24.709 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.707+0000 7fdd3c422640 0 -- 172.21.15.39:0/715530332 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x55aea1123100 msgr2=0x7fdd300b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:24.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:24.913+0000 7fdd3b420640 0 -- 172.21.15.39:0/715530332 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fdd34059400 msgr2=0x7fdd34059860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:25.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:25.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:25.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:25.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:25.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:25.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:25.123 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.120+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 zone default found 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 4 Realm: () 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 zonegroup default 2024-09-22T09:11:25.124 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.121+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.122+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.122+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.122+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.122+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.123+0000 7fdd3ff35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.123+0000 7fdd3ff35800 20 started sync module instance, tier type = 2024-09-22T09:11:25.125 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.123+0000 7fdd3ff35800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:25.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=0 2024-09-22T09:11:25.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=1 2024-09-22T09:11:25.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=2 2024-09-22T09:11:25.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=3 2024-09-22T09:11:25.136 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=4 2024-09-22T09:11:25.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=5 2024-09-22T09:11:25.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.134+0000 7fdd3ff35800 20 add_watcher() i=6 2024-09-22T09:11:25.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.135+0000 7fdd3ff35800 20 add_watcher() i=7 2024-09-22T09:11:25.137 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.135+0000 7fdd3ff35800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:25.139 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.137+0000 7fdbf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:25.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:25.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:25.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 5 note: GC not initialized 2024-09-22T09:11:25.140 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdbf0fe1640 20 reqs_thread_entry: start 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 20 Filter name: none 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdb6a7fc640 20 reqs_thread_entry: start 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.138+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.141 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:25.142 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.139+0000 7fdd3ff35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:11:25.145 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.143+0000 7fdbf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:25.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.146+0000 7fdd3ff35800 20 remove_watcher() i=0 2024-09-22T09:11:25.148 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.146+0000 7fdd3ff35800 2 removed watcher, disabling cache 2024-09-22T09:11:25.149 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.147+0000 7fdd3ff35800 20 remove_watcher() i=1 2024-09-22T09:11:25.150 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.148+0000 7fdd3ff35800 20 remove_watcher() i=2 2024-09-22T09:11:25.151 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.149+0000 7fdd3ff35800 20 remove_watcher() i=3 2024-09-22T09:11:25.153 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.151+0000 7fdd3ff35800 20 remove_watcher() i=4 2024-09-22T09:11:25.154 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.152+0000 7fdd3ff35800 20 remove_watcher() i=5 2024-09-22T09:11:25.155 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.153+0000 7fdd3ff35800 20 remove_watcher() i=6 2024-09-22T09:11:25.156 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.154+0000 7fdd3ff35800 20 remove_watcher() i=7 2024-09-22T09:11:25.171 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-22T09:11:25.202 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:25.203 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:25.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.245+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 realm 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.246+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.247+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:25.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.247+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.248+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:25.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.248+0000 7fec5662f800 20 searching for the correct realm 2024-09-22T09:11:25.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.249+0000 7fec54120640 0 -- 172.21.15.39:0/537540953 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x5586f49a3430 msgr2=0x7fec4c062570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:25.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.252+0000 7fec54120640 0 -- 172.21.15.39:0/537540953 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x5586f49aba20 msgr2=0x7fec4c067450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:25.464 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.462+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 zone default found 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 4 Realm: () 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 zonegroup default 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.463+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.464+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.466 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.464+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.464+0000 7fec5662f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.464+0000 7fec5662f800 20 started sync module instance, tier type = 2024-09-22T09:11:25.467 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.464+0000 7fec5662f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=0 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=1 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=2 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=3 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=4 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=5 2024-09-22T09:11:25.477 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.475+0000 7fec5662f800 20 add_watcher() i=6 2024-09-22T09:11:25.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.476+0000 7fec5662f800 20 add_watcher() i=7 2024-09-22T09:11:25.478 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.476+0000 7fec5662f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:25.479 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.477+0000 7feb0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:25.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:25.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:25.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 5 note: GC not initialized 2024-09-22T09:11:25.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7feb09fdb640 20 reqs_thread_entry: start 2024-09-22T09:11:25.480 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:25.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 20 Filter name: none 2024-09-22T09:11:25.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fea7b7fe640 20 reqs_thread_entry: start 2024-09-22T09:11:25.481 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.478+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:25.482 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.479+0000 7fec5662f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:25.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.480+0000 7fec5662f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:25.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.480+0000 7fec5662f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:25.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.480+0000 7fec5662f800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:25.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.480+0000 7fec5662f800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:25.483 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.482+0000 7feb0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:25.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.484+0000 7fec5662f800 20 remove_watcher() i=0 2024-09-22T09:11:25.486 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.484+0000 7fec5662f800 2 removed watcher, disabling cache 2024-09-22T09:11:25.487 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.486+0000 7fec5662f800 20 remove_watcher() i=1 2024-09-22T09:11:25.488 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.486+0000 7fec5662f800 20 remove_watcher() i=2 2024-09-22T09:11:25.489 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.488+0000 7fec5662f800 20 remove_watcher() i=3 2024-09-22T09:11:25.491 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.490+0000 7fec5662f800 20 remove_watcher() i=4 2024-09-22T09:11:25.492 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.490+0000 7fec5662f800 20 remove_watcher() i=5 2024-09-22T09:11:25.493 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.491+0000 7fec5662f800 20 remove_watcher() i=6 2024-09-22T09:11:25.494 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.492+0000 7fec5662f800 20 remove_watcher() i=7 2024-09-22T09:11:25.507 INFO:tasks.workunit.client.0.smithi039.stderr:check reshard logrecord successfully 2024-09-22T09:11:25.507 INFO:tasks.workunit.client.0.smithi039.stderr: test: reshard versioned bucket 2024-09-22T09:11:25.509 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T09:11:25.539 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:25.539 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:25.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.579+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 20 realm 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.581+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.582+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:25.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.582+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.583+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:25.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.583+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:25.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.583+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:25.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.583+0000 7f558c126800 20 searching for the correct realm 2024-09-22T09:11:25.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.586+0000 7f55886d7640 0 -- 172.21.15.39:0/259129646 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f557c06b020 msgr2=0x7f557c096ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:25.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.792+0000 7f55876d5640 0 -- 172.21.15.39:0/259129646 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f558000ac20 msgr2=0x7f5580032920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:26.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:25.999+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:26.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 zone default found 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 4 Realm: () 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 zonegroup default 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.000+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 started sync module instance, tier type = 2024-09-22T09:11:26.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.001+0000 7f558c126800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=0 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=1 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=2 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=3 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=4 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=5 2024-09-22T09:11:26.013 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.012+0000 7f558c126800 20 add_watcher() i=6 2024-09-22T09:11:26.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.013+0000 7f558c126800 20 add_watcher() i=7 2024-09-22T09:11:26.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.013+0000 7f558c126800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f543e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:26.016 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f558c126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f558c126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f558c126800 5 note: GC not initialized 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f543d7e2640 20 reqs_thread_entry: start 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f558c126800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.015+0000 7f558c126800 20 Filter name: none 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.016+0000 7f54367fc640 20 reqs_thread_entry: start 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.016+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.016+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:26.017 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.016+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.017+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:26.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.017+0000 7f558c126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:26.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.017+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.018 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.017+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:26.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.017+0000 7f558c126800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.018+0000 7f558c126800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:26.019 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.018+0000 7f558c126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:26.020 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.019+0000 7f543e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:26.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.022+0000 7f558c126800 20 remove_watcher() i=0 2024-09-22T09:11:26.023 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.022+0000 7f558c126800 2 removed watcher, disabling cache 2024-09-22T09:11:26.024 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.023+0000 7f558c126800 20 remove_watcher() i=1 2024-09-22T09:11:26.025 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.024+0000 7f558c126800 20 remove_watcher() i=2 2024-09-22T09:11:26.026 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.025+0000 7f558c126800 20 remove_watcher() i=3 2024-09-22T09:11:26.027 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.026+0000 7f558c126800 20 remove_watcher() i=4 2024-09-22T09:11:26.028 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.027+0000 7f558c126800 20 remove_watcher() i=5 2024-09-22T09:11:26.029 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.028+0000 7f558c126800 20 remove_watcher() i=6 2024-09-22T09:11:26.030 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.029+0000 7f558c126800 20 remove_watcher() i=7 2024-09-22T09:11:26.042 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:26.042 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:11:26.042 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: myver id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-22T09:11:26.042 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:26.044 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-22T09:11:26.075 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:26.075 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:26.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.115+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 20 realm 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.116+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.117+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.117+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.118+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:26.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.118+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.118+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:26.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.118+0000 7ff283735800 20 searching for the correct realm 2024-09-22T09:11:26.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.120+0000 7ff27fc22640 0 -- 172.21.15.39:0/852153253 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff27406d070 msgr2=0x7ff274088970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:26.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.327+0000 7ff27ec20640 0 -- 172.21.15.39:0/852153253 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7ff278024b90 msgr2=0x7ff27808b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:26.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:26.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:26.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:26.535 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:26.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:26.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:26.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.536 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.534+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:26.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:26.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 zone default found 2024-09-22T09:11:26.537 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 4 Realm: () 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 zonegroup default 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.535+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.536+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.536+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.536+0000 7ff283735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.536+0000 7ff283735800 20 started sync module instance, tier type = 2024-09-22T09:11:26.538 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.536+0000 7ff283735800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:26.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=0 2024-09-22T09:11:26.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=1 2024-09-22T09:11:26.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=2 2024-09-22T09:11:26.547 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=3 2024-09-22T09:11:26.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=4 2024-09-22T09:11:26.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=5 2024-09-22T09:11:26.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.546+0000 7ff283735800 20 add_watcher() i=6 2024-09-22T09:11:26.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.547+0000 7ff283735800 20 add_watcher() i=7 2024-09-22T09:11:26.548 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.547+0000 7ff283735800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:26.550 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.549+0000 7ff135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:26.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:26.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:26.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 5 note: GC not initialized 2024-09-22T09:11:26.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff134fe1640 20 reqs_thread_entry: start 2024-09-22T09:11:26.551 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:26.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 20 Filter name: none 2024-09-22T09:11:26.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff0ae7fc640 20 reqs_thread_entry: start 2024-09-22T09:11:26.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T09:11:26.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.550+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.552 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : miss 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 adding default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.553 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.551+0000 7ff283735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:26.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff283735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff283735800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff283735800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff283735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:26.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff162ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529753 cookie 94754425053856 notifier 8502 bl.length()=821 2024-09-22T09:11:26.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff162ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff162ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.556+0000 7ff162ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.558+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:26.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.558+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:26.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.558+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:26.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.558+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:26.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:26.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:26.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:26.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:26.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.0 2024-09-22T09:11:26.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:26.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.560+0000 7ff283735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:26.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff283735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff283735800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff283735800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff283735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:26.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff162ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529754 cookie 94754425053856 notifier 8502 bl.length()=821 2024-09-22T09:11:26.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff162ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff162ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.562+0000 7ff162ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.564+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:26.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.564+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:26.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.564+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:26.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.564+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:26.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.565+0000 7ff283735800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.0 2024-09-22T09:11:26.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.565+0000 7ff283735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:26.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.565+0000 7ff283735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff283735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff283735800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff283735800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff283735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff1627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529755 cookie 94754425053856 notifier 8502 bl.length()=789 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff1627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff1627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:26.568 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.567+0000 7ff1627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:26.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.568+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:26.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.568+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:26.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.568+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:26.569 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.568+0000 7ff283735800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:26.570 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.569+0000 7ff283735800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-22T09:11:26.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.571+0000 7ff135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:26.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.574+0000 7ff283735800 20 remove_watcher() i=0 2024-09-22T09:11:26.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.574+0000 7ff283735800 2 removed watcher, disabling cache 2024-09-22T09:11:26.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.575+0000 7ff283735800 20 remove_watcher() i=1 2024-09-22T09:11:26.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.578+0000 7ff283735800 20 remove_watcher() i=2 2024-09-22T09:11:26.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.580+0000 7ff283735800 20 remove_watcher() i=3 2024-09-22T09:11:26.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.581+0000 7ff283735800 20 remove_watcher() i=4 2024-09-22T09:11:26.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.582+0000 7ff283735800 20 remove_watcher() i=5 2024-09-22T09:11:26.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.583+0000 7ff283735800 20 remove_watcher() i=6 2024-09-22T09:11:26.585 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.584+0000 7ff283735800 20 remove_watcher() i=7 2024-09-22T09:11:26.598 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T09:11:26.628 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:26.628 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:26.668 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.667+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.668+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.668+0000 7f8608210800 20 realm 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:26.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.669+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.670+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:26.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.670+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:26.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.671+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:26.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.671+0000 7f8608210800 20 searching for the correct realm 2024-09-22T09:11:26.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.673+0000 7f86041bd640 0 -- 172.21.15.39:0/3577086596 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f85f8035030 msgr2=0x7f85f804e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:26.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:26.880+0000 7f86031bb640 0 -- 172.21.15.39:0/3577086596 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f85fc0730a0 msgr2=0x7f85fc071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.087+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:27.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:27.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 zone default found 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 4 Realm: () 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 zonegroup default 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.088+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.089+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.089+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.090+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.090+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.090+0000 7f8608210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.090+0000 7f8608210800 20 started sync module instance, tier type = 2024-09-22T09:11:27.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.090+0000 7f8608210800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:27.101 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=0 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=1 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=2 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=3 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=4 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=5 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.100+0000 7f8608210800 20 add_watcher() i=6 2024-09-22T09:11:27.102 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.102+0000 7f8608210800 20 add_watcher() i=7 2024-09-22T09:11:27.103 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.102+0000 7f8608210800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:27.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.103+0000 7f84b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:27.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 5 note: GC not initialized 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f84b8fe1640 20 reqs_thread_entry: start 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 20 Filter name: none 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f84327fc640 20 reqs_thread_entry: start 2024-09-22T09:11:27.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.104+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.105+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.105+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:27.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:27.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.106+0000 7f8608210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:27.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.108+0000 7f84b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:27.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.111+0000 7f8608210800 20 remove_watcher() i=0 2024-09-22T09:11:27.112 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.111+0000 7f8608210800 2 removed watcher, disabling cache 2024-09-22T09:11:27.113 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.112+0000 7f8608210800 20 remove_watcher() i=1 2024-09-22T09:11:27.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.113+0000 7f8608210800 20 remove_watcher() i=2 2024-09-22T09:11:27.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.114+0000 7f8608210800 20 remove_watcher() i=3 2024-09-22T09:11:27.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.115+0000 7f8608210800 20 remove_watcher() i=4 2024-09-22T09:11:27.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.117+0000 7f8608210800 20 remove_watcher() i=5 2024-09-22T09:11:27.119 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.118+0000 7f8608210800 20 remove_watcher() i=6 2024-09-22T09:11:27.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.119+0000 7f8608210800 20 remove_watcher() i=7 2024-09-22T09:11:27.132 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:27.132 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:11:27.132 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: myver id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-22T09:11:27.132 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:27.135 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:27.135 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:27.153 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:27.154 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:27.212 INFO:tasks.workunit.client.0.smithi039.stderr: test: reshard removes olh entries with empty name 2024-09-22T09:11:27.214 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:27.214 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:27.287 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:27.287 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:27.486 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-22T09:11:27.515 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:27.515 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:27.555 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.554+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 20 realm 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.556+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.557+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.557+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.557+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:27.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.557+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.558+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:27.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.558+0000 7f8f9632e800 20 searching for the correct realm 2024-09-22T09:11:27.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.560+0000 7f8f928de640 0 -- 172.21.15.39:0/2530763869 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8f7c017070 msgr2=0x7f8f7c02e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:27.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.767+0000 7f8f918dc640 0 -- 172.21.15.39:0/2530763869 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8f8c02d410 msgr2=0x7f8f8c02d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:27.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:27.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.975+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 zone default found 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 4 Realm: () 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:27.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 zonegroup default 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.976+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.977+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.977+0000 7f8f9632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.977+0000 7f8f9632e800 20 started sync module instance, tier type = 2024-09-22T09:11:27.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.977+0000 7f8f9632e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=0 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=1 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=2 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=3 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=4 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=5 2024-09-22T09:11:27.988 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.987+0000 7f8f9632e800 20 add_watcher() i=6 2024-09-22T09:11:27.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.988+0000 7f8f9632e800 20 add_watcher() i=7 2024-09-22T09:11:27.989 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.988+0000 7f8f9632e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:27.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.990+0000 7f8e48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.990+0000 7f8f9632e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.990+0000 7f8f9632e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.990+0000 7f8f9632e800 5 note: GC not initialized 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.990+0000 7f8dc37fe640 20 reqs_thread_entry: start 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.991+0000 7f8f9632e800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.991+0000 7f8f9632e800 20 Filter name: none 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.991+0000 7f8dc17fa640 20 reqs_thread_entry: start 2024-09-22T09:11:27.992 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.991+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.991+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:27.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.992+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.992+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.992+0000 7f8f9632e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.992+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.993+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.993+0000 7f8f9632e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.993+0000 7f8f9632e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:27.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.993+0000 7f8f9632e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:27.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.994+0000 7f8e48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:27.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.997+0000 7f8f9632e800 20 remove_watcher() i=0 2024-09-22T09:11:27.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.997+0000 7f8f9632e800 2 removed watcher, disabling cache 2024-09-22T09:11:27.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.998+0000 7f8f9632e800 20 remove_watcher() i=1 2024-09-22T09:11:28.000 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:27.999+0000 7f8f9632e800 20 remove_watcher() i=2 2024-09-22T09:11:28.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.000+0000 7f8f9632e800 20 remove_watcher() i=3 2024-09-22T09:11:28.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.001+0000 7f8f9632e800 20 remove_watcher() i=4 2024-09-22T09:11:28.003 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.002+0000 7f8f9632e800 20 remove_watcher() i=5 2024-09-22T09:11:28.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.003+0000 7f8f9632e800 20 remove_watcher() i=6 2024-09-22T09:11:28.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.004+0000 7f8f9632e800 20 remove_watcher() i=7 2024-09-22T09:11:28.017 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:28.017 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:11:28.017 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: a-bucket id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-22T09:11:28.017 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:28.019 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-22T09:11:28.048 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:28.048 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:28.087 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.086+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.089 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 20 realm 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.088+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.089+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.090 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.089+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.090+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:28.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.090+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.090+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:28.091 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.090+0000 7fd9e3373800 20 searching for the correct realm 2024-09-22T09:11:28.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.093+0000 7fd9e165e640 0 -- 172.21.15.39:0/412935926 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd9cc018020 msgr2=0x7fd9cc09b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:28.098 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.097+0000 7fd9dbfff640 0 -- 172.21.15.39:0/412935926 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd9dc026040 msgr2=0x7fd9dc00c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:28.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:28.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.303+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:28.306 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:28.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 zone default found 2024-09-22T09:11:28.307 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 4 Realm: () 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 zonegroup default 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.304+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.305+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.310 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.305+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.305+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.305+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.306+0000 7fd9e3373800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.306+0000 7fd9e3373800 20 started sync module instance, tier type = 2024-09-22T09:11:28.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.306+0000 7fd9e3373800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=0 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=1 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=2 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=3 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=4 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=5 2024-09-22T09:11:28.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.316+0000 7fd9e3373800 20 add_watcher() i=6 2024-09-22T09:11:28.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.317+0000 7fd9e3373800 20 add_watcher() i=7 2024-09-22T09:11:28.318 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.317+0000 7fd9e3373800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:28.319 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.318+0000 7fd896fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:28.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:28.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:28.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 5 note: GC not initialized 2024-09-22T09:11:28.320 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd895fe3640 20 reqs_thread_entry: start 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 20 Filter name: none 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd8077fe640 20 reqs_thread_entry: start 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.319+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.320+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:28.321 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.320+0000 7fd9e3373800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.320+0000 7fd9e3373800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:28.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.320+0000 7fd9e3373800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:28.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.321+0000 7fd896fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:28.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.324+0000 7fd9e3373800 20 remove_watcher() i=0 2024-09-22T09:11:28.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.324+0000 7fd9e3373800 2 removed watcher, disabling cache 2024-09-22T09:11:28.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.325+0000 7fd9e3373800 20 remove_watcher() i=1 2024-09-22T09:11:28.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.326+0000 7fd9e3373800 20 remove_watcher() i=2 2024-09-22T09:11:28.328 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.327+0000 7fd9e3373800 20 remove_watcher() i=3 2024-09-22T09:11:28.329 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.328+0000 7fd9e3373800 20 remove_watcher() i=4 2024-09-22T09:11:28.330 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.329+0000 7fd9e3373800 20 remove_watcher() i=5 2024-09-22T09:11:28.331 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.330+0000 7fd9e3373800 20 remove_watcher() i=6 2024-09-22T09:11:28.332 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.331+0000 7fd9e3373800 20 remove_watcher() i=7 2024-09-22T09:11:28.346 INFO:tasks.workunit.client.0.smithi039.stderr:rados -p default.rgw.buckets.index setomapval .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-22T09:11:28.372 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:28.372 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:28.389 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T09:11:28.418 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:28.419 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:28.459 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.458+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.459+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.459+0000 7fa917a0e800 20 realm 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.459+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.460+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.460+0000 7fa917a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.460+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.460+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.460+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.461 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.461+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:28.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.461+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.461+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:28.462 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.461+0000 7fa917a0e800 20 searching for the correct realm 2024-09-22T09:11:28.465 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.464+0000 7fa913a1b640 0 -- 172.21.15.39:0/2191548464 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa9080692b0 msgr2=0x7fa9080a4ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:28.469 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.468+0000 7fa912a19640 0 -- 172.21.15.39:0/2191548464 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa90c01a910 msgr2=0x7fa90c02e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.674+0000 7fa917a0e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.676 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.675+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 zone default found 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 4 Realm: () 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 zonegroup default 2024-09-22T09:11:28.678 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.676+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.677+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.677+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.677+0000 7fa917a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.677+0000 7fa917a0e800 20 started sync module instance, tier type = 2024-09-22T09:11:28.679 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.677+0000 7fa917a0e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:28.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=0 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=1 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=2 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=3 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=4 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=5 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.687+0000 7fa917a0e800 20 add_watcher() i=6 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.688+0000 7fa917a0e800 20 add_watcher() i=7 2024-09-22T09:11:28.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.688+0000 7fa917a0e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:28.691 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.690+0000 7fa7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:28.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:28.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:28.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 5 note: GC not initialized 2024-09-22T09:11:28.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa7c8fe1640 20 reqs_thread_entry: start 2024-09-22T09:11:28.692 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:28.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 20 Filter name: none 2024-09-22T09:11:28.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa7427fc640 20 reqs_thread_entry: start 2024-09-22T09:11:28.693 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.691+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 INFO: main: starting shard=0 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.692+0000 7fa917a0e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T09:11:28.694 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 INFO: main: starting shard=1 2024-09-22T09:11:28.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:28.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:28.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:28.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 INFO: main: starting shard=2 2024-09-22T09:11:28.695 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:28.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.693+0000 7fa917a0e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:28.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.694+0000 7fa917a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:28.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.694+0000 7fa917a0e800 20 INFO: main: done 2024-09-22T09:11:28.696 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.695+0000 7fa7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:28.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.698+0000 7fa917a0e800 20 remove_watcher() i=0 2024-09-22T09:11:28.699 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.698+0000 7fa917a0e800 2 removed watcher, disabling cache 2024-09-22T09:11:28.700 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.699+0000 7fa917a0e800 20 remove_watcher() i=1 2024-09-22T09:11:28.701 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.700+0000 7fa917a0e800 20 remove_watcher() i=2 2024-09-22T09:11:28.702 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.702+0000 7fa917a0e800 20 remove_watcher() i=3 2024-09-22T09:11:28.703 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.703+0000 7fa917a0e800 20 remove_watcher() i=4 2024-09-22T09:11:28.704 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.704+0000 7fa917a0e800 20 remove_watcher() i=5 2024-09-22T09:11:28.705 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.704+0000 7fa917a0e800 20 remove_watcher() i=6 2024-09-22T09:11:28.706 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.705+0000 7fa917a0e800 20 remove_watcher() i=7 2024-09-22T09:11:28.719 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-22T09:11:28.751 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:28.751 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:28.791 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.790+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.792 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 20 realm 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.791+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.792+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:28.793 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.792+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.793+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:28.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.793+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:28.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.793+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:28.794 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.793+0000 7f0ba05af800 20 searching for the correct realm 2024-09-22T09:11:28.796 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:28.795+0000 7f0b9e89a640 0 -- 172.21.15.39:0/2860944561 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f0b9403e360 msgr2=0x7f0b9403dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:29.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.001+0000 7f0b9d898640 0 -- 172.21.15.39:0/2860944561 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f0b9806ebc0 msgr2=0x7f0b98071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:29.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:29.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:29.209 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:29.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.208+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 zone default found 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 4 Realm: () 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 zonegroup default 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.209+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.210+0000 7f0ba05af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.210+0000 7f0ba05af800 20 started sync module instance, tier type = 2024-09-22T09:11:29.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.210+0000 7f0ba05af800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=0 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=1 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=2 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=3 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=4 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=5 2024-09-22T09:11:29.221 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.220+0000 7f0ba05af800 20 add_watcher() i=6 2024-09-22T09:11:29.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.221+0000 7f0ba05af800 20 add_watcher() i=7 2024-09-22T09:11:29.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.221+0000 7f0ba05af800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:29.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0ba05af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0ba05af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0ba05af800 5 note: GC not initialized 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f09cf7fe640 20 reqs_thread_entry: start 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0ba05af800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.223+0000 7f0ba05af800 20 Filter name: none 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f09cd7fa640 20 reqs_thread_entry: start 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-22T09:11:29.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : miss 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.224+0000 7f0ba05af800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.226 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:29.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.227 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.225+0000 7f0ba05af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0ba05af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0ba05af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0ba05af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0ba05af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0a817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529757 cookie 94244924690816 notifier 8012 bl.length()=827 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0a817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.230 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0a817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.229+0000 7f0a817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.231 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.231+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:11:29.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.231+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:11:29.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.231+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:11:29.232 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.231+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:11:29.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:11:29.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:11:29.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:29.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.234+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.235+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.235+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.235+0000 7f0ba05af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:29.236 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.235+0000 7f0ba05af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:11:29.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0ba05af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0ba05af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0ba05af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0ba05af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529758 cookie 94244924690816 notifier 8012 bl.length()=827 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0a81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.237+0000 7f0a81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.238+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:11:29.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.238+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:11:29.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.238+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:11:29.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.238+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:11:29.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.240+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:29.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.240+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.0 2024-09-22T09:11:29.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.240+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:29.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.240+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.1 2024-09-22T09:11:29.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.241+0000 7f0ba05af800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:29.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.241+0000 7f0ba05af800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.2.2 2024-09-22T09:11:29.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.241+0000 7f0ba05af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:29.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.241+0000 7f0ba05af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0ba05af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0ba05af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0ba05af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0ba05af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17, ofs0, ns] 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529759 cookie 94244924690816 notifier 8012 bl.length()=795 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 info.flags=0x17 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0a81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.17 to cache LRU end 2024-09-22T09:11:29.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.243+0000 7f0a81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:29.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.244+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_sources= new_sources= 2024-09-22T09:11:29.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.244+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential sources added=[] removed=[] 2024-09-22T09:11:29.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.244+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): orig_dests= new_dests= 2024-09-22T09:11:29.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.244+0000 7f0ba05af800 20 handle_bi_update(): bucket=:a-bucket[530e834e-7701-4a35-ad82-1b0744ba8777.4617.17]): potential dests added=[] removed=[] 2024-09-22T09:11:29.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.247+0000 7f0ba05af800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-22T09:11:29.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.248+0000 7f0a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:29.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.251+0000 7f0ba05af800 20 remove_watcher() i=0 2024-09-22T09:11:29.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.251+0000 7f0ba05af800 2 removed watcher, disabling cache 2024-09-22T09:11:29.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.252+0000 7f0ba05af800 20 remove_watcher() i=1 2024-09-22T09:11:29.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.253+0000 7f0ba05af800 20 remove_watcher() i=2 2024-09-22T09:11:29.255 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.254+0000 7f0ba05af800 20 remove_watcher() i=3 2024-09-22T09:11:29.256 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.255+0000 7f0ba05af800 20 remove_watcher() i=4 2024-09-22T09:11:29.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.256+0000 7f0ba05af800 20 remove_watcher() i=5 2024-09-22T09:11:29.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.257+0000 7f0ba05af800 20 remove_watcher() i=6 2024-09-22T09:11:29.259 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.258+0000 7f0ba05af800 20 remove_watcher() i=7 2024-09-22T09:11:29.272 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-22T09:11:29.301 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:29.301 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:29.342 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.340+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.343 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 realm 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.342+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.343+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:29.344 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.343+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.344+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:29.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.344+0000 7f55ae13b800 20 searching for the correct realm 2024-09-22T09:11:29.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.346+0000 7f55aa626640 0 -- 172.21.15.39:0/770501143 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f55a0082060 msgr2=0x7f55a0069b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:29.352 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.351+0000 7f55a9624640 0 -- 172.21.15.39:0/770501143 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f55a4017070 msgr2=0x7f55a4060420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:29.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:29.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:29.560 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.558+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:29.562 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:29.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 zone default found 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 4 Realm: () 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 zonegroup default 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.559+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 started sync module instance, tier type = 2024-09-22T09:11:29.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.560+0000 7f55ae13b800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=0 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=1 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=2 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=3 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=4 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=5 2024-09-22T09:11:29.572 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.571+0000 7f55ae13b800 20 add_watcher() i=6 2024-09-22T09:11:29.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.572+0000 7f55ae13b800 20 add_watcher() i=7 2024-09-22T09:11:29.573 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.572+0000 7f55ae13b800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:29.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.574+0000 7f545b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.574+0000 7f55ae13b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.574+0000 7f55ae13b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.574+0000 7f55ae13b800 5 note: GC not initialized 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.574+0000 7f545a7fc640 20 reqs_thread_entry: start 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f55ae13b800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f55ae13b800 20 Filter name: none 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f53cbfff640 20 reqs_thread_entry: start 2024-09-22T09:11:29.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=176 2024-09-22T09:11:29.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.575+0000 7f55ae13b800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 rados_obj.operate() r=0 bl.length=398 2024-09-22T09:11:29.577 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 INFO: main: starting shard=0 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.17.3.0 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.576+0000 7f55ae13b800 20 INFO: main: done 2024-09-22T09:11:29.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.577+0000 7f545b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:29.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.580+0000 7f55ae13b800 20 remove_watcher() i=0 2024-09-22T09:11:29.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.580+0000 7f55ae13b800 2 removed watcher, disabling cache 2024-09-22T09:11:29.582 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.581+0000 7f55ae13b800 20 remove_watcher() i=1 2024-09-22T09:11:29.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.582+0000 7f55ae13b800 20 remove_watcher() i=2 2024-09-22T09:11:29.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.583+0000 7f55ae13b800 20 remove_watcher() i=3 2024-09-22T09:11:29.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.585+0000 7f55ae13b800 20 remove_watcher() i=4 2024-09-22T09:11:29.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.586+0000 7f55ae13b800 20 remove_watcher() i=5 2024-09-22T09:11:29.588 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.587+0000 7f55ae13b800 20 remove_watcher() i=6 2024-09-22T09:11:29.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.588+0000 7f55ae13b800 20 remove_watcher() i=7 2024-09-22T09:11:29.600 INFO:tasks.workunit.client.0.smithi039.stderr: test: PUT succeeds during reshard 2024-09-22T09:11:29.602 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T09:11:29.632 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:29.632 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:29.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.670+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 realm 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:29.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.672+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.673+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:29.674 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.673+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:29.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.674+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:29.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.674+0000 7f2334a98800 20 searching for the correct realm 2024-09-22T09:11:29.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.676+0000 7f2332d83640 0 -- 172.21.15.39:0/824021761 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f232804b040 msgr2=0x7f232804c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:29.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:29.883+0000 7f2331d81640 0 -- 172.21.15.39:0/824021761 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f232c07d040 msgr2=0x7f232c0ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:30.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:30.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:30.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:30.093 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.091+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:30.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 zone default found 2024-09-22T09:11:30.094 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 4 Realm: () 2024-09-22T09:11:30.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:30.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:30.095 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 zonegroup default 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.092+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.093+0000 7f2334a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.093+0000 7f2334a98800 20 started sync module instance, tier type = 2024-09-22T09:11:30.096 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.093+0000 7f2334a98800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:30.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=0 2024-09-22T09:11:30.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=1 2024-09-22T09:11:30.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=2 2024-09-22T09:11:30.104 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=3 2024-09-22T09:11:30.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=4 2024-09-22T09:11:30.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=5 2024-09-22T09:11:30.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.103+0000 7f2334a98800 20 add_watcher() i=6 2024-09-22T09:11:30.105 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.104+0000 7f2334a98800 20 add_watcher() i=7 2024-09-22T09:11:30.106 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.104+0000 7f2334a98800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:30.107 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.106+0000 7f21e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:30.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:30.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:30.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 5 note: GC not initialized 2024-09-22T09:11:30.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f21637fe640 20 reqs_thread_entry: start 2024-09-22T09:11:30.108 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 20 Filter name: none 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f21617fa640 20 reqs_thread_entry: start 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.107+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.109 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.108+0000 7f2334a98800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.109+0000 7f2334a98800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:30.110 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.109+0000 7f2334a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:30.111 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.110+0000 7f21e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:30.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.113+0000 7f2334a98800 20 remove_watcher() i=0 2024-09-22T09:11:30.114 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.113+0000 7f2334a98800 2 removed watcher, disabling cache 2024-09-22T09:11:30.115 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.114+0000 7f2334a98800 20 remove_watcher() i=1 2024-09-22T09:11:30.116 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.115+0000 7f2334a98800 20 remove_watcher() i=2 2024-09-22T09:11:30.117 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.116+0000 7f2334a98800 20 remove_watcher() i=3 2024-09-22T09:11:30.118 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.118+0000 7f2334a98800 20 remove_watcher() i=4 2024-09-22T09:11:30.120 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.119+0000 7f2334a98800 20 remove_watcher() i=5 2024-09-22T09:11:30.121 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.120+0000 7f2334a98800 20 remove_watcher() i=6 2024-09-22T09:11:30.122 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.121+0000 7f2334a98800 20 remove_watcher() i=7 2024-09-22T09:11:30.134 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:30.134 INFO:tasks.workunit.client.0.smithi039.stderr:BUCKET_STATS: 2024-09-22T09:11:30.134 INFO:tasks.workunit.client.0.smithi039.stderr:bucket: myver id: 530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-22T09:11:30.134 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:30.135 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-22T09:11:30.170 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:30.170 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:30.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.209+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 realm 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.211+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.212+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:30.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.212+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.213+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:30.214 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.213+0000 7fe56472e800 20 searching for the correct realm 2024-09-22T09:11:30.216 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.215+0000 7fe560b65640 0 -- 172.21.15.39:0/1721536769 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fe5540b6140 msgr2=0x7fe5540ab9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:30.423 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.422+0000 7fe55fb63640 0 -- 172.21.15.39:0/1721536769 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fe558044660 msgr2=0x7fe558054930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:30.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:30.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:30.630 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.631 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.629+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 zone default found 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 4 Realm: () 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 zonegroup default 2024-09-22T09:11:30.632 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.630+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.631+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.631+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.631+0000 7fe56472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.631+0000 7fe56472e800 20 started sync module instance, tier type = 2024-09-22T09:11:30.633 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.631+0000 7fe56472e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:30.642 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=0 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=1 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=2 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=3 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=4 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=5 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=6 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.642+0000 7fe56472e800 20 add_watcher() i=7 2024-09-22T09:11:30.643 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.643+0000 7fe56472e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:30.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.644+0000 7fe416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:30.645 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.644+0000 7fe56472e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:30.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.644+0000 7fe56472e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:30.646 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 5 note: GC not initialized 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe415fdb640 20 reqs_thread_entry: start 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 20 Filter name: none 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe3877fe640 20 reqs_thread_entry: start 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.645+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:30.647 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : miss 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 adding default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:30.648 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.646+0000 7fe56472e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.650+0000 7fe56472e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.650+0000 7fe56472e800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.650+0000 7fe56472e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.650+0000 7fe56472e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.651+0000 7fe436ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529760 cookie 94119631203392 notifier 8652 bl.length()=821 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.651+0000 7fe436ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.651+0000 7fe436ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:30.652 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.651+0000 7fe436ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:30.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.652+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:30.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.652+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:30.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.652+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:30.653 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.652+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:30.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:30.656+0000 7fe56472e800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-22T09:11:31.140 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:31.140 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:31.206 INFO:tasks.workunit.client.0.smithi039.stderr:put object successful 2024-09-22T09:11:35.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:35.657 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.656+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.657+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:35.658 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.657+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:35.660 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.660+0000 7fe56472e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:35.661 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.660+0000 7fe56472e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:35.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.661+0000 7fe56472e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:35.662 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.661+0000 7fe56472e800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.661+0000 7fe56472e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.661+0000 7fe56472e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.662+0000 7fe436ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529761 cookie 94119631203392 notifier 8652 bl.length()=821 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.662+0000 7fe436ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.662+0000 7fe436ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:35.663 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.662+0000 7fe436ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:35.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.664+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:35.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.664+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:35.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.664+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:35.665 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.664+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:35.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.666+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:35.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.666+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.0 2024-09-22T09:11:35.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.666+0000 7fe56472e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:35.667 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.666+0000 7fe56472e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.1.1 2024-09-22T09:11:35.669 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.669+0000 7fe56472e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:35.670 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.669+0000 7fe56472e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:35.671 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.670+0000 7fe56472e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.670+0000 7fe56472e800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.670+0000 7fe56472e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.670+0000 7fe56472e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.670+0000 7fe436ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529762 cookie 94119631203392 notifier 8652 bl.length()=789 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.671+0000 7fe436ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.671+0000 7fe436ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:35.672 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.671+0000 7fe436ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:35.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.672+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:35.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.672+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:35.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.672+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:35.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.672+0000 7fe56472e800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:35.675 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.674+0000 7fe56472e800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-22T09:11:35.677 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.677+0000 7fe416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:35.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.679+0000 7fe56472e800 20 remove_watcher() i=0 2024-09-22T09:11:35.680 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.679+0000 7fe56472e800 2 removed watcher, disabling cache 2024-09-22T09:11:35.682 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.681+0000 7fe56472e800 20 remove_watcher() i=1 2024-09-22T09:11:35.683 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.682+0000 7fe56472e800 20 remove_watcher() i=2 2024-09-22T09:11:35.684 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.683+0000 7fe56472e800 20 remove_watcher() i=3 2024-09-22T09:11:35.686 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.685+0000 7fe56472e800 20 remove_watcher() i=4 2024-09-22T09:11:35.687 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.686+0000 7fe56472e800 20 remove_watcher() i=5 2024-09-22T09:11:35.688 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.687+0000 7fe56472e800 20 remove_watcher() i=6 2024-09-22T09:11:35.689 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:35.688+0000 7fe56472e800 20 remove_watcher() i=7 2024-09-22T09:11:36.211 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-22T09:11:36.212 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:11:36.214 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.214 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.246 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.246 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.306 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.307 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.358 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.359 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.384 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.384 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.433 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.433 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.459 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.459 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.509 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:36.509 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:36.534 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T09:11:36.960 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-22T09:11:38.387 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:38.388 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:38.474 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T09:11:38.476 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-22T09:11:38.511 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:38.511 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:38.554 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.553+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.555+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.555+0000 7f3a36532800 20 realm 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.555+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.556+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.556+0000 7f3a36532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.556+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.556+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.557 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.556+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.557+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:38.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.557+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.558 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.558+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:38.559 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.558+0000 7f3a36532800 20 searching for the correct realm 2024-09-22T09:11:38.561 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.560+0000 7f3a329bd640 0 -- 172.21.15.39:0/834503684 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f3a2802b070 msgr2=0x7f3a2803a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:38.768 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.767+0000 7f3a319bb640 0 -- 172.21.15.39:0/834503684 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f3a2c06f640 msgr2=0x7f3a2c06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:38.976 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.977 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.975+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 zone default found 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 4 Realm: () 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 zonegroup default 2024-09-22T09:11:38.978 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.976+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.977+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.977+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.977+0000 7f3a36532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.977+0000 7f3a36532800 20 started sync module instance, tier type = 2024-09-22T09:11:38.979 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.977+0000 7f3a36532800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:38.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=0 2024-09-22T09:11:38.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=1 2024-09-22T09:11:38.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=2 2024-09-22T09:11:38.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=3 2024-09-22T09:11:38.990 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=4 2024-09-22T09:11:38.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=5 2024-09-22T09:11:38.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.989+0000 7f3a36532800 20 add_watcher() i=6 2024-09-22T09:11:38.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.990+0000 7f3a36532800 20 add_watcher() i=7 2024-09-22T09:11:38.991 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.990+0000 7f3a36532800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:38.993 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.992+0000 7f38e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:38.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:38.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:38.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 5 note: GC not initialized 2024-09-22T09:11:38.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f38637fe640 20 reqs_thread_entry: start 2024-09-22T09:11:38.994 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:38.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 20 Filter name: none 2024-09-22T09:11:38.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f38617fa640 20 reqs_thread_entry: start 2024-09-22T09:11:38.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.993+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.995 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 rados->read ofs=0 len=0 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 INFO: main: starting shard=0 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.994+0000 7f3a36532800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:38.996 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.995+0000 7f3a36532800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.995+0000 7f3a36532800 20 INFO: main: starting shard=1 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.995+0000 7f3a36532800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.995+0000 7f3a36532800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.996+0000 7f3a36532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.996+0000 7f3a36532800 20 INFO: main: starting shard=2 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.996+0000 7f3a36532800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:38.997 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.996+0000 7f3a36532800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:38.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.997+0000 7f3a36532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:38.998 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.997+0000 7f3a36532800 20 INFO: main: done 2024-09-22T09:11:38.999 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:38.998+0000 7f38e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:39.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.000+0000 7f3a36532800 20 remove_watcher() i=0 2024-09-22T09:11:39.001 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.000+0000 7f3a36532800 2 removed watcher, disabling cache 2024-09-22T09:11:39.002 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.001+0000 7f3a36532800 20 remove_watcher() i=1 2024-09-22T09:11:39.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.003+0000 7f3a36532800 20 remove_watcher() i=2 2024-09-22T09:11:39.005 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.004+0000 7f3a36532800 20 remove_watcher() i=3 2024-09-22T09:11:39.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.005+0000 7f3a36532800 20 remove_watcher() i=4 2024-09-22T09:11:39.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.007+0000 7f3a36532800 20 remove_watcher() i=5 2024-09-22T09:11:39.009 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.008+0000 7f3a36532800 20 remove_watcher() i=6 2024-09-22T09:11:39.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.009+0000 7f3a36532800 20 remove_watcher() i=7 2024-09-22T09:11:39.026 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:39.026 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:39.052 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:39.052 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:39.133 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T09:11:39.138 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-22T09:11:39.167 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:39.167 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:39.207 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.206+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.208+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.208+0000 7f0307698800 20 realm 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.208+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.209+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.209+0000 7f0307698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.209+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.209+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.210 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.209+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.210+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:39.211 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.210+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.211+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:39.212 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.211+0000 7f0307698800 20 searching for the correct realm 2024-09-22T09:11:39.213 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.212+0000 7f0304981640 0 -- 172.21.15.39:0/920308763 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f02f8080410 msgr2=0x7f02f8080830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:39.217 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.216+0000 7f0305182640 0 -- 172.21.15.39:0/920308763 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f030004ab00 msgr2=0x7f0300043990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.223 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:39.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.222+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 zone default found 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 4 Realm: () 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 zonegroup default 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 started sync module instance, tier type = 2024-09-22T09:11:39.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.223+0000 7f0307698800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:39.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=0 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=1 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=2 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=3 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=4 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=5 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.233+0000 7f0307698800 20 add_watcher() i=6 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.234+0000 7f0307698800 20 add_watcher() i=7 2024-09-22T09:11:39.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.234+0000 7f0307698800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:39.237 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f0307698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f0307698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f0307698800 5 note: GC not initialized 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f01ba7e4640 20 reqs_thread_entry: start 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f0307698800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.236+0000 7f0307698800 20 Filter name: none 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f012bfff640 20 reqs_thread_entry: start 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:39.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:39.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 INFO: main: starting shard=0 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.237+0000 7f0307698800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 INFO: main: starting shard=1 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 INFO: main: starting shard=2 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:39.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.238+0000 7f0307698800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:39.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.239+0000 7f0307698800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T09:11:39.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.239+0000 7f0307698800 20 INFO: main: done 2024-09-22T09:11:39.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.240+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:39.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.242+0000 7f0307698800 20 remove_watcher() i=0 2024-09-22T09:11:39.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.242+0000 7f0307698800 2 removed watcher, disabling cache 2024-09-22T09:11:39.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.243+0000 7f0307698800 20 remove_watcher() i=1 2024-09-22T09:11:39.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.245+0000 7f0307698800 20 remove_watcher() i=2 2024-09-22T09:11:39.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.246+0000 7f0307698800 20 remove_watcher() i=3 2024-09-22T09:11:39.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.247+0000 7f0307698800 20 remove_watcher() i=4 2024-09-22T09:11:39.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.248+0000 7f0307698800 20 remove_watcher() i=5 2024-09-22T09:11:39.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.249+0000 7f0307698800 20 remove_watcher() i=6 2024-09-22T09:11:39.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.250+0000 7f0307698800 20 remove_watcher() i=7 2024-09-22T09:11:39.264 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:39.264 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:39.288 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:39.288 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:39.368 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T09:11:39.370 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-22T09:11:39.402 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:39.402 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:39.441 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.440+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.442+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.442+0000 7f767620e800 20 realm 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.442+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.443+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.443+0000 7f767620e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.443+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.443+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.444 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.443+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.444+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:39.445 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.444+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.445+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:39.446 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.445+0000 7f767620e800 20 searching for the correct realm 2024-09-22T09:11:39.448 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.447+0000 7f767216c640 0 -- 172.21.15.39:0/2355008226 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f7668078e30 msgr2=0x7f76680917c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:39.655 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.654+0000 7f767116a640 0 -- 172.21.15.39:0/2355008226 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f766c066740 msgr2=0x7f766c0818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:11:39.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:39.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:39.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:39.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:39.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:39.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:39.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.861+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 zone default found 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 4 Realm: () 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:39.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 zonegroup default 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.862+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.863+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.863+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.863+0000 7f767620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.863+0000 7f767620e800 20 started sync module instance, tier type = 2024-09-22T09:11:39.865 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.863+0000 7f767620e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:39.874 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=0 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=1 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=2 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=3 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=4 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=5 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.873+0000 7f767620e800 20 add_watcher() i=6 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.874+0000 7f767620e800 20 add_watcher() i=7 2024-09-22T09:11:39.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.874+0000 7f767620e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:39.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f7527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f767620e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f767620e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f767620e800 5 note: GC not initialized 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f7526fe5640 20 reqs_thread_entry: start 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.876+0000 7f767620e800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.877+0000 7f767620e800 20 Filter name: none 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.877+0000 7f7524fe1640 20 reqs_thread_entry: start 2024-09-22T09:11:39.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.877+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.877+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.877+0000 7f767620e800 20 rados->read ofs=0 len=0 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 INFO: main: starting shard=0 2024-09-22T09:11:39.879 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:39.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:39.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:39.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 INFO: main: starting shard=1 2024-09-22T09:11:39.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:39.880 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.878+0000 7f767620e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 20 INFO: main: starting shard=2 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.879+0000 7f767620e800 20 INFO: main: done 2024-09-22T09:11:39.881 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.880+0000 7f7527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:39.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.883+0000 7f767620e800 20 remove_watcher() i=0 2024-09-22T09:11:39.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.883+0000 7f767620e800 2 removed watcher, disabling cache 2024-09-22T09:11:39.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.884+0000 7f767620e800 20 remove_watcher() i=1 2024-09-22T09:11:39.886 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.885+0000 7f767620e800 20 remove_watcher() i=2 2024-09-22T09:11:39.887 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.886+0000 7f767620e800 20 remove_watcher() i=3 2024-09-22T09:11:39.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.888+0000 7f767620e800 20 remove_watcher() i=4 2024-09-22T09:11:39.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.889+0000 7f767620e800 20 remove_watcher() i=5 2024-09-22T09:11:39.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.890+0000 7f767620e800 20 remove_watcher() i=6 2024-09-22T09:11:39.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:39.891+0000 7f767620e800 20 remove_watcher() i=7 2024-09-22T09:11:39.905 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:39.905 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:39.930 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T09:11:40.351 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-22T09:11:40.773 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-22T09:11:40.805 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:40.805 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:40.846 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.845+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.847 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 20 realm 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.846+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.847+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.847+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.848+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:40.848 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.848+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.848+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:40.849 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.848+0000 7f16def19800 20 searching for the correct realm 2024-09-22T09:11:40.852 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.851+0000 7f16dca0a640 0 -- 172.21.15.39:0/1427018087 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f16d40cb070 msgr2=0x7f16d40a5840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:40.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.855+0000 7f16dc209640 0 -- 172.21.15.39:0/1427018087 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f16d40c7b60 msgr2=0x7f16d40c7260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.861 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:40.862 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 zone default found 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 4 Realm: () 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 zonegroup default 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.860+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.863 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:40.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 started sync module instance, tier type = 2024-09-22T09:11:40.864 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.861+0000 7f16def19800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:40.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=0 2024-09-22T09:11:40.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=1 2024-09-22T09:11:40.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=2 2024-09-22T09:11:40.872 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=3 2024-09-22T09:11:40.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=4 2024-09-22T09:11:40.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=5 2024-09-22T09:11:40.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.871+0000 7f16def19800 20 add_watcher() i=6 2024-09-22T09:11:40.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.872+0000 7f16def19800 20 add_watcher() i=7 2024-09-22T09:11:40.873 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.872+0000 7f16def19800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:40.875 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.874+0000 7f1592fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.874+0000 7f16def19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.874+0000 7f16def19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.874+0000 7f16def19800 5 note: GC not initialized 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f1591fe3640 20 reqs_thread_entry: start 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 20 Filter name: none 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f15037fe640 20 reqs_thread_entry: start 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T09:11:40.876 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : miss 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.875+0000 7f16def19800 20 rados->read ofs=0 len=0 2024-09-22T09:11:40.877 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:40.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 10 adding default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:40.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.878 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.876+0000 7f16def19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:40.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f16def19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f16def19800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f16def19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f16def19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:40.883 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f15b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529763 cookie 94407638860288 notifier 8156 bl.length()=821 2024-09-22T09:11:40.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f15b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f15b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.884 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.882+0000 7f15b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.884+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:40.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.884+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:40.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.884+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:40.885 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.884+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:40.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.0 2024-09-22T09:11:40.888 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.0 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.1 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.1 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.2 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.2 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.3 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.3 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.4 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.4 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.5 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.5 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.6 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.6 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.7 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.7 2024-09-22T09:11:40.889 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.8 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.8 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.10 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.10 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.11 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.11 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.12 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.12 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.13 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.13 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.14 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.14 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.15 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.15 2024-09-22T09:11:40.890 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.16 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.16 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.887+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.888+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:40.891 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.888+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:40.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.891+0000 7f16def19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:40.892 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.891+0000 7f16def19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.892+0000 7f16def19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.892+0000 7f16def19800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.892+0000 7f16def19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.892+0000 7f16def19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.893+0000 7f15b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529764 cookie 94407638860288 notifier 8156 bl.length()=821 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.893+0000 7f15b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.893+0000 7f15b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.894 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.893+0000 7f15b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.894+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:40.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.894+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:40.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.894+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:40.895 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.894+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:40.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:40.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.0 2024-09-22T09:11:40.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:40.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.1 2024-09-22T09:11:40.897 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:40.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.896+0000 7f16def19800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.2.2 2024-09-22T09:11:40.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.897+0000 7f16def19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : hit (requested=0x17, cached=0x17) 2024-09-22T09:11:40.898 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.897+0000 7f16def19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:40.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f16def19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f16def19800 10 moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f16def19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.899 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f16def19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18, ofs0, ns] 2024-09-22T09:11:40.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f15b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529765 cookie 94407638860288 notifier 8156 bl.length()=789 2024-09-22T09:11:40.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f15b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:40.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f15b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:40.900 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.898+0000 7f15b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:40.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.900+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_sources= new_sources= 2024-09-22T09:11:40.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.900+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential sources added=[] removed=[] 2024-09-22T09:11:40.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.900+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): orig_dests= new_dests= 2024-09-22T09:11:40.901 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.900+0000 7f16def19800 20 handle_bi_update(): bucket=:myver[530e834e-7701-4a35-ad82-1b0744ba8777.4617.18]): potential dests added=[] removed=[] 2024-09-22T09:11:40.904 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.904+0000 7f16def19800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-22T09:11:40.906 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.906+0000 7f1592fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:40.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.908+0000 7f16def19800 20 remove_watcher() i=0 2024-09-22T09:11:40.909 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.908+0000 7f16def19800 2 removed watcher, disabling cache 2024-09-22T09:11:40.910 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.909+0000 7f16def19800 20 remove_watcher() i=1 2024-09-22T09:11:40.911 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.910+0000 7f16def19800 20 remove_watcher() i=2 2024-09-22T09:11:40.912 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.911+0000 7f16def19800 20 remove_watcher() i=3 2024-09-22T09:11:40.913 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.913+0000 7f16def19800 20 remove_watcher() i=4 2024-09-22T09:11:40.914 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.914+0000 7f16def19800 20 remove_watcher() i=5 2024-09-22T09:11:40.915 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.915+0000 7f16def19800 20 remove_watcher() i=6 2024-09-22T09:11:40.917 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:40.916+0000 7f16def19800 20 remove_watcher() i=7 2024-09-22T09:11:40.929 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-22T09:11:40.965 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:40.965 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:41.004 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.003+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 realm 2024-09-22T09:11:41.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.006 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:41.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.005+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.006+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:41.007 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.006+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.007+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:41.008 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.007+0000 7f9dcef75800 20 searching for the correct realm 2024-09-22T09:11:41.010 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.009+0000 7f9dcd260640 0 -- 172.21.15.39:0/2437235142 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f9db4028040 msgr2=0x7f9db4045720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:41.014 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.013+0000 7f9dcc25e640 0 -- 172.21.15.39:0/2437235142 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f9dc40dc040 msgr2=0x7f9dc40c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.220+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:41.222 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 zone default found 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 4 Realm: () 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 zonegroup default 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.221+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.222+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.224 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.222+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.222+0000 7f9dcef75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.222+0000 7f9dcef75800 20 started sync module instance, tier type = 2024-09-22T09:11:41.225 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.222+0000 7f9dcef75800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=0 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=1 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=2 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=3 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=4 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=5 2024-09-22T09:11:41.234 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.233+0000 7f9dcef75800 20 add_watcher() i=6 2024-09-22T09:11:41.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.234+0000 7f9dcef75800 20 add_watcher() i=7 2024-09-22T09:11:41.235 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.234+0000 7f9dcef75800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:41.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.236+0000 7f9c837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:41.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:41.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:41.238 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 5 note: GC not initialized 2024-09-22T09:11:41.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9c827e4640 20 reqs_thread_entry: start 2024-09-22T09:11:41.239 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 20 Filter name: none 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9c7b7fe640 20 reqs_thread_entry: start 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.237+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 : miss 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 info.flags=0x17 2024-09-22T09:11:41.240 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 adding default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 to cache LRU end 2024-09-22T09:11:41.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:11:41.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-22T09:11:41.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:530e834e-7701-4a35-ad82-1b0744ba8777.4617.18 2024-09-22T09:11:41.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.0 2024-09-22T09:11:41.241 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.238+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.0 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.239+0000 7f9dcef75800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.239+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.1 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.239+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.1 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.2 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.2 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.3 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.3 2024-09-22T09:11:41.242 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-22T09:11:41.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.4 2024-09-22T09:11:41.243 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.240+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.4 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.241+0000 7f9dcef75800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.241+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.5 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.241+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.5 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.6 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.6 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.7 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.242+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.7 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-22T09:11:41.244 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.8 2024-09-22T09:11:41.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.8 2024-09-22T09:11:41.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-22T09:11:41.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.245 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.10 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.243+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.10 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.244+0000 7f9dcef75800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.244+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.11 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.244+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.11 2024-09-22T09:11:41.246 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-22T09:11:41.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.12 2024-09-22T09:11:41.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.12 2024-09-22T09:11:41.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-22T09:11:41.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.13 2024-09-22T09:11:41.247 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.245+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.13 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.246+0000 7f9dcef75800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.246+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.14 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.246+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.14 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.15 2024-09-22T09:11:41.248 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.15 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 10 bucket_obj is .dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.16 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.247+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.16 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.249 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:x state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to 0953reqs3fpqfbtkqpfz8qxrstsju102 2024-09-22T09:11:41.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 20 get_obj_state_impl: setting s->olh_tag to 2jeh09vgtddpu6f0hfrg7l6a5y7726jl 2024-09-22T09:11:41.250 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.248+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2jeh09vgtddpu6f0hfrg7l6a5y7726jl 2024-09-22T09:11:41.251 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.250+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.252 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.251+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-22T09:11:41.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=3 key=x[Qzub-PBl2HitvuyHabCRVzmpIGZE3uT] 2024-09-22T09:11:41.253 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:Qzub-PBl2HitvuyHabCRVzmpIGZE3uT_x state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 10 manifest: total_size = 22 2024-09-22T09:11:41.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15593352101934725318 2024-09-22T09:11:41.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:Qzub-PBl2HitvuyHabCRVzmpIGZE3uT_x state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 prepare_atomic_modification: state is not atomic. state=0x5627719cf058 2024-09-22T09:11:41.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.252+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.256+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:x state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.257 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.256+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2jeh09vgtddpu6f0hfrg7l6a5y7726jl 2024-09-22T09:11:41.258 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.257+0000 7f9ca37fe640 20 handle_completion(): completion ok for obj=x[Qzub-PBl2HitvuyHabCRVzmpIGZE3uT] 2024-09-22T09:11:41.261 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.260+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.261+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.262 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.261+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.262+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:y state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.262+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to khmjsxw0xu5erq5sfrl6500y50ydr9v9 2024-09-22T09:11:41.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.262+0000 7f9dcef75800 20 get_obj_state_impl: setting s->olh_tag to ckh0lvycacgo6d9f0kj67l49bvzcqc3i 2024-09-22T09:11:41.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.262+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ckh0lvycacgo6d9f0kj67l49bvzcqc3i 2024-09-22T09:11:41.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.263+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.265+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.265+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-22T09:11:41.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.265+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=3 key=y[pevCMe69jmzv2BRCuwjqNUdZWtlWsGC] 2024-09-22T09:11:41.266 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.265+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:pevCMe69jmzv2BRCuwjqNUdZWtlWsGC_y state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.266+0000 7f9dcef75800 10 manifest: total_size = 12 2024-09-22T09:11:41.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.266+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.15703381615541410576 2024-09-22T09:11:41.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.266+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:pevCMe69jmzv2BRCuwjqNUdZWtlWsGC_y state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.266+0000 7f9dcef75800 20 prepare_atomic_modification: state is not atomic. state=0x5627719cf058 2024-09-22T09:11:41.267 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.266+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.271 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.271+0000 7f9ca37fe640 20 handle_completion(): completion ok for obj=y[pevCMe69jmzv2BRCuwjqNUdZWtlWsGC] 2024-09-22T09:11:41.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.271+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:y state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.272 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.271+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ckh0lvycacgo6d9f0kj67l49bvzcqc3i 2024-09-22T09:11:41.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.274+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.276+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.276+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.276+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:z state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.277+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to ylkfza4l6wo6ratqik60zbreeqgw6vj4 2024-09-22T09:11:41.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.277+0000 7f9dcef75800 20 get_obj_state_impl: setting s->olh_tag to n1z3kkthyz3lr520ej97iwzdc37zkjpy 2024-09-22T09:11:41.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.277+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1z3kkthyz3lr520ej97iwzdc37zkjpy 2024-09-22T09:11:41.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.278+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.279+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-22T09:11:41.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 20 olh_log_entry: epoch=2 op=3 key=z[gR8HJgfWoFBsE2XuMgRUrKswqh2qROO] 2024-09-22T09:11:41.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:gR8HJgfWoFBsE2XuMgRUrKswqh2qROO_z state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 10 manifest: total_size = 9 2024-09-22T09:11:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 20 get_obj_state: setting s->obj_tag to 530e834e-7701-4a35-ad82-1b0744ba8777.4617.8168751271875532331 2024-09-22T09:11:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.280+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:_:gR8HJgfWoFBsE2XuMgRUrKswqh2qROO_z state=0x5627719cf058 s->prefetch_data=0 2024-09-22T09:11:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.281+0000 7f9dcef75800 20 prepare_atomic_modification: state is not atomic. state=0x5627719cf058 2024-09-22T09:11:41.282 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.281+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.285 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.284+0000 7f9ca3fff640 20 handle_completion(): completion ok for obj=z[gR8HJgfWoFBsE2XuMgRUrKswqh2qROO] 2024-09-22T09:11:41.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.285+0000 7f9dcef75800 20 get_obj_state: octx=0x5627716c40f0 obj=myver:z state=0x562771991578 s->prefetch_data=0 2024-09-22T09:11:41.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.285+0000 7f9dcef75800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n1z3kkthyz3lr520ej97iwzdc37zkjpy 2024-09-22T09:11:41.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.288+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.289+0000 7f9dcef75800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.18.3.9 2024-09-22T09:11:41.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.289+0000 7f9dcef75800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-22T09:11:41.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.289+0000 7f9dcef75800 1 NOTICE: finished all shards (3 entries removed) 2024-09-22T09:11:41.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.290+0000 7f9c837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:41.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.292+0000 7f9dcef75800 20 remove_watcher() i=0 2024-09-22T09:11:41.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.292+0000 7f9dcef75800 2 removed watcher, disabling cache 2024-09-22T09:11:41.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.293+0000 7f9dcef75800 20 remove_watcher() i=1 2024-09-22T09:11:41.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.295+0000 7f9dcef75800 20 remove_watcher() i=2 2024-09-22T09:11:41.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.296+0000 7f9dcef75800 20 remove_watcher() i=3 2024-09-22T09:11:41.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.297+0000 7f9dcef75800 20 remove_watcher() i=4 2024-09-22T09:11:41.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.298+0000 7f9dcef75800 20 remove_watcher() i=5 2024-09-22T09:11:41.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.299+0000 7f9dcef75800 20 remove_watcher() i=6 2024-09-22T09:11:41.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.300+0000 7f9dcef75800 20 remove_watcher() i=7 2024-09-22T09:11:41.315 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:41.315 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:41.354 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:41.355 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:41.451 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket stats --bucket myver 2024-09-22T09:11:41.480 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:11:41.480 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:11:41.520 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.519+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.522 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 20 realm 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.521+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.522+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.522+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.522+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:41.523 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.522+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.523+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:11:41.524 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.523+0000 7f8cea923800 20 searching for the correct realm 2024-09-22T09:11:41.526 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.525+0000 7f8ce6e0d640 0 -- 172.21.15.39:0/3964488520 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f8cd0073060 msgr2=0x7f8cd00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:41.732 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.731+0000 7f8cdde0b640 0 -- 172.21.15.39:0/3964488520 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f8ce0070650 msgr2=0x7f8ce0087650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:11:41.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:11:41.939 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.938+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:11:41.940 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:11:41.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 zone default found 2024-09-22T09:11:41.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 4 Realm: () 2024-09-22T09:11:41.941 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 zonegroup default 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.939+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.940+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.940+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.940+0000 7f8cea923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.940+0000 7f8cea923800 20 started sync module instance, tier type = 2024-09-22T09:11:41.942 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.940+0000 7f8cea923800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=0 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=1 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=2 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=3 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=4 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=5 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.949+0000 7f8cea923800 20 add_watcher() i=6 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.950+0000 7f8cea923800 20 add_watcher() i=7 2024-09-22T09:11:41.951 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.950+0000 7f8cea923800 2 all 8 watchers are set, enabling cache 2024-09-22T09:11:41.953 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.952+0000 7f8b9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.952+0000 7f8cea923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.952+0000 7f8cea923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 5 note: GC not initialized 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8b177fe640 20 reqs_thread_entry: start 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 20 init_complete bucket index max shards: 1 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 20 Filter name: none 2024-09-22T09:11:41.954 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8b157fa640 20 reqs_thread_entry: start 2024-09-22T09:11:41.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.955 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.953+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.954+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.954+0000 7f8cea923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.954+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.954+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=173 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.954+0000 7f8cea923800 20 rados->read ofs=0 len=0 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.955+0000 7f8cea923800 20 rados_obj.operate() r=0 bl.length=395 2024-09-22T09:11:41.956 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.955+0000 7f8cea923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:11:41.958 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.957+0000 7f8b9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:11:41.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.959+0000 7f8cea923800 20 remove_watcher() i=0 2024-09-22T09:11:41.960 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.959+0000 7f8cea923800 2 removed watcher, disabling cache 2024-09-22T09:11:41.961 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.960+0000 7f8cea923800 20 remove_watcher() i=1 2024-09-22T09:11:41.962 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.961+0000 7f8cea923800 20 remove_watcher() i=2 2024-09-22T09:11:41.963 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.962+0000 7f8cea923800 20 remove_watcher() i=3 2024-09-22T09:11:41.964 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.963+0000 7f8cea923800 20 remove_watcher() i=4 2024-09-22T09:11:41.965 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.964+0000 7f8cea923800 20 remove_watcher() i=5 2024-09-22T09:11:41.966 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.965+0000 7f8cea923800 20 remove_watcher() i=6 2024-09-22T09:11:41.967 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:11:41.966+0000 7f8cea923800 20 remove_watcher() i=7 2024-09-22T09:11:41.979 INFO:tasks.workunit.client.0.smithi039.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-22T09:11:41.979 INFO:tasks.workunit.client.0.smithi039.stderr:Deleting bucket a-bucket 2024-09-22T09:11:41.982 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:41.982 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:42.007 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:42.007 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:42.061 INFO:tasks.workunit.client.0.smithi039.stderr:Deleting bucket myver 2024-09-22T09:11:42.062 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:42.062 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:42.137 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:11:42.137 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:11:42.312 INFO:tasks.workunit.client.0.smithi039.stderr:Completed resharding tests 2024-09-22T09:11:42.312 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T09:11:42.313 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T09:11:42.313 INFO:tasks.workunit.client.0.smithi039.stdout:connected to https://localhost:443 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ deactivate 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ export PATH 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ hash -r 2024-09-22T09:11:42.393 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T09:11:42.394 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset VIRTUAL_ENV 2024-09-22T09:11:42.394 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T09:11:42.394 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset -f deactivate 2024-09-22T09:11:42.394 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo OK. 2024-09-22T09:11:42.394 INFO:tasks.workunit.client.0.smithi039.stdout:OK. 2024-09-22T09:11:42.395 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T09:11:42.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T09:11:42.477 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-22T09:11:42.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T09:11:42.901 DEBUG:teuthology.parallel:result is None 2024-09-22T09:11:42.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:11:42.940 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:11:42.941 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:11:43.011 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:11:43.012 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-22T09:11:43.031 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-22T09:11:43.032 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-22T09:11:43.032 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-22T09:11:43.032 DEBUG:teuthology.orchestra.run.smithi039:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-22T09:11:43.081 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-22T09:11:47.473 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-22T09:11:47.473 DEBUG:teuthology.orchestra.run.smithi039:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-22T09:11:49.609 INFO:teuthology.orchestra.run.smithi039.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-22T09:11:50.215 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:33:19 ago on Sun 22 Sep 2024 08:38:31 AM UTC. 2024-09-22T09:11:50.361 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-22T09:11:50.362 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout:Install 5 Packages 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:11:50.363 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 46 M 2024-09-22T09:11:50.364 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 166 M 2024-09-22T09:11:50.364 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-22T09:11:51.273 INFO:teuthology.orchestra.run.smithi039.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 493 kB/s | 426 kB 00:00 2024-09-22T09:11:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 2.5 MB/s | 3.5 MB 00:01 2024-09-22T09:11:52.400 INFO:teuthology.orchestra.run.smithi039.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 45 kB/s | 26 kB 00:00 2024-09-22T09:11:52.541 INFO:teuthology.orchestra.run.smithi039.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 4.4 MB/s | 9.3 MB 00:02 2024-09-22T09:11:53.450 INFO:teuthology.orchestra.run.smithi039.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 15 MB/s | 32 MB 00:02 2024-09-22T09:11:53.450 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-22T09:11:53.451 INFO:teuthology.orchestra.run.smithi039.stdout:Total 15 MB/s | 46 MB 00:03 2024-09-22T09:11:53.894 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-22T09:11:53.917 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-22T09:11:53.917 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-22T09:11:54.420 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-22T09:11:54.420 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-22T09:11:54.957 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-22T09:11:55.114 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-22T09:11:55.317 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-22T09:11:55.961 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-22T09:11:56.004 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T09:11:56.250 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-22T09:11:56.280 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T09:11:56.521 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-22T09:11:56.568 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T09:11:56.576 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T09:11:56.586 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-22T09:11:56.620 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-22T09:11:59.298 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-22T09:11:59.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-22T09:11:59.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-22T09:11:59.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-22T09:11:59.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T09:11:59.680 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T09:11:59.681 INFO:teuthology.orchestra.run.smithi039.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-22T09:11:59.681 INFO:teuthology.orchestra.run.smithi039.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-22T09:11:59.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:11:59.681 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-22T09:12:00.079 INFO:teuthology.orchestra.run.smithi039.stdout: Gradle will be installed under /opt/gradle 2024-09-22T09:12:00.166 INFO:teuthology.orchestra.run.smithi039.stderr:--2024-09-22 09:12:00-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-22T09:12:00.314 INFO:teuthology.orchestra.run.smithi039.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-22T09:12:00.322 INFO:teuthology.orchestra.run.smithi039.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-22T09:12:00.393 INFO:teuthology.orchestra.run.smithi039.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-22T09:12:00.393 INFO:teuthology.orchestra.run.smithi039.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-22T09:12:00.393 INFO:teuthology.orchestra.run.smithi039.stderr:--2024-09-22 09:12:00-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-22T09:12:00.393 INFO:teuthology.orchestra.run.smithi039.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-22T09:12:00.403 INFO:teuthology.orchestra.run.smithi039.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-22T09:12:00.539 INFO:teuthology.orchestra.run.smithi039.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-22T09:12:00.539 INFO:teuthology.orchestra.run.smithi039.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T091200Z&X-Amz-Expires=300&X-Amz-Signature=89908954eff8bb9639f21bc6c8b1e89da6f8ce288baa71c7e8d1027ef3f724a1&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-22T09:12:00.539 INFO:teuthology.orchestra.run.smithi039.stderr:--2024-09-22 09:12:00-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240922%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240922T091200Z&X-Amz-Expires=300&X-Amz-Signature=89908954eff8bb9639f21bc6c8b1e89da6f8ce288baa71c7e8d1027ef3f724a1&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-22T09:12:00.539 INFO:teuthology.orchestra.run.smithi039.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.111.133, 185.199.110.133, ... 2024-09-22T09:12:00.551 INFO:teuthology.orchestra.run.smithi039.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-22T09:12:00.628 INFO:teuthology.orchestra.run.smithi039.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-22T09:12:00.628 INFO:teuthology.orchestra.run.smithi039.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-22T09:12:00.628 INFO:teuthology.orchestra.run.smithi039.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-22T09:12:00.628 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:12:00.650 INFO:teuthology.orchestra.run.smithi039.stderr: 0K .......... .......... .......... .......... .......... 0% 2.12M 43s 2024-09-22T09:12:00.653 INFO:teuthology.orchestra.run.smithi039.stderr: 50K .......... .......... .......... .......... .......... 0% 15.1M 24s 2024-09-22T09:12:00.663 INFO:teuthology.orchestra.run.smithi039.stderr: 100K .......... .......... .......... .......... .......... 0% 5.41M 22s 2024-09-22T09:12:00.665 INFO:teuthology.orchestra.run.smithi039.stderr: 150K .......... .......... .......... .......... .......... 0% 17.2M 18s 2024-09-22T09:12:00.667 INFO:teuthology.orchestra.run.smithi039.stderr: 200K .......... .......... .......... .......... .......... 0% 39.4M 15s 2024-09-22T09:12:00.669 INFO:teuthology.orchestra.run.smithi039.stderr: 250K .......... .......... .......... .......... .......... 0% 22.3M 13s 2024-09-22T09:12:00.675 INFO:teuthology.orchestra.run.smithi039.stderr: 300K .......... .......... .......... .......... .......... 0% 8.04M 13s 2024-09-22T09:12:00.676 INFO:teuthology.orchestra.run.smithi039.stderr: 350K .......... .......... .......... .......... .......... 0% 36.5M 11s 2024-09-22T09:12:00.678 INFO:teuthology.orchestra.run.smithi039.stderr: 400K .......... .......... .......... .......... .......... 0% 33.6M 10s 2024-09-22T09:12:00.678 INFO:teuthology.orchestra.run.smithi039.stderr: 450K .......... .......... .......... .......... .......... 0% 81.0M 9s 2024-09-22T09:12:00.679 INFO:teuthology.orchestra.run.smithi039.stderr: 500K .......... .......... .......... .......... .......... 0% 42.8M 9s 2024-09-22T09:12:00.680 INFO:teuthology.orchestra.run.smithi039.stderr: 550K .......... .......... .......... .......... .......... 0% 58.3M 8s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 600K .......... .......... .......... .......... .......... 0% 7.87M 8s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 650K .......... .......... .......... .......... .......... 0% 59.6M 8s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 700K .......... .......... .......... .......... .......... 0% 220M 7s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 750K .......... .......... .......... .......... .......... 0% 71.8M 7s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 800K .......... .......... .......... .......... .......... 0% 59.1M 7s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 850K .......... .......... .......... .......... .......... 0% 62.9M 6s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 900K .......... .......... .......... .......... .......... 1% 73.0M 6s 2024-09-22T09:12:00.697 INFO:teuthology.orchestra.run.smithi039.stderr: 950K .......... .......... .......... .......... .......... 1% 328M 6s 2024-09-22T09:12:00.698 INFO:teuthology.orchestra.run.smithi039.stderr: 1000K .......... .......... .......... .......... .......... 1% 75.1M 6s 2024-09-22T09:12:00.698 INFO:teuthology.orchestra.run.smithi039.stderr: 1050K .......... .......... .......... .......... .......... 1% 85.2M 5s 2024-09-22T09:12:00.698 INFO:teuthology.orchestra.run.smithi039.stderr: 1100K .......... .......... .......... .......... .......... 1% 81.2M 5s 2024-09-22T09:12:00.698 INFO:teuthology.orchestra.run.smithi039.stderr: 1150K .......... .......... .......... .......... .......... 1% 360M 5s 2024-09-22T09:12:00.698 INFO:teuthology.orchestra.run.smithi039.stderr: 1200K .......... .......... .......... .......... .......... 1% 91.6M 5s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1250K .......... .......... .......... .......... .......... 1% 9.85M 5s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1300K .......... .......... .......... .......... .......... 1% 245M 5s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1350K .......... .......... .......... .......... .......... 1% 103M 5s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1400K .......... .......... .......... .......... .......... 1% 327M 5s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1450K .......... .......... .......... .......... .......... 1% 108M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1500K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1550K .......... .......... .......... .......... .......... 1% 122M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1600K .......... .......... .......... .......... .......... 1% 381M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1650K .......... .......... .......... .......... .......... 1% 101M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1700K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-22T09:12:02.100 INFO:teuthology.orchestra.run.smithi039.stderr: 1750K .......... .......... .......... .......... .......... 1% 140M 4s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 1800K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 1850K .......... .......... .......... .......... .......... 2% 259M 4s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 1900K .......... .......... .......... .......... .......... 2% 165M 4s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 1950K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2000K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2050K .......... .......... .......... .......... .......... 2% 128M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2100K .......... .......... .......... .......... .......... 2% 298M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2150K .......... .......... .......... .......... .......... 2% 185M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2200K .......... .......... .......... .......... .......... 2% 225M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2250K .......... .......... .......... .......... .......... 2% 176M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2300K .......... .......... .......... .......... .......... 2% 268M 3s 2024-09-22T09:12:02.101 INFO:teuthology.orchestra.run.smithi039.stderr: 2350K .......... .......... .......... .......... .......... 2% 212M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2400K .......... .......... .......... .......... .......... 2% 164M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2450K .......... .......... .......... .......... .......... 2% 183M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2500K .......... .......... .......... .......... .......... 2% 11.6M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2550K .......... .......... .......... .......... .......... 2% 229M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2600K .......... .......... .......... .......... .......... 2% 364M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2650K .......... .......... .......... .......... .......... 2% 323M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2700K .......... .......... .......... .......... .......... 2% 240M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2750K .......... .......... .......... .......... .......... 3% 369M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2800K .......... .......... .......... .......... .......... 3% 208M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2850K .......... .......... .......... .......... .......... 3% 186M 3s 2024-09-22T09:12:02.102 INFO:teuthology.orchestra.run.smithi039.stderr: 2900K .......... .......... .......... .......... .......... 3% 246M 3s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 2950K .......... .......... .......... .......... .......... 3% 302M 3s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3000K .......... .......... .......... .......... .......... 3% 226M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3050K .......... .......... .......... .......... .......... 3% 316M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3100K .......... .......... .......... .......... .......... 3% 266M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3150K .......... .......... .......... .......... .......... 3% 262M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3200K .......... .......... .......... .......... .......... 3% 205M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3250K .......... .......... .......... .......... .......... 3% 306M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3300K .......... .......... .......... .......... .......... 3% 365M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3350K .......... .......... .......... .......... .......... 3% 303M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3400K .......... .......... .......... .......... .......... 3% 202M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3450K .......... .......... .......... .......... .......... 3% 323M 2s 2024-09-22T09:12:02.103 INFO:teuthology.orchestra.run.smithi039.stderr: 3500K .......... .......... .......... .......... .......... 3% 363M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3550K .......... .......... .......... .......... .......... 3% 360M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3600K .......... .......... .......... .......... .......... 3% 272M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3650K .......... .......... .......... .......... .......... 3% 310M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3700K .......... .......... .......... .......... .......... 4% 275M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3750K .......... .......... .......... .......... .......... 4% 357M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3800K .......... .......... .......... .......... .......... 4% 350M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3850K .......... .......... .......... .......... .......... 4% 322M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3900K .......... .......... .......... .......... .......... 4% 269M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 3950K .......... .......... .......... .......... .......... 4% 367M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 4000K .......... .......... .......... .......... .......... 4% 366M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 4050K .......... .......... .......... .......... .......... 4% 295M 2s 2024-09-22T09:12:02.104 INFO:teuthology.orchestra.run.smithi039.stderr: 4100K .......... .......... .......... .......... .......... 4% 358M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4150K .......... .......... .......... .......... .......... 4% 327M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4200K .......... .......... .......... .......... .......... 4% 338M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4250K .......... .......... .......... .......... .......... 4% 338M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4300K .......... .......... .......... .......... .......... 4% 356M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4350K .......... .......... .......... .......... .......... 4% 350M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4400K .......... .......... .......... .......... .......... 4% 358M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4450K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4500K .......... .......... .......... .......... .......... 4% 372M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4550K .......... .......... .......... .......... .......... 4% 381M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4600K .......... .......... .......... .......... .......... 5% 378M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4650K .......... .......... .......... .......... .......... 5% 344M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4700K .......... .......... .......... .......... .......... 5% 384M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4750K .......... .......... .......... .......... .......... 5% 311M 2s 2024-09-22T09:12:02.105 INFO:teuthology.orchestra.run.smithi039.stderr: 4800K .......... .......... .......... .......... .......... 5% 355M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 4850K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 4900K .......... .......... .......... .......... .......... 5% 355M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 4950K .......... .......... .......... .......... .......... 5% 372M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5000K .......... .......... .......... .......... .......... 5% 367M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5050K .......... .......... .......... .......... .......... 5% 14.1M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5100K .......... .......... .......... .......... .......... 5% 346M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5150K .......... .......... .......... .......... .......... 5% 161M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5200K .......... .......... .......... .......... .......... 5% 367M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5250K .......... .......... .......... .......... .......... 5% 287M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5300K .......... .......... .......... .......... .......... 5% 352M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5350K .......... .......... .......... .......... .......... 5% 360M 2s 2024-09-22T09:12:02.106 INFO:teuthology.orchestra.run.smithi039.stderr: 5400K .......... .......... .......... .......... .......... 5% 358M 2s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5450K .......... .......... .......... .......... .......... 5% 330M 2s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5500K .......... .......... .......... .......... .......... 5% 365M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5550K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5600K .......... .......... .......... .......... .......... 6% 335M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5650K .......... .......... .......... .......... .......... 6% 305M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5700K .......... .......... .......... .......... .......... 6% 377M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5750K .......... .......... .......... .......... .......... 6% 373M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5800K .......... .......... .......... .......... .......... 6% 323M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5850K .......... .......... .......... .......... .......... 6% 329M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5900K .......... .......... .......... .......... .......... 6% 373M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 5950K .......... .......... .......... .......... .......... 6% 380M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 6000K .......... .......... .......... .......... .......... 6% 358M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 6050K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-22T09:12:02.107 INFO:teuthology.orchestra.run.smithi039.stderr: 6100K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6150K .......... .......... .......... .......... .......... 6% 367M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6200K .......... .......... .......... .......... .......... 6% 369M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6250K .......... .......... .......... .......... .......... 6% 324M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6300K .......... .......... .......... .......... .......... 6% 364M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6350K .......... .......... .......... .......... .......... 6% 359M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6400K .......... .......... .......... .......... .......... 6% 374M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6450K .......... .......... .......... .......... .......... 6% 302M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6500K .......... .......... .......... .......... .......... 7% 324M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6550K .......... .......... .......... .......... .......... 7% 366M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6600K .......... .......... .......... .......... .......... 7% 340M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6650K .......... .......... .......... .......... .......... 7% 333M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6700K .......... .......... .......... .......... .......... 7% 351M 1s 2024-09-22T09:12:02.108 INFO:teuthology.orchestra.run.smithi039.stderr: 6750K .......... .......... .......... .......... .......... 7% 375M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 6800K .......... .......... .......... .......... .......... 7% 372M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 6850K .......... .......... .......... .......... .......... 7% 306M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 6900K .......... .......... .......... .......... .......... 7% 324M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 6950K .......... .......... .......... .......... .......... 7% 363M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7000K .......... .......... .......... .......... .......... 7% 367M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7050K .......... .......... .......... .......... .......... 7% 325M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7100K .......... .......... .......... .......... .......... 7% 366M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7150K .......... .......... .......... .......... .......... 7% 290M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7200K .......... .......... .......... .......... .......... 7% 370M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7250K .......... .......... .......... .......... .......... 7% 314M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7300K .......... .......... .......... .......... .......... 7% 360M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7350K .......... .......... .......... .......... .......... 7% 378M 1s 2024-09-22T09:12:02.109 INFO:teuthology.orchestra.run.smithi039.stderr: 7400K .......... .......... .......... .......... .......... 8% 367M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7450K .......... .......... .......... .......... .......... 8% 336M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7500K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7550K .......... .......... .......... .......... .......... 8% 384M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7600K .......... .......... .......... .......... .......... 8% 374M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7650K .......... .......... .......... .......... .......... 8% 310M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7700K .......... .......... .......... .......... .......... 8% 344M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7750K .......... .......... .......... .......... .......... 8% 290M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7800K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7850K .......... .......... .......... .......... .......... 8% 374M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7900K .......... .......... .......... .......... .......... 8% 364M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 7950K .......... .......... .......... .......... .......... 8% 302M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 8000K .......... .......... .......... .......... .......... 8% 367M 1s 2024-09-22T09:12:02.110 INFO:teuthology.orchestra.run.smithi039.stderr: 8050K .......... .......... .......... .......... .......... 8% 16.5M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8100K .......... .......... .......... .......... .......... 8% 307M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8150K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8200K .......... .......... .......... .......... .......... 8% 192M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8250K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8300K .......... .......... .......... .......... .......... 8% 364M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8350K .......... .......... .......... .......... .......... 9% 144M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8400K .......... .......... .......... .......... .......... 9% 357M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8450K .......... .......... .......... .......... .......... 9% 377M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8500K .......... .......... .......... .......... .......... 9% 386M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8550K .......... .......... .......... .......... .......... 9% 345M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8600K .......... .......... .......... .......... .......... 9% 351M 1s 2024-09-22T09:12:02.111 INFO:teuthology.orchestra.run.smithi039.stderr: 8650K .......... .......... .......... .......... .......... 9% 329M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8700K .......... .......... .......... .......... .......... 9% 338M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8750K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8800K .......... .......... .......... .......... .......... 9% 264M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8850K .......... .......... .......... .......... .......... 9% 343M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8900K .......... .......... .......... .......... .......... 9% 348M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 8950K .......... .......... .......... .......... .......... 9% 324M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9000K .......... .......... .......... .......... .......... 9% 367M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9050K .......... .......... .......... .......... .......... 9% 344M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9100K .......... .......... .......... .......... .......... 9% 362M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9150K .......... .......... .......... .......... .......... 9% 284M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9200K .......... .......... .......... .......... .......... 9% 371M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9250K .......... .......... .......... .......... .......... 10% 361M 1s 2024-09-22T09:12:02.112 INFO:teuthology.orchestra.run.smithi039.stderr: 9300K .......... .......... .......... .......... .......... 10% 365M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9350K .......... .......... .......... .......... .......... 10% 356M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9400K .......... .......... .......... .......... .......... 10% 273M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9450K .......... .......... .......... .......... .......... 10% 361M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9500K .......... .......... .......... .......... .......... 10% 363M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9550K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9600K .......... .......... .......... .......... .......... 10% 329M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9650K .......... .......... .......... .......... .......... 10% 364M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9700K .......... .......... .......... .......... .......... 10% 329M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9750K .......... .......... .......... .......... .......... 10% 336M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9800K .......... .......... .......... .......... .......... 10% 356M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9850K .......... .......... .......... .......... .......... 10% 351M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9900K .......... .......... .......... .......... .......... 10% 343M 1s 2024-09-22T09:12:02.113 INFO:teuthology.orchestra.run.smithi039.stderr: 9950K .......... .......... .......... .......... .......... 10% 287M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10000K .......... .......... .......... .......... .......... 10% 352M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10050K .......... .......... .......... .......... .......... 10% 324M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10100K .......... .......... .......... .......... .......... 10% 357M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10150K .......... .......... .......... .......... .......... 10% 283M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10200K .......... .......... .......... .......... .......... 11% 311M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10250K .......... .......... .......... .......... .......... 11% 377M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10300K .......... .......... .......... .......... .......... 11% 276M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10350K .......... .......... .......... .......... .......... 11% 323M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10400K .......... .......... .......... .......... .......... 11% 252M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10450K .......... .......... .......... .......... .......... 11% 287M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10500K .......... .......... .......... .......... .......... 11% 313M 1s 2024-09-22T09:12:02.114 INFO:teuthology.orchestra.run.smithi039.stderr: 10550K .......... .......... .......... .......... .......... 11% 367M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10600K .......... .......... .......... .......... .......... 11% 376M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10650K .......... .......... .......... .......... .......... 11% 314M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10700K .......... .......... .......... .......... .......... 11% 257M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10750K .......... .......... .......... .......... .......... 11% 343M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10800K .......... .......... .......... .......... .......... 11% 316M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10850K .......... .......... .......... .......... .......... 11% 339M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10900K .......... .......... .......... .......... .......... 11% 277M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 10950K .......... .......... .......... .......... .......... 11% 333M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 11000K .......... .......... .......... .......... .......... 11% 294M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 11050K .......... .......... .......... .......... .......... 11% 352M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 11100K .......... .......... .......... .......... .......... 12% 285M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 11150K .......... .......... .......... .......... .......... 12% 26.2M 1s 2024-09-22T09:12:02.115 INFO:teuthology.orchestra.run.smithi039.stderr: 11200K .......... .......... .......... .......... .......... 12% 69.9M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11250K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11300K .......... .......... .......... .......... .......... 12% 269M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11350K .......... .......... .......... .......... .......... 12% 322M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11400K .......... .......... .......... .......... .......... 12% 331M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11450K .......... .......... .......... .......... .......... 12% 167M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11500K .......... .......... .......... .......... .......... 12% 133M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11550K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11600K .......... .......... .......... .......... .......... 12% 309M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11650K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11700K .......... .......... .......... .......... .......... 12% 335M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11750K .......... .......... .......... .......... .......... 12% 367M 1s 2024-09-22T09:12:02.116 INFO:teuthology.orchestra.run.smithi039.stderr: 11800K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 11850K .......... .......... .......... .......... .......... 12% 213M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 11900K .......... .......... .......... .......... .......... 12% 302M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 11950K .......... .......... .......... .......... .......... 12% 354M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12000K .......... .......... .......... .......... .......... 12% 369M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12050K .......... .......... .......... .......... .......... 13% 362M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12100K .......... .......... .......... .......... .......... 13% 331M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12150K .......... .......... .......... .......... .......... 13% 359M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12200K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12250K .......... .......... .......... .......... .......... 13% 360M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12300K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-22T09:12:02.117 INFO:teuthology.orchestra.run.smithi039.stderr: 12350K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12400K .......... .......... .......... .......... .......... 13% 374M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12450K .......... .......... .......... .......... .......... 13% 346M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12500K .......... .......... .......... .......... .......... 13% 331M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12550K .......... .......... .......... .......... .......... 13% 367M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12600K .......... .......... .......... .......... .......... 13% 320M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12650K .......... .......... .......... .......... .......... 13% 367M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12700K .......... .......... .......... .......... .......... 13% 341M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12750K .......... .......... .......... .......... .......... 13% 329M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12800K .......... .......... .......... .......... .......... 13% 306M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12850K .......... .......... .......... .......... .......... 13% 370M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12900K .......... .......... .......... .......... .......... 13% 374M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 12950K .......... .......... .......... .......... .......... 13% 173M 1s 2024-09-22T09:12:02.118 INFO:teuthology.orchestra.run.smithi039.stderr: 13000K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13050K .......... .......... .......... .......... .......... 14% 363M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13100K .......... .......... .......... .......... .......... 14% 335M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13150K .......... .......... .......... .......... .......... 14% 363M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13200K .......... .......... .......... .......... .......... 14% 328M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13250K .......... .......... .......... .......... .......... 14% 350M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13300K .......... .......... .......... .......... .......... 14% 335M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13350K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13400K .......... .......... .......... .......... .......... 14% 366M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13450K .......... .......... .......... .......... .......... 14% 259M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13500K .......... .......... .......... .......... .......... 14% 292M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13550K .......... .......... .......... .......... .......... 14% 359M 1s 2024-09-22T09:12:02.119 INFO:teuthology.orchestra.run.smithi039.stderr: 13600K .......... .......... .......... .......... .......... 14% 363M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13650K .......... .......... .......... .......... .......... 14% 359M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13700K .......... .......... .......... .......... .......... 14% 336M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13750K .......... .......... .......... .......... .......... 14% 357M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13800K .......... .......... .......... .......... .......... 14% 355M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13850K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13900K .......... .......... .......... .......... .......... 15% 125M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 13950K .......... .......... .......... .......... .......... 15% 331M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14000K .......... .......... .......... .......... .......... 15% 369M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14050K .......... .......... .......... .......... .......... 15% 353M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14100K .......... .......... .......... .......... .......... 15% 334M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14150K .......... .......... .......... .......... .......... 15% 29.8M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14200K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14250K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-22T09:12:02.120 INFO:teuthology.orchestra.run.smithi039.stderr: 14300K .......... .......... .......... .......... .......... 15% 68.7M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14350K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14400K .......... .......... .......... .......... .......... 15% 340M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14450K .......... .......... .......... .......... .......... 15% 316M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14500K .......... .......... .......... .......... .......... 15% 334M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14550K .......... .......... .......... .......... .......... 15% 222M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14600K .......... .......... .......... .......... .......... 15% 116M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14650K .......... .......... .......... .......... .......... 15% 288M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14700K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14750K .......... .......... .......... .......... .......... 15% 359M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14800K .......... .......... .......... .......... .......... 15% 145M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14850K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14900K .......... .......... .......... .......... .......... 16% 309M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 14950K .......... .......... .......... .......... .......... 16% 360M 1s 2024-09-22T09:12:02.121 INFO:teuthology.orchestra.run.smithi039.stderr: 15000K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15050K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15100K .......... .......... .......... .......... .......... 16% 300M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15150K .......... .......... .......... .......... .......... 16% 354M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15200K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15250K .......... .......... .......... .......... .......... 16% 357M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15300K .......... .......... .......... .......... .......... 16% 337M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15350K .......... .......... .......... .......... .......... 16% 165M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15400K .......... .......... .......... .......... .......... 16% 359M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15450K .......... .......... .......... .......... .......... 16% 296M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15500K .......... .......... .......... .......... .......... 16% 290M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15550K .......... .......... .......... .......... .......... 16% 352M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15600K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-22T09:12:02.122 INFO:teuthology.orchestra.run.smithi039.stderr: 15650K .......... .......... .......... .......... .......... 16% 363M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15700K .......... .......... .......... .......... .......... 16% 307M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15750K .......... .......... .......... .......... .......... 17% 368M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15800K .......... .......... .......... .......... .......... 17% 362M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15850K .......... .......... .......... .......... .......... 17% 349M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15900K .......... .......... .......... .......... .......... 17% 308M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 15950K .......... .......... .......... .......... .......... 17% 179M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16000K .......... .......... .......... .......... .......... 17% 370M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16050K .......... .......... .......... .......... .......... 17% 366M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16100K .......... .......... .......... .......... .......... 17% 329M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16150K .......... .......... .......... .......... .......... 17% 233M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16200K .......... .......... .......... .......... .......... 17% 354M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16250K .......... .......... .......... .......... .......... 17% 386M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16300K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-22T09:12:02.123 INFO:teuthology.orchestra.run.smithi039.stderr: 16350K .......... .......... .......... .......... .......... 17% 302M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16400K .......... .......... .......... .......... .......... 17% 324M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16450K .......... .......... .......... .......... .......... 17% 361M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16500K .......... .......... .......... .......... .......... 17% 313M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16550K .......... .......... .......... .......... .......... 17% 361M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16600K .......... .......... .......... .......... .......... 17% 368M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16650K .......... .......... .......... .......... .......... 17% 136M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16700K .......... .......... .......... .......... .......... 18% 241M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16750K .......... .......... .......... .......... .......... 18% 155M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16800K .......... .......... .......... .......... .......... 18% 358M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16850K .......... .......... .......... .......... .......... 18% 329M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16900K .......... .......... .......... .......... .......... 18% 325M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 16950K .......... .......... .......... .......... .......... 18% 306M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 17000K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-22T09:12:02.124 INFO:teuthology.orchestra.run.smithi039.stderr: 17050K .......... .......... .......... .......... .......... 18% 156M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17100K .......... .......... .......... .......... .......... 18% 282M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17150K .......... .......... .......... .......... .......... 18% 59.7M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17200K .......... .......... .......... .......... .......... 18% 362M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17250K .......... .......... .......... .......... .......... 18% 376M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17300K .......... .......... .......... .......... .......... 18% 60.5M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17350K .......... .......... .......... .......... .......... 18% 362M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17400K .......... .......... .......... .......... .......... 18% 356M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17450K .......... .......... .......... .......... .......... 18% 249M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17500K .......... .......... .......... .......... .......... 18% 310M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17550K .......... .......... .......... .......... .......... 18% 328M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17600K .......... .......... .......... .......... .......... 18% 360M 1s 2024-09-22T09:12:02.125 INFO:teuthology.orchestra.run.smithi039.stderr: 17650K .......... .......... .......... .......... .......... 19% 104M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17700K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17750K .......... .......... .......... .......... .......... 19% 344M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17800K .......... .......... .......... .......... .......... 19% 366M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17850K .......... .......... .......... .......... .......... 19% 90.0M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17900K .......... .......... .......... .......... .......... 19% 273M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 17950K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18000K .......... .......... .......... .......... .......... 19% 379M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18050K .......... .......... .......... .......... .......... 19% 355M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18100K .......... .......... .......... .......... .......... 19% 343M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18150K .......... .......... .......... .......... .......... 19% 347M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18200K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-22T09:12:02.126 INFO:teuthology.orchestra.run.smithi039.stderr: 18250K .......... .......... .......... .......... .......... 19% 383M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18300K .......... .......... .......... .......... .......... 19% 261M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18350K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18400K .......... .......... .......... .......... .......... 19% 314M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18450K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18500K .......... .......... .......... .......... .......... 19% 332M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18550K .......... .......... .......... .......... .......... 20% 175M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18600K .......... .......... .......... .......... .......... 20% 344M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18650K .......... .......... .......... .......... .......... 20% 356M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18700K .......... .......... .......... .......... .......... 20% 280M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18750K .......... .......... .......... .......... .......... 20% 357M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18800K .......... .......... .......... .......... .......... 20% 154M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18850K .......... .......... .......... .......... .......... 20% 355M 1s 2024-09-22T09:12:02.127 INFO:teuthology.orchestra.run.smithi039.stderr: 18900K .......... .......... .......... .......... .......... 20% 312M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 18950K .......... .......... .......... .......... .......... 20% 367M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19000K .......... .......... .......... .......... .......... 20% 373M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19050K .......... .......... .......... .......... .......... 20% 374M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19100K .......... .......... .......... .......... .......... 20% 117M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19150K .......... .......... .......... .......... .......... 20% 339M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19200K .......... .......... .......... .......... .......... 20% 337M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19250K .......... .......... .......... .......... .......... 20% 352M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19300K .......... .......... .......... .......... .......... 20% 316M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19350K .......... .......... .......... .......... .......... 20% 367M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19400K .......... .......... .......... .......... .......... 20% 371M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19450K .......... .......... .......... .......... .......... 20% 354M 1s 2024-09-22T09:12:02.128 INFO:teuthology.orchestra.run.smithi039.stderr: 19500K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19550K .......... .......... .......... .......... .......... 21% 347M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19600K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19650K .......... .......... .......... .......... .......... 21% 174M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19700K .......... .......... .......... .......... .......... 21% 118M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19750K .......... .......... .......... .......... .......... 21% 366M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19800K .......... .......... .......... .......... .......... 21% 345M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19850K .......... .......... .......... .......... .......... 21% 317M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19900K .......... .......... .......... .......... .......... 21% 138M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 19950K .......... .......... .......... .......... .......... 21% 113M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 20000K .......... .......... .......... .......... .......... 21% 341M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 20050K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 20100K .......... .......... .......... .......... .......... 21% 324M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 20150K .......... .......... .......... .......... .......... 21% 360M 1s 2024-09-22T09:12:02.129 INFO:teuthology.orchestra.run.smithi039.stderr: 20200K .......... .......... .......... .......... .......... 21% 308M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20250K .......... .......... .......... .......... .......... 21% 62.1M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20300K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20350K .......... .......... .......... .......... .......... 21% 350M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20400K .......... .......... .......... .......... .......... 22% 171M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20450K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20500K .......... .......... .......... .......... .......... 22% 396M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20550K .......... .......... .......... .......... .......... 22% 351M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20600K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20650K .......... .......... .......... .......... .......... 22% 150M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20700K .......... .......... .......... .......... .......... 22% 371M 1s 2024-09-22T09:12:02.130 INFO:teuthology.orchestra.run.smithi039.stderr: 20750K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 20800K .......... .......... .......... .......... .......... 22% 308M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 20850K .......... .......... .......... .......... .......... 22% 379M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 20900K .......... .......... .......... .......... .......... 22% 108M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 20950K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21000K .......... .......... .......... .......... .......... 22% 378M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21050K .......... .......... .......... .......... .......... 22% 350M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21100K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21150K .......... .......... .......... .......... .......... 22% 273M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21200K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21250K .......... .......... .......... .......... .......... 22% 369M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21300K .......... .......... .......... .......... .......... 22% 361M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21350K .......... .......... .......... .......... .......... 23% 322M 1s 2024-09-22T09:12:02.131 INFO:teuthology.orchestra.run.smithi039.stderr: 21400K .......... .......... .......... .......... .......... 23% 341M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21450K .......... .......... .......... .......... .......... 23% 353M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21500K .......... .......... .......... .......... .......... 23% 211M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21550K .......... .......... .......... .......... .......... 23% 310M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21600K .......... .......... .......... .......... .......... 23% 379M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21650K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21700K .......... .......... .......... .......... .......... 23% 361M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21750K .......... .......... .......... .......... .......... 23% 324M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21800K .......... .......... .......... .......... .......... 23% 366M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21850K .......... .......... .......... .......... .......... 23% 229M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21900K .......... .......... .......... .......... .......... 23% 356M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 21950K .......... .......... .......... .......... .......... 23% 235M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 22000K .......... .......... .......... .......... .......... 23% 365M 1s 2024-09-22T09:12:02.132 INFO:teuthology.orchestra.run.smithi039.stderr: 22050K .......... .......... .......... .......... .......... 23% 364M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22100K .......... .......... .......... .......... .......... 23% 88.7M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22150K .......... .......... .......... .......... .......... 23% 322M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22200K .......... .......... .......... .......... .......... 23% 336M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22250K .......... .......... .......... .......... .......... 24% 354M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22300K .......... .......... .......... .......... .......... 24% 286M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22350K .......... .......... .......... .......... .......... 24% 183M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22400K .......... .......... .......... .......... .......... 24% 363M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22450K .......... .......... .......... .......... .......... 24% 397M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22500K .......... .......... .......... .......... .......... 24% 331M 1s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22550K .......... .......... .......... .......... .......... 24% 320M 0s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22600K .......... .......... .......... .......... .......... 24% 359M 0s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22650K .......... .......... .......... .......... .......... 24% 367M 0s 2024-09-22T09:12:02.133 INFO:teuthology.orchestra.run.smithi039.stderr: 22700K .......... .......... .......... .......... .......... 24% 369M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 22750K .......... .......... .......... .......... .......... 24% 145M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 22800K .......... .......... .......... .......... .......... 24% 220M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 22850K .......... .......... .......... .......... .......... 24% 362M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 22900K .......... .......... .......... .......... .......... 24% 354M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 22950K .......... .......... .......... .......... .......... 24% 258M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23000K .......... .......... .......... .......... .......... 24% 91.8M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23050K .......... .......... .......... .......... .......... 24% 180M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23100K .......... .......... .......... .......... .......... 24% 382M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23150K .......... .......... .......... .......... .......... 24% 290M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23200K .......... .......... .......... .......... .......... 25% 357M 0s 2024-09-22T09:12:02.134 INFO:teuthology.orchestra.run.smithi039.stderr: 23250K .......... .......... .......... .......... .......... 25% 381M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23300K .......... .......... .......... .......... .......... 25% 92.1M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23350K .......... .......... .......... .......... .......... 25% 287M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23400K .......... .......... .......... .......... .......... 25% 174M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23450K .......... .......... .......... .......... .......... 25% 239M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23500K .......... .......... .......... .......... .......... 25% 116M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23550K .......... .......... .......... .......... .......... 25% 301M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23600K .......... .......... .......... .......... .......... 25% 386M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23650K .......... .......... .......... .......... .......... 25% 348M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23700K .......... .......... .......... .......... .......... 25% 336M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23750K .......... .......... .......... .......... .......... 25% 331M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23800K .......... .......... .......... .......... .......... 25% 369M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23850K .......... .......... .......... .......... .......... 25% 185M 0s 2024-09-22T09:12:02.135 INFO:teuthology.orchestra.run.smithi039.stderr: 23900K .......... .......... .......... .......... .......... 25% 293M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 23950K .......... .......... .......... .......... .......... 25% 106M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24000K .......... .......... .......... .......... .......... 25% 359M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24050K .......... .......... .......... .......... .......... 25% 306M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24100K .......... .......... .......... .......... .......... 25% 341M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24150K .......... .......... .......... .......... .......... 26% 252M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24200K .......... .......... .......... .......... .......... 26% 226M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24250K .......... .......... .......... .......... .......... 26% 389M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24300K .......... .......... .......... .......... .......... 26% 350M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24350K .......... .......... .......... .......... .......... 26% 273M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24400K .......... .......... .......... .......... .......... 26% 348M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24450K .......... .......... .......... .......... .......... 26% 362M 0s 2024-09-22T09:12:02.136 INFO:teuthology.orchestra.run.smithi039.stderr: 24500K .......... .......... .......... .......... .......... 26% 378M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24550K .......... .......... .......... .......... .......... 26% 313M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24600K .......... .......... .......... .......... .......... 26% 338M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24650K .......... .......... .......... .......... .......... 26% 366M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24700K .......... .......... .......... .......... .......... 26% 375M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24750K .......... .......... .......... .......... .......... 26% 197M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24800K .......... .......... .......... .......... .......... 26% 158M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24850K .......... .......... .......... .......... .......... 26% 367M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24900K .......... .......... .......... .......... .......... 26% 378M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 24950K .......... .......... .......... .......... .......... 26% 329M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 25000K .......... .......... .......... .......... .......... 26% 374M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 25050K .......... .......... .......... .......... .......... 27% 161M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 25100K .......... .......... .......... .......... .......... 27% 380M 0s 2024-09-22T09:12:02.137 INFO:teuthology.orchestra.run.smithi039.stderr: 25150K .......... .......... .......... .......... .......... 27% 188M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25200K .......... .......... .......... .......... .......... 27% 358M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25250K .......... .......... .......... .......... .......... 27% 324M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25300K .......... .......... .......... .......... .......... 27% 115M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25350K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25400K .......... .......... .......... .......... .......... 27% 372M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25450K .......... .......... .......... .......... .......... 27% 408M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25500K .......... .......... .......... .......... .......... 27% 371M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25550K .......... .......... .......... .......... .......... 27% 258M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25600K .......... .......... .......... .......... .......... 27% 98.4M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25650K .......... .......... .......... .......... .......... 27% 326M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25700K .......... .......... .......... .......... .......... 27% 383M 0s 2024-09-22T09:12:02.138 INFO:teuthology.orchestra.run.smithi039.stderr: 25750K .......... .......... .......... .......... .......... 27% 334M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 25800K .......... .......... .......... .......... .......... 27% 397M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 25850K .......... .......... .......... .......... .......... 27% 362M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 25900K .......... .......... .......... .......... .......... 27% 376M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 25950K .......... .......... .......... .......... .......... 27% 301M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26000K .......... .......... .......... .......... .......... 28% 367M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26050K .......... .......... .......... .......... .......... 28% 152M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26100K .......... .......... .......... .......... .......... 28% 143M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26150K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26200K .......... .......... .......... .......... .......... 28% 158M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26250K .......... .......... .......... .......... .......... 28% 359M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26300K .......... .......... .......... .......... .......... 28% 150M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26350K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-22T09:12:02.139 INFO:teuthology.orchestra.run.smithi039.stderr: 26400K .......... .......... .......... .......... .......... 28% 361M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26450K .......... .......... .......... .......... .......... 28% 380M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26500K .......... .......... .......... .......... .......... 28% 155M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26550K .......... .......... .......... .......... .......... 28% 84.4M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26600K .......... .......... .......... .......... .......... 28% 338M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26650K .......... .......... .......... .......... .......... 28% 364M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26700K .......... .......... .......... .......... .......... 28% 240M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26750K .......... .......... .......... .......... .......... 28% 102M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26800K .......... .......... .......... .......... .......... 28% 342M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26850K .......... .......... .......... .......... .......... 28% 365M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26900K .......... .......... .......... .......... .......... 29% 370M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 26950K .......... .......... .......... .......... .......... 29% 333M 0s 2024-09-22T09:12:02.140 INFO:teuthology.orchestra.run.smithi039.stderr: 27000K .......... .......... .......... .......... .......... 29% 331M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27050K .......... .......... .......... .......... .......... 29% 375M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27100K .......... .......... .......... .......... .......... 29% 358M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27150K .......... .......... .......... .......... .......... 29% 186M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27200K .......... .......... .......... .......... .......... 29% 192M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27250K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27300K .......... .......... .......... .......... .......... 29% 297M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27350K .......... .......... .......... .......... .......... 29% 331M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27400K .......... .......... .......... .......... .......... 29% 380M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27450K .......... .......... .......... .......... .......... 29% 374M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27500K .......... .......... .......... .......... .......... 29% 367M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27550K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27600K .......... .......... .......... .......... .......... 29% 267M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27650K .......... .......... .......... .......... .......... 29% 336M 0s 2024-09-22T09:12:02.141 INFO:teuthology.orchestra.run.smithi039.stderr: 27700K .......... .......... .......... .......... .......... 29% 358M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 27750K .......... .......... .......... .......... .......... 29% 328M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 27800K .......... .......... .......... .......... .......... 29% 366M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 27850K .......... .......... .......... .......... .......... 30% 224M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 27900K .......... .......... .......... .......... .......... 30% 376M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 27950K .......... .......... .......... .......... .......... 30% 165M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28000K .......... .......... .......... .......... .......... 30% 347M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28050K .......... .......... .......... .......... .......... 30% 372M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28100K .......... .......... .......... .......... .......... 30% 230M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28150K .......... .......... .......... .......... .......... 30% 197M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28200K .......... .......... .......... .......... .......... 30% 372M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28250K .......... .......... .......... .......... .......... 30% 357M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28300K .......... .......... .......... .......... .......... 30% 231M 0s 2024-09-22T09:12:02.142 INFO:teuthology.orchestra.run.smithi039.stderr: 28350K .......... .......... .......... .......... .......... 30% 151M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28400K .......... .......... .......... .......... .......... 30% 216M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28450K .......... .......... .......... .......... .......... 30% 351M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28500K .......... .......... .......... .......... .......... 30% 337M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28550K .......... .......... .......... .......... .......... 30% 322M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28600K .......... .......... .......... .......... .......... 30% 359M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28650K .......... .......... .......... .......... .......... 30% 216M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28700K .......... .......... .......... .......... .......... 30% 319M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28750K .......... .......... .......... .......... .......... 31% 104M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28800K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28850K .......... .......... .......... .......... .......... 31% 304M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28900K .......... .......... .......... .......... .......... 31% 368M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 28950K .......... .......... .......... .......... .......... 31% 344M 0s 2024-09-22T09:12:02.143 INFO:teuthology.orchestra.run.smithi039.stderr: 29000K .......... .......... .......... .......... .......... 31% 159M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29050K .......... .......... .......... .......... .......... 31% 290M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29100K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29150K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29200K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29250K .......... .......... .......... .......... .......... 31% 121M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29300K .......... .......... .......... .......... .......... 31% 171M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29350K .......... .......... .......... .......... .......... 31% 204M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29400K .......... .......... .......... .......... .......... 31% 355M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29450K .......... .......... .......... .......... .......... 31% 356M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29500K .......... .......... .......... .......... .......... 31% 348M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29550K .......... .......... .......... .......... .......... 31% 184M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29600K .......... .......... .......... .......... .......... 31% 102M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29650K .......... .......... .......... .......... .......... 31% 354M 0s 2024-09-22T09:12:02.144 INFO:teuthology.orchestra.run.smithi039.stderr: 29700K .......... .......... .......... .......... .......... 32% 144M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 29750K .......... .......... .......... .......... .......... 32% 147M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 29800K .......... .......... .......... .......... .......... 32% 134M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 29850K .......... .......... .......... .......... .......... 32% 373M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 29900K .......... .......... .......... .......... .......... 32% 380M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 29950K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30000K .......... .......... .......... .......... .......... 32% 344M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30050K .......... .......... .......... .......... .......... 32% 366M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30100K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30150K .......... .......... .......... .......... .......... 32% 328M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30200K .......... .......... .......... .......... .......... 32% 366M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30250K .......... .......... .......... .......... .......... 32% 381M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30300K .......... .......... .......... .......... .......... 32% 383M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30350K .......... .......... .......... .......... .......... 32% 191M 0s 2024-09-22T09:12:02.145 INFO:teuthology.orchestra.run.smithi039.stderr: 30400K .......... .......... .......... .......... .......... 32% 334M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30450K .......... .......... .......... .......... .......... 32% 318M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30500K .......... .......... .......... .......... .......... 32% 192M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30550K .......... .......... .......... .......... .......... 32% 333M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30600K .......... .......... .......... .......... .......... 32% 378M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30650K .......... .......... .......... .......... .......... 33% 238M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30700K .......... .......... .......... .......... .......... 33% 181M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30750K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30800K .......... .......... .......... .......... .......... 33% 347M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30850K .......... .......... .......... .......... .......... 33% 366M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30900K .......... .......... .......... .......... .......... 33% 318M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 30950K .......... .......... .......... .......... .......... 33% 384M 0s 2024-09-22T09:12:02.146 INFO:teuthology.orchestra.run.smithi039.stderr: 31000K .......... .......... .......... .......... .......... 33% 263M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31050K .......... .......... .......... .......... .......... 33% 337M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31100K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31150K .......... .......... .......... .......... .......... 33% 366M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31200K .......... .......... .......... .......... .......... 33% 349M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31250K .......... .......... .......... .......... .......... 33% 356M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31300K .......... .......... .......... .......... .......... 33% 323M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31350K .......... .......... .......... .......... .......... 33% 314M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31400K .......... .......... .......... .......... .......... 33% 151M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31450K .......... .......... .......... .......... .......... 33% 341M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31500K .......... .......... .......... .......... .......... 33% 180M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31550K .......... .......... .......... .......... .......... 34% 362M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31600K .......... .......... .......... .......... .......... 34% 197M 0s 2024-09-22T09:12:02.147 INFO:teuthology.orchestra.run.smithi039.stderr: 31650K .......... .......... .......... .......... .......... 34% 147M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31700K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31750K .......... .......... .......... .......... .......... 34% 369M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31800K .......... .......... .......... .......... .......... 34% 374M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31850K .......... .......... .......... .......... .......... 34% 199M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31900K .......... .......... .......... .......... .......... 34% 301M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 31950K .......... .......... .......... .......... .......... 34% 129M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32000K .......... .......... .......... .......... .......... 34% 348M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32050K .......... .......... .......... .......... .......... 34% 326M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32100K .......... .......... .......... .......... .......... 34% 315M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32150K .......... .......... .......... .......... .......... 34% 255M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32200K .......... .......... .......... .......... .......... 34% 364M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32250K .......... .......... .......... .......... .......... 34% 136M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32300K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-22T09:12:02.148 INFO:teuthology.orchestra.run.smithi039.stderr: 32350K .......... .......... .......... .......... .......... 34% 342M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32400K .......... .......... .......... .......... .......... 34% 85.2M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32450K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32500K .......... .......... .......... .......... .......... 35% 321M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32550K .......... .......... .......... .......... .......... 35% 299M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32600K .......... .......... .......... .......... .......... 35% 126M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32650K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32700K .......... .......... .......... .......... .......... 35% 289M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32750K .......... .......... .......... .......... .......... 35% 339M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32800K .......... .......... .......... .......... .......... 35% 196M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32850K .......... .......... .......... .......... .......... 35% 86.5M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32900K .......... .......... .......... .......... .......... 35% 260M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 32950K .......... .......... .......... .......... .......... 35% 150M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 33000K .......... .......... .......... .......... .......... 35% 351M 0s 2024-09-22T09:12:02.149 INFO:teuthology.orchestra.run.smithi039.stderr: 33050K .......... .......... .......... .......... .......... 35% 354M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33100K .......... .......... .......... .......... .......... 35% 310M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33150K .......... .......... .......... .......... .......... 35% 361M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33200K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33250K .......... .......... .......... .......... .......... 35% 344M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33300K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33350K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33400K .......... .......... .......... .......... .......... 36% 334M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33450K .......... .......... .......... .......... .......... 36% 258M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33500K .......... .......... .......... .......... .......... 36% 291M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33550K .......... .......... .......... .......... .......... 36% 364M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33600K .......... .......... .......... .......... .......... 36% 361M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33650K .......... .......... .......... .......... .......... 36% 368M 0s 2024-09-22T09:12:02.150 INFO:teuthology.orchestra.run.smithi039.stderr: 33700K .......... .......... .......... .......... .......... 36% 311M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 33750K .......... .......... .......... .......... .......... 36% 178M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 33800K .......... .......... .......... .......... .......... 36% 176M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 33850K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 33900K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 33950K .......... .......... .......... .......... .......... 36% 355M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34000K .......... .......... .......... .......... .......... 36% 349M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34050K .......... .......... .......... .......... .......... 36% 383M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34100K .......... .......... .......... .......... .......... 36% 338M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34150K .......... .......... .......... .......... .......... 36% 264M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34200K .......... .......... .......... .......... .......... 36% 371M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34250K .......... .......... .......... .......... .......... 36% 368M 0s 2024-09-22T09:12:02.151 INFO:teuthology.orchestra.run.smithi039.stderr: 34300K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34350K .......... .......... .......... .......... .......... 37% 378M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34400K .......... .......... .......... .......... .......... 37% 346M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34450K .......... .......... .......... .......... .......... 37% 377M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34500K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34550K .......... .......... .......... .......... .......... 37% 369M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34600K .......... .......... .......... .......... .......... 37% 334M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34650K .......... .......... .......... .......... .......... 37% 336M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34700K .......... .......... .......... .......... .......... 37% 74.7M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34750K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34800K .......... .......... .......... .......... .......... 37% 356M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34850K .......... .......... .......... .......... .......... 37% 355M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34900K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 34950K .......... .......... .......... .......... .......... 37% 360M 0s 2024-09-22T09:12:02.152 INFO:teuthology.orchestra.run.smithi039.stderr: 35000K .......... .......... .......... .......... .......... 37% 228M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35050K .......... .......... .......... .......... .......... 37% 357M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35100K .......... .......... .......... .......... .......... 37% 213M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35150K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35200K .......... .......... .......... .......... .......... 37% 162M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35250K .......... .......... .......... .......... .......... 37% 352M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35300K .......... .......... .......... .......... .......... 38% 118M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35350K .......... .......... .......... .......... .......... 38% 361M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35400K .......... .......... .......... .......... .......... 38% 369M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35450K .......... .......... .......... .......... .......... 38% 366M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35500K .......... .......... .......... .......... .......... 38% 57.9M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35550K .......... .......... .......... .......... .......... 38% 370M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35600K .......... .......... .......... .......... .......... 38% 355M 0s 2024-09-22T09:12:02.153 INFO:teuthology.orchestra.run.smithi039.stderr: 35650K .......... .......... .......... .......... .......... 38% 353M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35700K .......... .......... .......... .......... .......... 38% 337M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35750K .......... .......... .......... .......... .......... 38% 130M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35800K .......... .......... .......... .......... .......... 38% 360M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35850K .......... .......... .......... .......... .......... 38% 284M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35900K .......... .......... .......... .......... .......... 38% 101M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 35950K .......... .......... .......... .......... .......... 38% 330M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36000K .......... .......... .......... .......... .......... 38% 88.7M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36050K .......... .......... .......... .......... .......... 38% 311M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36100K .......... .......... .......... .......... .......... 38% 287M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36150K .......... .......... .......... .......... .......... 38% 338M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36200K .......... .......... .......... .......... .......... 39% 361M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36250K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36300K .......... .......... .......... .......... .......... 39% 260M 0s 2024-09-22T09:12:02.154 INFO:teuthology.orchestra.run.smithi039.stderr: 36350K .......... .......... .......... .......... .......... 39% 355M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36400K .......... .......... .......... .......... .......... 39% 351M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36450K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36500K .......... .......... .......... .......... .......... 39% 317M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36550K .......... .......... .......... .......... .......... 39% 360M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36600K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36650K .......... .......... .......... .......... .......... 39% 236M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36700K .......... .......... .......... .......... .......... 39% 311M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36750K .......... .......... .......... .......... .......... 39% 153M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36800K .......... .......... .......... .......... .......... 39% 357M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36850K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36900K .......... .......... .......... .......... .......... 39% 311M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 36950K .......... .......... .......... .......... .......... 39% 357M 0s 2024-09-22T09:12:02.155 INFO:teuthology.orchestra.run.smithi039.stderr: 37000K .......... .......... .......... .......... .......... 39% 367M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37050K .......... .......... .......... .......... .......... 39% 366M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37100K .......... .......... .......... .......... .......... 39% 307M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37150K .......... .......... .......... .......... .......... 40% 380M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37200K .......... .......... .......... .......... .......... 40% 373M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37250K .......... .......... .......... .......... .......... 40% 358M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37300K .......... .......... .......... .......... .......... 40% 132M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37350K .......... .......... .......... .......... .......... 40% 245M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37400K .......... .......... .......... .......... .......... 40% 353M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37450K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37500K .......... .......... .......... .......... .......... 40% 260M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37550K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37600K .......... .......... .......... .......... .......... 40% 214M 0s 2024-09-22T09:12:02.156 INFO:teuthology.orchestra.run.smithi039.stderr: 37650K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37700K .......... .......... .......... .......... .......... 40% 287M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37750K .......... .......... .......... .......... .......... 40% 77.8M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37800K .......... .......... .......... .......... .......... 40% 374M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37850K .......... .......... .......... .......... .......... 40% 367M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37900K .......... .......... .......... .......... .......... 40% 288M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 37950K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38000K .......... .......... .......... .......... .......... 40% 354M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38050K .......... .......... .......... .......... .......... 41% 369M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38100K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38150K .......... .......... .......... .......... .......... 41% 375M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38200K .......... .......... .......... .......... .......... 41% 351M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38250K .......... .......... .......... .......... .......... 41% 377M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38300K .......... .......... .......... .......... .......... 41% 305M 0s 2024-09-22T09:12:02.157 INFO:teuthology.orchestra.run.smithi039.stderr: 38350K .......... .......... .......... .......... .......... 41% 132M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38400K .......... .......... .......... .......... .......... 41% 349M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38450K .......... .......... .......... .......... .......... 41% 347M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38500K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38550K .......... .......... .......... .......... .......... 41% 68.6M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38600K .......... .......... .......... .......... .......... 41% 286M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38650K .......... .......... .......... .......... .......... 41% 308M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38700K .......... .......... .......... .......... .......... 41% 99.1M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38750K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38800K .......... .......... .......... .......... .......... 41% 356M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38850K .......... .......... .......... .......... .......... 41% 249M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38900K .......... .......... .......... .......... .......... 41% 293M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 38950K .......... .......... .......... .......... .......... 41% 338M 0s 2024-09-22T09:12:02.158 INFO:teuthology.orchestra.run.smithi039.stderr: 39000K .......... .......... .......... .......... .......... 42% 372M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39050K .......... .......... .......... .......... .......... 42% 74.7M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39100K .......... .......... .......... .......... .......... 42% 251M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39150K .......... .......... .......... .......... .......... 42% 244M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39200K .......... .......... .......... .......... .......... 42% 235M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39250K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39300K .......... .......... .......... .......... .......... 42% 321M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39350K .......... .......... .......... .......... .......... 42% 369M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39400K .......... .......... .......... .......... .......... 42% 322M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39450K .......... .......... .......... .......... .......... 42% 334M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39500K .......... .......... .......... .......... .......... 42% 294M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39550K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39600K .......... .......... .......... .......... .......... 42% 364M 0s 2024-09-22T09:12:02.159 INFO:teuthology.orchestra.run.smithi039.stderr: 39650K .......... .......... .......... .......... .......... 42% 355M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39700K .......... .......... .......... .......... .......... 42% 308M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39750K .......... .......... .......... .......... .......... 42% 351M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39800K .......... .......... .......... .......... .......... 42% 244M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39850K .......... .......... .......... .......... .......... 42% 118M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39900K .......... .......... .......... .......... .......... 43% 269M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 39950K .......... .......... .......... .......... .......... 43% 355M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40000K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40050K .......... .......... .......... .......... .......... 43% 360M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40100K .......... .......... .......... .......... .......... 43% 323M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40150K .......... .......... .......... .......... .......... 43% 345M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40200K .......... .......... .......... .......... .......... 43% 339M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40250K .......... .......... .......... .......... .......... 43% 378M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40300K .......... .......... .......... .......... .......... 43% 123M 0s 2024-09-22T09:12:02.160 INFO:teuthology.orchestra.run.smithi039.stderr: 40350K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40400K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40450K .......... .......... .......... .......... .......... 43% 359M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40500K .......... .......... .......... .......... .......... 43% 337M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40550K .......... .......... .......... .......... .......... 43% 358M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40600K .......... .......... .......... .......... .......... 43% 352M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40650K .......... .......... .......... .......... .......... 43% 384M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40700K .......... .......... .......... .......... .......... 43% 61.4M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40750K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40800K .......... .......... .......... .......... .......... 43% 294M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40850K .......... .......... .......... .......... .......... 44% 301M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40900K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 40950K .......... .......... .......... .......... .......... 44% 418M 0s 2024-09-22T09:12:02.161 INFO:teuthology.orchestra.run.smithi039.stderr: 41000K .......... .......... .......... .......... .......... 44% 353M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41050K .......... .......... .......... .......... .......... 44% 288M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41100K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41150K .......... .......... .......... .......... .......... 44% 269M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41200K .......... .......... .......... .......... .......... 44% 365M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41250K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41300K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41350K .......... .......... .......... .......... .......... 44% 333M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41400K .......... .......... .......... .......... .......... 44% 379M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41450K .......... .......... .......... .......... .......... 44% 361M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41500K .......... .......... .......... .......... .......... 44% 338M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41550K .......... .......... .......... .......... .......... 44% 85.5M 0s 2024-09-22T09:12:02.162 INFO:teuthology.orchestra.run.smithi039.stderr: 41600K .......... .......... .......... .......... .......... 44% 314M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41650K .......... .......... .......... .......... .......... 44% 124M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41700K .......... .......... .......... .......... .......... 44% 371M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41750K .......... .......... .......... .......... .......... 44% 136M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41800K .......... .......... .......... .......... .......... 45% 306M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41850K .......... .......... .......... .......... .......... 45% 381M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41900K .......... .......... .......... .......... .......... 45% 389M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 41950K .......... .......... .......... .......... .......... 45% 314M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42000K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42050K .......... .......... .......... .......... .......... 45% 373M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42100K .......... .......... .......... .......... .......... 45% 76.5M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42150K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42200K .......... .......... .......... .......... .......... 45% 202M 0s 2024-09-22T09:12:02.163 INFO:teuthology.orchestra.run.smithi039.stderr: 42250K .......... .......... .......... .......... .......... 45% 360M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42300K .......... .......... .......... .......... .......... 45% 160M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42350K .......... .......... .......... .......... .......... 45% 233M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42400K .......... .......... .......... .......... .......... 45% 200M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42450K .......... .......... .......... .......... .......... 45% 223M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42500K .......... .......... .......... .......... .......... 45% 360M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42550K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42600K .......... .......... .......... .......... .......... 45% 378M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42650K .......... .......... .......... .......... .......... 45% 338M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42700K .......... .......... .......... .......... .......... 46% 310M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42750K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42800K .......... .......... .......... .......... .......... 46% 385M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42850K .......... .......... .......... .......... .......... 46% 328M 0s 2024-09-22T09:12:02.164 INFO:teuthology.orchestra.run.smithi039.stderr: 42900K .......... .......... .......... .......... .......... 46% 380M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 42950K .......... .......... .......... .......... .......... 46% 347M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43000K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43050K .......... .......... .......... .......... .......... 46% 141M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43100K .......... .......... .......... .......... .......... 46% 356M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43150K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43200K .......... .......... .......... .......... .......... 46% 370M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43250K .......... .......... .......... .......... .......... 46% 395M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43300K .......... .......... .......... .......... .......... 46% 176M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43350K .......... .......... .......... .......... .......... 46% 343M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43400K .......... .......... .......... .......... .......... 46% 374M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43450K .......... .......... .......... .......... .......... 46% 77.1M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43500K .......... .......... .......... .......... .......... 46% 361M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43550K .......... .......... .......... .......... .......... 46% 312M 0s 2024-09-22T09:12:02.165 INFO:teuthology.orchestra.run.smithi039.stderr: 43600K .......... .......... .......... .......... .......... 46% 369M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43650K .......... .......... .......... .......... .......... 47% 390M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43700K .......... .......... .......... .......... .......... 47% 126M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43750K .......... .......... .......... .......... .......... 47% 179M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43800K .......... .......... .......... .......... .......... 47% 373M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43850K .......... .......... .......... .......... .......... 47% 374M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43900K .......... .......... .......... .......... .......... 47% 381M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 43950K .......... .......... .......... .......... .......... 47% 328M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 44000K .......... .......... .......... .......... .......... 47% 119M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 44050K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 44100K .......... .......... .......... .......... .......... 47% 370M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 44150K .......... .......... .......... .......... .......... 47% 346M 0s 2024-09-22T09:12:02.166 INFO:teuthology.orchestra.run.smithi039.stderr: 44200K .......... .......... .......... .......... .......... 47% 389M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44250K .......... .......... .......... .......... .......... 47% 382M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44300K .......... .......... .......... .......... .......... 47% 379M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44350K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44400K .......... .......... .......... .......... .......... 47% 402M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44450K .......... .......... .......... .......... .......... 47% 336M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44500K .......... .......... .......... .......... .......... 47% 310M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44550K .......... .......... .......... .......... .......... 48% 113M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44600K .......... .......... .......... .......... .......... 48% 302M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44650K .......... .......... .......... .......... .......... 48% 380M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44700K .......... .......... .......... .......... .......... 48% 166M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44750K .......... .......... .......... .......... .......... 48% 120M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44800K .......... .......... .......... .......... .......... 48% 364M 0s 2024-09-22T09:12:02.167 INFO:teuthology.orchestra.run.smithi039.stderr: 44850K .......... .......... .......... .......... .......... 48% 386M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 44900K .......... .......... .......... .......... .......... 48% 125M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 44950K .......... .......... .......... .......... .......... 48% 338M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45000K .......... .......... .......... .......... .......... 48% 363M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45050K .......... .......... .......... .......... .......... 48% 385M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45100K .......... .......... .......... .......... .......... 48% 360M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45150K .......... .......... .......... .......... .......... 48% 136M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45200K .......... .......... .......... .......... .......... 48% 388M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45250K .......... .......... .......... .......... .......... 48% 211M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45300K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45350K .......... .......... .......... .......... .......... 48% 89.0M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45400K .......... .......... .......... .......... .......... 48% 348M 0s 2024-09-22T09:12:02.168 INFO:teuthology.orchestra.run.smithi039.stderr: 45450K .......... .......... .......... .......... .......... 48% 173M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45500K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45550K .......... .......... .......... .......... .......... 49% 263M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45600K .......... .......... .......... .......... .......... 49% 212M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45650K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45700K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45750K .......... .......... .......... .......... .......... 49% 116M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45800K .......... .......... .......... .......... .......... 49% 381M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45850K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45900K .......... .......... .......... .......... .......... 49% 172M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 45950K .......... .......... .......... .......... .......... 49% 290M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 46000K .......... .......... .......... .......... .......... 49% 376M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 46050K .......... .......... .......... .......... .......... 49% 359M 0s 2024-09-22T09:12:02.169 INFO:teuthology.orchestra.run.smithi039.stderr: 46100K .......... .......... .......... .......... .......... 49% 341M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46150K .......... .......... .......... .......... .......... 49% 314M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46200K .......... .......... .......... .......... .......... 49% 360M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46250K .......... .......... .......... .......... .......... 49% 339M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46300K .......... .......... .......... .......... .......... 49% 243M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46350K .......... .......... .......... .......... .......... 49% 269M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46400K .......... .......... .......... .......... .......... 49% 190M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46450K .......... .......... .......... .......... .......... 50% 385M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46500K .......... .......... .......... .......... .......... 50% 273M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46550K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46600K .......... .......... .......... .......... .......... 50% 369M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46650K .......... .......... .......... .......... .......... 50% 188M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46700K .......... .......... .......... .......... .......... 50% 281M 0s 2024-09-22T09:12:02.170 INFO:teuthology.orchestra.run.smithi039.stderr: 46750K .......... .......... .......... .......... .......... 50% 287M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 46800K .......... .......... .......... .......... .......... 50% 372M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 46850K .......... .......... .......... .......... .......... 50% 355M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 46900K .......... .......... .......... .......... .......... 50% 301M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 46950K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47000K .......... .......... .......... .......... .......... 50% 382M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47050K .......... .......... .......... .......... .......... 50% 130M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47100K .......... .......... .......... .......... .......... 50% 266M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47150K .......... .......... .......... .......... .......... 50% 313M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47200K .......... .......... .......... .......... .......... 50% 348M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47250K .......... .......... .......... .......... .......... 50% 362M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47300K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-22T09:12:02.171 INFO:teuthology.orchestra.run.smithi039.stderr: 47350K .......... .......... .......... .......... .......... 51% 314M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47400K .......... .......... .......... .......... .......... 51% 374M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47450K .......... .......... .......... .......... .......... 51% 162M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47500K .......... .......... .......... .......... .......... 51% 355M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47550K .......... .......... .......... .......... .......... 51% 136M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47600K .......... .......... .......... .......... .......... 51% 158M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47650K .......... .......... .......... .......... .......... 51% 305M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47700K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47750K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47800K .......... .......... .......... .......... .......... 51% 375M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47850K .......... .......... .......... .......... .......... 51% 391M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47900K .......... .......... .......... .......... .......... 51% 158M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 47950K .......... .......... .......... .......... .......... 51% 126M 0s 2024-09-22T09:12:02.172 INFO:teuthology.orchestra.run.smithi039.stderr: 48000K .......... .......... .......... .......... .......... 51% 192M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48050K .......... .......... .......... .......... .......... 51% 354M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48100K .......... .......... .......... .......... .......... 51% 348M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48150K .......... .......... .......... .......... .......... 51% 105M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48200K .......... .......... .......... .......... .......... 51% 368M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48250K .......... .......... .......... .......... .......... 51% 376M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48300K .......... .......... .......... .......... .......... 52% 392M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48350K .......... .......... .......... .......... .......... 52% 295M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48400K .......... .......... .......... .......... .......... 52% 368M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48450K .......... .......... .......... .......... .......... 52% 73.7M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48500K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48550K .......... .......... .......... .......... .......... 52% 343M 0s 2024-09-22T09:12:02.173 INFO:teuthology.orchestra.run.smithi039.stderr: 48600K .......... .......... .......... .......... .......... 52% 154M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48650K .......... .......... .......... .......... .......... 52% 321M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48700K .......... .......... .......... .......... .......... 52% 369M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48750K .......... .......... .......... .......... .......... 52% 111M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48800K .......... .......... .......... .......... .......... 52% 274M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48850K .......... .......... .......... .......... .......... 52% 122M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48900K .......... .......... .......... .......... .......... 52% 253M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 48950K .......... .......... .......... .......... .......... 52% 141M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49000K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49050K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49100K .......... .......... .......... .......... .......... 52% 367M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49150K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49200K .......... .......... .......... .......... .......... 53% 382M 0s 2024-09-22T09:12:02.174 INFO:teuthology.orchestra.run.smithi039.stderr: 49250K .......... .......... .......... .......... .......... 53% 362M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49300K .......... .......... .......... .......... .......... 53% 386M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49350K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49400K .......... .......... .......... .......... .......... 53% 382M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49450K .......... .......... .......... .......... .......... 53% 372M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49500K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49550K .......... .......... .......... .......... .......... 53% 306M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49600K .......... .......... .......... .......... .......... 53% 364M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49650K .......... .......... .......... .......... .......... 53% 397M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49700K .......... .......... .......... .......... .......... 53% 387M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49750K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49800K .......... .......... .......... .......... .......... 53% 396M 0s 2024-09-22T09:12:02.175 INFO:teuthology.orchestra.run.smithi039.stderr: 49850K .......... .......... .......... .......... .......... 53% 240M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 49900K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 49950K .......... .......... .......... .......... .......... 53% 239M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50000K .......... .......... .......... .......... .......... 53% 296M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50050K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50100K .......... .......... .......... .......... .......... 53% 159M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50150K .......... .......... .......... .......... .......... 54% 368M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50200K .......... .......... .......... .......... .......... 54% 366M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50250K .......... .......... .......... .......... .......... 54% 216M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50300K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50350K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50400K .......... .......... .......... .......... .......... 54% 382M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50450K .......... .......... .......... .......... .......... 54% 397M 0s 2024-09-22T09:12:02.176 INFO:teuthology.orchestra.run.smithi039.stderr: 50500K .......... .......... .......... .......... .......... 54% 395M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50550K .......... .......... .......... .......... .......... 54% 348M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50600K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50650K .......... .......... .......... .......... .......... 54% 292M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50700K .......... .......... .......... .......... .......... 54% 131M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50750K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50800K .......... .......... .......... .......... .......... 54% 292M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50850K .......... .......... .......... .......... .......... 54% 342M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50900K .......... .......... .......... .......... .......... 54% 372M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 50950K .......... .......... .......... .......... .......... 54% 163M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 51000K .......... .......... .......... .......... .......... 54% 204M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 51050K .......... .......... .......... .......... .......... 55% 99.4M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 51100K .......... .......... .......... .......... .......... 55% 364M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 51150K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-22T09:12:02.177 INFO:teuthology.orchestra.run.smithi039.stderr: 51200K .......... .......... .......... .......... .......... 55% 141M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51250K .......... .......... .......... .......... .......... 55% 97.5M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51300K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51350K .......... .......... .......... .......... .......... 55% 345M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51400K .......... .......... .......... .......... .......... 55% 356M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51450K .......... .......... .......... .......... .......... 55% 382M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51500K .......... .......... .......... .......... .......... 55% 217M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51550K .......... .......... .......... .......... .......... 55% 366M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51600K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51650K .......... .......... .......... .......... .......... 55% 187M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51700K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51750K .......... .......... .......... .......... .......... 55% 235M 0s 2024-09-22T09:12:02.178 INFO:teuthology.orchestra.run.smithi039.stderr: 51800K .......... .......... .......... .......... .......... 55% 371M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 51850K .......... .......... .......... .......... .......... 55% 133M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 51900K .......... .......... .......... .......... .......... 55% 103M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 51950K .......... .......... .......... .......... .......... 55% 288M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52000K .......... .......... .......... .......... .......... 56% 107M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52050K .......... .......... .......... .......... .......... 56% 285M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52100K .......... .......... .......... .......... .......... 56% 168M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52150K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52200K .......... .......... .......... .......... .......... 56% 337M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52250K .......... .......... .......... .......... .......... 56% 358M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52300K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52350K .......... .......... .......... .......... .......... 56% 363M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52400K .......... .......... .......... .......... .......... 56% 378M 0s 2024-09-22T09:12:02.179 INFO:teuthology.orchestra.run.smithi039.stderr: 52450K .......... .......... .......... .......... .......... 56% 379M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52500K .......... .......... .......... .......... .......... 56% 351M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52550K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52600K .......... .......... .......... .......... .......... 56% 360M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52650K .......... .......... .......... .......... .......... 56% 396M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52700K .......... .......... .......... .......... .......... 56% 315M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52750K .......... .......... .......... .......... .......... 56% 360M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52800K .......... .......... .......... .......... .......... 56% 370M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52850K .......... .......... .......... .......... .......... 56% 388M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52900K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 52950K .......... .......... .......... .......... .......... 57% 354M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 53000K .......... .......... .......... .......... .......... 57% 365M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 53050K .......... .......... .......... .......... .......... 57% 379M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 53100K .......... .......... .......... .......... .......... 57% 302M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 53150K .......... .......... .......... .......... .......... 57% 191M 0s 2024-09-22T09:12:02.180 INFO:teuthology.orchestra.run.smithi039.stderr: 53200K .......... .......... .......... .......... .......... 57% 147M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53250K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53300K .......... .......... .......... .......... .......... 57% 276M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53350K .......... .......... .......... .......... .......... 57% 368M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53400K .......... .......... .......... .......... .......... 57% 384M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53450K .......... .......... .......... .......... .......... 57% 388M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53500K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53550K .......... .......... .......... .......... .......... 57% 352M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53600K .......... .......... .......... .......... .......... 57% 210M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53650K .......... .......... .......... .......... .......... 57% 370M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53700K .......... .......... .......... .......... .......... 57% 359M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53750K .......... .......... .......... .......... .......... 57% 215M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53800K .......... .......... .......... .......... .......... 57% 343M 0s 2024-09-22T09:12:02.181 INFO:teuthology.orchestra.run.smithi039.stderr: 53850K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 53900K .......... .......... .......... .......... .......... 58% 191M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 53950K .......... .......... .......... .......... .......... 58% 198M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54000K .......... .......... .......... .......... .......... 58% 141M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54050K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54100K .......... .......... .......... .......... .......... 58% 113M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54150K .......... .......... .......... .......... .......... 58% 354M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54200K .......... .......... .......... .......... .......... 58% 387M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54250K .......... .......... .......... .......... .......... 58% 184M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54300K .......... .......... .......... .......... .......... 58% 92.7M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54350K .......... .......... .......... .......... .......... 58% 115M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54400K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54450K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-22T09:12:02.182 INFO:teuthology.orchestra.run.smithi039.stderr: 54500K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54550K .......... .......... .......... .......... .......... 58% 380M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54600K .......... .......... .......... .......... .......... 58% 379M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54650K .......... .......... .......... .......... .......... 58% 375M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54700K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54750K .......... .......... .......... .......... .......... 58% 372M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54800K .......... .......... .......... .......... .......... 59% 376M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54850K .......... .......... .......... .......... .......... 59% 359M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54900K .......... .......... .......... .......... .......... 59% 174M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 54950K .......... .......... .......... .......... .......... 59% 84.0M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 55000K .......... .......... .......... .......... .......... 59% 265M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 55050K .......... .......... .......... .......... .......... 59% 117M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 55100K .......... .......... .......... .......... .......... 59% 348M 0s 2024-09-22T09:12:02.183 INFO:teuthology.orchestra.run.smithi039.stderr: 55150K .......... .......... .......... .......... .......... 59% 138M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55200K .......... .......... .......... .......... .......... 59% 252M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55250K .......... .......... .......... .......... .......... 59% 376M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55300K .......... .......... .......... .......... .......... 59% 137M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55350K .......... .......... .......... .......... .......... 59% 292M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55400K .......... .......... .......... .......... .......... 59% 332M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55450K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55500K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55550K .......... .......... .......... .......... .......... 59% 374M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55600K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55650K .......... .......... .......... .......... .......... 59% 365M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55700K .......... .......... .......... .......... .......... 60% 372M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55750K .......... .......... .......... .......... .......... 60% 383M 0s 2024-09-22T09:12:02.184 INFO:teuthology.orchestra.run.smithi039.stderr: 55800K .......... .......... .......... .......... .......... 60% 332M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 55850K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 55900K .......... .......... .......... .......... .......... 60% 379M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 55950K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56000K .......... .......... .......... .......... .......... 60% 306M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56050K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56100K .......... .......... .......... .......... .......... 60% 390M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56150K .......... .......... .......... .......... .......... 60% 386M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56200K .......... .......... .......... .......... .......... 60% 341M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56250K .......... .......... .......... .......... .......... 60% 385M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56300K .......... .......... .......... .......... .......... 60% 228M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56350K .......... .......... .......... .......... .......... 60% 172M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56400K .......... .......... .......... .......... .......... 60% 134M 0s 2024-09-22T09:12:02.185 INFO:teuthology.orchestra.run.smithi039.stderr: 56450K .......... .......... .......... .......... .......... 60% 187M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56500K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56550K .......... .......... .......... .......... .......... 60% 193M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56600K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56650K .......... .......... .......... .......... .......... 61% 373M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56700K .......... .......... .......... .......... .......... 61% 370M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56750K .......... .......... .......... .......... .......... 61% 357M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56800K .......... .......... .......... .......... .......... 61% 309M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56850K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56900K .......... .......... .......... .......... .......... 61% 387M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 56950K .......... .......... .......... .......... .......... 61% 363M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 57000K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 57050K .......... .......... .......... .......... .......... 61% 375M 0s 2024-09-22T09:12:02.186 INFO:teuthology.orchestra.run.smithi039.stderr: 57100K .......... .......... .......... .......... .......... 61% 240M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57150K .......... .......... .......... .......... .......... 61% 162M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57200K .......... .......... .......... .......... .......... 61% 95.9M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57250K .......... .......... .......... .......... .......... 61% 248M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57300K .......... .......... .......... .......... .......... 61% 367M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57350K .......... .......... .......... .......... .......... 61% 185M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57400K .......... .......... .......... .......... .......... 61% 121M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57450K .......... .......... .......... .......... .......... 61% 298M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57500K .......... .......... .......... .......... .......... 61% 105M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57550K .......... .......... .......... .......... .......... 62% 377M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57600K .......... .......... .......... .......... .......... 62% 174M 0s 2024-09-22T09:12:02.187 INFO:teuthology.orchestra.run.smithi039.stderr: 57650K .......... .......... .......... .......... .......... 62% 346M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57700K .......... .......... .......... .......... .......... 62% 364M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57750K .......... .......... .......... .......... .......... 62% 357M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57800K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57850K .......... .......... .......... .......... .......... 62% 360M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57900K .......... .......... .......... .......... .......... 62% 391M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 57950K .......... .......... .......... .......... .......... 62% 389M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58000K .......... .......... .......... .......... .......... 62% 200M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58050K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58100K .......... .......... .......... .......... .......... 62% 115M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58150K .......... .......... .......... .......... .......... 62% 371M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58200K .......... .......... .......... .......... .......... 62% 140M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58250K .......... .......... .......... .......... .......... 62% 350M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58300K .......... .......... .......... .......... .......... 62% 369M 0s 2024-09-22T09:12:02.188 INFO:teuthology.orchestra.run.smithi039.stderr: 58350K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58400K .......... .......... .......... .......... .......... 62% 133M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58450K .......... .......... .......... .......... .......... 62% 242M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58500K .......... .......... .......... .......... .......... 63% 251M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58550K .......... .......... .......... .......... .......... 63% 157M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58600K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58650K .......... .......... .......... .......... .......... 63% 265M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58700K .......... .......... .......... .......... .......... 63% 178M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58750K .......... .......... .......... .......... .......... 63% 276M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58800K .......... .......... .......... .......... .......... 63% 269M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58850K .......... .......... .......... .......... .......... 63% 380M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58900K .......... .......... .......... .......... .......... 63% 365M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 58950K .......... .......... .......... .......... .......... 63% 353M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 59000K .......... .......... .......... .......... .......... 63% 276M 0s 2024-09-22T09:12:02.189 INFO:teuthology.orchestra.run.smithi039.stderr: 59050K .......... .......... .......... .......... .......... 63% 361M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59100K .......... .......... .......... .......... .......... 63% 341M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59150K .......... .......... .......... .......... .......... 63% 374M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59200K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59250K .......... .......... .......... .......... .......... 63% 374M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59300K .......... .......... .......... .......... .......... 63% 370M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59350K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59400K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59450K .......... .......... .......... .......... .......... 64% 83.8M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59500K .......... .......... .......... .......... .......... 64% 367M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59550K .......... .......... .......... .......... .......... 64% 364M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59600K .......... .......... .......... .......... .......... 64% 108M 0s 2024-09-22T09:12:02.190 INFO:teuthology.orchestra.run.smithi039.stderr: 59650K .......... .......... .......... .......... .......... 64% 375M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59700K .......... .......... .......... .......... .......... 64% 375M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59750K .......... .......... .......... .......... .......... 64% 371M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59800K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59850K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59900K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 59950K .......... .......... .......... .......... .......... 64% 368M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60000K .......... .......... .......... .......... .......... 64% 304M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60050K .......... .......... .......... .......... .......... 64% 377M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60100K .......... .......... .......... .......... .......... 64% 378M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60150K .......... .......... .......... .......... .......... 64% 374M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60200K .......... .......... .......... .......... .......... 64% 336M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60250K .......... .......... .......... .......... .......... 64% 387M 0s 2024-09-22T09:12:02.191 INFO:teuthology.orchestra.run.smithi039.stderr: 60300K .......... .......... .......... .......... .......... 64% 175M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60350K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60400K .......... .......... .......... .......... .......... 65% 221M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60450K .......... .......... .......... .......... .......... 65% 137M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60500K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60550K .......... .......... .......... .......... .......... 65% 109M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60600K .......... .......... .......... .......... .......... 65% 304M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60650K .......... .......... .......... .......... .......... 65% 171M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60700K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60750K .......... .......... .......... .......... .......... 65% 339M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60800K .......... .......... .......... .......... .......... 65% 295M 0s 2024-09-22T09:12:02.192 INFO:teuthology.orchestra.run.smithi039.stderr: 60850K .......... .......... .......... .......... .......... 65% 368M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 60900K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 60950K .......... .......... .......... .......... .......... 65% 385M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61000K .......... .......... .......... .......... .......... 65% 216M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61050K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61100K .......... .......... .......... .......... .......... 65% 76.4M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61150K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61200K .......... .......... .......... .......... .......... 65% 122M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61250K .......... .......... .......... .......... .......... 65% 162M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61300K .......... .......... .......... .......... .......... 66% 256M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61350K .......... .......... .......... .......... .......... 66% 371M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61400K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-22T09:12:02.193 INFO:teuthology.orchestra.run.smithi039.stderr: 61450K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61500K .......... .......... .......... .......... .......... 66% 304M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61550K .......... .......... .......... .......... .......... 66% 368M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61600K .......... .......... .......... .......... .......... 66% 89.8M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61650K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61700K .......... .......... .......... .......... .......... 66% 112M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61750K .......... .......... .......... .......... .......... 66% 373M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61800K .......... .......... .......... .......... .......... 66% 245M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61850K .......... .......... .......... .......... .......... 66% 377M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61900K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 61950K .......... .......... .......... .......... .......... 66% 384M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 62000K .......... .......... .......... .......... .......... 66% 129M 0s 2024-09-22T09:12:02.194 INFO:teuthology.orchestra.run.smithi039.stderr: 62050K .......... .......... .......... .......... .......... 66% 218M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62100K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62150K .......... .......... .......... .......... .......... 66% 373M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62200K .......... .......... .......... .......... .......... 67% 339M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62250K .......... .......... .......... .......... .......... 67% 376M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62300K .......... .......... .......... .......... .......... 67% 360M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62350K .......... .......... .......... .......... .......... 67% 384M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62400K .......... .......... .......... .......... .......... 67% 306M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62450K .......... .......... .......... .......... .......... 67% 347M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62500K .......... .......... .......... .......... .......... 67% 367M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62550K .......... .......... .......... .......... .......... 67% 369M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62600K .......... .......... .......... .......... .......... 67% 61.1M 0s 2024-09-22T09:12:02.195 INFO:teuthology.orchestra.run.smithi039.stderr: 62650K .......... .......... .......... .......... .......... 67% 337M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62700K .......... .......... .......... .......... .......... 67% 307M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62750K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62800K .......... .......... .......... .......... .......... 67% 363M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62850K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62900K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 62950K .......... .......... .......... .......... .......... 67% 368M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63000K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63050K .......... .......... .......... .......... .......... 67% 349M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63100K .......... .......... .......... .......... .......... 67% 268M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63150K .......... .......... .......... .......... .......... 68% 295M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63200K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-22T09:12:02.196 INFO:teuthology.orchestra.run.smithi039.stderr: 63250K .......... .......... .......... .......... .......... 68% 370M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63300K .......... .......... .......... .......... .......... 68% 341M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63350K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63400K .......... .......... .......... .......... .......... 68% 381M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63450K .......... .......... .......... .......... .......... 68% 366M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63500K .......... .......... .......... .......... .......... 68% 84.8M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63550K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63600K .......... .......... .......... .......... .......... 68% 84.0M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63650K .......... .......... .......... .......... .......... 68% 65.9M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63700K .......... .......... .......... .......... .......... 68% 306M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63750K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63800K .......... .......... .......... .......... .......... 68% 147M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63850K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-22T09:12:02.197 INFO:teuthology.orchestra.run.smithi039.stderr: 63900K .......... .......... .......... .......... .......... 68% 88.7M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 63950K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64000K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64050K .......... .......... .......... .......... .......... 68% 107M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64100K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64150K .......... .......... .......... .......... .......... 69% 289M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64200K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64250K .......... .......... .......... .......... .......... 69% 183M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64300K .......... .......... .......... .......... .......... 69% 247M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64350K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64400K .......... .......... .......... .......... .......... 69% 331M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64450K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64500K .......... .......... .......... .......... .......... 69% 321M 0s 2024-09-22T09:12:02.198 INFO:teuthology.orchestra.run.smithi039.stderr: 64550K .......... .......... .......... .......... .......... 69% 374M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64600K .......... .......... .......... .......... .......... 69% 350M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64650K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64700K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64750K .......... .......... .......... .......... .......... 69% 145M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64800K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64850K .......... .......... .......... .......... .......... 69% 319M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64900K .......... .......... .......... .......... .......... 69% 294M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 64950K .......... .......... .......... .......... .......... 69% 320M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 65000K .......... .......... .......... .......... .......... 70% 311M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 65050K .......... .......... .......... .......... .......... 70% 301M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 65100K .......... .......... .......... .......... .......... 70% 186M 0s 2024-09-22T09:12:02.199 INFO:teuthology.orchestra.run.smithi039.stderr: 65150K .......... .......... .......... .......... .......... 70% 298M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65200K .......... .......... .......... .......... .......... 70% 352M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65250K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65300K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65350K .......... .......... .......... .......... .......... 70% 383M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65400K .......... .......... .......... .......... .......... 70% 390M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65450K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65500K .......... .......... .......... .......... .......... 70% 318M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65550K .......... .......... .......... .......... .......... 70% 141M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65600K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65650K .......... .......... .......... .......... .......... 70% 371M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65700K .......... .......... .......... .......... .......... 70% 177M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65750K .......... .......... .......... .......... .......... 70% 59.6M 0s 2024-09-22T09:12:02.200 INFO:teuthology.orchestra.run.smithi039.stderr: 65800K .......... .......... .......... .......... .......... 70% 291M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 65850K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 65900K .......... .......... .......... .......... .......... 70% 224M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 65950K .......... .......... .......... .......... .......... 71% 156M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66000K .......... .......... .......... .......... .......... 71% 261M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66050K .......... .......... .......... .......... .......... 71% 109M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66100K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66150K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66200K .......... .......... .......... .......... .......... 71% 281M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66250K .......... .......... .......... .......... .......... 71% 113M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66300K .......... .......... .......... .......... .......... 71% 295M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66350K .......... .......... .......... .......... .......... 71% 381M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66400K .......... .......... .......... .......... .......... 71% 123M 0s 2024-09-22T09:12:02.201 INFO:teuthology.orchestra.run.smithi039.stderr: 66450K .......... .......... .......... .......... .......... 71% 60.0M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66500K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66550K .......... .......... .......... .......... .......... 71% 357M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66600K .......... .......... .......... .......... .......... 71% 61.9M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66650K .......... .......... .......... .......... .......... 71% 48.7M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66700K .......... .......... .......... .......... .......... 71% 72.0M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66750K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66800K .......... .......... .......... .......... .......... 71% 367M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66850K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66900K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 66950K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 67000K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-22T09:12:02.202 INFO:teuthology.orchestra.run.smithi039.stderr: 67050K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67100K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67150K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67200K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67250K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67300K .......... .......... .......... .......... .......... 72% 332M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67350K .......... .......... .......... .......... .......... 72% 380M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67400K .......... .......... .......... .......... .......... 72% 357M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67450K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67500K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67550K .......... .......... .......... .......... .......... 72% 358M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67600K .......... .......... .......... .......... .......... 72% 358M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67650K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-22T09:12:02.203 INFO:teuthology.orchestra.run.smithi039.stderr: 67700K .......... .......... .......... .......... .......... 72% 278M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 67750K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 67800K .......... .......... .......... .......... .......... 73% 346M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 67850K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 67900K .......... .......... .......... .......... .......... 73% 278M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 67950K .......... .......... .......... .......... .......... 73% 384M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68000K .......... .......... .......... .......... .......... 73% 376M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68050K .......... .......... .......... .......... .......... 73% 247M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68100K .......... .......... .......... .......... .......... 73% 294M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68150K .......... .......... .......... .......... .......... 73% 370M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68200K .......... .......... .......... .......... .......... 73% 370M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68250K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68300K .......... .......... .......... .......... .......... 73% 300M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68350K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-22T09:12:02.204 INFO:teuthology.orchestra.run.smithi039.stderr: 68400K .......... .......... .......... .......... .......... 73% 344M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68450K .......... .......... .......... .......... .......... 73% 237M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68500K .......... .......... .......... .......... .......... 73% 294M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68550K .......... .......... .......... .......... .......... 73% 345M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68600K .......... .......... .......... .......... .......... 73% 335M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68650K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68700K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68750K .......... .......... .......... .......... .......... 74% 166M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68800K .......... .......... .......... .......... .......... 74% 37.3M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68850K .......... .......... .......... .......... .......... 74% 256M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68900K .......... .......... .......... .......... .......... 74% 300M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 68950K .......... .......... .......... .......... .......... 74% 137M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 69000K .......... .......... .......... .......... .......... 74% 95.7M 0s 2024-09-22T09:12:02.205 INFO:teuthology.orchestra.run.smithi039.stderr: 69050K .......... .......... .......... .......... .......... 74% 77.7M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69100K .......... .......... .......... .......... .......... 74% 60.7M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69150K .......... .......... .......... .......... .......... 74% 330M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69200K .......... .......... .......... .......... .......... 74% 154M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69250K .......... .......... .......... .......... .......... 74% 122M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69300K .......... .......... .......... .......... .......... 74% 87.8M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69350K .......... .......... .......... .......... .......... 74% 354M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69400K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69450K .......... .......... .......... .......... .......... 74% 107M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69500K .......... .......... .......... .......... .......... 74% 115M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69550K .......... .......... .......... .......... .......... 74% 135M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69600K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-22T09:12:02.206 INFO:teuthology.orchestra.run.smithi039.stderr: 69650K .......... .......... .......... .......... .......... 75% 216M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69700K .......... .......... .......... .......... .......... 75% 250M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69750K .......... .......... .......... .......... .......... 75% 255M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69800K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69850K .......... .......... .......... .......... .......... 75% 362M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69900K .......... .......... .......... .......... .......... 75% 286M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 69950K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70000K .......... .......... .......... .......... .......... 75% 374M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70050K .......... .......... .......... .......... .......... 75% 371M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70100K .......... .......... .......... .......... .......... 75% 178M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70150K .......... .......... .......... .......... .......... 75% 370M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70200K .......... .......... .......... .......... .......... 75% 142M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70250K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-22T09:12:02.207 INFO:teuthology.orchestra.run.smithi039.stderr: 70300K .......... .......... .......... .......... .......... 75% 120M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70350K .......... .......... .......... .......... .......... 75% 129M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70400K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70450K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70500K .......... .......... .......... .......... .......... 75% 335M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70550K .......... .......... .......... .......... .......... 75% 362M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70600K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70650K .......... .......... .......... .......... .......... 76% 131M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70700K .......... .......... .......... .......... .......... 76% 308M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70750K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70800K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70850K .......... .......... .......... .......... .......... 76% 368M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70900K .......... .......... .......... .......... .......... 76% 342M 0s 2024-09-22T09:12:02.208 INFO:teuthology.orchestra.run.smithi039.stderr: 70950K .......... .......... .......... .......... .......... 76% 366M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71000K .......... .......... .......... .......... .......... 76% 280M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71050K .......... .......... .......... .......... .......... 76% 297M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71100K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71150K .......... .......... .......... .......... .......... 76% 157M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71200K .......... .......... .......... .......... .......... 76% 324M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71250K .......... .......... .......... .......... .......... 76% 324M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71300K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71350K .......... .......... .......... .......... .......... 76% 376M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71400K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71450K .......... .......... .......... .......... .......... 76% 323M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71500K .......... .......... .......... .......... .......... 77% 338M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71550K .......... .......... .......... .......... .......... 77% 350M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71600K .......... .......... .......... .......... .......... 77% 349M 0s 2024-09-22T09:12:02.209 INFO:teuthology.orchestra.run.smithi039.stderr: 71650K .......... .......... .......... .......... .......... 77% 374M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71700K .......... .......... .......... .......... .......... 77% 219M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71750K .......... .......... .......... .......... .......... 77% 282M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71800K .......... .......... .......... .......... .......... 77% 245M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71850K .......... .......... .......... .......... .......... 77% 23.7M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71900K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 71950K .......... .......... .......... .......... .......... 77% 67.4M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72000K .......... .......... .......... .......... .......... 77% 94.8M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72050K .......... .......... .......... .......... .......... 77% 120M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72100K .......... .......... .......... .......... .......... 77% 60.6M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72150K .......... .......... .......... .......... .......... 77% 340M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72200K .......... .......... .......... .......... .......... 77% 75.8M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72250K .......... .......... .......... .......... .......... 77% 375M 0s 2024-09-22T09:12:02.210 INFO:teuthology.orchestra.run.smithi039.stderr: 72300K .......... .......... .......... .......... .......... 77% 191M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72350K .......... .......... .......... .......... .......... 77% 361M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72400K .......... .......... .......... .......... .......... 77% 375M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72450K .......... .......... .......... .......... .......... 78% 384M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72500K .......... .......... .......... .......... .......... 78% 311M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72550K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72600K .......... .......... .......... .......... .......... 78% 354M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72650K .......... .......... .......... .......... .......... 78% 365M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72700K .......... .......... .......... .......... .......... 78% 240M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72750K .......... .......... .......... .......... .......... 78% 129M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72800K .......... .......... .......... .......... .......... 78% 66.4M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72850K .......... .......... .......... .......... .......... 78% 377M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72900K .......... .......... .......... .......... .......... 78% 134M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 72950K .......... .......... .......... .......... .......... 78% 107M 0s 2024-09-22T09:12:02.211 INFO:teuthology.orchestra.run.smithi039.stderr: 73000K .......... .......... .......... .......... .......... 78% 367M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73050K .......... .......... .......... .......... .......... 78% 378M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73100K .......... .......... .......... .......... .......... 78% 339M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73150K .......... .......... .......... .......... .......... 78% 365M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73200K .......... .......... .......... .......... .......... 78% 355M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73250K .......... .......... .......... .......... .......... 78% 348M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73300K .......... .......... .......... .......... .......... 78% 321M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73350K .......... .......... .......... .......... .......... 79% 392M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73400K .......... .......... .......... .......... .......... 79% 376M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73450K .......... .......... .......... .......... .......... 79% 386M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73500K .......... .......... .......... .......... .......... 79% 340M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73550K .......... .......... .......... .......... .......... 79% 377M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73600K .......... .......... .......... .......... .......... 79% 361M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73650K .......... .......... .......... .......... .......... 79% 378M 0s 2024-09-22T09:12:02.212 INFO:teuthology.orchestra.run.smithi039.stderr: 73700K .......... .......... .......... .......... .......... 79% 248M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 73750K .......... .......... .......... .......... .......... 79% 286M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 73800K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 73850K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 73900K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 73950K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74000K .......... .......... .......... .......... .......... 79% 379M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74050K .......... .......... .......... .......... .......... 79% 386M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74100K .......... .......... .......... .......... .......... 79% 129M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74150K .......... .......... .......... .......... .......... 79% 296M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74200K .......... .......... .......... .......... .......... 79% 102M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74250K .......... .......... .......... .......... .......... 79% 366M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74300K .......... .......... .......... .......... .......... 80% 53.3M 0s 2024-09-22T09:12:02.213 INFO:teuthology.orchestra.run.smithi039.stderr: 74350K .......... .......... .......... .......... .......... 80% 87.7M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74400K .......... .......... .......... .......... .......... 80% 204M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74450K .......... .......... .......... .......... .......... 80% 370M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74500K .......... .......... .......... .......... .......... 80% 196M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74550K .......... .......... .......... .......... .......... 80% 312M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74600K .......... .......... .......... .......... .......... 80% 73.3M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74650K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74700K .......... .......... .......... .......... .......... 80% 279M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74750K .......... .......... .......... .......... .......... 80% 227M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74800K .......... .......... .......... .......... .......... 80% 171M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74850K .......... .......... .......... .......... .......... 80% 125M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74900K .......... .......... .......... .......... .......... 80% 38.8M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 74950K .......... .......... .......... .......... .......... 80% 370M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 75000K .......... .......... .......... .......... .......... 80% 246M 0s 2024-09-22T09:12:02.214 INFO:teuthology.orchestra.run.smithi039.stderr: 75050K .......... .......... .......... .......... .......... 80% 88.7M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75100K .......... .......... .......... .......... .......... 80% 224M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75150K .......... .......... .......... .......... .......... 80% 375M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75200K .......... .......... .......... .......... .......... 81% 229M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75250K .......... .......... .......... .......... .......... 81% 82.2M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75300K .......... .......... .......... .......... .......... 81% 143M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75350K .......... .......... .......... .......... .......... 81% 128M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75400K .......... .......... .......... .......... .......... 81% 366M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75450K .......... .......... .......... .......... .......... 81% 330M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75500K .......... .......... .......... .......... .......... 81% 379M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75550K .......... .......... .......... .......... .......... 81% 389M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75600K .......... .......... .......... .......... .......... 81% 386M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75650K .......... .......... .......... .......... .......... 81% 315M 0s 2024-09-22T09:12:02.215 INFO:teuthology.orchestra.run.smithi039.stderr: 75700K .......... .......... .......... .......... .......... 81% 381M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 75750K .......... .......... .......... .......... .......... 81% 386M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 75800K .......... .......... .......... .......... .......... 81% 390M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 75850K .......... .......... .......... .......... .......... 81% 319M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 75900K .......... .......... .......... .......... .......... 81% 398M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 75950K .......... .......... .......... .......... .......... 81% 355M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76000K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76050K .......... .......... .......... .......... .......... 81% 152M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76100K .......... .......... .......... .......... .......... 81% 376M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76150K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76200K .......... .......... .......... .......... .......... 82% 387M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76250K .......... .......... .......... .......... .......... 82% 332M 0s 2024-09-22T09:12:02.216 INFO:teuthology.orchestra.run.smithi039.stderr: 76300K .......... .......... .......... .......... .......... 82% 372M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76350K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76400K .......... .......... .......... .......... .......... 82% 365M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76450K .......... .......... .......... .......... .......... 82% 368M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76500K .......... .......... .......... .......... .......... 82% 371M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76550K .......... .......... .......... .......... .......... 82% 153M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76600K .......... .......... .......... .......... .......... 82% 351M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76650K .......... .......... .......... .......... .......... 82% 374M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76700K .......... .......... .......... .......... .......... 82% 166M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76750K .......... .......... .......... .......... .......... 82% 270M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76800K .......... .......... .......... .......... .......... 82% 267M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76850K .......... .......... .......... .......... .......... 82% 77.5M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76900K .......... .......... .......... .......... .......... 82% 135M 0s 2024-09-22T09:12:02.217 INFO:teuthology.orchestra.run.smithi039.stderr: 76950K .......... .......... .......... .......... .......... 82% 130M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77000K .......... .......... .......... .......... .......... 82% 138M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77050K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77100K .......... .......... .......... .......... .......... 83% 94.0M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77150K .......... .......... .......... .......... .......... 83% 93.4M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77200K .......... .......... .......... .......... .......... 83% 76.1M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77250K .......... .......... .......... .......... .......... 83% 357M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77300K .......... .......... .......... .......... .......... 83% 118M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77350K .......... .......... .......... .......... .......... 83% 36.2M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77400K .......... .......... .......... .......... .......... 83% 81.9M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77450K .......... .......... .......... .......... .......... 83% 179M 0s 2024-09-22T09:12:02.218 INFO:teuthology.orchestra.run.smithi039.stderr: 77500K .......... .......... .......... .......... .......... 83% 363M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77550K .......... .......... .......... .......... .......... 83% 277M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77600K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77650K .......... .......... .......... .......... .......... 83% 308M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77700K .......... .......... .......... .......... .......... 83% 371M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77750K .......... .......... .......... .......... .......... 83% 194M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77800K .......... .......... .......... .......... .......... 83% 329M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77850K .......... .......... .......... .......... .......... 83% 370M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77900K .......... .......... .......... .......... .......... 83% 66.2M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 77950K .......... .......... .......... .......... .......... 83% 48.5M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 78000K .......... .......... .......... .......... .......... 84% 360M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 78050K .......... .......... .......... .......... .......... 84% 127M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 78100K .......... .......... .......... .......... .......... 84% 48.8M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 78150K .......... .......... .......... .......... .......... 84% 168M 0s 2024-09-22T09:12:02.219 INFO:teuthology.orchestra.run.smithi039.stderr: 78200K .......... .......... .......... .......... .......... 84% 391M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78250K .......... .......... .......... .......... .......... 84% 383M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78300K .......... .......... .......... .......... .......... 84% 373M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78350K .......... .......... .......... .......... .......... 84% 346M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78400K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78450K .......... .......... .......... .......... .......... 84% 389M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78500K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78550K .......... .......... .......... .......... .......... 84% 314M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78600K .......... .......... .......... .......... .......... 84% 384M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78650K .......... .......... .......... .......... .......... 84% 379M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78700K .......... .......... .......... .......... .......... 84% 383M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78750K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78800K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-22T09:12:02.220 INFO:teuthology.orchestra.run.smithi039.stderr: 78850K .......... .......... .......... .......... .......... 84% 390M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 78900K .......... .......... .......... .......... .......... 84% 397M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 78950K .......... .......... .......... .......... .......... 85% 321M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79000K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79050K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79100K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79150K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79200K .......... .......... .......... .......... .......... 85% 366M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79250K .......... .......... .......... .......... .......... 85% 374M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79300K .......... .......... .......... .......... .......... 85% 136M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79350K .......... .......... .......... .......... .......... 85% 302M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79400K .......... .......... .......... .......... .......... 85% 327M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79450K .......... .......... .......... .......... .......... 85% 92.1M 0s 2024-09-22T09:12:02.221 INFO:teuthology.orchestra.run.smithi039.stderr: 79500K .......... .......... .......... .......... .......... 85% 141M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79550K .......... .......... .......... .......... .......... 85% 78.7M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79600K .......... .......... .......... .......... .......... 85% 177M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79650K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79700K .......... .......... .......... .......... .......... 85% 368M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79750K .......... .......... .......... .......... .......... 85% 164M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79800K .......... .......... .......... .......... .......... 85% 383M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79850K .......... .......... .......... .......... .......... 86% 234M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79900K .......... .......... .......... .......... .......... 86% 118M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 79950K .......... .......... .......... .......... .......... 86% 132M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 80000K .......... .......... .......... .......... .......... 86% 97.3M 0s 2024-09-22T09:12:02.222 INFO:teuthology.orchestra.run.smithi039.stderr: 80050K .......... .......... .......... .......... .......... 86% 288M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80100K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80150K .......... .......... .......... .......... .......... 86% 58.0M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80200K .......... .......... .......... .......... .......... 86% 109M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80250K .......... .......... .......... .......... .......... 86% 55.8M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80300K .......... .......... .......... .......... .......... 86% 125M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80350K .......... .......... .......... .......... .......... 86% 304M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80400K .......... .......... .......... .......... .......... 86% 90.2M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80450K .......... .......... .......... .......... .......... 86% 36.0M 0s 2024-09-22T09:12:02.223 INFO:teuthology.orchestra.run.smithi039.stderr: 80500K .......... .......... .......... .......... .......... 86% 331M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80550K .......... .......... .......... .......... .......... 86% 225M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80600K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80650K .......... .......... .......... .......... .......... 86% 373M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80700K .......... .......... .......... .......... .......... 86% 315M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80750K .......... .......... .......... .......... .......... 86% 131M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80800K .......... .......... .......... .......... .......... 87% 322M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80850K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80900K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 80950K .......... .......... .......... .......... .......... 87% 65.8M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 81000K .......... .......... .......... .......... .......... 87% 84.5M 0s 2024-09-22T09:12:02.224 INFO:teuthology.orchestra.run.smithi039.stderr: 81050K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81100K .......... .......... .......... .......... .......... 87% 148M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81150K .......... .......... .......... .......... .......... 87% 107M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81200K .......... .......... .......... .......... .......... 87% 284M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81250K .......... .......... .......... .......... .......... 87% 346M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81300K .......... .......... .......... .......... .......... 87% 191M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81350K .......... .......... .......... .......... .......... 87% 194M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81400K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81450K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81500K .......... .......... .......... .......... .......... 87% 389M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81550K .......... .......... .......... .......... .......... 87% 161M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81600K .......... .......... .......... .......... .......... 87% 71.2M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81650K .......... .......... .......... .......... .......... 87% 260M 0s 2024-09-22T09:12:02.225 INFO:teuthology.orchestra.run.smithi039.stderr: 81700K .......... .......... .......... .......... .......... 87% 384M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 81750K .......... .......... .......... .......... .......... 88% 158M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 81800K .......... .......... .......... .......... .......... 88% 249M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 81850K .......... .......... .......... .......... .......... 88% 365M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 81900K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 81950K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82000K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82050K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82100K .......... .......... .......... .......... .......... 88% 349M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82150K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82200K .......... .......... .......... .......... .......... 88% 382M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82250K .......... .......... .......... .......... .......... 88% 391M 0s 2024-09-22T09:12:02.226 INFO:teuthology.orchestra.run.smithi039.stderr: 82300K .......... .......... .......... .......... .......... 88% 389M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82350K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82400K .......... .......... .......... .......... .......... 88% 390M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82450K .......... .......... .......... .......... .......... 88% 404M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82500K .......... .......... .......... .......... .......... 88% 391M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82550K .......... .......... .......... .......... .......... 88% 322M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82600K .......... .......... .......... .......... .......... 88% 256M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82650K .......... .......... .......... .......... .......... 89% 390M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82700K .......... .......... .......... .......... .......... 89% 174M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82750K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82800K .......... .......... .......... .......... .......... 89% 374M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82850K .......... .......... .......... .......... .......... 89% 108M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82900K .......... .......... .......... .......... .......... 89% 365M 0s 2024-09-22T09:12:02.227 INFO:teuthology.orchestra.run.smithi039.stderr: 82950K .......... .......... .......... .......... .......... 89% 87.6M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83000K .......... .......... .......... .......... .......... 89% 57.4M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83050K .......... .......... .......... .......... .......... 89% 359M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83100K .......... .......... .......... .......... .......... 89% 322M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83150K .......... .......... .......... .......... .......... 89% 213M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83200K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83250K .......... .......... .......... .......... .......... 89% 147M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83300K .......... .......... .......... .......... .......... 89% 32.0M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83350K .......... .......... .......... .......... .......... 89% 319M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83400K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83450K .......... .......... .......... .......... .......... 89% 98.8M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83500K .......... .......... .......... .......... .......... 89% 25.6M 0s 2024-09-22T09:12:02.228 INFO:teuthology.orchestra.run.smithi039.stderr: 83550K .......... .......... .......... .......... .......... 89% 196M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83600K .......... .......... .......... .......... .......... 90% 321M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83650K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83700K .......... .......... .......... .......... .......... 90% 332M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83750K .......... .......... .......... .......... .......... 90% 345M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83800K .......... .......... .......... .......... .......... 90% 318M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83850K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83900K .......... .......... .......... .......... .......... 90% 376M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 83950K .......... .......... .......... .......... .......... 90% 324M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 84000K .......... .......... .......... .......... .......... 90% 398M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 84050K .......... .......... .......... .......... .......... 90% 309M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 84100K .......... .......... .......... .......... .......... 90% 131M 0s 2024-09-22T09:12:02.229 INFO:teuthology.orchestra.run.smithi039.stderr: 84150K .......... .......... .......... .......... .......... 90% 189M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84200K .......... .......... .......... .......... .......... 90% 99.6M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84250K .......... .......... .......... .......... .......... 90% 245M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84300K .......... .......... .......... .......... .......... 90% 315M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84350K .......... .......... .......... .......... .......... 90% 171M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84400K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84450K .......... .......... .......... .......... .......... 90% 220M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84500K .......... .......... .......... .......... .......... 91% 209M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84550K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84600K .......... .......... .......... .......... .......... 91% 264M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84650K .......... .......... .......... .......... .......... 91% 173M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84700K .......... .......... .......... .......... .......... 91% 309M 0s 2024-09-22T09:12:02.230 INFO:teuthology.orchestra.run.smithi039.stderr: 84750K .......... .......... .......... .......... .......... 91% 317M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 84800K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 84850K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 84900K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 84950K .......... .......... .......... .......... .......... 91% 268M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85000K .......... .......... .......... .......... .......... 91% 377M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85050K .......... .......... .......... .......... .......... 91% 305M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85100K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85150K .......... .......... .......... .......... .......... 91% 236M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85200K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85250K .......... .......... .......... .......... .......... 91% 368M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85300K .......... .......... .......... .......... .......... 91% 222M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85350K .......... .......... .......... .......... .......... 91% 217M 0s 2024-09-22T09:12:02.231 INFO:teuthology.orchestra.run.smithi039.stderr: 85400K .......... .......... .......... .......... .......... 91% 246M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85450K .......... .......... .......... .......... .......... 92% 382M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85500K .......... .......... .......... .......... .......... 92% 302M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85550K .......... .......... .......... .......... .......... 92% 211M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85600K .......... .......... .......... .......... .......... 92% 283M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85650K .......... .......... .......... .......... .......... 92% 204M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85700K .......... .......... .......... .......... .......... 92% 253M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85750K .......... .......... .......... .......... .......... 92% 238M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85800K .......... .......... .......... .......... .......... 92% 103M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85850K .......... .......... .......... .......... .......... 92% 139M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85900K .......... .......... .......... .......... .......... 92% 359M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 85950K .......... .......... .......... .......... .......... 92% 103M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 86000K .......... .......... .......... .......... .......... 92% 41.5M 0s 2024-09-22T09:12:02.232 INFO:teuthology.orchestra.run.smithi039.stderr: 86050K .......... .......... .......... .......... .......... 92% 40.9M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86100K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86150K .......... .......... .......... .......... .......... 92% 313M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86200K .......... .......... .......... .......... .......... 92% 88.1M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86250K .......... .......... .......... .......... .......... 92% 348M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86300K .......... .......... .......... .......... .......... 92% 392M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86350K .......... .......... .......... .......... .......... 93% 49.1M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86400K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86450K .......... .......... .......... .......... .......... 93% 373M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86500K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86550K .......... .......... .......... .......... .......... 93% 61.1M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86600K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86650K .......... .......... .......... .......... .......... 93% 339M 0s 2024-09-22T09:12:02.233 INFO:teuthology.orchestra.run.smithi039.stderr: 86700K .......... .......... .......... .......... .......... 93% 225M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 86750K .......... .......... .......... .......... .......... 93% 291M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 86800K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 86850K .......... .......... .......... .......... .......... 93% 385M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 86900K .......... .......... .......... .......... .......... 93% 366M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 86950K .......... .......... .......... .......... .......... 93% 259M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87000K .......... .......... .......... .......... .......... 93% 361M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87050K .......... .......... .......... .......... .......... 93% 286M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87100K .......... .......... .......... .......... .......... 93% 389M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87150K .......... .......... .......... .......... .......... 93% 215M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87200K .......... .......... .......... .......... .......... 93% 136M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87250K .......... .......... .......... .......... .......... 93% 111M 0s 2024-09-22T09:12:02.234 INFO:teuthology.orchestra.run.smithi039.stderr: 87300K .......... .......... .......... .......... .......... 94% 314M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87350K .......... .......... .......... .......... .......... 94% 316M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87400K .......... .......... .......... .......... .......... 94% 356M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87450K .......... .......... .......... .......... .......... 94% 180M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87500K .......... .......... .......... .......... .......... 94% 197M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87550K .......... .......... .......... .......... .......... 94% 167M 0s 2024-09-22T09:12:02.235 INFO:teuthology.orchestra.run.smithi039.stderr: 87600K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-22T09:12:02.237 INFO:teuthology.orchestra.run.smithi039.stderr: 87650K .......... .......... .......... .......... .......... 94% 271M 0s 2024-09-22T09:12:02.237 INFO:teuthology.orchestra.run.smithi039.stderr: 87700K .......... .......... .......... .......... .......... 94% 106M 0s 2024-09-22T09:12:02.237 INFO:teuthology.orchestra.run.smithi039.stderr: 87750K .......... .......... .......... .......... .......... 94% 239M 0s 2024-09-22T09:12:02.237 INFO:teuthology.orchestra.run.smithi039.stderr: 87800K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 87850K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 87900K .......... .......... .......... .......... .......... 94% 264M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 87950K .......... .......... .......... .......... .......... 94% 242M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88000K .......... .......... .......... .......... .......... 94% 57.0M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88050K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88100K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88150K .......... .......... .......... .......... .......... 94% 267M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88200K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88250K .......... .......... .......... .......... .......... 95% 275M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88300K .......... .......... .......... .......... .......... 95% 85.2M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88350K .......... .......... .......... .......... .......... 95% 185M 0s 2024-09-22T09:12:02.238 INFO:teuthology.orchestra.run.smithi039.stderr: 88400K .......... .......... .......... .......... .......... 95% 120M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88450K .......... .......... .......... .......... .......... 95% 178M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88500K .......... .......... .......... .......... .......... 95% 381M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88550K .......... .......... .......... .......... .......... 95% 100M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88600K .......... .......... .......... .......... .......... 95% 330M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88650K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88700K .......... .......... .......... .......... .......... 95% 377M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88750K .......... .......... .......... .......... .......... 95% 90.8M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88800K .......... .......... .......... .......... .......... 95% 151M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88850K .......... .......... .......... .......... .......... 95% 115M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88900K .......... .......... .......... .......... .......... 95% 79.8M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 88950K .......... .......... .......... .......... .......... 95% 291M 0s 2024-09-22T09:12:02.239 INFO:teuthology.orchestra.run.smithi039.stderr: 89000K .......... .......... .......... .......... .......... 95% 90.2M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89050K .......... .......... .......... .......... .......... 95% 88.2M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89100K .......... .......... .......... .......... .......... 95% 77.6M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89150K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89200K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89250K .......... .......... .......... .......... .......... 96% 189M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89300K .......... .......... .......... .......... .......... 96% 371M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89350K .......... .......... .......... .......... .......... 96% 132M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89400K .......... .......... .......... .......... .......... 96% 250M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89450K .......... .......... .......... .......... .......... 96% 332M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89500K .......... .......... .......... .......... .......... 96% 294M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89550K .......... .......... .......... .......... .......... 96% 144M 0s 2024-09-22T09:12:02.240 INFO:teuthology.orchestra.run.smithi039.stderr: 89600K .......... .......... .......... .......... .......... 96% 224M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89650K .......... .......... .......... .......... .......... 96% 377M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89700K .......... .......... .......... .......... .......... 96% 397M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89750K .......... .......... .......... .......... .......... 96% 333M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89800K .......... .......... .......... .......... .......... 96% 387M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89850K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89900K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 89950K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90000K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90050K .......... .......... .......... .......... .......... 96% 225M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90100K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90150K .......... .......... .......... .......... .......... 97% 342M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90200K .......... .......... .......... .......... .......... 97% 306M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90250K .......... .......... .......... .......... .......... 97% 131M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90300K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-22T09:12:02.241 INFO:teuthology.orchestra.run.smithi039.stderr: 90350K .......... .......... .......... .......... .......... 97% 278M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90400K .......... .......... .......... .......... .......... 97% 351M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90450K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90500K .......... .......... .......... .......... .......... 97% 189M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90550K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90600K .......... .......... .......... .......... .......... 97% 341M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90650K .......... .......... .......... .......... .......... 97% 359M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90700K .......... .......... .......... .......... .......... 97% 189M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90750K .......... .......... .......... .......... .......... 97% 117M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90800K .......... .......... .......... .......... .......... 97% 101M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90850K .......... .......... .......... .......... .......... 97% 292M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90900K .......... .......... .......... .......... .......... 97% 279M 0s 2024-09-22T09:12:02.242 INFO:teuthology.orchestra.run.smithi039.stderr: 90950K .......... .......... .......... .......... .......... 97% 144M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91000K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91050K .......... .......... .......... .......... .......... 98% 385M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91100K .......... .......... .......... .......... .......... 98% 39.1M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91150K .......... .......... .......... .......... .......... 98% 127M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91200K .......... .......... .......... .......... .......... 98% 167M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91250K .......... .......... .......... .......... .......... 98% 182M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91300K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91350K .......... .......... .......... .......... .......... 98% 70.2M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91400K .......... .......... .......... .......... .......... 98% 106M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91450K .......... .......... .......... .......... .......... 98% 121M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91500K .......... .......... .......... .......... .......... 98% 391M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91550K .......... .......... .......... .......... .......... 98% 204M 0s 2024-09-22T09:12:02.243 INFO:teuthology.orchestra.run.smithi039.stderr: 91600K .......... .......... .......... .......... .......... 98% 115M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91650K .......... .......... .......... .......... .......... 98% 79.3M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91700K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91750K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91800K .......... .......... .......... .......... .......... 98% 126M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91850K .......... .......... .......... .......... .......... 98% 189M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91900K .......... .......... .......... .......... .......... 98% 93.8M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 91950K .......... .......... .......... .......... .......... 99% 215M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92000K .......... .......... .......... .......... .......... 99% 370M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92050K .......... .......... .......... .......... .......... 99% 295M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92100K .......... .......... .......... .......... .......... 99% 192M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92150K .......... .......... .......... .......... .......... 99% 255M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92200K .......... .......... .......... .......... .......... 99% 176M 0s 2024-09-22T09:12:02.244 INFO:teuthology.orchestra.run.smithi039.stderr: 92250K .......... .......... .......... .......... .......... 99% 369M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92300K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92350K .......... .......... .......... .......... .......... 99% 292M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92400K .......... .......... .......... .......... .......... 99% 381M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92450K .......... .......... .......... .......... .......... 99% 353M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92500K .......... .......... .......... .......... .......... 99% 367M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92550K .......... .......... .......... .......... .......... 99% 236M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92600K .......... .......... .......... .......... .......... 99% 205M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92650K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92700K .......... .......... .......... .......... .......... 99% 354M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92750K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92800K .......... .......... .......... .......... .......... 99% 185M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92850K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 92900K 100% 134G=0.5s 2024-09-22T09:12:02.245 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:12:02.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22 09:12:01 (192 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-22T09:12:02.246 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:12:02.285 INFO:teuthology.orchestra.run.smithi039.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-22T09:12:02.285 INFO:teuthology.orchestra.run.smithi039.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-22T09:12:02.286 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-22T09:12:02.287 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-22T09:12:02.288 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-22T09:12:02.289 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-22T09:12:02.290 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-22T09:12:02.291 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-22T09:12:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-22T09:12:02.293 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-22T09:12:02.294 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-22T09:12:02.295 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-22T09:12:02.296 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-22T09:12:02.297 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-22T09:12:02.298 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-22T09:12:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-22T09:12:02.300 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-22T09:12:02.301 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-22T09:12:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-22T09:12:02.303 INFO:teuthology.orchestra.run.smithi039.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout:Welcome to Gradle 6.0.1! 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout:Here are the highlights of this release: 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Substantial improvements in dependency management, including 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Advanced control of transitive versions 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Support for optional features and dependencies 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Rules to tweak published metadata 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Support for Java 13 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - Faster incremental Java and Groovy compilation 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - New Zinc compiler for Scala 2024-09-22T09:12:02.304 INFO:teuthology.orchestra.run.smithi039.stdout: - VS2019 support 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:------------------------------------------------------------ 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:Gradle 6.0.1 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:------------------------------------------------------------ 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.305 INFO:teuthology.orchestra.run.smithi039.stdout:Kotlin: 1.3.50 2024-09-22T09:12:02.306 INFO:teuthology.orchestra.run.smithi039.stdout:Groovy: 2.5.8 2024-09-22T09:12:02.306 INFO:teuthology.orchestra.run.smithi039.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-22T09:12:02.306 INFO:teuthology.orchestra.run.smithi039.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-22T09:12:02.306 INFO:teuthology.orchestra.run.smithi039.stdout:OS: Linux 5.14.0-508.el9.x86_64 amd64 2024-09-22T09:12:02.306 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:02.306 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-22T09:12:02.306 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T09:12:02.306 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:12:02.306 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T09:12:02.306 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:12:02.307 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-22T09:12:04.505 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-22T09:12:04.505 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-22T09:12:04.506 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ICZNIPKNVZEIUPDVHUPG', 'access_secret': 'swNR2Kv2XB1LmqK1VZZv1uaK2rGnOCcyQNAXST7jgWTQH2obQkWAdQ==', 'region': 'mexico', 'endpoint': 'smithi039.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi039.front.sepia.ceph.com'} 2024-09-22T09:12:04.506 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-22T09:12:04.506 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ICZNIPKNVZEIUPDVHUPG', '--secret', 'swNR2Kv2XB1LmqK1VZZv1uaK2rGnOCcyQNAXST7jgWTQH2obQkWAdQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-22T09:12:04.506 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ICZNIPKNVZEIUPDVHUPG --secret swNR2Kv2XB1LmqK1VZZv1uaK2rGnOCcyQNAXST7jgWTQH2obQkWAdQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-22T09:12:04.581 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:12:04.582 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:12:04.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.630+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 realm 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:12:04.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:04.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:04.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.631+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:04.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.632+0000 7f0b92936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:04.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.632+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:04.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.633+0000 7f0b92936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:12:04.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.633+0000 7f0b92936800 20 searching for the correct realm 2024-09-22T09:12:04.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.635+0000 7f0b8eeb8640 0 -- 172.21.15.39:0/2323851478 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f0b8402a070 msgr2=0x7f0b84044430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:12:04.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:04.842+0000 7f0b8deb6640 0 -- 172.21.15.39:0/2323851478 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f0b88058430 msgr2=0x7f0b880b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.050+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:05.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:12:05.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 zone default found 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 4 Realm: () 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 zonegroup default 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.051+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 started sync module instance, tier type = 2024-09-22T09:12:05.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.052+0000 7f0b92936800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=0 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=1 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=2 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=3 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=4 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=5 2024-09-22T09:12:05.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.064+0000 7f0b92936800 20 add_watcher() i=6 2024-09-22T09:12:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.065+0000 7f0b92936800 20 add_watcher() i=7 2024-09-22T09:12:05.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.065+0000 7f0b92936800 2 all 8 watchers are set, enabling cache 2024-09-22T09:12:05.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.067+0000 7f0a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:05.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.067+0000 7f0b92936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:12:05.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.067+0000 7f0b92936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:12:05.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.067+0000 7f0b92936800 5 note: GC not initialized 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f09bf7fe640 20 reqs_thread_entry: start 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f0b92936800 20 init_complete bucket index max shards: 1 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f0b92936800 20 Filter name: none 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f09bd7fa640 20 reqs_thread_entry: start 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f0b92936800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T09:12:05.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.068+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache get: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG : miss 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG info.flags=0x0 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 adding default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG to cache LRU end 2024-09-22T09:12:05.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache get: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG : hit (negative entry) 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.069+0000 7f0b92936800 10 cache get: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG : hit (negative entry) 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0b92936800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0b92936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0a71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529768 cookie 94814443735824 notifier 8204 bl.length()=670 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0a71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-22T09:12:05.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.071+0000 7f0a71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T09:12:05.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.074+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T09:12:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.074+0000 7f0b92936800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T09:12:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.074+0000 7f0b92936800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T09:12:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.075+0000 7f0a71ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 94814443729024 notifier 8204 bl.length()=200 2024-09-22T09:12:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.075+0000 7f0a71ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-22T09:12:05.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.075+0000 7f0a71ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-22T09:12:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0b92936800 10 cache put: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG info.flags=0x7 2024-09-22T09:12:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0b92936800 10 moving default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG to cache LRU end 2024-09-22T09:12:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0b92936800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ICZNIPKNVZEIUPDVHUPG, ofs0, ns] 2024-09-22T09:12:05.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0a717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529730 cookie 94814443716784 notifier 8204 bl.length()=189 2024-09-22T09:12:05.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0a717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG info.flags=0x7 2024-09-22T09:12:05.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.078+0000 7f0a717fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ICZNIPKNVZEIUPDVHUPG to cache LRU end 2024-09-22T09:12:05.081 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:12:05.081 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "tester.client.0", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Ms. tester.client.0", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "tester.client.0_test@test.test", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "tester.client.0", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "ICZNIPKNVZEIUPDVHUPG", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "swNR2Kv2XB1LmqK1VZZv1uaK2rGnOCcyQNAXST7jgWTQH2obQkWAdQ==", 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:12:05.082 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:12:05.070624Z" 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:12:05.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:12:05.070611Z", 2024-09-22T09:12:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.081+0000 7f0a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.084+0000 7f0b92936800 20 remove_watcher() i=0 2024-09-22T09:12:05.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.084+0000 7f0b92936800 2 removed watcher, disabling cache 2024-09-22T09:12:05.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.086+0000 7f0b92936800 20 remove_watcher() i=1 2024-09-22T09:12:05.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.087+0000 7f0b92936800 20 remove_watcher() i=2 2024-09-22T09:12:05.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.088+0000 7f0b92936800 20 remove_watcher() i=3 2024-09-22T09:12:05.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.089+0000 7f0b92936800 20 remove_watcher() i=4 2024-09-22T09:12:05.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.091+0000 7f0b92936800 20 remove_watcher() i=5 2024-09-22T09:12:05.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.092+0000 7f0b92936800 20 remove_watcher() i=6 2024-09-22T09:12:05.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.093+0000 7f0b92936800 20 remove_watcher() i=7 2024-09-22T09:12:05.108 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:12:05.109 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-22T09:12:05.143 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-22T09:12:05.144 DEBUG:teuthology.orchestra.run.smithi039:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-22T09:12:05.213 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:12:05.309 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:12:05.309 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:12:05.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.350+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 realm 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.351+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.352+0000 7f42455a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.352+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.353+0000 7f42455a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:12:05.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.353+0000 7f42455a7800 20 searching for the correct realm 2024-09-22T09:12:05.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.355+0000 7f4243892640 0 -- 172.21.15.39:0/2642295853 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f422c08a040 msgr2=0x7f422c069a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:12:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.561+0000 7f423a890640 0 -- 172.21.15.39:0/2642295853 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f423c00e3c0 msgr2=0x7f423c00e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:12:05.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.768+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 zone default found 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 4 Realm: () 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:12:05.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 zonegroup default 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.769+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 rados->read ofs=0 len=0 2024-09-22T09:12:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 started sync module instance, tier type = 2024-09-22T09:12:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.770+0000 7f42455a7800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=0 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=1 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=2 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=3 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=4 2024-09-22T09:12:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.781+0000 7f42455a7800 20 add_watcher() i=5 2024-09-22T09:12:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.782+0000 7f42455a7800 20 add_watcher() i=6 2024-09-22T09:12:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.782+0000 7f42455a7800 20 add_watcher() i=7 2024-09-22T09:12:05.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.782+0000 7f42455a7800 2 all 8 watchers are set, enabling cache 2024-09-22T09:12:05.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.784+0000 7f40f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:05.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.784+0000 7f42455a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:12:05.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.784+0000 7f42455a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:12:05.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.823+0000 7f40f8fe1640 20 reqs_thread_entry: start 2024-09-22T09:12:05.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.823+0000 7f42455a7800 20 init_complete bucket index max shards: 1 2024-09-22T09:12:05.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.823+0000 7f42455a7800 20 Filter name: none 2024-09-22T09:12:05.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.824+0000 7f40727fc640 20 reqs_thread_entry: start 2024-09-22T09:12:05.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.824+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:12:05.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.825+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_ZOTig1kI-BD1J6BfroDbzaKOu1wElak', time=2024-09-22T11:02:17.156789+0000, chain.objs.size()=1 2024-09-22T09:12:05.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.BI5dwxAFmiRkTutSYsiXmR18Ud6PRA-_0 2024-09-22T09:12:05.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12807449107205085774', time=2024-09-22T11:02:17.200932+0000, chain.objs.size()=3 2024-09-22T09:12:05.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.1 2024-09-22T09:12:05.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.2 2024-09-22T09:12:05.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.826+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.3 2024-09-22T09:12:05.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.829+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.831+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:12:05.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.832+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.9399811591066906751', time=2024-09-22T11:02:17.232160+0000, chain.objs.size()=3 2024-09-22T09:12:05.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.1 2024-09-22T09:12:05.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.2 2024-09-22T09:12:05.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.833+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.3 2024-09-22T09:12:05.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.835+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.837+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:12:05.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.839+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.839+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.839+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:12:05.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.245704419642164049', time=2024-09-22T11:02:17.117784+0000, chain.objs.size()=4 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.1 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.2 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.3 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.9__multipart_foo.2~r3pprePiT5en6fhd7ZYY7sEWM0xidTT.4 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_kJyoIXE3F6zCayDW78NPax4-0VpKeHZ', time=2024-09-22T11:02:17.215317+0000, chain.objs.size()=2 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.FPiu0W-rw8d_TR5BSnw2fF1j36g4PRb_0 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.FPiu0W-rw8d_TR5BSnw2fF1j36g4PRb_1 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_t0QQhegl34CKLI82G_YJEnIU5q5gZfA', time=2024-09-22T11:02:17.219419+0000, chain.objs.size()=2 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.CqpO-QUQ6DQVREiOGLWLG_jTXJk5giO_1 2024-09-22T09:12:05.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.840+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.CqpO-QUQ6DQVREiOGLWLG_jTXJk5giO_2 2024-09-22T09:12:05.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.844+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.847+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:12:05.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.848+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_f3m4eohaKxzublDUotRxfNEPXx23uK4', time=2024-09-22T11:02:17.144132+0000, chain.objs.size()=1 2024-09-22T09:12:05.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.oDS2Vd4r_j0J4WFdIf_6FkwbMbuNCs__0 2024-09-22T09:12:05.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_BvbF_0qUwd_iGAJwG7njC7pw8cQxHIn', time=2024-09-22T11:02:17.178985+0000, chain.objs.size()=1 2024-09-22T09:12:05.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.849+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.-TcASjjkjGOKcInYcsDJlxjUXpg_fsr_0 2024-09-22T09:12:05.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.851+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.853+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:12:05.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.856+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.856+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.857+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.858+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:12:05.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.859+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.860+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.860+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.860+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4621551648394144862', time=2024-09-22T11:02:17.296646+0000, chain.objs.size()=2 2024-09-22T09:12:05.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.860+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.mOaaBVKp8_e58qJx2Hs6nTk-7Cw9gl1_0 2024-09-22T09:12:05.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.860+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.mOaaBVKp8_e58qJx2Hs6nTk-7Cw9gl1_1 2024-09-22T09:12:05.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.863+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.865+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:12:05.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.866+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7751789128567278334', time=2024-09-22T11:02:17.135410+0000, chain.objs.size()=1 2024-09-22T09:12:05.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.U4VxWvXHHoDhuo8JkbRxIIOjuedHI4H_0 2024-09-22T09:12:05.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.662418120770494123', time=2024-09-22T11:02:17.252995+0000, chain.objs.size()=3 2024-09-22T09:12:05.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.1 2024-09-22T09:12:05.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.2 2024-09-22T09:12:05.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.867+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.3 2024-09-22T09:12:05.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.870+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.872+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:12:05.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6956427252035123885', time=2024-09-22T11:02:17.076296+0000, chain.objs.size()=4 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.1 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.2 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.3 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.12__multipart_foo.2~0mdyjRBUNqUUMnLM144G3goLN2bZQru.4 2024-09-22T09:12:05.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.11362012038409363565', time=2024-09-22T11:02:17.273936+0000, chain.objs.size()=3 2024-09-22T09:12:05.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.1 2024-09-22T09:12:05.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.2 2024-09-22T09:12:05.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.874+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-LUKEWARM.2~fizEgyxr4CJE9FNz_3OxQQ7KabYRWRZ.3 2024-09-22T09:12:05.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.878+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.880+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:12:05.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.882+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.882+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.882+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.882+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3549030833625285912', time=2024-09-22T11:02:17.161061+0000, chain.objs.size()=1 2024-09-22T09:12:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.883+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.OPHXHWHrSXWfLOB7Ma_kRLhPbOBorZk_0 2024-09-22T09:12:05.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.884+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.887+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:12:05.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.888+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.889+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.889+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.889+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_ER2s-LSFZ0CVhluRyXHUuCAZISZCEsz', time=2024-09-22T11:02:17.165373+0000, chain.objs.size()=1 2024-09-22T09:12:05.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.889+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.RcR6yVAG2MfgvY5JYQ9gDhtWGmNauzI_1 2024-09-22T09:12:05.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.891+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.893+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:12:05.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.895+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.895+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.895+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.896+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:12:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.897+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.898+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.898+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.899+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:12:05.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.901+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.901+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.901+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.902+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:12:05.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.904+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.904+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_vmdh5N7olxNGuLtLajiVzUOSze-fLRp', time=2024-09-22T11:02:17.236315+0000, chain.objs.size()=2 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.OY733wXLZ1djbtCE1KFDXkf-bDlnLJE_1 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.OY733wXLZ1djbtCE1KFDXkf-bDlnLJE_2 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_T00OrO0YW-eIv73988MkBB6ZEn3lKJn', time=2024-09-22T11:02:17.248908+0000, chain.objs.size()=1 2024-09-22T09:12:05.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.905+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.RDmeTSp0jDVko8ZeY31Vq5JZuPfhlFp_0 2024-09-22T09:12:05.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.907+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.909+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:12:05.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5200090918335847265', time=2024-09-22T11:02:17.096739+0000, chain.objs.size()=4 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.1 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.2 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.3 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.911+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.10__multipart_foo.2~LuLLzvw7CGUkVKrAhYKR6bEFfaXKmbg.4 2024-09-22T09:12:05.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.913+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.916+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:12:05.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.917+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.917+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:12:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3231443603765549351', time=2024-09-22T11:02:17.170197+0000, chain.objs.size()=1 2024-09-22T09:12:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.SgUEElGY1rhh04UluMZy12Jqtf5yjEs_1 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.18086739026202241027', time=2024-09-22T11:02:17.211310+0000, chain.objs.size()=3 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.1 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.2 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-FROZEN.2~CzcVfYc-jYA4JzMCLR9IvmyFBGrMFNB.3 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.114289834528138657', time=2024-09-22T11:02:17.240542+0000, chain.objs.size()=3 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.1 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.2 2024-09-22T09:12:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.918+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-STANDARD.2~wFbvFo3vJYyphUt9a6XSBgepRl00JH0.3 2024-09-22T09:12:05.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.922+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.924+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:12:05.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.925+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.926+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.926+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.927+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:12:05.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.928+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.928+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.929+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.929+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12253096733284433394', time=2024-09-22T11:02:17.223863+0000, chain.objs.size()=3 2024-09-22T09:12:05.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.929+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.1 2024-09-22T09:12:05.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.929+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.2 2024-09-22T09:12:05.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.929+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__multipart_foo-LUKEWARM.2~1ne4TSi6t9FW90GX305qziz3QYcbXlQ.3 2024-09-22T09:12:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.932+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.934+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:12:05.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.935+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2756330665792251302', time=2024-09-22T11:02:17.152621+0000, chain.objs.size()=1 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.OPHXHWHrSXWfLOB7Ma_kRLhPbOBorZk_0 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.275507411603225826', time=2024-09-22T11:02:17.300764+0000, chain.objs.size()=2 2024-09-22T09:12:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.X0t9ubZBsA_FK7CPIgEfaMp-NK9EHQ1_0 2024-09-22T09:12:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.936+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.13__shadow_.X0t9ubZBsA_FK7CPIgEfaMp-NK9EHQ1_1 2024-09-22T09:12:05.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.939+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.941+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:12:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.942+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.943+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.943+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.943+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_21FB5ChAIayUH4YIjEDvZAv16q35Ecl', time=2024-09-22T11:02:17.227968+0000, chain.objs.size()=2 2024-09-22T09:12:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.943+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.ElZBMp1Ylrz10f-j5RMGU3AycKkpABR_0 2024-09-22T09:12:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.943+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.ElZBMp1Ylrz10f-j5RMGU3AycKkpABR_1 2024-09-22T09:12:05.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.946+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.948+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:12:05.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.949+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.949+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:12:05.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14506039106474669975', time=2024-09-22T11:02:17.057492+0000, chain.objs.size()=4 2024-09-22T09:12:05.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.1 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.2 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.3 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.11__multipart_foo.2~ctIeJTIG436PkMfwpMstbY60MFvRBPX.4 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.11709535482568247405', time=2024-09-22T11:02:17.139688+0000, chain.objs.size()=1 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.U4VxWvXHHoDhuo8JkbRxIIOjuedHI4H_0 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6497966623138020771', time=2024-09-22T11:02:17.183288+0000, chain.objs.size()=1 2024-09-22T09:12:05.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.950+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.SgUEElGY1rhh04UluMZy12Jqtf5yjEs_1 2024-09-22T09:12:05.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.953+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.956+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:12:05.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.957+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16691927038598613190', time=2024-09-22T11:02:17.269149+0000, chain.objs.size()=3 2024-09-22T09:12:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.1 2024-09-22T09:12:05.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.2 2024-09-22T09:12:05.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.958+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-FROZEN.2~b6vyKVA9796P3LIe_cEJTaRAuk_XJIy.3 2024-09-22T09:12:05.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.961+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.963+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:12:05.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.964+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.964+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.965+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.966+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:12:05.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.967+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.967+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.968+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:12:05.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.968+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_onm2uqcoKmFnA_rur12GAxhazHztx2r', time=2024-09-22T11:02:17.148158+0000, chain.objs.size()=1 2024-09-22T09:12:05.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.968+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.85FbXUeoud50gbEEcfW9-wB-n4Kptnm_1 2024-09-22T09:12:05.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.968+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_E5zXxC9WTc2qSbtl68vuD8dY9QPKgFy', time=2024-09-22T11:02:17.244622+0000, chain.objs.size()=1 2024-09-22T09:12:05.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.968+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.16__shadow_.dMaL7ztAqAu9ZK1prM7PmZXTcMfIWmm_0 2024-09-22T09:12:05.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.969+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.972+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:12:05.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.973+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.974+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.974+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.975+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:12:05.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.976+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.977+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.977+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.978+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:12:05.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.979+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.979+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.980+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.980+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='_4jJO9PVDbxdI4_BGspHKxVpIrxZ7TiO', time=2024-09-22T11:02:17.174881+0000, chain.objs.size()=1 2024-09-22T09:12:05.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.980+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.15__shadow_.fcSXLPf11PTeSSCgrgP_g8HReVTOTV2_0 2024-09-22T09:12:05.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.981+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:05.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.983+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:12:05.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.985+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.985+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.985+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.986+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:12:05.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.988+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.988+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.988+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.989+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:12:05.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.991+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.991+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.991+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.993+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:12:05.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.994+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:05.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.994+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:05.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.995+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:12:05.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.995+0000 7f42455a7800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.124404739904928078', time=2024-09-22T11:02:17.278122+0000, chain.objs.size()=3 2024-09-22T09:12:05.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.995+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.1 2024-09-22T09:12:05.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.995+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.2 2024-09-22T09:12:05.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.995+0000 7f42455a7800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.14__multipart_foo-STANDARD.2~zXc-EE8EMkPYBbg5gm_5XY5pzIEjT6B.3 2024-09-22T09:12:05.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.997+0000 7f42455a7800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:12:06.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:05.999+0000 7f42455a7800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:12:06.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.001+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.001+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.001+0000 7f42455a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.003+0000 7f40f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:06.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.005+0000 7f42455a7800 20 remove_watcher() i=0 2024-09-22T09:12:06.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.005+0000 7f42455a7800 2 removed watcher, disabling cache 2024-09-22T09:12:06.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.006+0000 7f42455a7800 20 remove_watcher() i=1 2024-09-22T09:12:06.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.007+0000 7f42455a7800 20 remove_watcher() i=2 2024-09-22T09:12:06.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.008+0000 7f42455a7800 20 remove_watcher() i=3 2024-09-22T09:12:06.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.009+0000 7f42455a7800 20 remove_watcher() i=4 2024-09-22T09:12:06.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.010+0000 7f42455a7800 20 remove_watcher() i=5 2024-09-22T09:12:06.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.012+0000 7f42455a7800 20 remove_watcher() i=6 2024-09-22T09:12:06.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.013+0000 7f42455a7800 20 remove_watcher() i=7 2024-09-22T09:12:06.025 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:12:06.078 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:12:06.078 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.118+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 realm 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.120+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.121+0000 7f9e45e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.121+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.122+0000 7f9e45e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:12:06.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.122+0000 7f9e45e20800 20 searching for the correct realm 2024-09-22T09:12:06.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.124+0000 7f9e4410b640 0 -- 172.21.15.39:0/3467494492 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f9e2c0a3040 msgr2=0x7f9e2c069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:12:06.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.329+0000 7f9e3bfff640 0 -- 172.21.15.39:0/3467494492 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f9e3c061040 msgr2=0x7f9e3c0b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:12:06.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:12:06.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:12:06.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.534+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:12:06.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:12:06.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 zone default found 2024-09-22T09:12:06.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 4 Realm: () 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 zonegroup default 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.535+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 rados->read ofs=0 len=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 started sync module instance, tier type = 2024-09-22T09:12:06.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.536+0000 7f9e45e20800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=0 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=1 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=2 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=3 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=4 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=5 2024-09-22T09:12:06.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.547+0000 7f9e45e20800 20 add_watcher() i=6 2024-09-22T09:12:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.549+0000 7f9e45e20800 20 add_watcher() i=7 2024-09-22T09:12:06.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.549+0000 7f9e45e20800 2 all 8 watchers are set, enabling cache 2024-09-22T09:12:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.551+0000 7f9cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.551+0000 7f9e45e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:12:06.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.551+0000 7f9e45e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:12:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.588+0000 7f9cf8fe1640 20 reqs_thread_entry: start 2024-09-22T09:12:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.588+0000 7f9e45e20800 20 init_complete bucket index max shards: 1 2024-09-22T09:12:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.588+0000 7f9e45e20800 20 Filter name: none 2024-09-22T09:12:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.588+0000 7f9c727fc640 20 reqs_thread_entry: start 2024-09-22T09:12:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.588+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:12:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.590+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.590+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.591+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.592+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:12:06.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.593+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.594+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.594+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.595+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:12:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.596+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.596+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.597+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.598+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:12:06.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.599+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.599+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.600+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.601+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:12:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.602+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.602+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.603+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.604+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:12:06.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.605+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.605+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.606+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.607+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:12:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.608+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.608+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.609+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.610+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:12:06.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.611+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.612+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.612+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.613+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:12:06.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.614+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.614+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.615+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.616+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:12:06.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.617+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.617+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.618+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.619+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:12:06.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.620+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.620+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.620+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.621+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:12:06.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.623+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.623+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.624+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.625+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:12:06.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.626+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.626+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.627+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.628+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:12:06.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.629+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.629+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.630+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.631+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:12:06.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.632+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.632+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.633+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.634+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:12:06.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.635+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.635+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.636+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.637+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:12:06.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.638+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.639+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.639+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.640+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:12:06.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.642+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.642+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.642+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.643+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:12:06.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.645+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.645+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.646+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.646+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:12:06.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.648+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.648+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.649+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.650+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:12:06.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.651+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.651+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.651+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.652+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:12:06.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.654+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.654+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.654+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.655+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:12:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.657+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.657+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.657+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.658+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:12:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.659+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.660+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.660+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.662+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:12:06.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.663+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.663+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.664+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.664+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:12:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.666+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.666+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.667+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.667+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:12:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.669+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.669+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.669+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.670+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:12:06.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.672+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.672+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.672+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.673+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:12:06.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.674+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.675+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.675+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.676+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:12:06.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.677+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.678+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.678+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.679+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:12:06.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.681+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.681+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.681+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.682+0000 7f9e45e20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:12:06.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.684+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.684+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:12:06.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.684+0000 7f9e45e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:12:06.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.686+0000 7f9cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:12:06.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.689+0000 7f9e45e20800 20 remove_watcher() i=0 2024-09-22T09:12:06.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.689+0000 7f9e45e20800 2 removed watcher, disabling cache 2024-09-22T09:12:06.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.690+0000 7f9e45e20800 20 remove_watcher() i=1 2024-09-22T09:12:06.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.691+0000 7f9e45e20800 20 remove_watcher() i=2 2024-09-22T09:12:06.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.692+0000 7f9e45e20800 20 remove_watcher() i=3 2024-09-22T09:12:06.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.693+0000 7f9e45e20800 20 remove_watcher() i=4 2024-09-22T09:12:06.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.694+0000 7f9e45e20800 20 remove_watcher() i=5 2024-09-22T09:12:06.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.695+0000 7f9e45e20800 20 remove_watcher() i=6 2024-09-22T09:12:06.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:12:06.696+0000 7f9e45e20800 20 remove_watcher() i=7 2024-09-22T09:12:06.709 DEBUG:teuthology.orchestra.run.smithi039:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-22T09:12:07.222 INFO:teuthology.orchestra.run.smithi039.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-22T09:12:10.923 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :clean UP-TO-DATE 2024-09-22T09:12:28.821 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileJava 2024-09-22T09:12:28.921 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processResources 2024-09-22T09:12:28.921 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :classes 2024-09-22T09:12:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:29.621 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileTestJava 2024-09-22T09:12:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T09:12:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T09:12:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:29.623 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T09:12:29.623 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :testClasses 2024-09-22T09:12:35.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :test 2024-09-22T09:12:35.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:35.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-22T09:12:41.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:41.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-22T09:12:41.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:41.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-22T09:12:41.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:41.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-22T09:12:41.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:41.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-22T09:12:51.221 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:51.221 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-22T09:12:51.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:51.621 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T09:12:51.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:51.621 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T09:12:51.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-22T09:12:51.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-22T09:12:52.221 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:52.221 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-22T09:12:57.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:57.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-22T09:12:58.221 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:58.221 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-22T09:12:58.521 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:12:58.521 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-22T09:12:58.521 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:12:58,465 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T09:13:19.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:19.922 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-22T09:13:20.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:20.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-22T09:13:20.521 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:20.521 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-22T09:13:20.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:20.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-22T09:13:20.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:20.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-22T09:13:21.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:21.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-22T09:13:27.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:27.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-22T09:13:27.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:27.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-22T09:13:27.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:27.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-22T09:13:27.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:27.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-22T09:13:35.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:35.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-22T09:13:37.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:37.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-22T09:13:37.722 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:13:37,621 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-22T09:13:37.722 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:13:37,623 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-22T09:13:37.722 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:13:37,625 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-22T09:13:37.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:37.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T09:13:48.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:48.621 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T09:13:49.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:49.121 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-22T09:13:56.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:56.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-22T09:13:56.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:13:56.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-22T09:15:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:15:47.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-22T09:15:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:15:47.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-22T09:15:56.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:15:56.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-22T09:15:56.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:15:56.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-22T09:16:02.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:02.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:02.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-22T09:16:04.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:04.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-22T09:16:07.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:07.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-22T09:16:08.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:08.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-22T09:16:08.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:08.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-22T09:16:08.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:08.421 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-22T09:16:08.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:08.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-22T09:16:08.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:08.821 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-22T09:16:09.221 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:09.221 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-22T09:16:09.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:09.321 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-22T09:16:09.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:09.621 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-22T09:16:09.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:09.721 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-22T09:16:10.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:10.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-22T09:16:10.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:10.121 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-22T09:16:10.521 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:10.521 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-22T09:16:10.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:10.621 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-22T09:16:10.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:10.921 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-22T09:16:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:24.021 INFO:teuthology.orchestra.run.smithi039.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-22T09:16:24.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:24.421 INFO:teuthology.orchestra.run.smithi039.stdout:---------------------------------------------------------------------- 2024-09-22T09:16:24.422 INFO:teuthology.orchestra.run.smithi039.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-22T09:16:24.422 INFO:teuthology.orchestra.run.smithi039.stdout:---------------------------------------------------------------------- 2024-09-22T09:16:24.469 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:24.469 INFO:teuthology.orchestra.run.smithi039.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T09:16:24.469 INFO:teuthology.orchestra.run.smithi039.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T09:16:24.470 INFO:teuthology.orchestra.run.smithi039.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T09:16:24.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:24.470 INFO:teuthology.orchestra.run.smithi039.stdout:BUILD SUCCESSFUL in 4m 17s 2024-09-22T09:16:24.470 INFO:teuthology.orchestra.run.smithi039.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-22T09:16:24.789 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:24.843 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:24.843 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.882+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 realm 2024-09-22T09:16:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.884+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.885+0000 7f224571f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.885+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.886+0000 7f224571f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.886+0000 7f224571f800 20 searching for the correct realm 2024-09-22T09:16:24.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.889+0000 7f2241caa640 0 -- 172.21.15.39:0/581394343 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f223809e040 msgr2=0x7f223808b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:24.892+0000 7f2240ca8640 0 -- 172.21.15.39:0/581394343 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f223c06e410 msgr2=0x7f223c07e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:25.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.100+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:25.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 zone default found 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 4 Realm: () 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 zonegroup default 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.101+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.102+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.102+0000 7f224571f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.102+0000 7f224571f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.102+0000 7f224571f800 20 started sync module instance, tier type = 2024-09-22T09:16:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.102+0000 7f224571f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=0 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=1 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=2 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=3 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=4 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=5 2024-09-22T09:16:25.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.113+0000 7f224571f800 20 add_watcher() i=6 2024-09-22T09:16:25.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.114+0000 7f224571f800 20 add_watcher() i=7 2024-09-22T09:16:25.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.114+0000 7f224571f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:25.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.116+0000 7f20f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:25.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.116+0000 7f224571f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:25.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.116+0000 7f224571f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:25.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.154+0000 7f20f67e4640 20 reqs_thread_entry: start 2024-09-22T09:16:25.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.154+0000 7f224571f800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:25.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.154+0000 7f224571f800 20 Filter name: none 2024-09-22T09:16:25.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.155+0000 7f2067fff640 20 reqs_thread_entry: start 2024-09-22T09:16:25.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.155+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:25.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.156+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.226339527581084093', time=2024-09-22T11:12:51.376340+0000, chain.objs.size()=5 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.42__multipart_key1.2~oWJ6oV4IxG5O1G30LvJWoKo2wvvlwQW.1 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.42__multipart_key1.2~oWJ6oV4IxG5O1G30LvJWoKo2wvvlwQW.2 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.42__multipart_key1.2~oWJ6oV4IxG5O1G30LvJWoKo2wvvlwQW.3 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.42__multipart_key1.2~oWJ6oV4IxG5O1G30LvJWoKo2wvvlwQW.4 2024-09-22T09:16:25.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.42__multipart_key1.2~oWJ6oV4IxG5O1G30LvJWoKo2wvvlwQW.5 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.258080638701096012', time=2024-09-22T11:13:17.296646+0000, chain.objs.size()=5 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.157+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~6vjJDViBduAAvyPnAQ-GpVIES0p-Fn5.1 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.158+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~6vjJDViBduAAvyPnAQ-GpVIES0p-Fn5.1_1 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.158+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~6vjJDViBduAAvyPnAQ-GpVIES0p-Fn5.2 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.158+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~6vjJDViBduAAvyPnAQ-GpVIES0p-Fn5.2_1 2024-09-22T09:16:25.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.158+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~6vjJDViBduAAvyPnAQ-GpVIES0p-Fn5.3 2024-09-22T09:16:25.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.163+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.166+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:25.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.168+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.168+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13257597723928324652', time=2024-09-22T11:15:03.750423+0000, chain.objs.size()=10 2024-09-22T09:16:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.1 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.2 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.3 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.4 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.5 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.6 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.7 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.8 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.9 2024-09-22T09:16:25.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.169+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~lRhFB7s6WsaN0OHke132FaJWcTVpCKE.10 2024-09-22T09:16:25.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.175+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.177+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:25.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7206368975688869273', time=2024-09-22T11:12:57.787853+0000, chain.objs.size()=5 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.1 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.179+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.2 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.180+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.3 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.180+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.4 2024-09-22T09:16:25.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.180+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.5 2024-09-22T09:16:25.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.182+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.185+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:25.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.186+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.186+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.187+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.188+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:25.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.189+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.190+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.820500160351460209', time=2024-09-22T11:13:27.473732+0000, chain.objs.size()=5 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.51__multipart_key1.2~Tbzk5DWYx_VuvBP86a-1u4VE0Mrz-ba.1 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.51__multipart_key1.2~Tbzk5DWYx_VuvBP86a-1u4VE0Mrz-ba.2 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.51__multipart_key1.2~Tbzk5DWYx_VuvBP86a-1u4VE0Mrz-ba.3 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.51__multipart_key1.2~Tbzk5DWYx_VuvBP86a-1u4VE0Mrz-ba.4 2024-09-22T09:16:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.191+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.51__multipart_key1.2~Tbzk5DWYx_VuvBP86a-1u4VE0Mrz-ba.5 2024-09-22T09:16:25.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.193+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.196+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:25.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.8739173380949473000', time=2024-09-22T11:13:48.797622+0000, chain.objs.size()=5 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file2.mpg.2~U9xbXNQxoWchrPba3_fT8_2A0KbgZzH.1 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file2.mpg.2~U9xbXNQxoWchrPba3_fT8_2A0KbgZzH.2 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file2.mpg.2~U9xbXNQxoWchrPba3_fT8_2A0KbgZzH.3 2024-09-22T09:16:25.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file2.mpg.2~U9xbXNQxoWchrPba3_fT8_2A0KbgZzH.4 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.198+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file2.mpg.2~U9xbXNQxoWchrPba3_fT8_2A0KbgZzH.5 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6336643764853225277', time=2024-09-22T11:15:35.784918+0000, chain.objs.size()=11 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.1 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.1_1 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.2 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.2_1 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.3 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.3_1 2024-09-22T09:16:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.199+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.4 2024-09-22T09:16:25.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.201+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.4_1 2024-09-22T09:16:25.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.202+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.5 2024-09-22T09:16:25.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.204+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.5_1 2024-09-22T09:16:25.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.204+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~AbkJzl626SgmOFSPDinOCRo563xGxhn.6 2024-09-22T09:16:25.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.208+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.210+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.211+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.212+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.212+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.213+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:25.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.214+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.214+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.215+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.216+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:25.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.217+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6128274664946484731', time=2024-09-22T11:13:19.997247+0000, chain.objs.size()=4 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.46__shadow_.L20z_LQoDgnhLDuDyF8SWbcPS9HYAFW_1 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.46__shadow_.L20z_LQoDgnhLDuDyF8SWbcPS9HYAFW_2 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.46__shadow_.L20z_LQoDgnhLDuDyF8SWbcPS9HYAFW_3 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.46__shadow_.L20z_LQoDgnhLDuDyF8SWbcPS9HYAFW_4 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.11950716527515951920', time=2024-09-22T11:16:24.136168+0000, chain.objs.size()=11 2024-09-22T09:16:25.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.1 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.218+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.2 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.3 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.4 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.5 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.6 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.7 2024-09-22T09:16:25.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.219+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.8 2024-09-22T09:16:25.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.221+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.9 2024-09-22T09:16:25.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.225+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.10 2024-09-22T09:16:25.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.225+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.66__multipart_key1.2~PyEk5QFAQjIyse3ogDPz6r2ftK_chYb.11 2024-09-22T09:16:25.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.229+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.231+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:25.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.232+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15955534702016761726', time=2024-09-22T11:13:08.731698+0000, chain.objs.size()=5 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~jQu4Q3U7z6xl_dJOCsOG4HRXQBMQNY9.1 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~jQu4Q3U7z6xl_dJOCsOG4HRXQBMQNY9.2 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~jQu4Q3U7z6xl_dJOCsOG4HRXQBMQNY9.3 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.233+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~jQu4Q3U7z6xl_dJOCsOG4HRXQBMQNY9.4 2024-09-22T09:16:25.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.234+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~jQu4Q3U7z6xl_dJOCsOG4HRXQBMQNY9.5 2024-09-22T09:16:25.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.236+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.239+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:25.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.240+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.241+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.241+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.242+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:25.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.244+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.244+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.723019829785209246', time=2024-09-22T11:13:20.223209+0000, chain.objs.size()=5 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~OC_dLvSkb-BNvoixfoubUebUOrGj54M.1 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~OC_dLvSkb-BNvoixfoubUebUOrGj54M.1_1 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~OC_dLvSkb-BNvoixfoubUebUOrGj54M.2 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~OC_dLvSkb-BNvoixfoubUebUOrGj54M.2_1 2024-09-22T09:16:25.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.245+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~OC_dLvSkb-BNvoixfoubUebUOrGj54M.3 2024-09-22T09:16:25.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.248+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.251+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:25.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.252+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12727002894115603134', time=2024-09-22T11:14:39.911887+0000, chain.objs.size()=11 2024-09-22T09:16:25.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.1 2024-09-22T09:16:25.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.2 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.3 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.4 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.5 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.6 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.7 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.8 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.9 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.10 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~LVeXWcRgwU8gwY6dNIlcb4X7hS1fU2K.11 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15557260925849345936', time=2024-09-22T11:15:47.443044+0000, chain.objs.size()=11 2024-09-22T09:16:25.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.253+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.1 2024-09-22T09:16:25.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.256+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.1_1 2024-09-22T09:16:25.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.2 2024-09-22T09:16:25.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.2_1 2024-09-22T09:16:25.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.3 2024-09-22T09:16:25.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.3_1 2024-09-22T09:16:25.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.4 2024-09-22T09:16:25.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.258+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.4_1 2024-09-22T09:16:25.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.259+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.5 2024-09-22T09:16:25.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.260+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.5_1 2024-09-22T09:16:25.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.260+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~vRpfUDcOo-TZ9ojFver7GtpySKOjICA.6 2024-09-22T09:16:25.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.265+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.268+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:25.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.269+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12162470262084375637', time=2024-09-22T11:12:58.013607+0000, chain.objs.size()=5 2024-09-22T09:16:25.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.1 2024-09-22T09:16:25.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.2 2024-09-22T09:16:25.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.3 2024-09-22T09:16:25.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.4 2024-09-22T09:16:25.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.270+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.44__multipart_key1.2~6BrXwJ56cJCxtL3x-h3wH4oTPpeZHA7.5 2024-09-22T09:16:25.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.273+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.276+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:25.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.277+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.277+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='2~rCM5B4ww82GfVsZrWCwA766t5deEUFM', time=2024-09-22T11:12:40.959998+0000, chain.objs.size()=5 2024-09-22T09:16:25.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.40__multipart_key1.2~rCM5B4ww82GfVsZrWCwA766t5deEUFM.1 2024-09-22T09:16:25.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.40__multipart_key1.2~rCM5B4ww82GfVsZrWCwA766t5deEUFM.2 2024-09-22T09:16:25.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.40__multipart_key1.2~rCM5B4ww82GfVsZrWCwA766t5deEUFM.3 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.40__multipart_key1.2~rCM5B4ww82GfVsZrWCwA766t5deEUFM.4 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.40__multipart_key1.2~rCM5B4ww82GfVsZrWCwA766t5deEUFM.5 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4211493609520182911', time=2024-09-22T11:13:37.631109+0000, chain.objs.size()=5 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.52__multipart_key1.2~6nFYUqCFY4pxUQZCQgwY6eIHV3efInw.1 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.52__multipart_key1.2~6nFYUqCFY4pxUQZCQgwY6eIHV3efInw.2 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.52__multipart_key1.2~6nFYUqCFY4pxUQZCQgwY6eIHV3efInw.3 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.52__multipart_key1.2~6nFYUqCFY4pxUQZCQgwY6eIHV3efInw.4 2024-09-22T09:16:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.278+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.52__multipart_key1.2~6nFYUqCFY4pxUQZCQgwY6eIHV3efInw.5 2024-09-22T09:16:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.283+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.286+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:25.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.287+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.288+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.288+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.289+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:25.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.290+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.604004192874910369', time=2024-09-22T11:15:47.227219+0000, chain.objs.size()=11 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.1_1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.2 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.2_1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.3 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.3_1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.4 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.4_1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.5 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__shadow_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.5_1 2024-09-22T09:16:25.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~3UHtJsPCKIsCYmosw0Kyct9Gf5C193X.6 2024-09-22T09:16:25.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh', time=2024-09-22T11:16:05.497372+0000, chain.objs.size()=20 2024-09-22T09:16:25.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.291+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.1 2024-09-22T09:16:25.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.295+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.2 2024-09-22T09:16:25.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.296+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.3 2024-09-22T09:16:25.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.297+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.4 2024-09-22T09:16:25.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.297+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.5 2024-09-22T09:16:25.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.298+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.6 2024-09-22T09:16:25.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.298+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.7 2024-09-22T09:16:25.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.8 2024-09-22T09:16:25.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.9 2024-09-22T09:16:25.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.10 2024-09-22T09:16:25.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.11 2024-09-22T09:16:25.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.12 2024-09-22T09:16:25.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.13 2024-09-22T09:16:25.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.301+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.14 2024-09-22T09:16:25.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.303+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.15 2024-09-22T09:16:25.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.303+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.16 2024-09-22T09:16:25.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.303+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.17 2024-09-22T09:16:25.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.303+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.18 2024-09-22T09:16:25.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.304+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.19 2024-09-22T09:16:25.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.305+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.58__multipart_key1.2~HMEwrFXuTTxBJbAyzEiPxb9HaAXXYPh.20 2024-09-22T09:16:25.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.309+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.312+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:25.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.313+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.313+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6420142946191894797', time=2024-09-22T11:13:48.726551+0000, chain.objs.size()=5 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file.mpg.2~dNY26Tkxe7rOvMajmgJ7XiYxNhCei8l.1 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file.mpg.2~dNY26Tkxe7rOvMajmgJ7XiYxNhCei8l.2 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file.mpg.2~dNY26Tkxe7rOvMajmgJ7XiYxNhCei8l.3 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file.mpg.2~dNY26Tkxe7rOvMajmgJ7XiYxNhCei8l.4 2024-09-22T09:16:25.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.314+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.53__multipart_file.mpg.2~dNY26Tkxe7rOvMajmgJ7XiYxNhCei8l.5 2024-09-22T09:16:25.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.317+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.320+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:25.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.321+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.322+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.322+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.323+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:25.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.324+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.324+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.325+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.326+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:25.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.327+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.328+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.328+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.329+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:25.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.330+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.330+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7351096010601868285', time=2024-09-22T11:13:19.781265+0000, chain.objs.size()=5 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~dEL8ZIa8dRLUwtJHkoqftawgnUvEbX3.1 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~dEL8ZIa8dRLUwtJHkoqftawgnUvEbX3.1_1 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~dEL8ZIa8dRLUwtJHkoqftawgnUvEbX3.2 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__shadow_key1.2~dEL8ZIa8dRLUwtJHkoqftawgnUvEbX3.2_1 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~dEL8ZIa8dRLUwtJHkoqftawgnUvEbX3.3 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='2~IBEpxaKZapUBE-cU4ciRVllY7vKkbwP', time=2024-09-22T11:13:56.219843+0000, chain.objs.size()=3 2024-09-22T09:16:25.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.54__multipart_key1.2~IBEpxaKZapUBE-cU4ciRVllY7vKkbwP.7 2024-09-22T09:16:25.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.54__multipart_key1.2~IBEpxaKZapUBE-cU4ciRVllY7vKkbwP.10 2024-09-22T09:16:25.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.331+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.54__multipart_key1.2~IBEpxaKZapUBE-cU4ciRVllY7vKkbwP.13 2024-09-22T09:16:25.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.335+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.338+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:25.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.339+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.340+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.340+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.341+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:25.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.342+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.343+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.343+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.344+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:25.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.345+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6336850983614453412', time=2024-09-22T11:15:56.488397+0000, chain.objs.size()=5 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.56__multipart_key1.2~zP3OFP3KOo0_ZX5LGtmYe-KOCOBqVvl.1 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.56__multipart_key1.2~zP3OFP3KOo0_ZX5LGtmYe-KOCOBqVvl.2 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.56__multipart_key1.2~zP3OFP3KOo0_ZX5LGtmYe-KOCOBqVvl.3 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.56__multipart_key1.2~zP3OFP3KOo0_ZX5LGtmYe-KOCOBqVvl.4 2024-09-22T09:16:25.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.346+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.56__multipart_key1.2~zP3OFP3KOo0_ZX5LGtmYe-KOCOBqVvl.5 2024-09-22T09:16:25.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.350+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.352+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:25.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.353+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.354+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.354+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.355+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:25.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.356+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.357+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.357+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.358+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:25.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.359+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14446774811349656863', time=2024-09-22T11:13:14.837792+0000, chain.objs.size()=5 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~nNd8xS1L7a4BgNBJuuBtNjF1Jm2mBio.1 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~nNd8xS1L7a4BgNBJuuBtNjF1Jm2mBio.2 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~nNd8xS1L7a4BgNBJuuBtNjF1Jm2mBio.3 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~nNd8xS1L7a4BgNBJuuBtNjF1Jm2mBio.4 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~nNd8xS1L7a4BgNBJuuBtNjF1Jm2mBio.5 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7678170998396051541', time=2024-09-22T11:16:02.117797+0000, chain.objs.size()=5 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.57__multipart_key1.2~mwExdFEpUNzZOGFviwom7kQny_gYywg.1 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.57__multipart_key1.2~mwExdFEpUNzZOGFviwom7kQny_gYywg.2 2024-09-22T09:16:25.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.57__multipart_key1.2~mwExdFEpUNzZOGFviwom7kQny_gYywg.3 2024-09-22T09:16:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.57__multipart_key1.2~mwExdFEpUNzZOGFviwom7kQny_gYywg.4 2024-09-22T09:16:25.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.360+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.57__multipart_key1.2~mwExdFEpUNzZOGFviwom7kQny_gYywg.5 2024-09-22T09:16:25.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.366+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.369+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:25.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.370+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.371+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.371+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.372+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.373+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5512726454535739830', time=2024-09-22T11:13:12.118857+0000, chain.objs.size()=5 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~i7f7TY1T37MeMAy69MExJHAI59gXhwz.1 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~i7f7TY1T37MeMAy69MExJHAI59gXhwz.2 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~i7f7TY1T37MeMAy69MExJHAI59gXhwz.3 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~i7f7TY1T37MeMAy69MExJHAI59gXhwz.4 2024-09-22T09:16:25.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.374+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.47__multipart_key1.2~i7f7TY1T37MeMAy69MExJHAI59gXhwz.5 2024-09-22T09:16:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.376+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.379+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.381+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.381+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.381+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.382+0000 7f224571f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:25.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.384+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.384+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.17498832000651422375', time=2024-09-22T11:14:52.311336+0000, chain.objs.size()=11 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.1 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.2 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.3 2024-09-22T09:16:25.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.4 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.5 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.6 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.7 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.8 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.9 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.10 2024-09-22T09:16:25.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.385+0000 7f224571f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.55__multipart_key1.2~JJFn6Jf3uZnJy9zKLmQzvd8afAektVa.11 2024-09-22T09:16:25.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.391+0000 7f224571f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:16:25.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.394+0000 7f20f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:25.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.397+0000 7f224571f800 20 remove_watcher() i=0 2024-09-22T09:16:25.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.397+0000 7f224571f800 2 removed watcher, disabling cache 2024-09-22T09:16:25.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.398+0000 7f224571f800 20 remove_watcher() i=1 2024-09-22T09:16:25.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.399+0000 7f224571f800 20 remove_watcher() i=2 2024-09-22T09:16:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.400+0000 7f224571f800 20 remove_watcher() i=3 2024-09-22T09:16:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.401+0000 7f224571f800 20 remove_watcher() i=4 2024-09-22T09:16:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.402+0000 7f224571f800 20 remove_watcher() i=5 2024-09-22T09:16:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.404+0000 7f224571f800 20 remove_watcher() i=6 2024-09-22T09:16:25.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.405+0000 7f224571f800 20 remove_watcher() i=7 2024-09-22T09:16:25.418 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:25.471 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:25.472 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:25.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.510+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 realm 2024-09-22T09:16:25.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:25.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.513+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.514+0000 7fb713620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:25.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.514+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.515+0000 7fb713620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:25.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.515+0000 7fb713620800 20 searching for the correct realm 2024-09-22T09:16:25.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.515+0000 7fb71110a640 0 -- 172.21.15.39:0/2363447448 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fb70c0e6030 msgr2=0x7fb70c0aad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:25.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.720+0000 7fb71110a640 0 -- 172.21.15.39:0/2363447448 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7fb70c0de040 msgr2=0x7fb70c0d1a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:25.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:25.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:25.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:25.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:25.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.928+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:25.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 zone default found 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 4 Realm: () 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 zonegroup default 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.929+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 rados->read ofs=0 len=0 2024-09-22T09:16:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 started sync module instance, tier type = 2024-09-22T09:16:25.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.930+0000 7fb713620800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=0 2024-09-22T09:16:25.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=1 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=2 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=3 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=4 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=5 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.939+0000 7fb713620800 20 add_watcher() i=6 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.940+0000 7fb713620800 20 add_watcher() i=7 2024-09-22T09:16:25.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.940+0000 7fb713620800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.942+0000 7fb5c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.942+0000 7fb713620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:25.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.942+0000 7fb713620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:25.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.977+0000 7fb5c67e4640 20 reqs_thread_entry: start 2024-09-22T09:16:25.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.977+0000 7fb713620800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:25.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.977+0000 7fb713620800 20 Filter name: none 2024-09-22T09:16:25.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.977+0000 7fb537fff640 20 reqs_thread_entry: start 2024-09-22T09:16:25.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.977+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:25.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.978+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.979+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.979+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.980+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:25.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.981+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.982+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.982+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.983+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:25.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.985+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.985+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.986+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.987+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:25.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.988+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.988+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.989+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.990+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:25.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.991+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.991+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.992+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.992+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:25.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.994+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.995+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.995+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.996+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:25.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.997+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:25.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.998+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:25.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.998+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:25.999+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:26.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.000+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.001+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.001+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.002+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:26.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.003+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.004+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.004+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.005+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:26.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.006+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.007+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.007+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.008+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:26.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.009+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.010+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.010+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.011+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:26.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.012+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.013+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.013+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.014+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:26.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.015+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.016+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.016+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.017+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:26.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.018+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.019+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.019+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.020+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:26.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.022+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.022+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.022+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.023+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:26.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.025+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.025+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.025+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.026+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:26.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.028+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.028+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.029+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.030+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:26.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.031+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.031+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.031+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.032+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:26.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.034+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.034+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.035+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.036+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:26.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.037+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.038+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.038+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.039+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:26.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.040+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.041+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.041+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.042+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:26.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.043+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.044+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.044+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.045+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:26.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.046+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.047+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.047+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.048+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:26.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.050+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.050+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.050+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.051+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.053+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.053+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.054+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.054+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.056+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.056+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.056+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.057+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.059+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.059+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.060+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.061+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:26.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.062+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.062+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.063+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.064+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:26.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.065+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.066+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.066+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.067+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:26.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.068+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.069+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.069+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.070+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:26.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.071+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.072+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.072+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.073+0000 7fb713620800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:26.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.074+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.075+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.075+0000 7fb713620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.077+0000 7fb5c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:26.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.079+0000 7fb713620800 20 remove_watcher() i=0 2024-09-22T09:16:26.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.079+0000 7fb713620800 2 removed watcher, disabling cache 2024-09-22T09:16:26.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.080+0000 7fb713620800 20 remove_watcher() i=1 2024-09-22T09:16:26.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.081+0000 7fb713620800 20 remove_watcher() i=2 2024-09-22T09:16:26.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.082+0000 7fb713620800 20 remove_watcher() i=3 2024-09-22T09:16:26.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.083+0000 7fb713620800 20 remove_watcher() i=4 2024-09-22T09:16:26.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.084+0000 7fb713620800 20 remove_watcher() i=5 2024-09-22T09:16:26.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.085+0000 7fb713620800 20 remove_watcher() i=6 2024-09-22T09:16:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.086+0000 7fb713620800 20 remove_watcher() i=7 2024-09-22T09:16:26.099 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:26.152 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:26.152 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:26.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.191+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 20 realm 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.192+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.193+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.193+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.193+0000 7fbd4d31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.193+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.194+0000 7fbd4d31f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:26.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.194+0000 7fbd4d31f800 20 searching for the correct realm 2024-09-22T09:16:26.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.196+0000 7fbd498a3640 0 -- 172.21.15.39:0/3567010739 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fbd34018070 msgr2=0x7fbd34069860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:26.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.402+0000 7fbd488a1640 0 -- 172.21.15.39:0/3567010739 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fbd44084880 msgr2=0x7fbd44072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:26.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.609+0000 7fbd4d31f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 zone default found 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 4 Realm: () 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 zonegroup default 2024-09-22T09:16:26.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.610+0000 7fbd4d31f800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.611+0000 7fbd4d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.611+0000 7fbd4d31f800 20 started sync module instance, tier type = 2024-09-22T09:16:26.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.611+0000 7fbd4d31f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=0 2024-09-22T09:16:26.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=1 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=2 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=3 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=4 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=5 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.621+0000 7fbd4d31f800 20 add_watcher() i=6 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.622+0000 7fbd4d31f800 20 add_watcher() i=7 2024-09-22T09:16:26.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.622+0000 7fbd4d31f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:26.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.624+0000 7fbbfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:26.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.624+0000 7fbd4d31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:26.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.624+0000 7fbd4d31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.661+0000 7fbbfefe5640 20 reqs_thread_entry: start 2024-09-22T09:16:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.661+0000 7fbd4d31f800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.662+0000 7fbd4d31f800 20 Filter name: none 2024-09-22T09:16:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.662+0000 7fbbfcfe1640 20 reqs_thread_entry: start 2024-09-22T09:16:26.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.662+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:26.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.663+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.664+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.664+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.666+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:26.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.667+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.667+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.668+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.669+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:26.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.671+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.671+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.671+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.673+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:26.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.674+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.675+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.675+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.676+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.677+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.677+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.677+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.678+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.680+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.680+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.680+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.681+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.683+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.683+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.683+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.684+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:26.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.686+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.686+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.687+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.688+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.689+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.690+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.690+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.691+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:26.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.693+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.693+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.694+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.695+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:26.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.696+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.696+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.697+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.698+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.699+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.699+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.700+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.700+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:26.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.702+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.703+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.703+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.704+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:26.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.705+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.706+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.706+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.707+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:26.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.708+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.709+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.709+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.711+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:26.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.713+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.713+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.714+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.715+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:26.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.716+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.716+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.717+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.718+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:26.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.719+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.719+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.720+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.721+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.722+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.722+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.722+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.723+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.725+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.725+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.726+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.727+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:26.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.728+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.728+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.729+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.730+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:26.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.731+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.731+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.732+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.733+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:26.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.735+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.735+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.735+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.736+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:26.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.738+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.738+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.739+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.740+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:26.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.741+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.742+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.742+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.743+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:26.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.744+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.745+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.745+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.746+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:26.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.747+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.748+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.748+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.749+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.751+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.751+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.751+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.752+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:26.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.754+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.755+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.755+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.756+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.757+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.757+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.758+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.759+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:26.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.760+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.760+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.760+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.761+0000 7fbd4d31f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:26.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.763+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.763+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:26.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.763+0000 7fbd4d31f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:26.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.765+0000 7fbbfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:26.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.767+0000 7fbd4d31f800 20 remove_watcher() i=0 2024-09-22T09:16:26.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.767+0000 7fbd4d31f800 2 removed watcher, disabling cache 2024-09-22T09:16:26.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.768+0000 7fbd4d31f800 20 remove_watcher() i=1 2024-09-22T09:16:26.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.770+0000 7fbd4d31f800 20 remove_watcher() i=2 2024-09-22T09:16:26.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.771+0000 7fbd4d31f800 20 remove_watcher() i=3 2024-09-22T09:16:26.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.772+0000 7fbd4d31f800 20 remove_watcher() i=4 2024-09-22T09:16:26.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.773+0000 7fbd4d31f800 20 remove_watcher() i=5 2024-09-22T09:16:26.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.774+0000 7fbd4d31f800 20 remove_watcher() i=6 2024-09-22T09:16:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.775+0000 7fbd4d31f800 20 remove_watcher() i=7 2024-09-22T09:16:26.788 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:26.842 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:26.843 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:26.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.881+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 realm 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:26.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:26.883+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.086+0000 7f150d723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:27.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.086+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.087+0000 7f150d723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.087+0000 7f150d723800 20 searching for the correct realm 2024-09-22T09:16:27.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.087+0000 7f1509b34640 0 -- 172.21.15.39:0/1912555523 >> [v2:172.21.15.39:6816/2957971359,v1:172.21.15.39:6817/2957971359] conn(0x563b0340cb60 msgr2=0x563b0340ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.090+0000 7f1509333640 0 -- 172.21.15.39:0/1912555523 >> [v2:172.21.15.39:6800/1561628689,v1:172.21.15.39:6801/1561628689] conn(0x563b034050d0 msgr2=0x563b03407550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.097+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 zone default found 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 4 Realm: () 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 zonegroup default 2024-09-22T09:16:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.098+0000 7f150d723800 20 rados->read ofs=0 len=0 2024-09-22T09:16:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.099+0000 7f150d723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.099+0000 7f150d723800 20 started sync module instance, tier type = 2024-09-22T09:16:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.099+0000 7f150d723800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=0 2024-09-22T09:16:27.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=1 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=2 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=3 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=4 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=5 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.108+0000 7f150d723800 20 add_watcher() i=6 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.109+0000 7f150d723800 20 add_watcher() i=7 2024-09-22T09:16:27.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.109+0000 7f150d723800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.111+0000 7f13bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.111+0000 7f150d723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.111+0000 7f150d723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:27.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.145+0000 7f13befe5640 20 reqs_thread_entry: start 2024-09-22T09:16:27.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.145+0000 7f150d723800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:27.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.145+0000 7f150d723800 20 Filter name: none 2024-09-22T09:16:27.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.146+0000 7f13bcfe1640 20 reqs_thread_entry: start 2024-09-22T09:16:27.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.146+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:27.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.147+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.148+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.148+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.149+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:27.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.150+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.151+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.151+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.152+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:27.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.153+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.154+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.154+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.155+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:27.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.157+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.157+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.157+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.158+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:27.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.159+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.160+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.160+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.162+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:27.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.163+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.164+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.164+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.165+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:27.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.166+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.167+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.167+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.168+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:27.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.169+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.170+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.170+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.171+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:27.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.172+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.173+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.173+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.174+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:27.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.175+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.176+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.176+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.177+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:27.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.179+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.180+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.180+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.181+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:27.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.182+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.183+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.183+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.184+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.185+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.185+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.186+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.187+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:27.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.188+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.188+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.189+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.190+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:27.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.191+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.191+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.192+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.192+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.194+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.194+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.194+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.195+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.197+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.197+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.197+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.198+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.200+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.200+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.201+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.201+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.203+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.203+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.204+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.205+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.206+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.206+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.206+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.207+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:27.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.208+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.209+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.209+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.210+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:27.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.211+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.212+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.212+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.213+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:27.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.215+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.215+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.215+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.216+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:27.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.217+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.218+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.218+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.220+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:27.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.221+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.222+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.222+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.223+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:27.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.224+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.225+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.225+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.226+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:27.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.227+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.228+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.228+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.229+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:27.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.230+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.231+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.231+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.232+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:27.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.233+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.234+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.234+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.235+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:27.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.236+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.237+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.237+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.238+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:27.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.239+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.240+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.240+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.241+0000 7f150d723800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:27.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.242+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.243+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:27.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.243+0000 7f150d723800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:27.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.245+0000 7f13bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:27.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.248+0000 7f150d723800 20 remove_watcher() i=0 2024-09-22T09:16:27.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.248+0000 7f150d723800 2 removed watcher, disabling cache 2024-09-22T09:16:27.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.249+0000 7f150d723800 20 remove_watcher() i=1 2024-09-22T09:16:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.250+0000 7f150d723800 20 remove_watcher() i=2 2024-09-22T09:16:27.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.251+0000 7f150d723800 20 remove_watcher() i=3 2024-09-22T09:16:27.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.252+0000 7f150d723800 20 remove_watcher() i=4 2024-09-22T09:16:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.253+0000 7f150d723800 20 remove_watcher() i=5 2024-09-22T09:16:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.254+0000 7f150d723800 20 remove_watcher() i=6 2024-09-22T09:16:27.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:27.255+0000 7f150d723800 20 remove_watcher() i=7 2024-09-22T09:16:27.268 DEBUG:teuthology.orchestra.run.smithi039:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-22T09:16:27.870 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :clean 2024-09-22T09:16:28.768 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileJava 2024-09-22T09:16:28.769 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processResources 2024-09-22T09:16:28.769 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :classes 2024-09-22T09:16:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileTestJava 2024-09-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T09:16:29.369 INFO:teuthology.orchestra.run.smithi039.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T09:16:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:29.370 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T09:16:29.370 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :testClasses 2024-09-22T09:16:31.269 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.269 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :test 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests STANDARD_OUT 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:16:30,577 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.270 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-22T09:16:31.569 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.569 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-22T09:16:31.569 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.569 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-22T09:16:31.868 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.868 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-22T09:16:31.968 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:31.969 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-22T09:16:32.068 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.069 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-22T09:16:32.268 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.268 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-22T09:16:32.568 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.569 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-22T09:16:32.569 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.569 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.668 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-22T09:16:32.868 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:32.869 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-22T09:16:33.369 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.369 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-22T09:16:33.468 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.469 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-22T09:16:33.668 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.669 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-22T09:16:33.768 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.768 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-22T09:16:33.851 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.851 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------- 2024-09-22T09:16:33.851 INFO:teuthology.orchestra.run.smithi039.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------- 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:BUILD SUCCESSFUL in 6s 2024-09-22T09:16:33.852 INFO:teuthology.orchestra.run.smithi039.stdout:5 actionable tasks: 5 executed 2024-09-22T09:16:33.855 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:33.908 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:33.909 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:33.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.948+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.949+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.949+0000 7fa703210800 20 realm 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.949+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.950+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.950+0000 7fa703210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.950+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.950+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.950+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:33.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.951+0000 7fa703210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:33.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.951+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.952+0000 7fa703210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.952+0000 7fa703210800 20 searching for the correct realm 2024-09-22T09:16:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.954+0000 7fa6ff1bd640 0 -- 172.21.15.39:0/2712405989 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa6f4027040 msgr2=0x7fa6f4067840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:33.959+0000 7fa6fe1bb640 0 -- 172.21.15.39:0/2712405989 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa6f80a62d0 msgr2=0x7fa6f80837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:34.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:34.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:34.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.165+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 zone default found 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 4 Realm: () 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:34.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 zonegroup default 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.166+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.167+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.167+0000 7fa703210800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.167+0000 7fa703210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.167+0000 7fa703210800 20 started sync module instance, tier type = 2024-09-22T09:16:34.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.167+0000 7fa703210800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=0 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=1 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=2 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=3 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=4 2024-09-22T09:16:34.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=5 2024-09-22T09:16:34.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.177+0000 7fa703210800 20 add_watcher() i=6 2024-09-22T09:16:34.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.178+0000 7fa703210800 20 add_watcher() i=7 2024-09-22T09:16:34.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.178+0000 7fa703210800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:34.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.180+0000 7fa5b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:34.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.180+0000 7fa703210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:34.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.180+0000 7fa703210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:34.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.218+0000 7fa52ffff640 20 reqs_thread_entry: start 2024-09-22T09:16:34.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.218+0000 7fa703210800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:34.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.218+0000 7fa703210800 20 Filter name: none 2024-09-22T09:16:34.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.218+0000 7fa52dffb640 20 reqs_thread_entry: start 2024-09-22T09:16:34.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.219+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:34.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.221+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.221+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.221+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.222+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:34.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.224+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.225+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.225+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.226+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:34.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.227+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.228+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.228+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.229+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:34.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.230+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.231+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.231+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.232+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:34.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.233+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.234+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.234+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.235+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:34.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.237+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.237+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.238+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.239+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:34.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.240+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.241+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.241+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.242+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:34.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.243+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.244+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.244+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.246+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:34.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.247+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.247+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.248+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.249+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.250+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.250+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.251+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.252+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:34.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.253+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.254+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.254+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.255+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:34.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.256+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.257+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.257+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.258+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:34.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.259+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.260+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.260+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.261+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.263+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.263+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.263+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.265+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.266+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.266+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.267+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.267+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:34.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.269+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.269+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.269+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.271+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.272+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.273+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.273+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.274+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:34.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.276+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.276+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.276+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.277+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.279+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.279+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.280+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.281+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:34.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.282+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.282+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.283+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.284+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:34.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.285+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.286+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.286+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.287+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:34.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.289+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.289+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.290+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.291+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:34.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.292+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.293+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.293+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.294+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:34.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.295+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.296+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.296+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.297+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:34.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.298+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.298+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.299+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.300+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:34.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.301+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.302+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.302+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.303+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:34.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.304+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.304+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.305+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.306+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:34.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.307+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.307+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.308+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.309+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:34.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.310+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.310+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.310+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.311+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:34.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.312+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.313+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.313+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.314+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:34.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.316+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.316+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.316+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.317+0000 7fa703210800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:34.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.318+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.319+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.319+0000 7fa703210800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.321+0000 7fa5b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.324+0000 7fa703210800 20 remove_watcher() i=0 2024-09-22T09:16:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.324+0000 7fa703210800 2 removed watcher, disabling cache 2024-09-22T09:16:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.325+0000 7fa703210800 20 remove_watcher() i=1 2024-09-22T09:16:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.326+0000 7fa703210800 20 remove_watcher() i=2 2024-09-22T09:16:34.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.327+0000 7fa703210800 20 remove_watcher() i=3 2024-09-22T09:16:34.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.328+0000 7fa703210800 20 remove_watcher() i=4 2024-09-22T09:16:34.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.329+0000 7fa703210800 20 remove_watcher() i=5 2024-09-22T09:16:34.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.330+0000 7fa703210800 20 remove_watcher() i=6 2024-09-22T09:16:34.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.331+0000 7fa703210800 20 remove_watcher() i=7 2024-09-22T09:16:34.344 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:34.397 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:34.397 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:34.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.436+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 20 realm 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.437+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.438+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.438+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.439+0000 7fb2f310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:34.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.439+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.439+0000 7fb2f310c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:34.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.439+0000 7fb2f310c800 20 searching for the correct realm 2024-09-22T09:16:34.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.441+0000 7fb2f13f7640 0 -- 172.21.15.39:0/734425409 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fb2e408a040 msgr2=0x7fb2e40672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:34.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.646+0000 7fb2f03f5640 0 -- 172.21.15.39:0/734425409 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fb2e8066910 msgr2=0x7fb2e8017400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:34.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.852+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 zone default found 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 4 Realm: () 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 zonegroup default 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.853+0000 7fb2f310c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.854+0000 7fb2f310c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.854+0000 7fb2f310c800 20 started sync module instance, tier type = 2024-09-22T09:16:34.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.854+0000 7fb2f310c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=0 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=1 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=2 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=3 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=4 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=5 2024-09-22T09:16:34.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.863+0000 7fb2f310c800 20 add_watcher() i=6 2024-09-22T09:16:34.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.864+0000 7fb2f310c800 20 add_watcher() i=7 2024-09-22T09:16:34.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.864+0000 7fb2f310c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:34.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.866+0000 7fb1a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:34.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.866+0000 7fb2f310c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:34.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.866+0000 7fb2f310c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.905+0000 7fb1a67e4640 20 reqs_thread_entry: start 2024-09-22T09:16:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.906+0000 7fb2f310c800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.906+0000 7fb2f310c800 20 Filter name: none 2024-09-22T09:16:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.906+0000 7fb19f7fe640 20 reqs_thread_entry: start 2024-09-22T09:16:34.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.906+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:34.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.907+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.908+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.908+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.909+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.911+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.911+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.911+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.912+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:34.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.914+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.914+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.914+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.915+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:34.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.916+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.917+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.917+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.918+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:34.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.920+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.920+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.920+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.921+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:34.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.923+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.923+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.923+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.924+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.926+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.926+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.927+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.928+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:34.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.929+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.930+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.930+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.931+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:34.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.932+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.933+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.933+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.934+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:34.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.935+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.936+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.936+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.937+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.939+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.939+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.940+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.941+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.942+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.942+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.943+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.944+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.945+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.945+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.946+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.947+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.948+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.948+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.948+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.949+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:34.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.951+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.951+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.952+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.953+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.954+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.954+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.955+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.956+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:34.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.957+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.958+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.958+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.959+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.961+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.961+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.962+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.963+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:34.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.964+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.964+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.965+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.966+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.967+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.968+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.968+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.969+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.970+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.971+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.971+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.972+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:34.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.974+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.974+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.975+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.976+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:34.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.977+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.978+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.978+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.979+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:34.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.980+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.981+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.982+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.983+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:34.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.984+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.984+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.984+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.985+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:34.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.987+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.987+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.987+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.988+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:34.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.990+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.990+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.990+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.991+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:34.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.993+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.993+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.993+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.994+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:34.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.996+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.996+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:34.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.996+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:34.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.997+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:35.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.999+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.999+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:34.999+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.000+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:35.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.002+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.002+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.003+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.004+0000 7fb2f310c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:35.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.005+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.005+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.006+0000 7fb2f310c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.008+0000 7fb1a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.010+0000 7fb2f310c800 20 remove_watcher() i=0 2024-09-22T09:16:35.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.010+0000 7fb2f310c800 2 removed watcher, disabling cache 2024-09-22T09:16:35.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.011+0000 7fb2f310c800 20 remove_watcher() i=1 2024-09-22T09:16:35.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.012+0000 7fb2f310c800 20 remove_watcher() i=2 2024-09-22T09:16:35.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.013+0000 7fb2f310c800 20 remove_watcher() i=3 2024-09-22T09:16:35.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.014+0000 7fb2f310c800 20 remove_watcher() i=4 2024-09-22T09:16:35.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.015+0000 7fb2f310c800 20 remove_watcher() i=5 2024-09-22T09:16:35.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.016+0000 7fb2f310c800 20 remove_watcher() i=6 2024-09-22T09:16:35.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.017+0000 7fb2f310c800 20 remove_watcher() i=7 2024-09-22T09:16:35.030 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:35.083 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:35.083 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:35.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.122+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 realm 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:35.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.124+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.125+0000 7f510e30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:35.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.125+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.126+0000 7f510e30c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:35.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.126+0000 7f510e30c800 20 searching for the correct realm 2024-09-22T09:16:35.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.127+0000 7f510c5f7640 0 -- 172.21.15.39:0/1972294917 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f50f40a51e0 msgr2=0x7f50f40969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:35.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.333+0000 7f510b5f5640 0 -- 172.21.15.39:0/1972294917 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5104008420 msgr2=0x7f5104008880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.540+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 zone default found 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 4 Realm: () 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 zonegroup default 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.541+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 started sync module instance, tier type = 2024-09-22T09:16:35.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.542+0000 7f510e30c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=0 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=1 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=2 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=3 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=4 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=5 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.552+0000 7f510e30c800 20 add_watcher() i=6 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.553+0000 7f510e30c800 20 add_watcher() i=7 2024-09-22T09:16:35.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.553+0000 7f510e30c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:35.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.555+0000 7f4fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:35.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.555+0000 7f510e30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:35.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.555+0000 7f510e30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:35.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.591+0000 7f4fc0fe1640 20 reqs_thread_entry: start 2024-09-22T09:16:35.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.591+0000 7f510e30c800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:35.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.591+0000 7f510e30c800 20 Filter name: none 2024-09-22T09:16:35.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.591+0000 7f4f3a7fc640 20 reqs_thread_entry: start 2024-09-22T09:16:35.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.591+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:35.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.593+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.593+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.594+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.594+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:35.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.596+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.597+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.597+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.598+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:35.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.600+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.600+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.600+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.601+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.603+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.603+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.604+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.605+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.606+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.606+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.607+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.608+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.609+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.609+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.610+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.611+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.612+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.612+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.613+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.614+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.615+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.616+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.616+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.617+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:35.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.618+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.619+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.619+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.620+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:35.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.621+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.622+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.622+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.623+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.625+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.625+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.626+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.627+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:35.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.628+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.629+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.629+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.630+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:35.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.632+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.633+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.633+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.634+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:35.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.635+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.636+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.636+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.637+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:35.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.639+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.639+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.639+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.640+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:35.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.641+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.642+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.642+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.643+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:35.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.645+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.645+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.645+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.647+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:35.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.648+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.648+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.649+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.650+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:35.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.652+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.653+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.653+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.654+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:35.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.656+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.656+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.657+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.658+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:35.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.659+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.660+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.660+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.661+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:35.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.662+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.663+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.663+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.664+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:35.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.665+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.666+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.666+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.667+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:35.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.668+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.669+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.669+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.670+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:35.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.671+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.672+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.672+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.673+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.675+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.675+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.675+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.676+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.678+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.678+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.679+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.680+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.681+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.681+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.682+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.683+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.684+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.684+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.685+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.686+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:35.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.687+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.688+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.688+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.689+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:35.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.691+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.691+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.692+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.693+0000 7f510e30c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.694+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.694+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.695+0000 7f510e30c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:35.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.697+0000 7f4fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:35.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.699+0000 7f510e30c800 20 remove_watcher() i=0 2024-09-22T09:16:35.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.699+0000 7f510e30c800 2 removed watcher, disabling cache 2024-09-22T09:16:35.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.700+0000 7f510e30c800 20 remove_watcher() i=1 2024-09-22T09:16:35.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.701+0000 7f510e30c800 20 remove_watcher() i=2 2024-09-22T09:16:35.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.702+0000 7f510e30c800 20 remove_watcher() i=3 2024-09-22T09:16:35.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.703+0000 7f510e30c800 20 remove_watcher() i=4 2024-09-22T09:16:35.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.704+0000 7f510e30c800 20 remove_watcher() i=5 2024-09-22T09:16:35.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.705+0000 7f510e30c800 20 remove_watcher() i=6 2024-09-22T09:16:35.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.706+0000 7f510e30c800 20 remove_watcher() i=7 2024-09-22T09:16:35.719 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:16:35.773 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:16:35.773 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:16:35.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.812+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 realm 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.813+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.814+0000 7fee44b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:35.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.814+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:35.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.815+0000 7fee44b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:16:35.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.815+0000 7fee44b2c800 20 searching for the correct realm 2024-09-22T09:16:35.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:35.817+0000 7fee40f3f640 0 -- 172.21.15.39:0/276441488 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fee2806fc20 msgr2=0x7fee2800f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:16:36.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.022+0000 7fee37fff640 0 -- 172.21.15.39:0/276441488 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fee3803b3f0 msgr2=0x7fee3803b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.229+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.230+0000 7fee44b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.230+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 zone default found 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 4 Realm: () 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 zonegroup default 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados->read ofs=0 len=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 started sync module instance, tier type = 2024-09-22T09:16:36.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.231+0000 7fee44b2c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:16:36.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=0 2024-09-22T09:16:36.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=1 2024-09-22T09:16:36.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=2 2024-09-22T09:16:36.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=3 2024-09-22T09:16:36.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=4 2024-09-22T09:16:36.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=5 2024-09-22T09:16:36.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.241+0000 7fee44b2c800 20 add_watcher() i=6 2024-09-22T09:16:36.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.242+0000 7fee44b2c800 20 add_watcher() i=7 2024-09-22T09:16:36.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.242+0000 7fee44b2c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:16:36.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.244+0000 7fecf6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:36.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.244+0000 7fee44b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:16:36.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.244+0000 7fee44b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:16:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.280+0000 7fecf5fdb640 20 reqs_thread_entry: start 2024-09-22T09:16:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.280+0000 7fee44b2c800 20 init_complete bucket index max shards: 1 2024-09-22T09:16:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.280+0000 7fee44b2c800 20 Filter name: none 2024-09-22T09:16:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.280+0000 7fec677fe640 20 reqs_thread_entry: start 2024-09-22T09:16:36.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.280+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:16:36.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.281+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.282+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.282+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.283+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:16:36.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.285+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.285+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.285+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.286+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:16:36.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.287+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.288+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.288+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.289+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:16:36.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.290+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.291+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.291+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.292+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:16:36.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.293+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.294+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.294+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.295+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:16:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.297+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.297+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.297+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.298+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:16:36.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.300+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.301+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.301+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.303+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:16:36.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.304+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.305+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.305+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.306+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:16:36.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.307+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.308+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.308+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.309+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:16:36.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.310+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.310+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.311+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.312+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:16:36.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.313+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.313+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.314+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.315+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:16:36.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.316+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.316+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.317+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.318+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:16:36.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.319+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.320+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.320+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.321+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:16:36.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.322+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.323+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.323+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.324+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:16:36.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.325+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.326+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.326+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.327+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:16:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.329+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.329+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.330+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.331+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:16:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.332+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.332+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.333+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.334+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:16:36.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.335+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.335+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.336+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.337+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:16:36.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.338+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.338+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.339+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.339+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:16:36.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.341+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.341+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.342+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.342+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:16:36.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.344+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.344+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.345+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.345+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:16:36.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.347+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.347+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.347+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.348+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:16:36.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.350+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.350+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.350+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.351+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:16:36.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.353+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.353+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.353+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.354+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:16:36.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.356+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.356+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.357+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.358+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:16:36.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.360+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.360+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.361+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.361+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:16:36.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.363+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.363+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.363+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.364+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:16:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.366+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.366+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.367+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.368+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:16:36.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.369+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.369+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.370+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.370+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:16:36.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.372+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.372+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.373+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.373+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.375+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.375+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.375+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.376+0000 7fee44b2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.377+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.378+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:16:36.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.378+0000 7fee44b2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.380+0000 7fecf6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.382+0000 7fee44b2c800 20 remove_watcher() i=0 2024-09-22T09:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.382+0000 7fee44b2c800 2 removed watcher, disabling cache 2024-09-22T09:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.383+0000 7fee44b2c800 20 remove_watcher() i=1 2024-09-22T09:16:36.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.384+0000 7fee44b2c800 20 remove_watcher() i=2 2024-09-22T09:16:36.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.385+0000 7fee44b2c800 20 remove_watcher() i=3 2024-09-22T09:16:36.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.386+0000 7fee44b2c800 20 remove_watcher() i=4 2024-09-22T09:16:36.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.387+0000 7fee44b2c800 20 remove_watcher() i=5 2024-09-22T09:16:36.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.388+0000 7fee44b2c800 20 remove_watcher() i=6 2024-09-22T09:16:36.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:16:36.389+0000 7fee44b2c800 20 remove_watcher() i=7 2024-09-22T09:16:36.402 DEBUG:teuthology.orchestra.run.smithi039:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-22T09:16:36.915 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :clean 2024-09-22T09:16:37.710 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileJava 2024-09-22T09:16:37.710 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processResources 2024-09-22T09:16:37.710 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :classes 2024-09-22T09:16:38.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:38.310 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :compileTestJava 2024-09-22T09:16:38.311 INFO:teuthology.orchestra.run.smithi039.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-22T09:16:38.311 INFO:teuthology.orchestra.run.smithi039.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-22T09:16:38.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:38.312 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :processTestResources NO-SOURCE 2024-09-22T09:16:38.312 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :testClasses 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout:> Task :test 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests STANDARD_OUT 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22 09:16:39,594 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.311 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-22T09:16:40.312 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.312 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-22T09:16:40.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-22T09:16:40.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-22T09:16:40.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:40.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-22T09:16:41.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:41.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-22T09:16:41.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:41.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-22T09:16:46.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:46.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-22T09:16:46.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:46.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-22T09:16:46.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:46.811 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-22T09:16:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-22T09:16:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-22T09:16:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-22T09:16:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-22T09:16:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-22T09:16:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:47.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-22T09:16:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:48.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-22T09:16:53.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:53.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-22T09:16:53.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:53.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-22T09:16:54.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:54.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-22T09:16:54.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:54.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:54.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-22T09:16:54.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:54.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-22T09:16:54.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:54.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-22T09:16:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-22T09:16:55.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-22T09:16:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-22T09:16:55.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-22T09:16:55.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-22T09:16:55.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:55.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-22T09:16:56.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:56.222 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-22T09:16:56.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:56.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-22T09:16:56.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:16:56.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-22T09:17:02.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:02.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-22T09:17:03.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:03.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-22T09:17:39.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:39.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-22T09:17:40.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:40.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-22T09:17:40.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:40.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-22T09:17:40.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:40.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-22T09:17:40.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:40.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-22T09:17:41.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:41.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-22T09:17:46.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:46.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-22T09:17:46.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:46.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-22T09:17:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:46.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-22T09:17:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:47.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-22T09:17:54.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:54.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-22T09:17:56.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:17:56.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-22T09:18:17.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:17.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-22T09:18:17.709 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-22T09:18:22.609 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:22.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-22T09:18:22.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:22.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-22T09:18:53.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:53.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-22T09:18:53.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:18:53.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-22T09:19:01.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-22T09:19:02.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:02.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-22T09:19:16.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:16.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-22T09:19:16.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:16.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-22T09:19:18.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:18.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-22T09:19:37.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:37.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-22T09:19:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:37.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-22T09:19:37.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:37.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-22T09:19:37.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:37.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-22T09:19:38.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:38.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-22T09:19:38.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:38.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-22T09:19:38.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:38.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-22T09:19:38.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:38.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-22T09:19:38.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:38.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-22T09:19:39.009 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:39.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-22T09:19:39.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:39.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-22T09:19:39.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:39.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-22T09:19:39.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:39.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-22T09:19:39.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:39.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-22T09:19:40.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:40.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-22T09:19:40.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:40.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-22T09:19:40.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:40.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-22T09:19:40.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:40.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-22T09:19:41.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:41.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-22T09:19:41.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-22T09:19:41.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:41.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-22T09:19:42.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:42.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-22T09:19:42.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-22T09:19:42.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:42.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-22T09:19:42.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:42.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-22T09:19:43.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:43.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-22T09:19:43.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:43.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-22T09:19:43.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:43.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-22T09:19:44.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:44.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-22T09:19:44.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:44.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-22T09:19:44.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:44.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-22T09:19:44.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:44.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-22T09:19:45.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:45.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-22T09:19:45.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:45.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-22T09:19:45.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:45.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-22T09:19:46.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:46.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-22T09:19:46.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:46.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-22T09:19:46.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:46.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-22T09:19:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:46.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-22T09:19:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:47.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-22T09:19:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:47.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-22T09:19:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:47.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-22T09:19:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:48.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-22T09:19:48.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:48.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-22T09:19:48.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:48.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-22T09:19:48.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:48.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-22T09:19:49.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:49.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-22T09:19:49.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:49.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-22T09:19:49.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:49.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-22T09:19:50.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:50.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-22T09:19:50.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:50.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-22T09:19:50.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:50.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-22T09:19:50.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:50.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-22T09:19:51.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:51.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-22T09:19:51.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:51.410 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-22T09:19:51.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:51.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-22T09:19:51.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:51.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-22T09:19:52.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:52.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-22T09:19:52.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:52.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-22T09:19:52.609 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:52.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-22T09:19:52.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:52.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-22T09:19:52.910 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:52.910 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-22T09:19:53.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-22T09:19:53.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:53.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-22T09:19:53.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:53.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-22T09:19:53.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:53.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-22T09:19:54.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-22T09:19:54.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-22T09:19:54.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-22T09:19:54.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.610 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-22T09:19:54.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-22T09:19:54.809 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:54.810 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-22T09:19:55.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:55.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-22T09:19:55.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:55.210 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-22T09:19:55.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:55.510 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-22T09:19:55.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:55.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-22T09:19:56.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:56.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-22T09:19:56.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:56.110 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-22T09:19:56.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:19:56.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-22T09:20:01.710 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:01.710 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-22T09:20:02.010 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:02.010 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-22T09:20:07.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:07.310 INFO:teuthology.orchestra.run.smithi039.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-22T09:20:07.671 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:---------------------------------------------------------------------- 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:---------------------------------------------------------------------- 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:BUILD SUCCESSFUL in 3m 31s 2024-09-22T09:20:07.672 INFO:teuthology.orchestra.run.smithi039.stdout:5 actionable tasks: 5 executed 2024-09-22T09:20:07.687 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:20:07.740 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:07.741 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:07.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.962+0000 7f508c80d640 0 --2- 172.21.15.39:0/2304547732 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x55bb29f74dc0 0x55bb29f6cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-22T09:20:07.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.981+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 20 realm 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.983+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.984+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:07.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.984+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.985+0000 7f5090323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.985+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.985+0000 7f5090323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.985+0000 7f5090323800 20 searching for the correct realm 2024-09-22T09:20:07.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:07.987+0000 7f508b80b640 0 -- 172.21.15.39:0/3871479802 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f507c070960 msgr2=0x7f507c064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:08.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.193+0000 7f508c00c640 0 -- 172.21.15.39:0/3871479802 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f5084038030 msgr2=0x7f508406d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.199+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 zone default found 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 4 Realm: () 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:08.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 zonegroup default 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.200+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 started sync module instance, tier type = 2024-09-22T09:20:08.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.201+0000 7f5090323800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=0 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=1 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=2 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=3 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=4 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=5 2024-09-22T09:20:08.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.212+0000 7f5090323800 20 add_watcher() i=6 2024-09-22T09:20:08.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.213+0000 7f5090323800 20 add_watcher() i=7 2024-09-22T09:20:08.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.213+0000 7f5090323800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:08.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.215+0000 7f4f42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.215+0000 7f5090323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:08.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.215+0000 7f5090323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.253+0000 7f4f41fdb640 20 reqs_thread_entry: start 2024-09-22T09:20:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.253+0000 7f5090323800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.253+0000 7f5090323800 20 Filter name: none 2024-09-22T09:20:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.253+0000 7f4eb37fe640 20 reqs_thread_entry: start 2024-09-22T09:20:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.253+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:20:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.255+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16763356264507971695', time=2024-09-22T11:19:16.185449+0000, chain.objs.size()=5 2024-09-22T09:20:08.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.104__multipart_key1.2~FNyb1v65DXt91G6bl9XEBe1L6ev1wdl.1 2024-09-22T09:20:08.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.104__multipart_key1.2~FNyb1v65DXt91G6bl9XEBe1L6ev1wdl.2 2024-09-22T09:20:08.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.104__multipart_key1.2~FNyb1v65DXt91G6bl9XEBe1L6ev1wdl.3 2024-09-22T09:20:08.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.104__multipart_key1.2~FNyb1v65DXt91G6bl9XEBe1L6ev1wdl.4 2024-09-22T09:20:08.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.256+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.104__multipart_key1.2~FNyb1v65DXt91G6bl9XEBe1L6ev1wdl.5 2024-09-22T09:20:08.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.260+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.263+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:20:08.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.264+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.264+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe', time=2024-09-22T11:18:22.795613+0000, chain.objs.size()=5 2024-09-22T09:20:08.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.101__multipart_key1.2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe.7 2024-09-22T09:20:08.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.101__multipart_key1.2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe.8 2024-09-22T09:20:08.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.101__multipart_key1.2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe.9 2024-09-22T09:20:08.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.101__multipart_key1.2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe.10 2024-09-22T09:20:08.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.265+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.101__multipart_key1.2~FS6bBrmJRNznu9T9WcIRDKy7kV-Kybe.11 2024-09-22T09:20:08.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.268+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.271+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:20:08.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.272+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.273+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.273+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.274+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:20:08.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.275+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3283218370800245833', time=2024-09-22T11:17:39.990413+0000, chain.objs.size()=5 2024-09-22T09:20:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~z_2UQZ8UuKP8cEZKdmL7iizu7NfiYaB.1 2024-09-22T09:20:08.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~z_2UQZ8UuKP8cEZKdmL7iizu7NfiYaB.1_1 2024-09-22T09:20:08.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~z_2UQZ8UuKP8cEZKdmL7iizu7NfiYaB.2 2024-09-22T09:20:08.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~z_2UQZ8UuKP8cEZKdmL7iizu7NfiYaB.2_1 2024-09-22T09:20:08.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.276+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~z_2UQZ8UuKP8cEZKdmL7iizu7NfiYaB.3 2024-09-22T09:20:08.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.279+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.282+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:20:08.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.283+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.17767809842636861619', time=2024-09-22T11:18:32.807548+0000, chain.objs.size()=5 2024-09-22T09:20:08.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~4pqi6i8GoqgdNb96FKPZ4NjNxXJEqQg.1 2024-09-22T09:20:08.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~4pqi6i8GoqgdNb96FKPZ4NjNxXJEqQg.2 2024-09-22T09:20:08.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~4pqi6i8GoqgdNb96FKPZ4NjNxXJEqQg.3 2024-09-22T09:20:08.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~4pqi6i8GoqgdNb96FKPZ4NjNxXJEqQg.4 2024-09-22T09:20:08.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.284+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~4pqi6i8GoqgdNb96FKPZ4NjNxXJEqQg.5 2024-09-22T09:20:08.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.287+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.290+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:20:08.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.291+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.291+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m', time=2024-09-22T11:16:46.424527+0000, chain.objs.size()=5 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.79__multipart_key1.2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m.1 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.79__multipart_key1.2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m.2 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.79__multipart_key1.2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m.3 2024-09-22T09:20:08.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.79__multipart_key1.2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m.4 2024-09-22T09:20:08.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.292+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.79__multipart_key1.2~-rCNkTZotOD0HTuek6cVfctytJHjJ_m.5 2024-09-22T09:20:08.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.295+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.298+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:20:08.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.299+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.300+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:20.290715+0000, chain.objs.size()=1 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.18 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:20.353256+0000, chain.objs.size()=1 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.19 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:20.391780+0000, chain.objs.size()=1 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.20 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:20.490718+0000, chain.objs.size()=27 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.1 2024-09-22T09:20:08.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.2 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.3 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.4 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.5 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.6 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.7 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.8 2024-09-22T09:20:08.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.301+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.9 2024-09-22T09:20:08.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.10 2024-09-22T09:20:08.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.11 2024-09-22T09:20:08.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.12 2024-09-22T09:20:08.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.13 2024-09-22T09:20:08.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.14 2024-09-22T09:20:08.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.306+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.15 2024-09-22T09:20:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.307+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.16 2024-09-22T09:20:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.307+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.17 2024-09-22T09:20:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.307+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.sqBH13NLK9ulr6q9Nw2VJMpGogNUodKL.18 2024-09-22T09:20:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.307+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.T_KB1hPHUsiGWYY4nL3xw08Ht8i3zChN.19 2024-09-22T09:20:08.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.307+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.rsi-PajNKTy378Y0wFdQLjgccaqPWOJ1.20 2024-09-22T09:20:08.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.311+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.21 2024-09-22T09:20:08.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.311+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.22 2024-09-22T09:20:08.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.311+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.23 2024-09-22T09:20:08.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.311+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.24 2024-09-22T09:20:08.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.313+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.25 2024-09-22T09:20:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.313+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.26 2024-09-22T09:20:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.313+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.27 2024-09-22T09:20:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:21.097886+0000, chain.objs.size()=9 2024-09-22T09:20:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.28 2024-09-22T09:20:08.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.29 2024-09-22T09:20:08.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.30 2024-09-22T09:20:08.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.31 2024-09-22T09:20:08.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.314+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.32 2024-09-22T09:20:08.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.316+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.33 2024-09-22T09:20:08.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.316+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.34 2024-09-22T09:20:08.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.316+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.35 2024-09-22T09:20:08.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.316+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.36 2024-09-22T09:20:08.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.317+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:21.647580+0000, chain.objs.size()=4 2024-09-22T09:20:08.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.318+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.37 2024-09-22T09:20:08.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.38 2024-09-22T09:20:08.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.39 2024-09-22T09:20:08.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.40 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:21.961503+0000, chain.objs.size()=6 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.41 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.42 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.43 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.44 2024-09-22T09:20:08.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.320+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.45 2024-09-22T09:20:08.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.322+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.46 2024-09-22T09:20:08.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.322+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:22.482628+0000, chain.objs.size()=3 2024-09-22T09:20:08.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.322+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.47 2024-09-22T09:20:08.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.322+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.48 2024-09-22T09:20:08.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.325+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.49 2024-09-22T09:20:08.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.325+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:22.915157+0000, chain.objs.size()=7 2024-09-22T09:20:08.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.325+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.50 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.51 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.52 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.53 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.54 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.55 2024-09-22T09:20:08.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.326+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.56 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.328+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:23.401095+0000, chain.objs.size()=4 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.328+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.57 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.328+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.58 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.328+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.59 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.329+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.60 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.329+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:23.862908+0000, chain.objs.size()=7 2024-09-22T09:20:08.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.329+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.61 2024-09-22T09:20:08.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.330+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.62 2024-09-22T09:20:08.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.330+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.63 2024-09-22T09:20:08.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.330+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.64 2024-09-22T09:20:08.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.331+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.65 2024-09-22T09:20:08.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.331+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.66 2024-09-22T09:20:08.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.331+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.67 2024-09-22T09:20:08.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:24.432114+0000, chain.objs.size()=3 2024-09-22T09:20:08.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.68 2024-09-22T09:20:08.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.69 2024-09-22T09:20:08.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.70 2024-09-22T09:20:08.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:24.852393+0000, chain.objs.size()=8 2024-09-22T09:20:08.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.71 2024-09-22T09:20:08.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.72 2024-09-22T09:20:08.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.335+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.73 2024-09-22T09:20:08.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.336+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.74 2024-09-22T09:20:08.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.336+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.75 2024-09-22T09:20:08.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.336+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.76 2024-09-22T09:20:08.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.336+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.77 2024-09-22T09:20:08.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.339+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.78 2024-09-22T09:20:08.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.339+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:25.464292+0000, chain.objs.size()=3 2024-09-22T09:20:08.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.339+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.79 2024-09-22T09:20:08.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.339+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.80 2024-09-22T09:20:08.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.340+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.81 2024-09-22T09:20:08.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.340+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:25.884155+0000, chain.objs.size()=8 2024-09-22T09:20:08.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.340+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.82 2024-09-22T09:20:08.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.341+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.83 2024-09-22T09:20:08.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.84 2024-09-22T09:20:08.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.85 2024-09-22T09:20:08.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.86 2024-09-22T09:20:08.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.87 2024-09-22T09:20:08.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.88 2024-09-22T09:20:08.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.89 2024-09-22T09:20:08.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:26.366708+0000, chain.objs.size()=2 2024-09-22T09:20:08.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.90 2024-09-22T09:20:08.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.91 2024-09-22T09:20:08.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:26.812589+0000, chain.objs.size()=8 2024-09-22T09:20:08.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.343+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.92 2024-09-22T09:20:08.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.344+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.93 2024-09-22T09:20:08.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.346+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.94 2024-09-22T09:20:08.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.347+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.95 2024-09-22T09:20:08.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.348+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.96 2024-09-22T09:20:08.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.97 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.98 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.99 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:27.256033+0000, chain.objs.size()=1 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.100 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:29.478317+0000, chain.objs.size()=1 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.349+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.18 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:29.552709+0000, chain.objs.size()=1 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.19 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:29.610775+0000, chain.objs.size()=1 2024-09-22T09:20:08.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.20 2024-09-22T09:20:08.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:29.710594+0000, chain.objs.size()=126 2024-09-22T09:20:08.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.1 2024-09-22T09:20:08.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.350+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.2 2024-09-22T09:20:08.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.351+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.3 2024-09-22T09:20:08.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.351+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.4 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.5 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.6 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.7 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.8 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.9 2024-09-22T09:20:08.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.10 2024-09-22T09:20:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.11 2024-09-22T09:20:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.12 2024-09-22T09:20:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.13 2024-09-22T09:20:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.355+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.14 2024-09-22T09:20:08.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.356+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.15 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.16 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.17 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.sqBH13NLK9ulr6q9Nw2VJMpGogNUodKL.18 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.T_KB1hPHUsiGWYY4nL3xw08Ht8i3zChN.19 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.rsi-PajNKTy378Y0wFdQLjgccaqPWOJ1.20 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.21 2024-09-22T09:20:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.22 2024-09-22T09:20:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.23 2024-09-22T09:20:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.24 2024-09-22T09:20:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.25 2024-09-22T09:20:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.358+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.26 2024-09-22T09:20:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.360+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.27 2024-09-22T09:20:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.361+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.28 2024-09-22T09:20:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.361+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.29 2024-09-22T09:20:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.361+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.30 2024-09-22T09:20:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.361+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.31 2024-09-22T09:20:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.362+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.32 2024-09-22T09:20:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.362+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.33 2024-09-22T09:20:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.34 2024-09-22T09:20:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.35 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.36 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.37 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.38 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.363+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.39 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.364+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.40 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.364+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.41 2024-09-22T09:20:08.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.364+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.42 2024-09-22T09:20:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.364+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.43 2024-09-22T09:20:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.365+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.44 2024-09-22T09:20:08.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.45 2024-09-22T09:20:08.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.46 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.47 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.48 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.49 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.50 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.51 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.52 2024-09-22T09:20:08.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.366+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.53 2024-09-22T09:20:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.367+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.54 2024-09-22T09:20:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.367+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.55 2024-09-22T09:20:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.368+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.56 2024-09-22T09:20:08.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.57 2024-09-22T09:20:08.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.58 2024-09-22T09:20:08.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.59 2024-09-22T09:20:08.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.60 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.61 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.369+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.62 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.370+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.63 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.370+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.64 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.370+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.65 2024-09-22T09:20:08.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.370+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.66 2024-09-22T09:20:08.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.371+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.67 2024-09-22T09:20:08.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.371+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.68 2024-09-22T09:20:08.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.371+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.69 2024-09-22T09:20:08.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.372+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.70 2024-09-22T09:20:08.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.372+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.71 2024-09-22T09:20:08.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.72 2024-09-22T09:20:08.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.73 2024-09-22T09:20:08.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.74 2024-09-22T09:20:08.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.75 2024-09-22T09:20:08.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.76 2024-09-22T09:20:08.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.77 2024-09-22T09:20:08.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.373+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.78 2024-09-22T09:20:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.374+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.79 2024-09-22T09:20:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.374+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.80 2024-09-22T09:20:08.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.375+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.81 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.375+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.82 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.375+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.83 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.375+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.84 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.375+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.85 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.376+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.86 2024-09-22T09:20:08.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.376+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.87 2024-09-22T09:20:08.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.376+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.88 2024-09-22T09:20:08.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.377+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.89 2024-09-22T09:20:08.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.377+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.90 2024-09-22T09:20:08.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.378+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.91 2024-09-22T09:20:08.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.378+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.92 2024-09-22T09:20:08.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.378+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.93 2024-09-22T09:20:08.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.378+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.94 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.95 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.96 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.97 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.98 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.99 2024-09-22T09:20:08.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.379+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.100 2024-09-22T09:20:08.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.380+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.101 2024-09-22T09:20:08.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.380+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.102 2024-09-22T09:20:08.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.381+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.103 2024-09-22T09:20:08.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.381+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.104 2024-09-22T09:20:08.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.382+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.105 2024-09-22T09:20:08.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.382+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.106 2024-09-22T09:20:08.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.382+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.107 2024-09-22T09:20:08.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.382+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.108 2024-09-22T09:20:08.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.383+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.109 2024-09-22T09:20:08.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.383+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.110 2024-09-22T09:20:08.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.383+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.111 2024-09-22T09:20:08.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.383+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.112 2024-09-22T09:20:08.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.385+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.113 2024-09-22T09:20:08.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.385+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.114 2024-09-22T09:20:08.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.385+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.115 2024-09-22T09:20:08.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.385+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.116 2024-09-22T09:20:08.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.385+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.117 2024-09-22T09:20:08.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.388+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.118 2024-09-22T09:20:08.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.388+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.119 2024-09-22T09:20:08.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.389+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.120 2024-09-22T09:20:08.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.389+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.121 2024-09-22T09:20:08.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.389+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.122 2024-09-22T09:20:08.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.389+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.123 2024-09-22T09:20:08.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.124 2024-09-22T09:20:08.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.125 2024-09-22T09:20:08.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.126 2024-09-22T09:20:08.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:30.185635+0000, chain.objs.size()=7 2024-09-22T09:20:08.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.127 2024-09-22T09:20:08.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.390+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.128 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.129 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.130 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.131 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.132 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.133 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:30.698170+0000, chain.objs.size()=7 2024-09-22T09:20:08.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.134 2024-09-22T09:20:08.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.394+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.135 2024-09-22T09:20:08.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.396+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.136 2024-09-22T09:20:08.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.397+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.137 2024-09-22T09:20:08.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.397+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.138 2024-09-22T09:20:08.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.397+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.139 2024-09-22T09:20:08.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.398+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.142 2024-09-22T09:20:08.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.398+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:31.255659+0000, chain.objs.size()=3 2024-09-22T09:20:08.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.398+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.140 2024-09-22T09:20:08.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.398+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.141 2024-09-22T09:20:08.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.398+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.143 2024-09-22T09:20:08.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.399+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:31.707127+0000, chain.objs.size()=6 2024-09-22T09:20:08.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.399+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.144 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.145 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.146 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.147 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.149 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.150 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:32.349679+0000, chain.objs.size()=6 2024-09-22T09:20:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.148 2024-09-22T09:20:08.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.402+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.151 2024-09-22T09:20:08.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.403+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.152 2024-09-22T09:20:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.404+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.153 2024-09-22T09:20:08.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.405+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.154 2024-09-22T09:20:08.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.405+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.155 2024-09-22T09:20:08.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.407+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:32.838321+0000, chain.objs.size()=8 2024-09-22T09:20:08.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.407+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.156 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.157 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.158 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.159 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.160 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.161 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.162 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.408+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.163 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.409+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:33.268625+0000, chain.objs.size()=2 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.409+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.164 2024-09-22T09:20:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.409+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.165 2024-09-22T09:20:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.411+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:33.713400+0000, chain.objs.size()=6 2024-09-22T09:20:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.411+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.166 2024-09-22T09:20:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.411+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.167 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.168 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.169 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.170 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.171 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:34.605226+0000, chain.objs.size()=10 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.172 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.173 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.174 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.175 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.414+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.176 2024-09-22T09:20:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.415+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.177 2024-09-22T09:20:08.417 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.415+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.178 2024-09-22T09:20:08.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.419+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.179 2024-09-22T09:20:08.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.419+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.180 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.419+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.181 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:35.003221+0000, chain.objs.size()=4 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.182 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.183 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.184 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.185 2024-09-22T09:20:08.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:35.477869+0000, chain.objs.size()=6 2024-09-22T09:20:08.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.186 2024-09-22T09:20:08.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.187 2024-09-22T09:20:08.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.420+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.188 2024-09-22T09:20:08.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.421+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.189 2024-09-22T09:20:08.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.423+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.190 2024-09-22T09:20:08.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.423+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.191 2024-09-22T09:20:08.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:35.965403+0000, chain.objs.size()=3 2024-09-22T09:20:08.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.192 2024-09-22T09:20:08.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.193 2024-09-22T09:20:08.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.195 2024-09-22T09:20:08.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:36.502893+0000, chain.objs.size()=7 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.194 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.196 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.197 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.198 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.425+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.199 2024-09-22T09:20:08.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.426+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.200 2024-09-22T09:20:08.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.201 2024-09-22T09:20:08.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:37.006985+0000, chain.objs.size()=4 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.202 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.203 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.204 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.205 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:37.447054+0000, chain.objs.size()=1 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.430+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.18 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.431+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:37.451222+0000, chain.objs.size()=1 2024-09-22T09:20:08.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.431+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.19 2024-09-22T09:20:08.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.432+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:37.455280+0000, chain.objs.size()=1 2024-09-22T09:20:08.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.432+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.20 2024-09-22T09:20:08.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.432+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn', time=2024-09-22T11:19:37.622095+0000, chain.objs.size()=212 2024-09-22T09:20:08.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.432+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.1 2024-09-22T09:20:08.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.432+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.2 2024-09-22T09:20:08.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.434+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.3 2024-09-22T09:20:08.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.434+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.4 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.435+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.5 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.435+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.6 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.436+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.7 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.436+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.8 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.436+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.9 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.436+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.10 2024-09-22T09:20:08.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.436+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.11 2024-09-22T09:20:08.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.438+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.12 2024-09-22T09:20:08.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.438+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.13 2024-09-22T09:20:08.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.438+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.14 2024-09-22T09:20:08.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.438+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.15 2024-09-22T09:20:08.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.439+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.16 2024-09-22T09:20:08.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.439+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.17 2024-09-22T09:20:08.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.439+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.sqBH13NLK9ulr6q9Nw2VJMpGogNUodKL.18 2024-09-22T09:20:08.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.439+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.T_KB1hPHUsiGWYY4nL3xw08Ht8i3zChN.19 2024-09-22T09:20:08.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.440+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.rsi-PajNKTy378Y0wFdQLjgccaqPWOJ1.20 2024-09-22T09:20:08.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.440+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.21 2024-09-22T09:20:08.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.440+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.22 2024-09-22T09:20:08.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.440+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.23 2024-09-22T09:20:08.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.440+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.24 2024-09-22T09:20:08.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.441+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.25 2024-09-22T09:20:08.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.441+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.26 2024-09-22T09:20:08.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.441+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.27 2024-09-22T09:20:08.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.441+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.28 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.29 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.30 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.31 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.32 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.33 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.443+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.34 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.444+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.35 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.444+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.36 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.444+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.37 2024-09-22T09:20:08.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.444+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.38 2024-09-22T09:20:08.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.445+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.39 2024-09-22T09:20:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.40 2024-09-22T09:20:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.41 2024-09-22T09:20:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.42 2024-09-22T09:20:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.43 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.44 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.45 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.446+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.46 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.447+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.47 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.447+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.48 2024-09-22T09:20:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.447+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.49 2024-09-22T09:20:08.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.448+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.50 2024-09-22T09:20:08.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.448+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.51 2024-09-22T09:20:08.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.449+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.52 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.53 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.54 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.55 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.56 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.57 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.58 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.59 2024-09-22T09:20:08.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.450+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.60 2024-09-22T09:20:08.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.451+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.61 2024-09-22T09:20:08.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.451+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.62 2024-09-22T09:20:08.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.451+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.63 2024-09-22T09:20:08.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.64 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.65 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.66 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.67 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.68 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.69 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.70 2024-09-22T09:20:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.453+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.71 2024-09-22T09:20:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.455+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.72 2024-09-22T09:20:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.455+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.73 2024-09-22T09:20:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.455+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.74 2024-09-22T09:20:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.455+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.75 2024-09-22T09:20:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.456+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.76 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.456+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.77 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.456+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.78 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.456+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.79 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.456+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.80 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.457+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.81 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.457+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.82 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.457+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.83 2024-09-22T09:20:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.457+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.84 2024-09-22T09:20:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.85 2024-09-22T09:20:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.86 2024-09-22T09:20:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.87 2024-09-22T09:20:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.88 2024-09-22T09:20:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.89 2024-09-22T09:20:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.459+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.90 2024-09-22T09:20:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.460+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.91 2024-09-22T09:20:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.460+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.92 2024-09-22T09:20:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.460+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.93 2024-09-22T09:20:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.460+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.94 2024-09-22T09:20:08.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.460+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.95 2024-09-22T09:20:08.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.461+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.96 2024-09-22T09:20:08.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.461+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.97 2024-09-22T09:20:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.461+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.98 2024-09-22T09:20:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.462+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.99 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.462+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.100 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.462+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.101 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.462+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.102 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.462+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.103 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.463+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.104 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.463+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.105 2024-09-22T09:20:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.463+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.106 2024-09-22T09:20:08.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.464+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.107 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.108 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.109 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.110 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.111 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.112 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.113 2024-09-22T09:20:08.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.465+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.114 2024-09-22T09:20:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.466+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.115 2024-09-22T09:20:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.466+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.116 2024-09-22T09:20:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.466+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.117 2024-09-22T09:20:08.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.467+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.118 2024-09-22T09:20:08.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.468+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.119 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.120 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.121 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.122 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.123 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.124 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.125 2024-09-22T09:20:08.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.126 2024-09-22T09:20:08.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.127 2024-09-22T09:20:08.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.469+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.128 2024-09-22T09:20:08.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.470+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.129 2024-09-22T09:20:08.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.470+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.130 2024-09-22T09:20:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.472+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.131 2024-09-22T09:20:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.472+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.132 2024-09-22T09:20:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.472+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.133 2024-09-22T09:20:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.472+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.134 2024-09-22T09:20:08.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.472+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.135 2024-09-22T09:20:08.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.136 2024-09-22T09:20:08.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.137 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.138 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.139 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.140 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.141 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.142 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.143 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.474+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.144 2024-09-22T09:20:08.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.475+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.145 2024-09-22T09:20:08.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.475+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.146 2024-09-22T09:20:08.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.476+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.147 2024-09-22T09:20:08.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.477+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.148 2024-09-22T09:20:08.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.477+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.149 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.477+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.150 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.477+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.151 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.152 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.153 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.154 2024-09-22T09:20:08.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.155 2024-09-22T09:20:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.156 2024-09-22T09:20:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.478+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.157 2024-09-22T09:20:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.479+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.158 2024-09-22T09:20:08.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.479+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.159 2024-09-22T09:20:08.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.480+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.160 2024-09-22T09:20:08.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.480+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.161 2024-09-22T09:20:08.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.480+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.162 2024-09-22T09:20:08.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.480+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.163 2024-09-22T09:20:08.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.481+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.164 2024-09-22T09:20:08.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.481+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.165 2024-09-22T09:20:08.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.481+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.166 2024-09-22T09:20:08.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.481+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.167 2024-09-22T09:20:08.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.481+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.168 2024-09-22T09:20:08.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.482+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.169 2024-09-22T09:20:08.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.170 2024-09-22T09:20:08.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.171 2024-09-22T09:20:08.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.172 2024-09-22T09:20:08.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.173 2024-09-22T09:20:08.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.174 2024-09-22T09:20:08.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.175 2024-09-22T09:20:08.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.483+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.176 2024-09-22T09:20:08.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.177 2024-09-22T09:20:08.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.178 2024-09-22T09:20:08.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.179 2024-09-22T09:20:08.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.180 2024-09-22T09:20:08.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.181 2024-09-22T09:20:08.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.485+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.182 2024-09-22T09:20:08.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.487+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.183 2024-09-22T09:20:08.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.487+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.184 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.487+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.185 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.186 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.187 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.188 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.189 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.190 2024-09-22T09:20:08.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.191 2024-09-22T09:20:08.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.192 2024-09-22T09:20:08.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.488+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.193 2024-09-22T09:20:08.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.489+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.194 2024-09-22T09:20:08.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.489+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.195 2024-09-22T09:20:08.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.489+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.196 2024-09-22T09:20:08.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.491+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.197 2024-09-22T09:20:08.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.491+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.198 2024-09-22T09:20:08.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.491+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.199 2024-09-22T09:20:08.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.491+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.200 2024-09-22T09:20:08.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.492+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.201 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.492+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.202 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.492+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.203 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.492+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.204 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.492+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.205 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.493+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.206 2024-09-22T09:20:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.493+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.207 2024-09-22T09:20:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.494+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.208 2024-09-22T09:20:08.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.494+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.209 2024-09-22T09:20:08.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.494+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.210 2024-09-22T09:20:08.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.494+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.211 2024-09-22T09:20:08.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.495+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.105__multipart_key1.2~30WXfvwC8PQJqw2ImBuCKwkWDLDAUBn.212 2024-09-22T09:20:08.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.498+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.501+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:20:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.502+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.503+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.503+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.504+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:20:08.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.505+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.506+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.506+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.507+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:20:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.509+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.509+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16342432876223885862', time=2024-09-22T11:17:02.860766+0000, chain.objs.size()=5 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.1 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.2 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.3 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.4 2024-09-22T09:20:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.510+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.5 2024-09-22T09:20:08.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.512+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.515+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:20:08.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.516+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.516+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:20:08.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7921751138507479431', time=2024-09-22T11:17:29.377231+0000, chain.objs.size()=5 2024-09-22T09:20:08.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~fy1xuSHkj4g_zYv54XcjlbfRnxta78j.1 2024-09-22T09:20:08.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~fy1xuSHkj4g_zYv54XcjlbfRnxta78j.2 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~fy1xuSHkj4g_zYv54XcjlbfRnxta78j.3 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~fy1xuSHkj4g_zYv54XcjlbfRnxta78j.4 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~fy1xuSHkj4g_zYv54XcjlbfRnxta78j.5 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.9181246092436152727', time=2024-09-22T11:17:33.187498+0000, chain.objs.size()=5 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Hm74jZm4NHvUVKEmq25oV_PHp3mmi5v.1 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Hm74jZm4NHvUVKEmq25oV_PHp3mmi5v.2 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Hm74jZm4NHvUVKEmq25oV_PHp3mmi5v.3 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Hm74jZm4NHvUVKEmq25oV_PHp3mmi5v.4 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Hm74jZm4NHvUVKEmq25oV_PHp3mmi5v.5 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4701284208428053836', time=2024-09-22T11:17:46.606597+0000, chain.objs.size()=5 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.98__multipart_key1.2~dpeGsvindRc2isIw_mngHNTQtNU8D4n.1 2024-09-22T09:20:08.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.517+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.98__multipart_key1.2~dpeGsvindRc2isIw_mngHNTQtNU8D4n.2 2024-09-22T09:20:08.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.520+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.98__multipart_key1.2~dpeGsvindRc2isIw_mngHNTQtNU8D4n.3 2024-09-22T09:20:08.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.521+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.98__multipart_key1.2~dpeGsvindRc2isIw_mngHNTQtNU8D4n.4 2024-09-22T09:20:08.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.98__multipart_key1.2~dpeGsvindRc2isIw_mngHNTQtNU8D4n.5 2024-09-22T09:20:08.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.1421410464356034977', time=2024-09-22T11:18:52.983677+0000, chain.objs.size()=5 2024-09-22T09:20:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~M3P87LS2TtZxS5aJ5QErB4j2WKb-i7w.1 2024-09-22T09:20:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~M3P87LS2TtZxS5aJ5QErB4j2WKb-i7w.1_1 2024-09-22T09:20:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~M3P87LS2TtZxS5aJ5QErB4j2WKb-i7w.2 2024-09-22T09:20:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~M3P87LS2TtZxS5aJ5QErB4j2WKb-i7w.2_1 2024-09-22T09:20:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.522+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~M3P87LS2TtZxS5aJ5QErB4j2WKb-i7w.3 2024-09-22T09:20:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.527+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.530+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:20:08.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.531+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6873521551774178604', time=2024-09-22T11:18:37.852940+0000, chain.objs.size()=5 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~qi80cONVNn35Z_Itx6aq6E6fDMo7NNY.1 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~qi80cONVNn35Z_Itx6aq6E6fDMo7NNY.2 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~qi80cONVNn35Z_Itx6aq6E6fDMo7NNY.3 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.532+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~qi80cONVNn35Z_Itx6aq6E6fDMo7NNY.4 2024-09-22T09:20:08.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.533+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~qi80cONVNn35Z_Itx6aq6E6fDMo7NNY.5 2024-09-22T09:20:08.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.536+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.538+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:20:08.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.540+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.540+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.540+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.541+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2978363617439624829', time=2024-09-22T11:16:53.642531+0000, chain.objs.size()=2 2024-09-22T09:20:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.541+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.83__shadow_.P6amx2ph08z0Mt25PXBO1_WcVefuv9S_1 2024-09-22T09:20:08.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.541+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.83__shadow_.P6amx2ph08z0Mt25PXBO1_WcVefuv9S_2 2024-09-22T09:20:08.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.542+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.544+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:20:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2679244090459162107', time=2024-09-22T11:18:17.395291+0000, chain.objs.size()=5 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file.mpg.2~jHnHGOtsQIGss7AHuq3s__poAJH3XnM.1 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file.mpg.2~jHnHGOtsQIGss7AHuq3s__poAJH3XnM.2 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file.mpg.2~jHnHGOtsQIGss7AHuq3s__poAJH3XnM.3 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file.mpg.2~jHnHGOtsQIGss7AHuq3s__poAJH3XnM.4 2024-09-22T09:20:08.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.546+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file.mpg.2~jHnHGOtsQIGss7AHuq3s__poAJH3XnM.5 2024-09-22T09:20:08.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.549+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.552+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:20:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.553+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.553+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:20:08.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6747626373539769094', time=2024-09-22T11:17:36.419754+0000, chain.objs.size()=5 2024-09-22T09:20:08.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~DHOlscFSiuGwXqEql7uM-kuGvGQ-OWB.1 2024-09-22T09:20:08.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~DHOlscFSiuGwXqEql7uM-kuGvGQ-OWB.1_1 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~DHOlscFSiuGwXqEql7uM-kuGvGQ-OWB.2 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~DHOlscFSiuGwXqEql7uM-kuGvGQ-OWB.2_1 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~DHOlscFSiuGwXqEql7uM-kuGvGQ-OWB.3 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4312796978375611989', time=2024-09-22T11:20:07.425618+0000, chain.objs.size()=5 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.144__multipart_key1/data/file.mpg.2~M6rOICDGq8NpXbdwOWDSCp1rU9gm7Os.1 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.144__multipart_key1/data/file.mpg.2~M6rOICDGq8NpXbdwOWDSCp1rU9gm7Os.2 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.144__multipart_key1/data/file.mpg.2~M6rOICDGq8NpXbdwOWDSCp1rU9gm7Os.3 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.144__multipart_key1/data/file.mpg.2~M6rOICDGq8NpXbdwOWDSCp1rU9gm7Os.4 2024-09-22T09:20:08.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.554+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.144__multipart_key1/data/file.mpg.2~M6rOICDGq8NpXbdwOWDSCp1rU9gm7Os.5 2024-09-22T09:20:08.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.559+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.562+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:20:08.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.563+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.563+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16914204180375013700', time=2024-09-22T11:18:53.171903+0000, chain.objs.size()=5 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~8L43chXYymm5WZMIkaNhbFxUQ0C4shd.1 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~8L43chXYymm5WZMIkaNhbFxUQ0C4shd.1_1 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~8L43chXYymm5WZMIkaNhbFxUQ0C4shd.2 2024-09-22T09:20:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~8L43chXYymm5WZMIkaNhbFxUQ0C4shd.2_1 2024-09-22T09:20:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.564+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~8L43chXYymm5WZMIkaNhbFxUQ0C4shd.3 2024-09-22T09:20:08.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.567+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.569+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:20:08.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.570+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6644766502798406139', time=2024-09-22T11:18:42.631682+0000, chain.objs.size()=5 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~JDakVMMGPl4XhcFiY8FUJo1eDehfs6L.1 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~JDakVMMGPl4XhcFiY8FUJo1eDehfs6L.2 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~JDakVMMGPl4XhcFiY8FUJo1eDehfs6L.3 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~JDakVMMGPl4XhcFiY8FUJo1eDehfs6L.4 2024-09-22T09:20:08.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.571+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~JDakVMMGPl4XhcFiY8FUJo1eDehfs6L.5 2024-09-22T09:20:08.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.573+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.576+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:20:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14042321744363376933', time=2024-09-22T11:17:39.800715+0000, chain.objs.size()=5 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Ou6_vPmLuSMBJ6Yz8DQhRTBjN3bIbmJ.1 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~Ou6_vPmLuSMBJ6Yz8DQhRTBjN3bIbmJ.1_1 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Ou6_vPmLuSMBJ6Yz8DQhRTBjN3bIbmJ.2 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__shadow_key1.2~Ou6_vPmLuSMBJ6Yz8DQhRTBjN3bIbmJ.2_1 2024-09-22T09:20:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.578+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~Ou6_vPmLuSMBJ6Yz8DQhRTBjN3bIbmJ.3 2024-09-22T09:20:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.582+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.584+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:20:08.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.586+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.586+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13797317171496374212', time=2024-09-22T11:19:01.784347+0000, chain.objs.size()=5 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.103__multipart_key1.2~qtiW9FlUKjio_wpQK24WmEayvTkWy0M.1 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.103__multipart_key1.2~qtiW9FlUKjio_wpQK24WmEayvTkWy0M.2 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.103__multipart_key1.2~qtiW9FlUKjio_wpQK24WmEayvTkWy0M.3 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.103__multipart_key1.2~qtiW9FlUKjio_wpQK24WmEayvTkWy0M.4 2024-09-22T09:20:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.587+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.103__multipart_key1.2~qtiW9FlUKjio_wpQK24WmEayvTkWy0M.5 2024-09-22T09:20:08.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.590+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.593+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:20:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.594+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.594+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5868957289324440607', time=2024-09-22T11:17:02.667426+0000, chain.objs.size()=5 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.1 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.2 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.3 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.4 2024-09-22T09:20:08.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.595+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.91__multipart_key1.2~Psk1QefAOjA6nagKQzpF5txbD4Cm-3u.5 2024-09-22T09:20:08.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.598+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.600+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:20:08.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.601+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.602+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.602+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.603+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:20:08.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.604+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5485921783379854248', time=2024-09-22T11:18:17.450984+0000, chain.objs.size()=4 2024-09-22T09:20:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file2.mpg.2~J45ESJWSi0nL-FBJnGP6mnDGqyHdJdr.1 2024-09-22T09:20:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file2.mpg.2~J45ESJWSi0nL-FBJnGP6mnDGqyHdJdr.2 2024-09-22T09:20:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file2.mpg.2~J45ESJWSi0nL-FBJnGP6mnDGqyHdJdr.3 2024-09-22T09:20:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.605+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.100__multipart_file2.mpg.2~J45ESJWSi0nL-FBJnGP6mnDGqyHdJdr.4 2024-09-22T09:20:08.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.607+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.610+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:20:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.612+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.612+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.612+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.613+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:20:08.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.615+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.615+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.616+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.617+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:20:08.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.618+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.618+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.619+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.620+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:20:08.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.621+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14263786244050805936', time=2024-09-22T11:17:40.184942+0000, chain.objs.size()=4 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.93__shadow_.SJNVUnKD6m4h4tccDxA9SVE5O7kZhcB_1 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.93__shadow_.SJNVUnKD6m4h4tccDxA9SVE5O7kZhcB_2 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.93__shadow_.SJNVUnKD6m4h4tccDxA9SVE5O7kZhcB_3 2024-09-22T09:20:08.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.622+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.93__shadow_.SJNVUnKD6m4h4tccDxA9SVE5O7kZhcB_4 2024-09-22T09:20:08.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.624+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.627+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:20:08.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.628+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.629+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.629+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.630+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:20:08.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.631+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16726258065330100705', time=2024-09-22T11:17:25.307316+0000, chain.objs.size()=5 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~FDiC3eDu4r8KQcVOsmRZX0I3ZZujv95.1 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~FDiC3eDu4r8KQcVOsmRZX0I3ZZujv95.2 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~FDiC3eDu4r8KQcVOsmRZX0I3ZZujv95.3 2024-09-22T09:20:08.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~FDiC3eDu4r8KQcVOsmRZX0I3ZZujv95.4 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.94__multipart_key1.2~FDiC3eDu4r8KQcVOsmRZX0I3ZZujv95.5 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.1853752400314471558', time=2024-09-22T11:17:55.702156+0000, chain.objs.size()=5 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.99__multipart_key1.2~4oGrcWk639d_BOQxs_TRNAby5F1XsI3.1 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.99__multipart_key1.2~4oGrcWk639d_BOQxs_TRNAby5F1XsI3.2 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.99__multipart_key1.2~4oGrcWk639d_BOQxs_TRNAby5F1XsI3.3 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.99__multipart_key1.2~4oGrcWk639d_BOQxs_TRNAby5F1XsI3.4 2024-09-22T09:20:08.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.632+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.99__multipart_key1.2~4oGrcWk639d_BOQxs_TRNAby5F1XsI3.5 2024-09-22T09:20:08.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.638+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.641+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:20:08.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.642+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:20:08.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.18426733112579923252', time=2024-09-22T11:18:47.592871+0000, chain.objs.size()=5 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~q0rv2-Q5i5l6s_7-QPf7yrebhvbQ_73.1 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~q0rv2-Q5i5l6s_7-QPf7yrebhvbQ_73.1_1 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~q0rv2-Q5i5l6s_7-QPf7yrebhvbQ_73.2 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__shadow_key1.2~q0rv2-Q5i5l6s_7-QPf7yrebhvbQ_73.2_1 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.102__multipart_key1.2~q0rv2-Q5i5l6s_7-QPf7yrebhvbQ_73.3 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.1595837462748345832', time=2024-09-22T11:20:01.798879+0000, chain.objs.size()=5 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.143__multipart_key1.2~D4nr6p_3Taz-8pIKHiXaOItU8lJKwqD.1 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.143__multipart_key1.2~D4nr6p_3Taz-8pIKHiXaOItU8lJKwqD.2 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.143__multipart_key1.2~D4nr6p_3Taz-8pIKHiXaOItU8lJKwqD.3 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.143__multipart_key1.2~D4nr6p_3Taz-8pIKHiXaOItU8lJKwqD.4 2024-09-22T09:20:08.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.643+0000 7f5090323800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.143__multipart_key1.2~D4nr6p_3Taz-8pIKHiXaOItU8lJKwqD.5 2024-09-22T09:20:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.649+0000 7f5090323800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:20:08.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.651+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:20:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.653+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.653+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.654+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.655+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:20:08.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.656+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.656+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.657+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.657+0000 7f5090323800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:20:08.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.659+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.659+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:08.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.660+0000 7f5090323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:08.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.662+0000 7f4f42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:08.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.664+0000 7f5090323800 20 remove_watcher() i=0 2024-09-22T09:20:08.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.664+0000 7f5090323800 2 removed watcher, disabling cache 2024-09-22T09:20:08.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.665+0000 7f5090323800 20 remove_watcher() i=1 2024-09-22T09:20:08.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.666+0000 7f5090323800 20 remove_watcher() i=2 2024-09-22T09:20:08.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.667+0000 7f5090323800 20 remove_watcher() i=3 2024-09-22T09:20:08.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.668+0000 7f5090323800 20 remove_watcher() i=4 2024-09-22T09:20:08.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.669+0000 7f5090323800 20 remove_watcher() i=5 2024-09-22T09:20:08.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.670+0000 7f5090323800 20 remove_watcher() i=6 2024-09-22T09:20:08.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.671+0000 7f5090323800 20 remove_watcher() i=7 2024-09-22T09:20:08.683 DEBUG:teuthology.orchestra.run.smithi039:> radosgw-admin gc process --include-all 2024-09-22T09:20:08.737 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:08.737 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:08.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.776+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 realm 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.777+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.778+0000 7f9579f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.778+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.779+0000 7f9579f2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.779+0000 7f9579f2f800 20 searching for the correct realm 2024-09-22T09:20:08.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.781+0000 7f9576477640 0 -- 172.21.15.39:0/464659110 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f956c072ec0 msgr2=0x7f956c068690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:08.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:08.987+0000 7f9575475640 0 -- 172.21.15.39:0/464659110 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f9570095340 msgr2=0x7f9570095a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:09.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:09.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:09.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.193+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:09.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 zone default found 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 4 Realm: () 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 zonegroup default 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.194+0000 7f9579f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.195+0000 7f9579f2f800 20 started sync module instance, tier type = 2024-09-22T09:20:09.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.195+0000 7f9579f2f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:09.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=0 2024-09-22T09:20:09.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=1 2024-09-22T09:20:09.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=2 2024-09-22T09:20:09.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=3 2024-09-22T09:20:09.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=4 2024-09-22T09:20:09.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=5 2024-09-22T09:20:09.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.204+0000 7f9579f2f800 20 add_watcher() i=6 2024-09-22T09:20:09.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.205+0000 7f9579f2f800 20 add_watcher() i=7 2024-09-22T09:20:09.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.205+0000 7f9579f2f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.207+0000 7f9427fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.207+0000 7f9579f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:09.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.207+0000 7f9579f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.241+0000 7f9426ffd640 20 reqs_thread_entry: start 2024-09-22T09:20:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.241+0000 7f9579f2f800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.241+0000 7f9579f2f800 20 Filter name: none 2024-09-22T09:20:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.241+0000 7f9424ff9640 20 reqs_thread_entry: start 2024-09-22T09:20:09.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.241+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:20:09.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.242+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.243+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.243+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.244+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:20:09.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.246+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.246+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.247+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.248+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:20:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.249+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.249+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.249+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.250+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:20:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.252+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.252+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.252+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.253+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:20:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.255+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.255+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.256+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.257+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:20:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.258+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.258+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.259+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.260+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:20:09.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.261+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.261+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.262+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.263+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:20:09.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.265+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.265+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.265+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.267+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:20:09.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.268+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.268+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.268+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.269+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:20:09.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.271+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.271+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.271+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.272+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:20:09.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.273+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.274+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.274+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.275+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:20:09.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.276+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.277+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.277+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.279+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:20:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.280+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.281+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.281+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.282+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:20:09.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.284+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.284+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.285+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.286+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:20:09.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.287+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.288+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.288+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.289+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:20:09.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.290+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.291+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.291+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.292+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:20:09.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.293+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.294+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.294+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.295+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:20:09.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.296+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.297+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.297+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.299+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:20:09.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.300+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.301+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.301+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.303+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:20:09.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.304+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.304+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.305+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.306+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:20:09.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.307+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.307+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.308+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.309+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:20:09.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.310+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.311+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.311+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.312+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:20:09.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.313+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.314+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.314+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.315+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:20:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.317+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.317+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.317+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.318+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:20:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.320+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.320+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.321+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.322+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:20:09.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.323+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.323+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.324+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.325+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:20:09.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.326+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.326+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.326+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.328+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:20:09.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.329+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.329+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.329+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.330+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:20:09.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.332+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.332+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.332+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.333+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:20:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.335+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.336+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.336+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.337+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:20:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.339+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.339+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.339+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.340+0000 7f9579f2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:20:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.341+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.342+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:20:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.342+0000 7f9579f2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:20:09.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.344+0000 7f9427fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.346+0000 7f9579f2f800 20 remove_watcher() i=0 2024-09-22T09:20:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.346+0000 7f9579f2f800 2 removed watcher, disabling cache 2024-09-22T09:20:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.347+0000 7f9579f2f800 20 remove_watcher() i=1 2024-09-22T09:20:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.348+0000 7f9579f2f800 20 remove_watcher() i=2 2024-09-22T09:20:09.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.349+0000 7f9579f2f800 20 remove_watcher() i=3 2024-09-22T09:20:09.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.350+0000 7f9579f2f800 20 remove_watcher() i=4 2024-09-22T09:20:09.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.351+0000 7f9579f2f800 20 remove_watcher() i=5 2024-09-22T09:20:09.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.352+0000 7f9579f2f800 20 remove_watcher() i=6 2024-09-22T09:20:09.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:09.354+0000 7f9579f2f800 20 remove_watcher() i=7 2024-09-22T09:20:09.367 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-22T09:20:09.382 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-22T09:20:09.382 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-22T09:20:09.382 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-22T09:20:09.382 DEBUG:teuthology.orchestra.run.smithi039:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T09:20:09.412 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-22T09:20:10.337 INFO:tasks.s3tests:Creating rgw users... 2024-09-22T09:20:10.337 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-22T09:20:10.439 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:10.439 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.475+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.476+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.476+0000 7f5dc202f800 20 realm 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.476+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.477+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.477+0000 7f5dc202f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.477+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.477+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.477+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.478+0000 7f5dc202f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:10.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.478+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.478+0000 7f5dc202f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:10.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.478+0000 7f5dc202f800 20 searching for the correct realm 2024-09-22T09:20:10.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.481+0000 7f5dc0321640 0 -- 172.21.15.39:0/595521343 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5da807d040 msgr2=0x7f5da80b8ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:10.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.687+0000 7f5db7fff640 0 -- 172.21.15.39:0/595521343 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f5db806b040 msgr2=0x7f5db8001890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.894+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 zone default found 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 4 Realm: () 2024-09-22T09:20:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 zonegroup default 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.895+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 started sync module instance, tier type = 2024-09-22T09:20:10.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.896+0000 7f5dc202f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=0 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=1 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=2 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=3 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=4 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=5 2024-09-22T09:20:10.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.907+0000 7f5dc202f800 20 add_watcher() i=6 2024-09-22T09:20:10.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.908+0000 7f5dc202f800 20 add_watcher() i=7 2024-09-22T09:20:10.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.908+0000 7f5dc202f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:10.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:10.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5dc202f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:10.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5dc202f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:10.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5dc202f800 5 note: GC not initialized 2024-09-22T09:20:10.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5c74fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:10.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.910+0000 7f5dc202f800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:10.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 20 Filter name: none 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5bee7fc640 20 reqs_thread_entry: start 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.911+0000 7f5dc202f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.912+0000 7f5dc202f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:10.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.912+0000 7f5dc202f800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-22T09:20:10.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.912+0000 7f5dc202f800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T09:20:10.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.912+0000 7f5dc202f800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-22T09:20:10.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5dc202f800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T09:20:10.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5dc202f800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:10.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5dc202f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-22T09:20:10.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5c9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529793 cookie 94727731520912 notifier 8426 bl.length()=384 2024-09-22T09:20:10.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5c9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T09:20:10.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.913+0000 7f5c9effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5dc202f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5dc202f800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5dc202f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5c9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529813 cookie 94727731529024 notifier 8426 bl.length()=225 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5c9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-22T09:20:10.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.917+0000 7f5c9effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5dc202f800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5dc202f800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5dc202f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5c9effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529781 cookie 94727731523248 notifier 8426 bl.length()=234 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5c9effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-22T09:20:10.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.920+0000 7f5c9effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-22T09:20:10.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.922+0000 7f5c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.925+0000 7f5dc202f800 20 remove_watcher() i=0 2024-09-22T09:20:10.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.925+0000 7f5dc202f800 2 removed watcher, disabling cache 2024-09-22T09:20:10.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.926+0000 7f5dc202f800 20 remove_watcher() i=1 2024-09-22T09:20:10.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.927+0000 7f5dc202f800 20 remove_watcher() i=2 2024-09-22T09:20:10.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.928+0000 7f5dc202f800 20 remove_watcher() i=3 2024-09-22T09:20:10.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.929+0000 7f5dc202f800 20 remove_watcher() i=4 2024-09-22T09:20:10.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.930+0000 7f5dc202f800 20 remove_watcher() i=5 2024-09-22T09:20:10.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.931+0000 7f5dc202f800 20 remove_watcher() i=6 2024-09-22T09:20:10.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:10.932+0000 7f5dc202f800 20 remove_watcher() i=7 2024-09-22T09:20:10.943 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:10.943 INFO:teuthology.orchestra.run.smithi039.stdout: "id": "RGW11111111111111111", 2024-09-22T09:20:10.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tenant": "", 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "Mr.RGW11111111111111111", 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "quota": { 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:10.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_users": 1000, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_roles": 1000, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_groups": 1000, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max_access_keys": 4 2024-09-22T09:20:10.945 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:10.946 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-22T09:20:10.946 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key VAJFYXRMHINMAYPAMOBX --secret 1CuuATXRbdtNGLWPHiJAR6DMuxPxu0Pa9nTh5y/Swnlve1azYkPBvw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-22T09:20:11.017 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:11.035 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:11.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.052+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 realm 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:11.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.055+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.056+0000 7fd298f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:11.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.056+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.057+0000 7fd298f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:11.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.057+0000 7fd298f75800 20 searching for the correct realm 2024-09-22T09:20:11.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.058+0000 7fd28e25e640 0 -- 172.21.15.39:0/2909770665 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7fd288066040 msgr2=0x7fd2880e5b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:11.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.063+0000 7fd296a5f640 0 -- 172.21.15.39:0/2909770665 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fd290028040 msgr2=0x7fd29002b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:11.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.069+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 zone default found 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 4 Realm: () 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:11.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 zonegroup default 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.070+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.071+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.071+0000 7fd298f75800 20 started sync module instance, tier type = 2024-09-22T09:20:11.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.071+0000 7fd298f75800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=0 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=1 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=2 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=3 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=4 2024-09-22T09:20:11.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=5 2024-09-22T09:20:11.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.080+0000 7fd298f75800 20 add_watcher() i=6 2024-09-22T09:20:11.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.081+0000 7fd298f75800 20 add_watcher() i=7 2024-09-22T09:20:11.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.081+0000 7fd298f75800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.082+0000 7fd14d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.082+0000 7fd298f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.082+0000 7fd298f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.082+0000 7fd298f75800 5 note: GC not initialized 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd0c7fff640 20 reqs_thread_entry: start 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 20 Filter name: none 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd0c5ffb640 20 reqs_thread_entry: start 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.083+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 cache get: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX : miss 2024-09-22T09:20:11.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX info.flags=0x0 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 adding default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX to cache LRU end 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.084+0000 7fd298f75800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T09:20:11.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 10 cache get: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX : hit (negative entry) 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.085+0000 7fd298f75800 10 cache get: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX : hit (negative entry) 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.086+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.086+0000 7fd298f75800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.086+0000 7fd298f75800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.087+0000 7fd17a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529814 cookie 94031083390192 notifier 8441 bl.length()=673 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.087+0000 7fd17a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T09:20:11.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.087+0000 7fd17a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.089+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.089+0000 7fd298f75800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.089+0000 7fd298f75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.090+0000 7fd179ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529815 cookie 94031083391424 notifier 8441 bl.length()=185 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.090+0000 7fd179ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-22T09:20:11.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.090+0000 7fd179ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.092+0000 7fd298f75800 10 cache put: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX info.flags=0x7 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.092+0000 7fd298f75800 10 moving default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX to cache LRU end 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.092+0000 7fd298f75800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:VAJFYXRMHINMAYPAMOBX, ofs0, ns] 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.093+0000 7fd17a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529827 cookie 94031083397152 notifier 8441 bl.length()=186 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.093+0000 7fd17a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX info.flags=0x7 2024-09-22T09:20:11.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.093+0000 7fd17a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VAJFYXRMHINMAYPAMOBX to cache LRU end 2024-09-22T09:20:11.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.095+0000 7fd298f75800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-22T09:20:11.096 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:11.096 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "foo.client.0", 2024-09-22T09:20:11.096 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-22T09:20:11.096 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "foo+test@test.test", 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "foo.client.0", 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "VAJFYXRMHINMAYPAMOBX", 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "1CuuATXRbdtNGLWPHiJAR6DMuxPxu0Pa9nTh5y/Swnlve1azYkPBvw==", 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:11.085894Z" 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:11.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:11.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "root", 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "RGW11111111111111111", 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:11.085882Z", 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:11.099 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:11.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.096+0000 7fd14d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:11.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.098+0000 7fd298f75800 20 remove_watcher() i=0 2024-09-22T09:20:11.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.098+0000 7fd298f75800 2 removed watcher, disabling cache 2024-09-22T09:20:11.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.099+0000 7fd298f75800 20 remove_watcher() i=1 2024-09-22T09:20:11.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.100+0000 7fd298f75800 20 remove_watcher() i=2 2024-09-22T09:20:11.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.102+0000 7fd298f75800 20 remove_watcher() i=3 2024-09-22T09:20:11.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.103+0000 7fd298f75800 20 remove_watcher() i=4 2024-09-22T09:20:11.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.104+0000 7fd298f75800 20 remove_watcher() i=5 2024-09-22T09:20:11.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.105+0000 7fd298f75800 20 remove_watcher() i=6 2024-09-22T09:20:11.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.106+0000 7fd298f75800 20 remove_watcher() i=7 2024-09-22T09:20:11.118 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9222264247 --totp-seed IORHA7HCZ3MGVZ6HS3XJMJ3CG4EVCOZOK6QYB4UVKICIYKY6PF6O2FY6EQZKYRZQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:11.186 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:11.186 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:11.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.221+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 20 realm 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.223+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.224+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.224+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.225+0000 7ff6d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:11.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.225+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.225+0000 7ff6d3726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:11.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.225+0000 7ff6d3726800 20 searching for the correct realm 2024-09-22T09:20:11.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.228+0000 7ff6cfb5e640 0 -- 172.21.15.39:0/612161592 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff6c40ac130 msgr2=0x7ff6c401a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.433+0000 7ff6cf35d640 0 -- 172.21.15.39:0/612161592 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7ff6c800e040 msgr2=0x7ff6c8037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:11.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.439+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 zone default found 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 4 Realm: () 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 zonegroup default 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.440+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.441+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.441+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.441+0000 7ff6d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.441+0000 7ff6d3726800 20 started sync module instance, tier type = 2024-09-22T09:20:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.441+0000 7ff6d3726800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=0 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=1 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=2 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=3 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=4 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=5 2024-09-22T09:20:11.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.451+0000 7ff6d3726800 20 add_watcher() i=6 2024-09-22T09:20:11.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.452+0000 7ff6d3726800 20 add_watcher() i=7 2024-09-22T09:20:11.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.452+0000 7ff6d3726800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.453+0000 7ff585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.453+0000 7ff6d3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.453+0000 7ff6d3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.453+0000 7ff6d3726800 5 note: GC not initialized 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.453+0000 7ff584fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 20 Filter name: none 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff4fe7fc640 20 reqs_thread_entry: start 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-22T09:20:11.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 20 rados->read ofs=0 len=0 2024-09-22T09:20:11.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 20 rados_obj.operate() r=0 bl.length=488 2024-09-22T09:20:11.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-22T09:20:11.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:11.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:11.454+0000 7ff6d3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.879+0000 7ff6d3726800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.879+0000 7ff6d3726800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.879+0000 7ff6d3726800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.880+0000 7ff5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464408 cookie 94024715598112 notifier 8459 bl.length()=687 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.880+0000 7ff5b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-22T09:20:12.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.880+0000 7ff5b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-22T09:20:12.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.883+0000 7ff585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:12.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.885+0000 7ff6d3726800 20 remove_watcher() i=0 2024-09-22T09:20:12.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.885+0000 7ff6d3726800 2 removed watcher, disabling cache 2024-09-22T09:20:12.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.887+0000 7ff6d3726800 20 remove_watcher() i=1 2024-09-22T09:20:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.888+0000 7ff6d3726800 20 remove_watcher() i=2 2024-09-22T09:20:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.890+0000 7ff6d3726800 20 remove_watcher() i=3 2024-09-22T09:20:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.891+0000 7ff6d3726800 20 remove_watcher() i=4 2024-09-22T09:20:12.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.892+0000 7ff6d3726800 20 remove_watcher() i=5 2024-09-22T09:20:12.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.894+0000 7ff6d3726800 20 remove_watcher() i=6 2024-09-22T09:20:12.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:12.895+0000 7ff6d3726800 20 remove_watcher() i=7 2024-09-22T09:20:12.909 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-22T09:20:12.909 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key DBKHUFJUOBJJBIXNTCTH --secret UtxN5m927rqsfK4tonyG8L5b3RY99EF046R5NobTKO31hvSXoXW0zA== --cluster ceph 2024-09-22T09:20:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:13.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.014+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 realm 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.016+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.017+0000 7fd3f4620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:13.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.017+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.018+0000 7fd3f4620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:13.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.018+0000 7fd3f4620800 20 searching for the correct realm 2024-09-22T09:20:13.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.021+0000 7fd3f290b640 0 -- 172.21.15.39:0/300262884 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd3e801a040 msgr2=0x7fd3e80621c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:13.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.024+0000 7fd3f1909640 0 -- 172.21.15.39:0/300262884 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd3ec0722e0 msgr2=0x7fd3ec068a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.232+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 zone default found 2024-09-22T09:20:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 4 Realm: () 2024-09-22T09:20:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 zonegroup default 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.233+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.234+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.234+0000 7fd3f4620800 20 started sync module instance, tier type = 2024-09-22T09:20:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.234+0000 7fd3f4620800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:13.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=0 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=1 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=2 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=3 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=4 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=5 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.244+0000 7fd3f4620800 20 add_watcher() i=6 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.245+0000 7fd3f4620800 20 add_watcher() i=7 2024-09-22T09:20:13.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.245+0000 7fd3f4620800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.247+0000 7fd2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.247+0000 7fd3f4620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.247+0000 7fd3f4620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.247+0000 7fd3f4620800 5 note: GC not initialized 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd2237fe640 20 reqs_thread_entry: start 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 20 Filter name: none 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd2217fa640 20 reqs_thread_entry: start 2024-09-22T09:20:13.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T09:20:13.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.248+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 cache get: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH : miss 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH info.flags=0x0 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 adding default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH to cache LRU end 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 cache get: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH : hit (negative entry) 2024-09-22T09:20:13.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.249+0000 7fd3f4620800 10 cache get: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH : hit (negative entry) 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.250+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.250+0000 7fd3f4620800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.250+0000 7fd3f4620800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.251+0000 7fd2d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94327204660608 notifier 9090 bl.length()=645 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.251+0000 7fd2d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T09:20:13.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.251+0000 7fd2d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T09:20:13.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd3f4620800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T09:20:13.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd3f4620800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-22T09:20:13.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd2d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464475 cookie 94327204674496 notifier 9090 bl.length()=185 2024-09-22T09:20:13.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd2d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-22T09:20:13.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.254+0000 7fd2d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-22T09:20:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd3f4620800 10 cache put: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH info.flags=0x7 2024-09-22T09:20:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd3f4620800 10 moving default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH to cache LRU end 2024-09-22T09:20:13.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd3f4620800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:DBKHUFJUOBJJBIXNTCTH, ofs0, ns] 2024-09-22T09:20:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd2d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464409 cookie 94327204677216 notifier 9090 bl.length()=186 2024-09-22T09:20:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd2d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH info.flags=0x7 2024-09-22T09:20:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.257+0000 7fd2d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DBKHUFJUOBJJBIXNTCTH to cache LRU end 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "bar.client.0", 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.bar.client.0", 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "bar+test@test.test", 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "bar.client.0", 2024-09-22T09:20:13.260 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "DBKHUFJUOBJJBIXNTCTH", 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "UtxN5m927rqsfK4tonyG8L5b3RY99EF046R5NobTKO31hvSXoXW0zA==", 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:13.250215Z" 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:13.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:13.250205Z", 2024-09-22T09:20:13.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.260+0000 7fd2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.262+0000 7fd3f4620800 20 remove_watcher() i=0 2024-09-22T09:20:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.262+0000 7fd3f4620800 2 removed watcher, disabling cache 2024-09-22T09:20:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.264+0000 7fd3f4620800 20 remove_watcher() i=1 2024-09-22T09:20:13.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.265+0000 7fd3f4620800 20 remove_watcher() i=2 2024-09-22T09:20:13.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.266+0000 7fd3f4620800 20 remove_watcher() i=3 2024-09-22T09:20:13.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.268+0000 7fd3f4620800 20 remove_watcher() i=4 2024-09-22T09:20:13.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.269+0000 7fd3f4620800 20 remove_watcher() i=5 2024-09-22T09:20:13.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.270+0000 7fd3f4620800 20 remove_watcher() i=6 2024-09-22T09:20:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.271+0000 7fd3f4620800 20 remove_watcher() i=7 2024-09-22T09:20:13.284 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2058118206 --totp-seed 4JMRBCOZWRRCLQ25YJ4FAFYCQY37GVQSCU3ZY4DWXZL3YWPB6GPMMY7WA46SFLW6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:13.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.388+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.389+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.389+0000 7fd778f28800 20 realm 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.389+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.390+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.390+0000 7fd778f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.390+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.390+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.390+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.391+0000 7fd778f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:13.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.391+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.391+0000 7fd778f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:13.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.392+0000 7fd778f28800 20 searching for the correct realm 2024-09-22T09:20:13.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.394+0000 7fd775470640 0 -- 172.21.15.39:0/3292673978 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd76803b040 msgr2=0x7fd76801b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:13.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.601+0000 7fd77446e640 0 -- 172.21.15.39:0/3292673978 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd76c0c1b80 msgr2=0x7fd76c0ba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.807+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.808+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.808+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.808+0000 7fd778f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.808+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:13.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 zone default found 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 4 Realm: () 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 zonegroup default 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.809+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.810+0000 7fd778f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.810+0000 7fd778f28800 20 started sync module instance, tier type = 2024-09-22T09:20:13.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.810+0000 7fd778f28800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=0 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=1 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=2 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=3 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=4 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=5 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.820+0000 7fd778f28800 20 add_watcher() i=6 2024-09-22T09:20:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.821+0000 7fd778f28800 20 add_watcher() i=7 2024-09-22T09:20:13.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.821+0000 7fd778f28800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:13.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 5 note: GC not initialized 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd629fe3640 20 reqs_thread_entry: start 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 20 Filter name: none 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd59b7fe640 20 reqs_thread_entry: start 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-22T09:20:13.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.824+0000 7fd778f28800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.825+0000 7fd778f28800 20 rados_obj.operate() r=0 bl.length=460 2024-09-22T09:20:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.825+0000 7fd778f28800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-22T09:20:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.825+0000 7fd778f28800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.825+0000 7fd778f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd778f28800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T09:20:13.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd778f28800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd778f28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-22T09:20:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd64bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94091895841552 notifier 9111 bl.length()=659 2024-09-22T09:20:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd64bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-22T09:20:13.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.828+0000 7fd64bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-22T09:20:13.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.831+0000 7fd62afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:13.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.834+0000 7fd778f28800 20 remove_watcher() i=0 2024-09-22T09:20:13.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.834+0000 7fd778f28800 2 removed watcher, disabling cache 2024-09-22T09:20:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.835+0000 7fd778f28800 20 remove_watcher() i=1 2024-09-22T09:20:13.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.836+0000 7fd778f28800 20 remove_watcher() i=2 2024-09-22T09:20:13.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.838+0000 7fd778f28800 20 remove_watcher() i=3 2024-09-22T09:20:13.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.839+0000 7fd778f28800 20 remove_watcher() i=4 2024-09-22T09:20:13.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.840+0000 7fd778f28800 20 remove_watcher() i=5 2024-09-22T09:20:13.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.841+0000 7fd778f28800 20 remove_watcher() i=6 2024-09-22T09:20:13.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.842+0000 7fd778f28800 20 remove_watcher() i=7 2024-09-22T09:20:13.857 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-22T09:20:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.970+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 20 realm 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.971+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.972+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.972+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.973+0000 7f5259a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:13.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.973+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:13.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.973+0000 7f5259a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:13.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.973+0000 7f5259a13800 20 searching for the correct realm 2024-09-22T09:20:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.976+0000 7f5255949640 0 -- 172.21.15.39:0/3698502613 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f5240011500 msgr2=0x7f524006c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:13.983+0000 7f5254947640 0 -- 172.21.15.39:0/3698502613 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f525003fa20 msgr2=0x7f5250052410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.193+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:14.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 zone default found 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 4 Realm: () 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 zonegroup default 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.194+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 started sync module instance, tier type = 2024-09-22T09:20:14.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.195+0000 7f5259a13800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=0 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=1 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=2 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=3 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=4 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=5 2024-09-22T09:20:14.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.206+0000 7f5259a13800 20 add_watcher() i=6 2024-09-22T09:20:14.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.207+0000 7f5259a13800 20 add_watcher() i=7 2024-09-22T09:20:14.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.207+0000 7f5259a13800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:14.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f510bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:14.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f5259a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:14.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f5259a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:14.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f5259a13800 5 note: GC not initialized 2024-09-22T09:20:14.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f510afe5640 20 reqs_thread_entry: start 2024-09-22T09:20:14.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f5259a13800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:14.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.209+0000 7f5259a13800 20 Filter name: none 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5108fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T09:20:14.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.210+0000 7f5259a13800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-22T09:20:14.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5259a13800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T09:20:14.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5259a13800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5259a13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-22T09:20:14.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5138ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431684 cookie 94404538812896 notifier 8513 bl.length()=389 2024-09-22T09:20:14.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5138ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T09:20:14.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.212+0000 7f5138ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.215+0000 7f5259a13800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T09:20:14.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.215+0000 7f5259a13800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.215+0000 7f5259a13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-22T09:20:14.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.216+0000 7f5127fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431706 cookie 94404538829216 notifier 8513 bl.length()=230 2024-09-22T09:20:14.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.216+0000 7f5127fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-22T09:20:14.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.216+0000 7f5127fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.218+0000 7f5259a13800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T09:20:14.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.218+0000 7f5259a13800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T09:20:14.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.218+0000 7f5259a13800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-22T09:20:14.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.219+0000 7f5127fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431670 cookie 94404538824704 notifier 8513 bl.length()=234 2024-09-22T09:20:14.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.219+0000 7f5127fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-22T09:20:14.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.219+0000 7f5127fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-22T09:20:14.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.221+0000 7f510bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:14.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.224+0000 7f5259a13800 20 remove_watcher() i=0 2024-09-22T09:20:14.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.224+0000 7f5259a13800 2 removed watcher, disabling cache 2024-09-22T09:20:14.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.225+0000 7f5259a13800 20 remove_watcher() i=1 2024-09-22T09:20:14.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.226+0000 7f5259a13800 20 remove_watcher() i=2 2024-09-22T09:20:14.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.227+0000 7f5259a13800 20 remove_watcher() i=3 2024-09-22T09:20:14.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.228+0000 7f5259a13800 20 remove_watcher() i=4 2024-09-22T09:20:14.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.229+0000 7f5259a13800 20 remove_watcher() i=5 2024-09-22T09:20:14.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.230+0000 7f5259a13800 20 remove_watcher() i=6 2024-09-22T09:20:14.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.231+0000 7f5259a13800 20 remove_watcher() i=7 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "id": "RGW33333333333333333", 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tenant": "testx", 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "Mr.RGW33333333333333333", 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "quota": { 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_users": 1000, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_roles": 1000, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_groups": 1000, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max_access_keys": 4 2024-09-22T09:20:14.243 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:14.244 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-22T09:20:14.245 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key ISXFFEKWLGOCPLMHFJJE --secret tI1WjmFwqMHgkfecPd2A3RDmpVrSTlBDauVkBjCjcvTPaeqd6uchmA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-22T09:20:14.314 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:14.314 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:14.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.350+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 realm 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:14.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.351+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.353+0000 7fa69c82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:14.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.353+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.353+0000 7fa69c82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:14.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.353+0000 7fa69c82f800 20 searching for the correct realm 2024-09-22T09:20:14.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.355+0000 7fa69ab1a640 0 -- 172.21.15.39:0/603543373 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fa684018070 msgr2=0x7fa68409c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:14.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.562+0000 7fa699b18640 0 -- 172.21.15.39:0/603543373 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fa694053c20 msgr2=0x7fa694030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:14.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:14.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:14.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:14.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:14.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:14.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:14.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.770+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 zone default found 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 4 Realm: () 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 zonegroup default 2024-09-22T09:20:14.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.771+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.772+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.772+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.772+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.772+0000 7fa69c82f800 20 started sync module instance, tier type = 2024-09-22T09:20:14.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.772+0000 7fa69c82f800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=0 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=1 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=2 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=3 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=4 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=5 2024-09-22T09:20:14.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.783+0000 7fa69c82f800 20 add_watcher() i=6 2024-09-22T09:20:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.784+0000 7fa69c82f800 20 add_watcher() i=7 2024-09-22T09:20:14.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.784+0000 7fa69c82f800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:14.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa69c82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa69c82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa69c82f800 5 note: GC not initialized 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa4cb7fe640 20 reqs_thread_entry: start 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.786+0000 7fa69c82f800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 Filter name: none 2024-09-22T09:20:14.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa4c97fa640 20 reqs_thread_entry: start 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:14.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-22T09:20:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-22T09:20:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T09:20:14.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE : miss 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.787+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE info.flags=0x0 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 adding default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE to cache LRU end 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-22T09:20:14.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE : hit (negative entry) 2024-09-22T09:20:14.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.788+0000 7fa69c82f800 10 cache get: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE : hit (negative entry) 2024-09-22T09:20:14.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T09:20:14.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa69c82f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:14.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa69c82f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T09:20:14.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa57dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431772 cookie 94601142504656 notifier 9150 bl.length()=732 2024-09-22T09:20:14.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa57dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T09:20:14.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.790+0000 7fa57dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:14.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.793+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T09:20:14.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.793+0000 7fa69c82f800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T09:20:14.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.793+0000 7fa69c82f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-22T09:20:14.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.794+0000 7fa57dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94601142511680 notifier 9150 bl.length()=215 2024-09-22T09:20:14.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.794+0000 7fa57dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-22T09:20:14.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.794+0000 7fa57dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-22T09:20:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.796+0000 7fa69c82f800 10 cache put: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE info.flags=0x7 2024-09-22T09:20:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.796+0000 7fa69c82f800 10 moving default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE to cache LRU end 2024-09-22T09:20:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.796+0000 7fa69c82f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:ISXFFEKWLGOCPLMHFJJE, ofs0, ns] 2024-09-22T09:20:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.797+0000 7fa57dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431773 cookie 94601142504656 notifier 9150 bl.length()=201 2024-09-22T09:20:14.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.797+0000 7fa57dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE info.flags=0x7 2024-09-22T09:20:14.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.797+0000 7fa57dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ISXFFEKWLGOCPLMHFJJE to cache LRU end 2024-09-22T09:20:14.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.799+0000 7fa69c82f800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-22T09:20:14.802 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-22T09:20:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-22T09:20:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-22T09:20:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "testx$tenanteduser.client.0", 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "ISXFFEKWLGOCPLMHFJJE", 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "tI1WjmFwqMHgkfecPd2A3RDmpVrSTlBDauVkBjCjcvTPaeqd6uchmA==", 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:14.789749Z" 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "root", 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "RGW33333333333333333", 2024-09-22T09:20:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:14.789737Z", 2024-09-22T09:20:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:14.809 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:14.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.800+0000 7fa550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:14.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.802+0000 7fa69c82f800 20 remove_watcher() i=0 2024-09-22T09:20:14.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.802+0000 7fa69c82f800 2 removed watcher, disabling cache 2024-09-22T09:20:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.804+0000 7fa69c82f800 20 remove_watcher() i=1 2024-09-22T09:20:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.805+0000 7fa69c82f800 20 remove_watcher() i=2 2024-09-22T09:20:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.806+0000 7fa69c82f800 20 remove_watcher() i=3 2024-09-22T09:20:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.808+0000 7fa69c82f800 20 remove_watcher() i=4 2024-09-22T09:20:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.809+0000 7fa69c82f800 20 remove_watcher() i=5 2024-09-22T09:20:14.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.810+0000 7fa69c82f800 20 remove_watcher() i=6 2024-09-22T09:20:14.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.811+0000 7fa69c82f800 20 remove_watcher() i=7 2024-09-22T09:20:14.824 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6502364268 --totp-seed MA2NWVVIBYT73NNZ2H7TUTQHP5F2YXWZXU54AXMR2UR6AAPCGJZFN2TOUJYBOW37 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:14.894 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:14.894 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:14.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.929+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.931+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.931+0000 7f34b66bb800 20 realm 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.931+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.932+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.932+0000 7f34b66bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.932+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.932+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:14.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.932+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.933+0000 7f34b66bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.933+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:14.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.934+0000 7f34b66bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:14.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.934+0000 7f34b66bb800 20 searching for the correct realm 2024-09-22T09:20:14.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:14.936+0000 7f34b49a6640 0 -- 172.21.15.39:0/700453877 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f349c076030 msgr2=0x7f349c095c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:15.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.141+0000 7f34abfff640 0 -- 172.21.15.39:0/700453877 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f34ac070860 msgr2=0x7f34ac09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:15.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:15.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.347+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:15.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 zone default found 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 4 Realm: () 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 zonegroup default 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.348+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 started sync module instance, tier type = 2024-09-22T09:20:15.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.349+0000 7f34b66bb800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=0 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=1 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=2 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=3 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=4 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=5 2024-09-22T09:20:15.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.360+0000 7f34b66bb800 20 add_watcher() i=6 2024-09-22T09:20:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.361+0000 7f34b66bb800 20 add_watcher() i=7 2024-09-22T09:20:15.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.361+0000 7f34b66bb800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:15.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.362+0000 7f336afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:15.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:15.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 5 note: GC not initialized 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f3369fdb640 20 reqs_thread_entry: start 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 20 Filter name: none 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f32db7fe640 20 reqs_thread_entry: start 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.363+0000 7f34b66bb800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.364+0000 7f34b66bb800 20 rados_obj.operate() r=0 bl.length=532 2024-09-22T09:20:15.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.364+0000 7f34b66bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-22T09:20:15.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.364+0000 7f34b66bb800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:15.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.364+0000 7f34b66bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:15.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f34b66bb800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T09:20:15.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f34b66bb800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:15.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f34b66bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-22T09:20:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f338b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431774 cookie 94562012622656 notifier 9168 bl.length()=746 2024-09-22T09:20:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f338b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-22T09:20:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.367+0000 7f338b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-22T09:20:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.370+0000 7f336afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:15.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.372+0000 7f34b66bb800 20 remove_watcher() i=0 2024-09-22T09:20:15.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.372+0000 7f34b66bb800 2 removed watcher, disabling cache 2024-09-22T09:20:15.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.373+0000 7f34b66bb800 20 remove_watcher() i=1 2024-09-22T09:20:15.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.375+0000 7f34b66bb800 20 remove_watcher() i=2 2024-09-22T09:20:15.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.376+0000 7f34b66bb800 20 remove_watcher() i=3 2024-09-22T09:20:15.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.377+0000 7f34b66bb800 20 remove_watcher() i=4 2024-09-22T09:20:15.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.378+0000 7f34b66bb800 20 remove_watcher() i=5 2024-09-22T09:20:15.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.379+0000 7f34b66bb800 20 remove_watcher() i=6 2024-09-22T09:20:15.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.380+0000 7f34b66bb800 20 remove_watcher() i=7 2024-09-22T09:20:15.392 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-22T09:20:15.393 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key JKTRWOGVTRSIYLBBKCCQ --secret 0L/WrcUfF8ZIyreec+10oxLbYeWbF+uwlbNFUm7xjeGQUxmA+uS2aA== --cluster ceph 2024-09-22T09:20:15.459 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:15.459 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:15.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.495+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 realm 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.497+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.498+0000 7ff704721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:15.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.498+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.499+0000 7ff704721800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:15.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.499+0000 7ff704721800 20 searching for the correct realm 2024-09-22T09:20:15.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.501+0000 7ff700c45640 0 -- 172.21.15.39:0/3579125615 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7ff6f40ba040 msgr2=0x7ff6f40ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:15.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.706+0000 7ff6ffc43640 0 -- 172.21.15.39:0/3579125615 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7ff5c8088970 msgr2=0x7ff5c808ada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:15.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:15.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.713+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 zone default found 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 4 Realm: () 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 zonegroup default 2024-09-22T09:20:15.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.714+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.715+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.715+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.715+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.715+0000 7ff704721800 20 started sync module instance, tier type = 2024-09-22T09:20:15.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.715+0000 7ff704721800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=0 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=1 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=2 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=3 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=4 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=5 2024-09-22T09:20:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.725+0000 7ff704721800 20 add_watcher() i=6 2024-09-22T09:20:15.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.726+0000 7ff704721800 20 add_watcher() i=7 2024-09-22T09:20:15.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.726+0000 7ff704721800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.727+0000 7ff5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.727+0000 7ff704721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.727+0000 7ff704721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.727+0000 7ff704721800 5 note: GC not initialized 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.727+0000 7ff5b57e2640 20 reqs_thread_entry: start 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 20 Filter name: none 2024-09-22T09:20:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff526ffd640 20 reqs_thread_entry: start 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.728+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 cache get: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ : miss 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ info.flags=0x0 2024-09-22T09:20:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 adding default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ to cache LRU end 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 cache get: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ : hit (negative entry) 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.729+0000 7ff704721800 10 cache get: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ : hit (negative entry) 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff704721800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff704721800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff5d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94580927964016 notifier 9189 bl.length()=660 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff5d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.730+0000 7ff5d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.733+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T09:20:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.733+0000 7ff704721800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T09:20:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.733+0000 7ff704721800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-22T09:20:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.734+0000 7ff5d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431685 cookie 94580927942448 notifier 9189 bl.length()=191 2024-09-22T09:20:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.734+0000 7ff5d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-22T09:20:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.734+0000 7ff5d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-22T09:20:15.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.736+0000 7ff704721800 10 cache put: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ info.flags=0x7 2024-09-22T09:20:15.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.736+0000 7ff704721800 10 moving default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ to cache LRU end 2024-09-22T09:20:15.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.736+0000 7ff704721800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:JKTRWOGVTRSIYLBBKCCQ, ofs0, ns] 2024-09-22T09:20:15.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.737+0000 7ff5d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431775 cookie 94580927961312 notifier 9189 bl.length()=189 2024-09-22T09:20:15.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.737+0000 7ff5d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ info.flags=0x7 2024-09-22T09:20:15.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.737+0000 7ff5d6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JKTRWOGVTRSIYLBBKCCQ to cache LRU end 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "foobar.client.0", 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "foobar+test@test.test", 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "foobar.client.0", 2024-09-22T09:20:15.739 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "JKTRWOGVTRSIYLBBKCCQ", 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "0L/WrcUfF8ZIyreec+10oxLbYeWbF+uwlbNFUm7xjeGQUxmA+uS2aA==", 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:15.730173Z" 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:15.740 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:15.741 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:15.730163Z", 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.739+0000 7ff5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.741+0000 7ff704721800 20 remove_watcher() i=0 2024-09-22T09:20:15.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.741+0000 7ff704721800 2 removed watcher, disabling cache 2024-09-22T09:20:15.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.743+0000 7ff704721800 20 remove_watcher() i=1 2024-09-22T09:20:15.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.744+0000 7ff704721800 20 remove_watcher() i=2 2024-09-22T09:20:15.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.745+0000 7ff704721800 20 remove_watcher() i=3 2024-09-22T09:20:15.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.746+0000 7ff704721800 20 remove_watcher() i=4 2024-09-22T09:20:15.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.747+0000 7ff704721800 20 remove_watcher() i=5 2024-09-22T09:20:15.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.748+0000 7ff704721800 20 remove_watcher() i=6 2024-09-22T09:20:15.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.749+0000 7ff704721800 20 remove_watcher() i=7 2024-09-22T09:20:15.762 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4150099745 --totp-seed J63LXSFMNNEYW5VOZZFMBAU66N5UKIC6WDPV26LOQBLGFF3S7MXMHL6E6Q7T3WE7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:15.830 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.866+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 20 realm 2024-09-22T09:20:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.867+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.868+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.868+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.868+0000 7f31a970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.868+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.869+0000 7f31a970c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.869+0000 7f31a970c800 20 searching for the correct realm 2024-09-22T09:20:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:15.871+0000 7f31a79fe640 0 -- 172.21.15.39:0/3799330877 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f319c03bb50 msgr2=0x7f319c0119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:16.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.077+0000 7f31a69fc640 0 -- 172.21.15.39:0/3799330877 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f31a00b4e50 msgr2=0x7f31a00b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.284+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:16.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:16.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 zone default found 2024-09-22T09:20:16.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 4 Realm: () 2024-09-22T09:20:16.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:16.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 zonegroup default 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.285+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.286+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.286+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.286+0000 7f31a970c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.286+0000 7f31a970c800 20 started sync module instance, tier type = 2024-09-22T09:20:16.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.286+0000 7f31a970c800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:16.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=0 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=1 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=2 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=3 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=4 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=5 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.295+0000 7f31a970c800 20 add_watcher() i=6 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.296+0000 7f31a970c800 20 add_watcher() i=7 2024-09-22T09:20:16.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.296+0000 7f31a970c800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.298+0000 7f305e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.298+0000 7f31a970c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.298+0000 7f31a970c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.298+0000 7f31a970c800 5 note: GC not initialized 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.298+0000 7f305d7e2640 20 reqs_thread_entry: start 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 20 Filter name: none 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f30567fc640 20 reqs_thread_entry: start 2024-09-22T09:20:16.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T09:20:16.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 20 rados_obj.operate() r=0 bl.length=472 2024-09-22T09:20:16.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T09:20:16.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.299+0000 7f31a970c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:16.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f31a970c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:16.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f31a970c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f31a970c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T09:20:16.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f308affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94133481085104 notifier 9207 bl.length()=674 2024-09-22T09:20:16.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f308affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:16.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.302+0000 7f308affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.305+0000 7f305e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:16.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.307+0000 7f31a970c800 20 remove_watcher() i=0 2024-09-22T09:20:16.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.307+0000 7f31a970c800 2 removed watcher, disabling cache 2024-09-22T09:20:16.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.308+0000 7f31a970c800 20 remove_watcher() i=1 2024-09-22T09:20:16.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.309+0000 7f31a970c800 20 remove_watcher() i=2 2024-09-22T09:20:16.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.310+0000 7f31a970c800 20 remove_watcher() i=3 2024-09-22T09:20:16.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.312+0000 7f31a970c800 20 remove_watcher() i=4 2024-09-22T09:20:16.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.313+0000 7f31a970c800 20 remove_watcher() i=5 2024-09-22T09:20:16.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.313+0000 7f31a970c800 20 remove_watcher() i=6 2024-09-22T09:20:16.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.315+0000 7f31a970c800 20 remove_watcher() i=7 2024-09-22T09:20:16.328 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-22T09:20:16.387 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:16.387 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:16.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.424+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 realm 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:16.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.426+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.427+0000 7fdfef333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:16.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.427+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.428+0000 7fdfef333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:16.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.428+0000 7fdfef333800 20 searching for the correct realm 2024-09-22T09:20:16.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.430+0000 7fdfeb877640 0 -- 172.21.15.39:0/4049624803 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fdfe0091020 msgr2=0x7fdfe00bade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:16.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.637+0000 7fdfea875640 0 -- 172.21.15.39:0/4049624803 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fdfe405e400 msgr2=0x7fdfe405e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:16.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:16.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.845+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 zone default found 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 4 Realm: () 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 zonegroup default 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.846+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.847+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.847+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.847+0000 7fdfef333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.847+0000 7fdfef333800 20 started sync module instance, tier type = 2024-09-22T09:20:16.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.847+0000 7fdfef333800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:16.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=0 2024-09-22T09:20:16.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=1 2024-09-22T09:20:16.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=2 2024-09-22T09:20:16.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=3 2024-09-22T09:20:16.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=4 2024-09-22T09:20:16.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=5 2024-09-22T09:20:16.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.857+0000 7fdfef333800 20 add_watcher() i=6 2024-09-22T09:20:16.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.858+0000 7fdfef333800 20 add_watcher() i=7 2024-09-22T09:20:16.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.858+0000 7fdfef333800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdfef333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdfef333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdfef333800 5 note: GC not initialized 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdea0fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdfef333800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.860+0000 7fdfef333800 20 Filter name: none 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fde1a7fc640 20 reqs_thread_entry: start 2024-09-22T09:20:16.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-22T09:20:16.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 20 rados_obj.operate() r=0 bl.length=486 2024-09-22T09:20:16.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-22T09:20:16.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.861+0000 7fdfef333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdfef333800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdfef333800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdfef333800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdeceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 93844030545072 notifier 9228 bl.length()=727 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdeceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-22T09:20:16.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.863+0000 7fdeceffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "foobar.client.0", 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.foobar.client.0", 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "foobar+test@test.test", 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "foobar.client.0", 2024-09-22T09:20:16.866 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "JKTRWOGVTRSIYLBBKCCQ", 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "0L/WrcUfF8ZIyreec+10oxLbYeWbF+uwlbNFUm7xjeGQUxmA+uS2aA==", 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:15.730173Z" 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [ 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "oidc-provider", 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "perm": "*" 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "roles", 2024-09-22T09:20:16.867 INFO:teuthology.orchestra.run.smithi039.stdout: "perm": "*" 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "user-policy", 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "perm": "*" 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:16.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "rgw", 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [ 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "4150099745" 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:16.869 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "", 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:15.730163Z", 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:16.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.866+0000 7fdea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:16.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.868+0000 7fdfef333800 20 remove_watcher() i=0 2024-09-22T09:20:16.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.868+0000 7fdfef333800 2 removed watcher, disabling cache 2024-09-22T09:20:16.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.870+0000 7fdfef333800 20 remove_watcher() i=1 2024-09-22T09:20:16.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.871+0000 7fdfef333800 20 remove_watcher() i=2 2024-09-22T09:20:16.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.872+0000 7fdfef333800 20 remove_watcher() i=3 2024-09-22T09:20:16.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.873+0000 7fdfef333800 20 remove_watcher() i=4 2024-09-22T09:20:16.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.874+0000 7fdfef333800 20 remove_watcher() i=5 2024-09-22T09:20:16.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.875+0000 7fdfef333800 20 remove_watcher() i=6 2024-09-22T09:20:16.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.876+0000 7fdfef333800 20 remove_watcher() i=7 2024-09-22T09:20:16.890 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-22T09:20:16.952 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:16.952 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:16.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.988+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.989+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.989+0000 7fd3f2c87800 20 realm 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.989+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.990+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.990+0000 7fd3f2c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.990+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.990+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:16.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.990+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.991+0000 7fd3f2c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:16.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.991+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:16.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.992+0000 7fd3f2c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:16.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.992+0000 7fd3f2c87800 20 searching for the correct realm 2024-09-22T09:20:16.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.994+0000 7fd3f0f72640 0 -- 172.21.15.39:0/4166315207 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7fd3e4030410 msgr2=0x7fd3e4030830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:16.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:16.998+0000 7fd3eff70640 0 -- 172.21.15.39:0/4166315207 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fd3e8077420 msgr2=0x7fd3e8077880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:17.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:17.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.204+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 zone default found 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 4 Realm: () 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:17.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 zonegroup default 2024-09-22T09:20:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.205+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.206+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.206+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.206+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.206+0000 7fd3f2c87800 20 started sync module instance, tier type = 2024-09-22T09:20:17.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.206+0000 7fd3f2c87800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=0 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=1 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=2 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=3 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=4 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=5 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.216+0000 7fd3f2c87800 20 add_watcher() i=6 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.217+0000 7fd3f2c87800 20 add_watcher() i=7 2024-09-22T09:20:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.217+0000 7fd3f2c87800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.219+0000 7fd2a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.219+0000 7fd3f2c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.219+0000 7fd3f2c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 5 note: GC not initialized 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd2a57e2640 20 reqs_thread_entry: start 2024-09-22T09:20:17.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 Filter name: none 2024-09-22T09:20:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd216ffd640 20 reqs_thread_entry: start 2024-09-22T09:20:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-22T09:20:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.220+0000 7fd3f2c87800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.221+0000 7fd3f2c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.221+0000 7fd3f2c87800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.221+0000 7fd3f2c87800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T09:20:17.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.221+0000 7fd3f2c87800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.222+0000 7fd3f2c87800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.222+0000 7fd3f2c87800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.222+0000 7fd3f2c87800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.223+0000 7fd2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 94479365011344 notifier 8615 bl.length()=384 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.223+0000 7fd2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T09:20:17.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.223+0000 7fd2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd3f2c87800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T09:20:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd3f2c87800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd3f2c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-22T09:20:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431707 cookie 94479365016560 notifier 8615 bl.length()=225 2024-09-22T09:20:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-22T09:20:17.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.226+0000 7fd2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd3f2c87800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd3f2c87800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd3f2c87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd2cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94479365024736 notifier 8615 bl.length()=234 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd2cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-22T09:20:17.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.229+0000 7fd2cf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-22T09:20:17.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.231+0000 7fd2a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.234+0000 7fd3f2c87800 20 remove_watcher() i=0 2024-09-22T09:20:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.234+0000 7fd3f2c87800 2 removed watcher, disabling cache 2024-09-22T09:20:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.235+0000 7fd3f2c87800 20 remove_watcher() i=1 2024-09-22T09:20:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.236+0000 7fd3f2c87800 20 remove_watcher() i=2 2024-09-22T09:20:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.237+0000 7fd3f2c87800 20 remove_watcher() i=3 2024-09-22T09:20:17.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.239+0000 7fd3f2c87800 20 remove_watcher() i=4 2024-09-22T09:20:17.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.240+0000 7fd3f2c87800 20 remove_watcher() i=5 2024-09-22T09:20:17.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.241+0000 7fd3f2c87800 20 remove_watcher() i=6 2024-09-22T09:20:17.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.242+0000 7fd3f2c87800 20 remove_watcher() i=7 2024-09-22T09:20:17.253 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "id": "RGW88888888888888888", 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tenant": "", 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "Mr.RGW88888888888888888", 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "quota": { 2024-09-22T09:20:17.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:17.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max_users": 1000, 2024-09-22T09:20:17.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max_roles": 1000, 2024-09-22T09:20:17.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max_groups": 1000, 2024-09-22T09:20:17.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:17.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max_access_keys": 4 2024-09-22T09:20:17.257 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:17.258 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-22T09:20:17.259 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key DGPQZFXNSXHXMZSSHBQE --secret io76NLumpFcf5VC451wFUj2xmh2yo1vKGjQrDksUr4h9/vGlMOXpqw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-22T09:20:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:17.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.364+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.365+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 realm 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.366+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.367+0000 7f32c772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.367+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.368+0000 7f32c772e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:17.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.368+0000 7f32c772e800 20 searching for the correct realm 2024-09-22T09:20:17.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.369+0000 7f32c2b6a640 0 -- 172.21.15.39:0/973705470 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f32b40af990 msgr2=0x7f32b40a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:17.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.574+0000 7f32c336b640 0 -- 172.21.15.39:0/973705470 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x5611f74e6900 msgr2=0x7f32bc0259e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.580+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.581+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.581+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.581+0000 7f32c772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.581+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 zone default found 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 4 Realm: () 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:17.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 zonegroup default 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 started sync module instance, tier type = 2024-09-22T09:20:17.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.582+0000 7f32c772e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=0 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=1 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=2 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=3 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=4 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=5 2024-09-22T09:20:17.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.593+0000 7f32c772e800 20 add_watcher() i=6 2024-09-22T09:20:17.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.594+0000 7f32c772e800 20 add_watcher() i=7 2024-09-22T09:20:17.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.594+0000 7f32c772e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:17.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.595+0000 7f3179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:17.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:17.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 5 note: GC not initialized 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f3178fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 20 Filter name: none 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f30f27fc640 20 reqs_thread_entry: start 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T09:20:17.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.596+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache get: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE : miss 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE info.flags=0x0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 adding default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE to cache LRU end 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.597+0000 7f32c772e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:17.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 10 cache get: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE : hit (negative entry) 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.598+0000 7f32c772e800 10 cache get: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE : hit (negative entry) 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f32c772e800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f32c772e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f31a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431687 cookie 94635164952928 notifier 9264 bl.length()=681 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f31a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T09:20:17.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.600+0000 7f31a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.603+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.603+0000 7f32c772e800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.603+0000 7f32c772e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.604+0000 7f31a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431776 cookie 94635164969872 notifier 9264 bl.length()=189 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.604+0000 7f31a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-22T09:20:17.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.604+0000 7f31a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-22T09:20:17.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.606+0000 7f32c772e800 10 cache put: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE info.flags=0x7 2024-09-22T09:20:17.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.606+0000 7f32c772e800 10 moving default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE to cache LRU end 2024-09-22T09:20:17.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.606+0000 7f32c772e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:DGPQZFXNSXHXMZSSHBQE, ofs0, ns] 2024-09-22T09:20:17.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.607+0000 7f31a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431716 cookie 94635164961728 notifier 9264 bl.length()=188 2024-09-22T09:20:17.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.607+0000 7f31a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE info.flags=0x7 2024-09-22T09:20:17.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.607+0000 7f31a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DGPQZFXNSXHXMZSSHBQE to cache LRU end 2024-09-22T09:20:17.610 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:17.610 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "root1.client.0", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "root1+test@test.test", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "root1.client.0", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "DGPQZFXNSXHXMZSSHBQE", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "io76NLumpFcf5VC451wFUj2xmh2yo1vKGjQrDksUr4h9/vGlMOXpqw==", 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:17.599318Z" 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:17.611 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:17.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "root", 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "RGW88888888888888888", 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:17.599305Z", 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:17.613 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:17.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.609+0000 7f32c772e800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-22T09:20:17.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.610+0000 7f3179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.613+0000 7f32c772e800 20 remove_watcher() i=0 2024-09-22T09:20:17.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.613+0000 7f32c772e800 2 removed watcher, disabling cache 2024-09-22T09:20:17.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.614+0000 7f32c772e800 20 remove_watcher() i=1 2024-09-22T09:20:17.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.615+0000 7f32c772e800 20 remove_watcher() i=2 2024-09-22T09:20:17.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.617+0000 7f32c772e800 20 remove_watcher() i=3 2024-09-22T09:20:17.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.618+0000 7f32c772e800 20 remove_watcher() i=4 2024-09-22T09:20:17.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.619+0000 7f32c772e800 20 remove_watcher() i=5 2024-09-22T09:20:17.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.620+0000 7f32c772e800 20 remove_watcher() i=6 2024-09-22T09:20:17.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.621+0000 7f32c772e800 20 remove_watcher() i=7 2024-09-22T09:20:17.633 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2197237566 --totp-seed ESJGGS3UHLNJNOIDIHTVSOQ6EIVCIZRRLDVCSGPCRBLN2BFSJGO5A6C7XQSARUGS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:17.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.737+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 realm 2024-09-22T09:20:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.739+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.740+0000 7fae8a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:17.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.740+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.741+0000 7fae8a123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:17.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.741+0000 7fae8a123800 20 searching for the correct realm 2024-09-22T09:20:17.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.742+0000 7fae85e0c640 0 -- 172.21.15.39:0/956469815 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7fae80078020 msgr2=0x7fae8006a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:17.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.745+0000 7fae85e0c640 0 -- 172.21.15.39:0/956469815 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7fae70003c90 msgr2=0x7fae80028aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.955+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.956+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.956+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.956+0000 7fae8a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.956+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 zone default found 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 4 Realm: () 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 zonegroup default 2024-09-22T09:20:17.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.957+0000 7fae8a123800 20 started sync module instance, tier type = 2024-09-22T09:20:17.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.958+0000 7fae8a123800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=0 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=1 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=2 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=3 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=4 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=5 2024-09-22T09:20:17.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.968+0000 7fae8a123800 20 add_watcher() i=6 2024-09-22T09:20:17.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.969+0000 7fae8a123800 20 add_watcher() i=7 2024-09-22T09:20:17.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.969+0000 7fae8a123800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fad377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:17.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 5 note: GC not initialized 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fad367fc640 20 reqs_thread_entry: start 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 20 Filter name: none 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7faca7fff640 20 reqs_thread_entry: start 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.971+0000 7fae8a123800 20 rados->read ofs=0 len=0 2024-09-22T09:20:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.972+0000 7fae8a123800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T09:20:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.972+0000 7fae8a123800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-22T09:20:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.972+0000 7fae8a123800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.972+0000 7fae8a123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fae8a123800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T09:20:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fae8a123800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fae8a123800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-22T09:20:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fad697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94779734503184 notifier 8645 bl.length()=695 2024-09-22T09:20:17.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fad697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-22T09:20:17.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.975+0000 7fad697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-22T09:20:17.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.978+0000 7fad377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:17.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.980+0000 7fae8a123800 20 remove_watcher() i=0 2024-09-22T09:20:17.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.980+0000 7fae8a123800 2 removed watcher, disabling cache 2024-09-22T09:20:17.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.982+0000 7fae8a123800 20 remove_watcher() i=1 2024-09-22T09:20:17.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.983+0000 7fae8a123800 20 remove_watcher() i=2 2024-09-22T09:20:17.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.984+0000 7fae8a123800 20 remove_watcher() i=3 2024-09-22T09:20:17.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.985+0000 7fae8a123800 20 remove_watcher() i=4 2024-09-22T09:20:17.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.986+0000 7fae8a123800 20 remove_watcher() i=5 2024-09-22T09:20:17.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.987+0000 7fae8a123800 20 remove_watcher() i=6 2024-09-22T09:20:17.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:17.988+0000 7fae8a123800 20 remove_watcher() i=7 2024-09-22T09:20:18.001 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-22T09:20:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:18.065 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:18.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.100+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.101+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.101+0000 7f850ae15800 20 realm 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.101+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.102+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.102+0000 7f850ae15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.102+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.102+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.102+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.103+0000 7f850ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:18.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.103+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.104+0000 7f850ae15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:18.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.104+0000 7f850ae15800 20 searching for the correct realm 2024-09-22T09:20:18.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.106+0000 7f8506592640 0 -- 172.21.15.39:0/2060745446 >> [v2:172.21.15.117:6824/3276057253,v1:172.21.15.117:6825/3276057253] conn(0x7f8500069040 msgr2=0x7f8500044a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:20:18.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.111+0000 7f8505d91640 0 -- 172.21.15.39:0/2060745446 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f85000a3a40 msgr2=0x7f850006b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.317+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:18.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 zone default found 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 4 Realm: () 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 zonegroup default 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.318+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 started sync module instance, tier type = 2024-09-22T09:20:18.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.319+0000 7f850ae15800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:18.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=0 2024-09-22T09:20:18.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=1 2024-09-22T09:20:18.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=2 2024-09-22T09:20:18.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=3 2024-09-22T09:20:18.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=4 2024-09-22T09:20:18.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=5 2024-09-22T09:20:18.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.330+0000 7f850ae15800 20 add_watcher() i=6 2024-09-22T09:20:18.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.331+0000 7f850ae15800 20 add_watcher() i=7 2024-09-22T09:20:18.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.331+0000 7f850ae15800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:18.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f83bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:18.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 5 note: GC not initialized 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f83377fe640 20 reqs_thread_entry: start 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 20 Filter name: none 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f83357fa640 20 reqs_thread_entry: start 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-22T09:20:18.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.333+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T09:20:18.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.334+0000 7f850ae15800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f850ae15800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f850ae15800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f850ae15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f83e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 93870951211152 notifier 8660 bl.length()=384 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f83e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T09:20:18.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.336+0000 7f83e9ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.339+0000 7f850ae15800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T09:20:18.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.339+0000 7f850ae15800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.339+0000 7f850ae15800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-22T09:20:18.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.340+0000 7f83e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431708 cookie 93870951218896 notifier 8660 bl.length()=225 2024-09-22T09:20:18.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.340+0000 7f83e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-22T09:20:18.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.340+0000 7f83e9ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f850ae15800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T09:20:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f850ae15800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T09:20:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f850ae15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-22T09:20:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f83e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431672 cookie 93870951216560 notifier 8660 bl.length()=234 2024-09-22T09:20:18.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f83e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-22T09:20:18.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.343+0000 7f83e97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-22T09:20:18.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.345+0000 7f83bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.348+0000 7f850ae15800 20 remove_watcher() i=0 2024-09-22T09:20:18.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.348+0000 7f850ae15800 2 removed watcher, disabling cache 2024-09-22T09:20:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.350+0000 7f850ae15800 20 remove_watcher() i=1 2024-09-22T09:20:18.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.351+0000 7f850ae15800 20 remove_watcher() i=2 2024-09-22T09:20:18.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.352+0000 7f850ae15800 20 remove_watcher() i=3 2024-09-22T09:20:18.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.354+0000 7f850ae15800 20 remove_watcher() i=4 2024-09-22T09:20:18.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.355+0000 7f850ae15800 20 remove_watcher() i=5 2024-09-22T09:20:18.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.356+0000 7f850ae15800 20 remove_watcher() i=6 2024-09-22T09:20:18.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.356+0000 7f850ae15800 20 remove_watcher() i=7 2024-09-22T09:20:18.367 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:18.367 INFO:teuthology.orchestra.run.smithi039.stdout: "id": "RGW99999999999999999", 2024-09-22T09:20:18.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tenant": "", 2024-09-22T09:20:18.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "Mr.RGW99999999999999999", 2024-09-22T09:20:18.367 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "quota": { 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:18.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max_users": 1000, 2024-09-22T09:20:18.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max_roles": 1000, 2024-09-22T09:20:18.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max_groups": 1000, 2024-09-22T09:20:18.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:18.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max_access_keys": 4 2024-09-22T09:20:18.369 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:18.370 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-22T09:20:18.370 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key BUXFDDFVZOWDBAERXMNE --secret n6rdfIiV/e/ZqQhpQc/g0sO2tZMhjPnKzyUwZijptSk4FdnTHQHydQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-22T09:20:18.439 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:18.439 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:18.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.478+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 realm 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.480+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.482+0000 7f87d6d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:18.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.482+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.482+0000 7f87d6d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:18.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.482+0000 7f87d6d3e800 20 searching for the correct realm 2024-09-22T09:20:18.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.485+0000 7f87d32ee640 0 -- 172.21.15.39:0/1569126771 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f87c807d040 msgr2=0x7f87c8092930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:18.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.691+0000 7f87d22ec640 0 -- 172.21.15.39:0/1569126771 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f87cc093ae0 msgr2=0x7f87cc0934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.897+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 zone default found 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 4 Realm: () 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 zonegroup default 2024-09-22T09:20:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.898+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 started sync module instance, tier type = 2024-09-22T09:20:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.899+0000 7f87d6d3e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:18.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=0 2024-09-22T09:20:18.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=1 2024-09-22T09:20:18.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=2 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=3 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=4 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=5 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.910+0000 7f87d6d3e800 20 add_watcher() i=6 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.911+0000 7f87d6d3e800 20 add_watcher() i=7 2024-09-22T09:20:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.911+0000 7f87d6d3e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f86897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f87d6d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f87d6d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f87d6d3e800 5 note: GC not initialized 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f8603fff640 20 reqs_thread_entry: start 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f87d6d3e800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.913+0000 7f87d6d3e800 20 Filter name: none 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f8601ffb640 20 reqs_thread_entry: start 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T09:20:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE : miss 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.914+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE info.flags=0x0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 adding default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE to cache LRU end 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 20 rados->read ofs=0 len=0 2024-09-22T09:20:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE : hit (negative entry) 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.915+0000 7f87d6d3e800 10 cache get: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE : hit (negative entry) 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T09:20:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f87d6d3e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f87d6d3e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T09:20:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f86b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94650232605056 notifier 9324 bl.length()=681 2024-09-22T09:20:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f86b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T09:20:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.917+0000 7f86b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f87d6d3e800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f87d6d3e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f86b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431777 cookie 94650232617200 notifier 9324 bl.length()=189 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f86b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-22T09:20:18.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.921+0000 7f86b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f87d6d3e800 10 cache put: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE info.flags=0x7 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f87d6d3e800 10 moving default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE to cache LRU end 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f87d6d3e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:BUXFDDFVZOWDBAERXMNE, ofs0, ns] 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f86b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431717 cookie 94650232602112 notifier 9324 bl.length()=188 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f86b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE info.flags=0x7 2024-09-22T09:20:18.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.924+0000 7f86b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BUXFDDFVZOWDBAERXMNE to cache LRU end 2024-09-22T09:20:18.928 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "user_id": "root2.client.0", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "email": "root2+test@test.test", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "suspended": 0, 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "max_buckets": 1000, 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "subusers": [], 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "keys": [ 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "user": "root2.client.0", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "access_key": "BUXFDDFVZOWDBAERXMNE", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "secret_key": "n6rdfIiV/e/ZqQhpQc/g0sO2tZMhjPnKzyUwZijptSk4FdnTHQHydQ==", 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "active": true, 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:18.916534Z" 2024-09-22T09:20:18.929 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "swift_keys": [], 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": [], 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "op_mask": "read, write, delete", 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "default_placement": "", 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "default_storage_class": "", 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "placement_tags": [], 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "bucket_quota": { 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: "user_quota": { 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": false, 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "check_on_raw": false, 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size": -1, 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max_size_kb": 0, 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max_objects": -1 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "temp_url_keys": [], 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "root", 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "mfa_ids": [], 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "account_id": "RGW99999999999999999", 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "create_date": "2024-09-22T09:20:18.916522Z", 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout: "group_ids": [] 2024-09-22T09:20:18.931 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:20:18.932 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:20:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.927+0000 7f87d6d3e800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-22T09:20:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.928+0000 7f86897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.931+0000 7f87d6d3e800 20 remove_watcher() i=0 2024-09-22T09:20:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.931+0000 7f87d6d3e800 2 removed watcher, disabling cache 2024-09-22T09:20:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.932+0000 7f87d6d3e800 20 remove_watcher() i=1 2024-09-22T09:20:18.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.934+0000 7f87d6d3e800 20 remove_watcher() i=2 2024-09-22T09:20:18.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.935+0000 7f87d6d3e800 20 remove_watcher() i=3 2024-09-22T09:20:18.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.936+0000 7f87d6d3e800 20 remove_watcher() i=4 2024-09-22T09:20:18.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.937+0000 7f87d6d3e800 20 remove_watcher() i=5 2024-09-22T09:20:18.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.938+0000 7f87d6d3e800 20 remove_watcher() i=6 2024-09-22T09:20:18.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:18.939+0000 7f87d6d3e800 20 remove_watcher() i=7 2024-09-22T09:20:18.952 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9185136451 --totp-seed YMDXA6W7TZ3LB7ZZR556AMGGV57JXNDERF5QKVASIUGZIG7NNAZEEFHXYNFJSR7R --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-22T09:20:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:20:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:20:19.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.057+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.058+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.058+0000 7f4452263800 20 realm 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.058+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.059+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.059+0000 7f4452263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.059+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.059+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.059+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.060+0000 7f4452263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:19.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.060+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.061+0000 7f4452263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:20:19.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.061+0000 7f4452263800 20 searching for the correct realm 2024-09-22T09:20:19.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.063+0000 7f4450555640 0 -- 172.21.15.39:0/2580768397 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f44440cda50 msgr2=0x7f44440b5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.269+0000 7f444f553640 0 -- 172.21.15.39:0/2580768397 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f44480760c0 msgr2=0x7f44480787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.475+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:20:19.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 zone default found 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 4 Realm: () 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 zonegroup default 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.476+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:20:19.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 started sync module instance, tier type = 2024-09-22T09:20:19.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.477+0000 7f4452263800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:20:19.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=0 2024-09-22T09:20:19.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=1 2024-09-22T09:20:19.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=2 2024-09-22T09:20:19.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=3 2024-09-22T09:20:19.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=4 2024-09-22T09:20:19.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=5 2024-09-22T09:20:19.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.487+0000 7f4452263800 20 add_watcher() i=6 2024-09-22T09:20:19.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.488+0000 7f4452263800 20 add_watcher() i=7 2024-09-22T09:20:19.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.488+0000 7f4452263800 2 all 8 watchers are set, enabling cache 2024-09-22T09:20:19.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4452263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4452263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4452263800 5 note: GC not initialized 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4304fe1640 20 reqs_thread_entry: start 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4452263800 20 init_complete bucket index max shards: 1 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.490+0000 7f4452263800 20 Filter name: none 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f427e7fc640 20 reqs_thread_entry: start 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-22T09:20:19.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 20 rados->read ofs=0 len=0 2024-09-22T09:20:19.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 20 rados_obj.operate() r=0 bl.length=494 2024-09-22T09:20:19.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-22T09:20:19.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:19.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.491+0000 7f4452263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:20:19.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.494+0000 7f4452263800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T09:20:19.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.494+0000 7f4452263800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:19.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.494+0000 7f4452263800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-22T09:20:19.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.495+0000 7f432effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431691 cookie 94030380626608 notifier 8693 bl.length()=695 2024-09-22T09:20:19.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.495+0000 7f432effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-22T09:20:19.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.495+0000 7f432effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-22T09:20:19.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.497+0000 7f4305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:20:19.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.500+0000 7f4452263800 20 remove_watcher() i=0 2024-09-22T09:20:19.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.500+0000 7f4452263800 2 removed watcher, disabling cache 2024-09-22T09:20:19.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.501+0000 7f4452263800 20 remove_watcher() i=1 2024-09-22T09:20:19.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.502+0000 7f4452263800 20 remove_watcher() i=2 2024-09-22T09:20:19.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.503+0000 7f4452263800 20 remove_watcher() i=3 2024-09-22T09:20:19.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.505+0000 7f4452263800 20 remove_watcher() i=4 2024-09-22T09:20:19.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.506+0000 7f4452263800 20 remove_watcher() i=5 2024-09-22T09:20:19.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.507+0000 7f4452263800 20 remove_watcher() i=6 2024-09-22T09:20:19.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:20:19.508+0000 7f4452263800 20 remove_watcher() i=7 2024-09-22T09:20:19.521 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-22T09:20:19.521 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:20:19.522 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-22T09:20:19.551 INFO:tasks.s3tests:Configuring boto... 2024-09-22T09:20:19.551 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:20:19.551 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T09:20:19.620 DEBUG:teuthology.orchestra.run.smithi039:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T09:20:19.808 INFO:teuthology.orchestra.run.smithi039.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-22T09:20:20.007 INFO:teuthology.orchestra.run.smithi039.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-22T09:20:20.284 INFO:teuthology.orchestra.run.smithi039.stdout:py installdeps: -rrequirements.txt 2024-09-22T09:22:25.430 INFO:teuthology.orchestra.run.smithi039.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-22T09:22:26.914 INFO:teuthology.orchestra.run.smithi039.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.1,gevent==24.2.1,greenlet==3.1.1,httplib2==0.22.0,idna==3.10,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.6,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.8.0,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=86d6c7a45fabefc679d9d53dde3c0b9abf328f9766c1f77917285f7dbbc11c60,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.20.0,urllib3==1.26.20,virtualenv==20.26.5,zope.event==5.0,zope.interface==7.0.3 2024-09-22T09:22:26.914 INFO:teuthology.orchestra.run.smithi039.stdout:py run-test-pre: PYTHONHASHSEED='3180034039' 2024-09-22T09:22:26.914 INFO:teuthology.orchestra.run.smithi039.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-22T09:22:27.054 INFO:teuthology.orchestra.run.smithi039.stdout:============================= test session starts ============================== 2024-09-22T09:22:27.054 INFO:teuthology.orchestra.run.smithi039.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-22T09:22:27.054 INFO:teuthology.orchestra.run.smithi039.stdout:cachedir: .tox/py/.pytest_cache 2024-09-22T09:22:27.054 INFO:teuthology.orchestra.run.smithi039.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T09:22:27.054 INFO:teuthology.orchestra.run.smithi039.stdout:configfile: pytest.ini 2024-09-22T09:22:28.885 INFO:teuthology.orchestra.run.smithi039.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-22T09:22:28.885 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:22:29.509 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-22T09:22:29.827 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-22T09:22:30.126 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-22T09:22:30.424 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-22T09:22:30.743 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-22T09:22:30.970 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-22T09:22:31.322 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-22T09:22:31.558 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-22T09:22:31.687 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-22T09:22:31.816 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-22T09:22:32.133 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-22T09:22:32.456 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-22T09:22:32.771 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-22T09:22:33.091 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-22T09:22:33.221 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-22T09:22:33.350 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-22T09:22:33.430 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.511 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.591 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.674 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.756 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.837 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-22T09:22:33.918 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T09:22:33.999 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.081 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.246 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.328 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.410 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-22T09:22:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.575 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.659 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.740 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.822 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.904 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T09:22:34.986 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-22T09:22:35.067 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-22T09:22:35.149 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.230 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.312 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.394 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.476 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.557 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.639 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-22T09:22:35.721 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-22T09:22:35.803 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-22T09:22:35.885 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-22T09:22:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T09:22:36.048 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-22T09:22:36.131 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T09:22:36.212 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-22T09:22:36.293 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-22T09:22:36.375 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-22T09:22:37.147 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-22T09:22:45.928 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-22T09:22:54.851 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-22T09:23:12.042 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-22T09:23:33.584 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-22T09:23:40.049 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-22T09:23:46.510 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-22T09:23:47.977 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-22T09:23:48.302 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-22T09:23:49.136 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-22T09:23:50.126 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-22T09:23:51.096 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-22T09:23:51.551 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-22T09:23:51.989 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-22T09:23:51.990 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T09:23:51.990 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-22T09:23:51.991 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-22T09:23:52.009 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-22T09:23:52.010 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T09:23:52.011 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-22T09:23:52.011 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-22T09:23:52.012 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.013 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.014 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.015 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.016 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-22T09:23:52.016 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.017 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.018 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-22T09:23:52.019 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T09:23:52.019 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-22T09:23:52.020 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T09:23:52.021 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-22T09:23:52.022 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-22T09:23:52.023 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-22T09:23:52.024 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-22T09:23:52.024 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-22T09:23:52.025 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-22T09:23:52.026 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-22T09:23:52.027 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-22T09:23:52.028 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-22T09:23:52.117 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-22T09:23:52.130 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-22T09:23:53.225 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-22T09:24:01.219 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-22T09:24:01.911 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-22T09:24:02.793 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-22T09:24:03.666 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-22T09:24:04.530 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-22T09:24:05.391 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-22T09:24:06.098 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-22T09:24:06.996 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-22T09:24:07.799 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-22T09:24:08.569 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-22T09:24:09.265 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-22T09:24:09.866 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-22T09:24:10.462 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-22T09:24:10.942 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-22T09:24:11.653 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-22T09:24:12.472 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-22T09:24:13.248 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-22T09:24:13.940 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-22T09:24:14.634 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-22T09:24:15.342 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-22T09:24:16.029 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-22T09:24:16.723 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-22T09:24:17.329 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-22T09:24:17.929 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-22T09:24:18.406 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-22T09:24:18.931 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-22T09:24:19.406 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-22T09:24:19.887 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-22T09:24:20.369 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-22T09:24:21.256 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-22T09:24:21.734 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-22T09:24:22.243 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-22T09:24:22.883 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-22T09:24:23.500 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-22T09:24:24.014 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-22T09:24:24.633 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-22T09:24:25.249 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-22T09:24:26.027 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T09:24:26.597 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-22T09:24:27.242 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-22T09:24:27.862 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-22T09:24:28.803 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-22T09:24:29.674 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T09:24:30.484 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-22T09:24:31.405 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:32.412 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:34.333 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:36.594 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:37.659 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:38.673 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-22T09:24:39.520 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-22T09:24:40.488 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-22T09:24:41.219 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-22T09:24:42.806 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-22T09:24:43.884 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-22T09:24:45.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-22T09:24:47.625 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-22T09:24:50.841 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-22T09:24:52.733 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-22T09:24:54.444 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-22T09:24:55.765 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-22T09:24:56.660 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-22T09:24:58.208 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-22T09:24:59.326 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-22T09:25:00.795 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-22T09:25:01.851 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-22T09:25:03.763 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-22T09:25:05.293 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-22T09:25:07.354 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-22T09:25:09.378 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-22T09:25:10.844 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-22T09:25:12.166 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-22T09:25:13.260 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-22T09:25:15.716 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-22T09:25:17.567 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-22T09:25:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-22T09:25:21.598 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-22T09:25:23.458 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-22T09:25:25.332 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-22T09:25:26.899 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-22T09:25:28.028 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-22T09:25:29.289 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-22T09:25:31.533 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-22T09:25:34.430 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-22T09:25:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-22T09:25:37.642 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-22T09:25:39.559 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-22T09:25:41.417 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-22T09:25:43.491 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-22T09:25:45.673 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-22T09:25:47.732 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-22T09:25:49.687 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-22T09:25:50.951 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-22T09:25:51.999 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-22T09:25:53.058 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-22T09:25:54.151 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-22T09:25:55.947 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-22T09:25:57.826 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-22T09:25:59.683 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-22T09:26:01.486 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-22T09:26:03.365 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-22T09:26:05.190 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-22T09:26:06.984 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-22T09:26:08.870 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-22T09:26:10.656 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-22T09:26:12.509 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T09:26:14.338 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-22T09:26:16.215 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-22T09:26:17.506 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-22T09:26:18.789 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-22T09:26:20.014 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-22T09:26:21.285 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-22T09:26:22.237 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-22T09:26:23.185 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-22T09:26:24.103 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-22T09:26:25.035 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-22T09:26:25.933 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-22T09:26:26.823 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-22T09:26:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-22T09:26:28.661 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-22T09:26:29.554 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-22T09:26:31.167 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-22T09:26:32.782 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-22T09:26:33.567 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T09:26:34.402 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-22T09:26:35.286 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-22T09:26:36.176 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-22T09:26:37.787 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T09:26:39.400 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-22T09:26:40.331 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-22T09:26:41.228 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-22T09:26:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-22T09:26:43.046 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-22T09:26:43.931 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-22T09:26:44.828 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-22T09:26:45.724 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-22T09:26:46.653 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-22T09:26:47.569 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-22T09:26:48.479 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-22T09:26:49.372 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-22T09:26:50.265 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-22T09:26:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-22T09:26:51.983 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-22T09:26:52.905 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-22T09:26:53.789 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-22T09:26:54.684 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-22T09:27:38.345 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-22T09:27:39.201 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-22T09:27:40.055 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-22T09:27:40.927 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-22T09:27:41.784 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-22T09:27:42.679 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-22T09:27:43.567 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-22T09:27:44.429 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-22T09:27:45.297 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-22T09:27:46.166 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-22T09:27:47.028 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-22T09:27:47.896 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-22T09:27:48.789 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-22T09:27:49.694 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T09:27:50.594 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-22T09:27:51.491 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T09:27:52.451 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-22T09:27:53.354 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-22T09:27:54.244 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-22T09:27:55.183 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T09:27:56.077 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-22T09:27:56.973 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T09:27:57.887 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-22T09:27:58.839 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-22T09:27:59.808 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-22T09:28:00.752 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-22T09:28:01.654 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-22T09:28:02.544 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-22T09:28:03.439 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-22T09:28:03.931 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-22T09:28:04.717 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-22T09:28:06.817 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-22T09:28:08.894 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-22T09:28:09.792 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-22T09:28:10.690 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-22T09:28:11.608 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-22T09:28:12.494 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-22T09:28:13.493 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-22T09:28:14.451 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-22T09:28:15.340 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-22T09:28:16.252 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-22T09:28:17.148 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-22T09:28:18.050 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-22T09:28:18.939 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-22T09:28:19.878 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-22T09:28:21.047 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-22T09:28:22.564 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-22T09:28:23.356 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-22T09:28:24.145 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-22T09:28:24.839 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-22T09:28:25.546 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-22T09:28:26.057 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-22T09:28:26.541 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-22T09:28:27.019 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-22T09:28:27.813 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-22T09:28:32.100 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-22T09:28:32.585 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-22T09:28:33.340 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-22T09:28:33.988 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-22T09:28:34.727 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-22T09:28:35.409 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-22T09:28:37.787 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-22T09:28:38.851 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-22T09:28:39.911 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-22T09:29:24.928 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-22T09:30:10.346 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-22T09:30:11.122 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-22T09:30:11.932 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-22T09:30:12.740 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-22T09:30:13.552 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-22T09:30:14.456 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-22T09:30:15.247 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-22T09:30:16.042 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-22T09:30:16.969 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-22T09:30:17.814 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-22T09:30:18.707 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-22T09:30:19.535 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-22T09:30:20.492 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-22T09:30:21.269 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-22T09:30:21.971 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-22T09:30:22.736 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-22T09:30:23.486 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-22T09:30:25.192 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-22T09:30:26.051 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-22T09:30:26.819 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-22T09:30:27.583 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-22T09:30:28.477 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-22T09:30:29.340 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-22T09:30:30.041 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-22T09:30:30.755 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-22T09:30:31.455 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-22T09:30:32.157 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-22T09:30:32.859 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-22T09:30:33.559 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-22T09:30:34.446 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-22T09:30:35.181 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-22T09:30:35.884 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-22T09:30:36.584 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-22T09:30:37.277 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-22T09:30:38.203 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-22T09:30:38.923 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-22T09:30:39.615 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-22T09:30:40.314 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-22T09:30:41.009 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-22T09:30:41.745 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-22T09:30:42.457 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-22T09:30:43.156 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-22T09:30:45.009 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-22T09:30:45.714 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-22T09:30:46.549 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-22T09:30:47.392 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-22T09:30:48.193 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-22T09:30:49.092 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-22T09:30:49.926 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-22T09:30:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-22T09:30:52.712 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-22T09:30:53.542 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-22T09:30:54.496 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-22T09:30:55.460 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-22T09:30:56.390 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-22T09:30:57.197 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-22T09:30:58.155 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-22T09:30:59.162 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-22T09:30:59.995 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-22T09:31:00.953 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-22T09:31:01.742 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-22T09:31:02.514 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-22T09:31:03.266 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-22T09:31:04.120 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-22T09:31:04.849 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-22T09:31:05.324 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-22T09:31:06.311 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-22T09:31:07.100 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-22T09:31:07.890 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-22T09:31:11.186 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-22T09:31:11.978 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-22T09:31:12.785 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-22T09:31:13.610 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-22T09:31:14.398 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-22T09:31:15.127 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-22T09:31:15.912 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-22T09:31:16.806 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-22T09:31:17.696 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-22T09:31:18.494 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-22T09:31:19.314 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-22T09:31:20.110 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-22T09:31:21.016 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-22T09:31:21.876 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-22T09:31:22.647 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-22T09:31:23.500 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-22T09:31:24.360 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-22T09:31:25.223 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-22T09:31:25.704 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-22T09:31:26.182 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-22T09:31:26.659 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-22T09:31:27.252 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-22T09:31:27.859 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-22T09:31:28.469 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-22T09:31:29.120 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-22T09:31:29.779 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-22T09:31:30.261 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-22T09:31:30.737 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-22T09:31:31.344 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-22T09:31:31.822 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-22T09:31:32.313 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-22T09:31:32.791 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-22T09:31:33.271 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-22T09:31:33.959 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-22T09:31:34.628 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-22T09:31:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-22T09:31:36.038 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-22T09:31:36.693 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-22T09:31:37.386 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-22T09:31:38.037 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-22T09:31:38.789 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-22T09:31:39.454 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T09:31:40.122 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T09:31:40.952 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-22T09:31:41.822 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-22T09:31:42.755 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-22T09:31:43.581 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-22T09:31:44.450 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-22T09:31:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-22T09:31:46.249 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-22T09:31:47.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-22T09:31:48.086 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-22T09:31:48.815 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-22T09:31:49.762 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-22T09:31:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-22T09:31:51.631 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-22T09:31:52.562 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-22T09:31:53.495 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-22T09:31:54.905 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-22T09:31:56.169 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-22T09:31:57.375 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-22T09:31:58.698 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-22T09:31:59.942 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-22T09:32:00.724 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-22T09:32:01.573 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-22T09:32:02.479 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-22T09:32:03.315 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-22T09:32:04.097 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-22T09:32:05.059 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-22T09:32:06.399 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-22T09:32:07.725 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-22T09:32:09.087 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-22T09:32:10.433 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-22T09:32:11.765 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-22T09:32:13.086 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-22T09:32:14.414 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-22T09:32:15.787 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-22T09:32:17.101 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-22T09:32:18.299 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-22T09:32:19.521 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-22T09:32:20.731 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-22T09:32:22.136 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-22T09:32:23.425 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-22T09:32:23.904 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-22T09:32:24.409 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-22T09:32:24.894 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-22T09:32:25.734 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-22T09:32:26.515 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-22T09:32:27.119 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-22T09:32:27.721 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-22T09:32:28.733 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-22T09:32:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-22T09:32:32.220 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-22T09:32:33.177 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-22T09:32:37.243 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-22T09:32:38.182 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-22T09:32:39.139 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-22T09:32:40.033 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-22T09:32:40.915 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-22T09:32:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-22T09:32:43.053 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-22T09:32:44.329 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-22T09:32:45.435 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-22T09:32:47.086 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-22T09:32:48.691 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-22T09:32:49.400 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-22T09:32:50.123 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-22T09:32:52.673 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-22T09:32:53.727 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-22T09:33:19.708 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-22T09:33:20.512 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-22T09:33:21.532 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-22T09:33:25.439 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-22T09:33:26.467 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-22T09:33:28.066 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-22T09:33:38.661 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-22T09:34:03.679 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-22T09:34:35.733 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-22T09:36:30.478 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-22T09:36:42.571 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-22T09:37:06.651 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-22T09:37:07.999 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-22T09:37:14.537 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-22T09:37:19.707 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-22T09:37:23.384 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-22T09:37:24.231 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-22T09:37:29.511 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-22T09:37:30.520 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-22T09:37:31.372 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-22T09:37:32.214 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-22T09:37:51.334 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-22T09:37:54.935 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-22T09:37:55.890 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-22T09:37:56.696 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-22T09:37:57.588 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-22T09:38:04.633 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-22T09:38:08.563 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-22T09:38:12.406 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-22T09:38:13.342 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-22T09:38:14.261 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-22T09:38:15.174 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-22T09:38:16.145 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-22T09:38:17.069 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-22T09:38:17.994 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-22T09:38:18.863 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-22T09:38:20.595 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-22T09:38:24.442 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-22T09:38:30.647 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-22T09:38:32.853 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-22T09:38:38.056 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-22T09:38:47.132 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-22T09:38:48.984 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-22T09:38:53.047 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-22T09:39:00.462 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-22T09:39:02.317 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-22T09:39:03.343 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-22T09:39:04.748 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-22T09:39:05.597 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-22T09:39:12.168 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-22T09:39:13.003 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-22T09:39:13.910 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-22T09:39:14.742 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-22T09:39:15.555 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-22T09:39:16.857 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-22T09:39:28.159 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-22T09:39:29.515 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-22T09:39:30.654 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-22T09:39:32.068 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-22T09:39:33.550 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-22T09:39:38.627 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-22T09:39:40.023 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-22T09:39:45.929 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-22T09:40:07.062 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-22T09:40:44.954 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-22T09:40:47.450 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-22T09:40:50.000 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-22T09:40:51.197 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-22T09:40:52.457 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-22T09:40:53.421 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-22T09:40:54.902 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-22T09:40:56.271 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-22T09:40:58.741 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-22T09:40:59.527 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-22T09:41:00.311 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-22T09:41:01.064 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-22T09:41:01.760 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-22T09:41:02.453 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-22T09:41:03.261 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-22T09:41:03.977 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-22T09:41:04.739 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-22T09:41:05.576 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-22T09:41:06.284 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-22T09:41:06.978 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-22T09:41:07.687 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-22T09:41:08.382 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-22T09:41:09.071 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-22T09:41:09.943 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-22T09:41:10.821 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-22T09:41:12.098 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-22T09:41:12.948 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-22T09:41:13.783 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-22T09:41:14.650 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-22T09:41:15.490 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-22T09:41:16.183 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-22T09:41:16.885 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-22T09:41:17.580 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-22T09:41:18.312 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-22T09:42:08.978 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-22T09:43:00.120 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-22T09:43:10.437 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-22T09:43:11.278 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-22T09:44:12.358 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-22T09:45:14.027 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-22T09:45:14.875 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-22T09:45:15.770 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-22T09:45:16.468 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-22T09:45:17.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-22T09:45:49.271 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-22T09:45:58.454 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-22T09:46:07.596 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-22T09:46:08.443 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-22T09:46:09.274 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-22T09:46:10.153 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-22T09:46:11.473 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-22T09:46:12.326 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-22T09:46:13.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-22T09:46:14.063 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-22T09:46:14.963 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-22T09:46:15.953 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-22T09:46:16.973 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-22T09:46:17.902 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-22T09:46:18.727 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-22T09:46:20.141 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-22T09:46:21.545 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-22T09:46:23.924 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-22T09:46:26.138 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-22T09:46:28.443 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-22T09:46:31.265 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-22T09:46:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-22T09:46:36.399 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-22T09:46:38.701 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-22T09:46:41.055 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-22T09:46:43.556 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-22T09:46:44.408 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-22T09:46:45.259 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-22T09:46:46.160 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-22T09:46:48.579 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-22T09:46:50.994 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-22T09:46:53.495 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-22T09:46:55.229 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-22T09:47:17.797 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-22T09:47:19.026 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-22T09:47:20.353 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T09:47:21.576 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-22T09:47:23.200 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-22T09:47:24.587 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-22T09:47:25.523 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-22T09:47:26.869 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-22T09:47:27.609 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-22T09:47:28.347 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-22T09:47:29.038 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-22T09:47:29.726 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-22T09:47:30.589 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-22T09:47:31.341 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-22T09:47:32.638 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-22T09:47:33.402 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-22T09:47:34.114 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-22T09:47:34.775 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-22T09:47:35.438 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-22T09:47:36.102 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-22T09:47:36.830 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-22T09:47:37.496 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-22T09:47:38.179 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-22T09:47:38.867 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-22T09:47:39.517 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-22T09:47:40.340 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-22T09:47:41.101 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-22T09:47:41.998 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-22T09:47:42.848 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-22T09:47:43.624 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-22T09:47:44.383 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-22T09:47:45.292 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-22T09:47:46.128 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-22T09:47:46.995 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-22T09:47:47.849 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-22T09:47:48.699 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-22T09:47:49.555 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-22T09:47:50.497 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-22T09:47:51.442 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-22T09:47:52.310 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-22T09:47:53.142 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-22T09:47:53.900 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-22T09:47:54.683 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-22T09:47:55.600 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-22T09:47:56.358 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-22T09:47:57.249 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T09:47:58.302 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-22T09:47:59.040 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-22T09:47:59.880 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-22T09:48:00.653 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-22T09:48:11.190 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-22T09:48:11.968 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-22T09:48:22.455 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-22T09:48:23.412 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-22T09:48:24.375 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-22T09:48:25.065 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-22T09:48:25.814 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:48:26.562 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:48:27.361 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-22T09:48:28.151 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-22T09:48:28.954 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-22T09:48:29.651 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-22T09:48:30.410 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-22T09:48:31.271 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-22T09:48:32.062 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-22T09:48:32.985 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-22T09:48:33.885 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-22T09:48:34.641 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-22T09:48:35.381 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-22T09:48:36.473 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-22T09:48:51.444 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-22T09:48:52.134 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:48:52.918 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:48:53.796 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-22T09:48:54.679 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-22T09:48:57.098 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-22T09:48:57.979 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-22T09:48:59.397 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-22T09:49:05.231 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-22T09:49:07.013 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-22T09:49:17.867 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-22T09:49:28.265 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-22T09:49:29.206 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-22T09:49:30.551 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-22T09:49:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-22T09:50:09.286 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-22T09:50:13.154 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-22T09:50:15.624 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-22T09:50:18.205 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-22T09:50:21.478 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-22T09:50:22.494 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-22T09:50:27.036 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-22T09:50:32.384 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-22T09:50:50.879 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-22T09:50:54.566 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-22T09:50:56.955 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-22T09:50:59.180 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-22T09:51:00.367 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-22T09:51:06.402 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-22T09:51:10.160 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-22T09:51:11.637 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-22T09:51:13.876 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-22T09:51:19.851 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-22T09:51:23.756 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-22T09:51:28.724 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-22T09:51:30.860 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-22T09:51:31.242 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-22T09:51:35.681 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-22T09:51:40.192 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-22T09:51:42.957 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-22T09:51:47.122 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-22T09:51:48.754 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-22T09:52:32.407 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-22T09:52:32.791 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-22T09:52:34.075 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-22T09:52:35.077 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-22T09:52:35.988 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-22T09:52:37.137 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-22T09:52:37.159 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-22T09:52:37.159 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.159 INFO:teuthology.orchestra.run.smithi039.stdout:=============================== warnings summary =============================== 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: import imp 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py:120 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: if boto_type is 'S3Connection': 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_headers.py:124 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: elif boto_type is 'HTTPRequest': 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.160 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3.py:359 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py:176 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: if k is 'BucketName': 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py:253 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: @pytest.mark.timeout(10) 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: @pytest.mark.s3website_routing_rules 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.161 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.163 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-22T09:52:37.164 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi039.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout: warnings.warn( 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-22T09:52:37.165 INFO:teuthology.orchestra.run.smithi039.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1810.11s (0:30:10) = 2024-09-22T09:52:37.290 INFO:teuthology.orchestra.run.smithi039.stdout:___________________________________ summary ____________________________________ 2024-09-22T09:52:37.290 INFO:teuthology.orchestra.run.smithi039.stdout: py: commands succeeded 2024-09-22T09:52:37.290 INFO:teuthology.orchestra.run.smithi039.stdout: congratulations :) 2024-09-22T09:52:37.308 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-22T09:52:37.309 DEBUG:teuthology.orchestra.run.smithi039:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T09:52:37.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:52:37.412 INFO:tasks.s3tests:Cleaning up boto... 2024-09-22T09:52:37.413 DEBUG:teuthology.orchestra.run.smithi039:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-22T09:52:37.442 INFO:tasks.s3tests:Removing s3-tests... 2024-09-22T09:52:37.442 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-22T09:52:37.648 INFO:teuthology.run_tasks:Running task workunit... 2024-09-22T09:52:37.658 INFO:tasks.workunit:Pulling workunits from ref 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:52:37.658 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-22T09:52:37.658 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:52:37.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:52:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-22T09:52:37.688 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:52:37.758 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-22T09:52:37.758 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-22T09:52:37.829 INFO:tasks.workunit:timeout=3h 2024-09-22T09:52:37.829 INFO:tasks.workunit:cleanup=True 2024-09-22T09:52:37.830 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8852379c050c686f4605f33f0129009b2029ca9d 2024-09-22T09:52:37.899 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-22T09:53:40.620 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 91% (11634/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '8852379c050c686f4605f33f0129009b2029ca9d'. 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-22T09:53:41.424 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:41.425 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 8852379c050 rgw/cloud-restore: Fixed storage class update while listing objects. 2024-09-22T09:53:41.429 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-22T09:53:41.498 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-22T09:53:41.501 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:53:41.501 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-22T09:53:41.551 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-22T09:53:41.601 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-22T09:53:41.642 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-22T09:53:41.643 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:53:41.643 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-22T09:53:41.683 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-22T09:53:41.687 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-22T09:53:41.687 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-22T09:53:41.757 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-22T09:53:41.758 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-22T09:53:41.759 DEBUG:teuthology.orchestra.run.smithi039:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8852379c050c686f4605f33f0129009b2029ca9d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T09:53:41.831 INFO:tasks.workunit.client.0.smithi039.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-22T09:53:41.832 INFO:tasks.workunit.client.0.smithi039.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:53:41.832 INFO:tasks.workunit.client.0.smithi039.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:53:44.239 INFO:tasks.workunit.client.0.smithi039.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-22T09:53:44.239 INFO:tasks.workunit.client.0.smithi039.stderr:++ deactivate nondestructive 2024-09-22T09:53:44.239 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:53:44.239 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ unset VIRTUAL_ENV 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-22T09:53:44.240 INFO:tasks.workunit.client.0.smithi039.stderr:++ export VIRTUAL_ENV 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PATH 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n '' ']' 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -z '' ']' 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-22T09:53:44.241 INFO:tasks.workunit.client.0.smithi039.stderr:++ PS1='(rgw) ' 2024-09-22T09:53:44.242 INFO:tasks.workunit.client.0.smithi039.stderr:++ export PS1 2024-09-22T09:53:44.242 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:53:44.242 INFO:tasks.workunit.client.0.smithi039.stderr:++ hash -r 2024-09-22T09:53:44.242 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install pip --upgrade 2024-09-22T09:53:44.479 INFO:tasks.workunit.client.0.smithi039.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-22T09:53:44.670 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting pip 2024-09-22T09:53:44.676 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-22T09:53:44.722 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: pip 2024-09-22T09:53:44.723 INFO:tasks.workunit.client.0.smithi039.stdout: Attempting uninstall: pip 2024-09-22T09:53:44.723 INFO:tasks.workunit.client.0.smithi039.stdout: Found existing installation: pip 21.3.1 2024-09-22T09:53:44.886 INFO:tasks.workunit.client.0.smithi039.stdout: Uninstalling pip-21.3.1: 2024-09-22T09:53:44.891 INFO:tasks.workunit.client.0.smithi039.stdout: Successfully uninstalled pip-21.3.1 2024-09-22T09:53:45.666 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed pip-24.2 2024-09-22T09:53:45.718 INFO:tasks.workunit.client.0.smithi039.stderr:+ pip install boto3 2024-09-22T09:53:46.518 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting boto3 2024-09-22T09:53:46.519 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached boto3-1.35.24-py3-none-any.whl.metadata (6.6 kB) 2024-09-22T09:53:47.085 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting botocore<1.36.0,>=1.35.24 (from boto3) 2024-09-22T09:53:47.087 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached botocore-1.35.24-py3-none-any.whl.metadata (5.7 kB) 2024-09-22T09:53:47.135 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-22T09:53:47.136 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-22T09:53:47.189 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-22T09:53:47.190 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-22T09:53:47.241 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:53:47.242 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-22T09:53:47.328 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:53:47.329 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-22T09:53:47.538 INFO:tasks.workunit.client.0.smithi039.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.24->boto3) 2024-09-22T09:53:47.539 INFO:tasks.workunit.client.0.smithi039.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-22T09:53:47.543 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached boto3-1.35.24-py3-none-any.whl (139 kB) 2024-09-22T09:53:47.545 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached botocore-1.35.24-py3-none-any.whl (12.6 MB) 2024-09-22T09:53:47.554 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-22T09:53:47.555 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-22T09:53:47.557 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-22T09:53:47.558 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-22T09:53:47.560 INFO:tasks.workunit.client.0.smithi039.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-22T09:53:47.636 INFO:tasks.workunit.client.0.smithi039.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-22T09:53:48.717 INFO:tasks.workunit.client.0.smithi039.stdout:Successfully installed boto3-1.35.24 botocore-1.35.24 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-22T09:53:48.838 INFO:tasks.workunit.client.0.smithi039.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-22T09:53:48.966 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-22T09:53:49.003 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:49.004 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:49.044 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.043+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 20 realm 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.044+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.045+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.046 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.045+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.046+0000 7f24cb340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:49.047 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.046+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.046+0000 7f24cb340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:53:49.048 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.046+0000 7f24cb340800 20 searching for the correct realm 2024-09-22T09:53:49.049 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.048+0000 7f24c68ec640 0 -- 172.21.15.39:0/2388121531 >> [v2:172.21.15.39:6824/1117132609,v1:172.21.15.39:6825/1117132609] conn(0x7f24b8009250 msgr2=0x7f24b80c0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:49.254 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.253+0000 7f24c70ed640 0 -- 172.21.15.39:0/2388121531 >> [v2:172.21.15.117:6816/277639924,v1:172.21.15.117:6817/277639924] conn(0x7f24c0038070 msgr2=0x7f24c0073ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.263 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.261+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:49.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.264 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 zone default found 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 4 Realm: () 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 zonegroup default 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.262+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.263+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.263+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.263+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.263+0000 7f24cb340800 20 started sync module instance, tier type = 2024-09-22T09:53:49.265 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.263+0000 7f24cb340800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:53:49.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=0 2024-09-22T09:53:49.274 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=1 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=2 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=3 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=4 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=5 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.273+0000 7f24cb340800 20 add_watcher() i=6 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.274+0000 7f24cb340800 20 add_watcher() i=7 2024-09-22T09:53:49.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.274+0000 7f24cb340800 2 all 8 watchers are set, enabling cache 2024-09-22T09:53:49.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f237dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f24cb340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f24cb340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f24cb340800 5 note: GC not initialized 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f237cfe1640 20 reqs_thread_entry: start 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f24cb340800 20 init_complete bucket index max shards: 1 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.276+0000 7f24cb340800 20 Filter name: none 2024-09-22T09:53:49.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f22f67fc640 20 reqs_thread_entry: start 2024-09-22T09:53:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-22T09:53:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-22T09:53:49.279 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.277+0000 7f24cb340800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-22T09:53:49.280 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f24cb340800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T09:53:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f24cb340800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:53:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f24cb340800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-22T09:53:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f23aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431847 cookie 94839969321536 notifier 8708 bl.length()=613 2024-09-22T09:53:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f23aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-22T09:53:49.281 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.279+0000 7f23aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-22T09:53:49.283 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f24cb340800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T09:53:49.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f24cb340800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:53:49.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f24cb340800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-22T09:53:49.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f23aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432036 cookie 94839969320480 notifier 8708 bl.length()=191 2024-09-22T09:53:49.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f23aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-22T09:53:49.284 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.282+0000 7f23aa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-22T09:53:49.286 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.284+0000 7f237dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:49.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.287+0000 7f24cb340800 20 remove_watcher() i=0 2024-09-22T09:53:49.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.287+0000 7f24cb340800 2 removed watcher, disabling cache 2024-09-22T09:53:49.289 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.288+0000 7f24cb340800 20 remove_watcher() i=1 2024-09-22T09:53:49.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.289+0000 7f24cb340800 20 remove_watcher() i=2 2024-09-22T09:53:49.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.290+0000 7f24cb340800 20 remove_watcher() i=3 2024-09-22T09:53:49.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.291+0000 7f24cb340800 20 remove_watcher() i=4 2024-09-22T09:53:49.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.292+0000 7f24cb340800 20 remove_watcher() i=5 2024-09-22T09:53:49.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.293+0000 7f24cb340800 20 remove_watcher() i=6 2024-09-22T09:53:49.295 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.294+0000 7f24cb340800 20 remove_watcher() i=7 2024-09-22T09:53:49.486 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.486 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.535 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.535 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.596 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.596 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.636 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.636 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.663 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-22T09:53:49.664 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:49.666 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.666 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.704 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.704 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.741 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:49.741 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:49.785 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T09:53:49.814 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:49.814 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:49.854 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.853+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.856 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 realm 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.855+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.856+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:49.857 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.856+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.857+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:53:49.858 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.857+0000 7f625a21d800 20 searching for the correct realm 2024-09-22T09:53:49.860 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:49.859+0000 7f62561f3640 0 -- 172.21.15.39:0/3969494830 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f624c069910 msgr2=0x7f624c0677b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:50.067 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.066+0000 7f62551f1640 0 -- 172.21.15.39:0/3969494830 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f62500e1bd0 msgr2=0x7f62500cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.273+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.275 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:50.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.276 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 zone default found 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 4 Realm: () 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 zonegroup default 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.274+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:50.277 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:50.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 started sync module instance, tier type = 2024-09-22T09:53:50.278 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.275+0000 7f625a21d800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:53:50.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=0 2024-09-22T09:53:50.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=1 2024-09-22T09:53:50.287 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=2 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=3 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=4 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=5 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.286+0000 7f625a21d800 20 add_watcher() i=6 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.287+0000 7f625a21d800 20 add_watcher() i=7 2024-09-22T09:53:50.288 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.287+0000 7f625a21d800 2 all 8 watchers are set, enabling cache 2024-09-22T09:53:50.290 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.289+0000 7f61077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:50.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.289+0000 7f625a21d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:53:50.291 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.289+0000 7f625a21d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f625a21d800 5 note: GC not initialized 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f61067fc640 20 reqs_thread_entry: start 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f625a21d800 20 init_complete bucket index max shards: 1 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f625a21d800 20 Filter name: none 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f6077fff640 20 reqs_thread_entry: start 2024-09-22T09:53:50.292 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.290+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 rados->read ofs=0 len=0 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 INFO: main: starting shard=0 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.291+0000 7f625a21d800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.782.0 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.292+0000 7f625a21d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:53:50.293 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.292+0000 7f625a21d800 20 INFO: main: done 2024-09-22T09:53:50.294 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.293+0000 7f61077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:50.296 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.295+0000 7f625a21d800 20 remove_watcher() i=0 2024-09-22T09:53:50.297 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.295+0000 7f625a21d800 2 removed watcher, disabling cache 2024-09-22T09:53:50.298 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.297+0000 7f625a21d800 20 remove_watcher() i=1 2024-09-22T09:53:50.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.298+0000 7f625a21d800 20 remove_watcher() i=2 2024-09-22T09:53:50.300 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.299+0000 7f625a21d800 20 remove_watcher() i=3 2024-09-22T09:53:50.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.300+0000 7f625a21d800 20 remove_watcher() i=4 2024-09-22T09:53:50.303 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.301+0000 7f625a21d800 20 remove_watcher() i=5 2024-09-22T09:53:50.304 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.303+0000 7f625a21d800 20 remove_watcher() i=6 2024-09-22T09:53:50.305 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.304+0000 7f625a21d800 20 remove_watcher() i=7 2024-09-22T09:53:50.319 INFO:tasks.workunit.client.0.smithi039.stderr:rados -p default.rgw.buckets.data ls | grep 80840f93-7bbe-42a1-b52a-729836434f2c 2024-09-22T09:53:50.342 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:50.342 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:50.387 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:50.386+0000 7f7f113b4640 0 -- 172.21.15.39:0/3993397805 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f7ef807c040 msgr2=0x7f7ef807c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:50.393 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-22T09:53:50.394 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:50.395 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T09:53:51.815 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:51.816 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:51.853 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T09:53:52.276 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-22T09:53:52.305 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:52.305 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:52.345 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.343+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.345+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.345+0000 7f3b9e72a800 20 realm 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.345+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.346+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.346+0000 7f3b9e72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:53:52.347 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.346+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.346+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.346+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.347+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:52.348 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.347+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.347+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:53:52.349 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.347+0000 7f3b9e72a800 20 searching for the correct realm 2024-09-22T09:53:52.351 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.350+0000 7f3b9acae640 0 -- 172.21.15.39:0/3061871599 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f3b84019040 msgr2=0x7f3b840735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:52.355 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.354+0000 7f3b99cac640 0 -- 172.21.15.39:0/3061871599 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f3b940cfb70 msgr2=0x7f3b940ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:53:52.563 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:53:52.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.561+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:52.564 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 zone default found 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 4 Realm: () 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:53:52.565 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 zonegroup default 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.562+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.563+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.563+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.563+0000 7f3b9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.563+0000 7f3b9e72a800 20 started sync module instance, tier type = 2024-09-22T09:53:52.566 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.563+0000 7f3b9e72a800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=0 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=1 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=2 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=3 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=4 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=5 2024-09-22T09:53:52.575 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.573+0000 7f3b9e72a800 20 add_watcher() i=6 2024-09-22T09:53:52.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.574+0000 7f3b9e72a800 20 add_watcher() i=7 2024-09-22T09:53:52.576 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.574+0000 7f3b9e72a800 2 all 8 watchers are set, enabling cache 2024-09-22T09:53:52.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.576+0000 7f3a50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:52.578 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 5 note: GC not initialized 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f39cb7fe640 20 reqs_thread_entry: start 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 20 init_complete bucket index max shards: 1 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 20 Filter name: none 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f39c97fa640 20 reqs_thread_entry: start 2024-09-22T09:53:52.579 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.577+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 rados->read ofs=0 len=0 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-22T09:53:52.580 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 INFO: main: starting shard=0 2024-09-22T09:53:52.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.782.0 2024-09-22T09:53:52.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-22T09:53:52.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.578+0000 7f3b9e72a800 20 INFO: main: done 2024-09-22T09:53:52.581 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.579+0000 7f3a50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:52.583 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.582+0000 7f3b9e72a800 20 remove_watcher() i=0 2024-09-22T09:53:52.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.582+0000 7f3b9e72a800 2 removed watcher, disabling cache 2024-09-22T09:53:52.584 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.583+0000 7f3b9e72a800 20 remove_watcher() i=1 2024-09-22T09:53:52.586 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.584+0000 7f3b9e72a800 20 remove_watcher() i=2 2024-09-22T09:53:52.587 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.586+0000 7f3b9e72a800 20 remove_watcher() i=3 2024-09-22T09:53:52.589 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.587+0000 7f3b9e72a800 20 remove_watcher() i=4 2024-09-22T09:53:52.590 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.588+0000 7f3b9e72a800 20 remove_watcher() i=5 2024-09-22T09:53:52.591 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.589+0000 7f3b9e72a800 20 remove_watcher() i=6 2024-09-22T09:53:52.592 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.590+0000 7f3b9e72a800 20 remove_watcher() i=7 2024-09-22T09:53:52.604 INFO:tasks.workunit.client.0.smithi039.stderr:rados -p default.rgw.buckets.data ls | grep 170a0e66-07f6-4a36-8f67-7b5c88e94775 2024-09-22T09:53:52.630 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:52.630 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:52.673 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:52.672+0000 7fee190e7640 0 -- 172.21.15.39:0/3599253099 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7fee040ad290 msgr2=0x7fee040a4d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:52.681 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-22T09:53:52.682 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:52.684 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:52.684 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:52.714 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:52.714 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:52.752 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:52.752 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:52.781 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-22T09:53:54.205 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.206 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:54.299 INFO:tasks.workunit.client.0.smithi039.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-22T09:53:54.300 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-22T09:53:54.738 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.738 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:54.810 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.810 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:54.855 INFO:tasks.workunit.client.0.smithi039.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-22T09:53:54.856 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-22T09:53:54.857 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.857 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:54.922 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.922 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:54.981 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:54.981 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:55.018 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-22T09:53:56.436 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:56.436 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:56.501 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:56.501 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:58.578 INFO:tasks.workunit.client.0.smithi039.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-22T09:53:59.010 INFO:tasks.workunit.client.0.smithi039.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-22T09:53:59.041 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:53:59.041 INFO:tasks.workunit.client.0.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:53:59.082 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.080+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.083 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 realm 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.082+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.084 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.083+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:59.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.083+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.084+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:53:59.085 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.084+0000 7f3032d26800 20 searching for the correct realm 2024-09-22T09:53:59.088 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.087+0000 7f302f1da640 0 -- 172.21.15.39:0/4946036 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f302406b060 msgr2=0x7f30240cb040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:59.092 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.091+0000 7f302e1d8640 0 -- 172.21.15.39:0/4946036 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f3028033b10 msgr2=0x7f3028010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.299 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.297+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 zone default found 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 4 Realm: () 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 zonegroup default 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.298+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.301 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.299+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.299+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.299+0000 7f3032d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:53:59.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.299+0000 7f3032d26800 20 started sync module instance, tier type = 2024-09-22T09:53:59.302 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.299+0000 7f3032d26800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=0 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=1 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=2 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=3 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=4 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=5 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.309+0000 7f3032d26800 20 add_watcher() i=6 2024-09-22T09:53:59.311 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.310+0000 7f3032d26800 20 add_watcher() i=7 2024-09-22T09:53:59.312 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.310+0000 7f3032d26800 2 all 8 watchers are set, enabling cache 2024-09-22T09:53:59.313 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.312+0000 7f2ee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:59.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:53:59.314 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 5 note: GC not initialized 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f2e5ffff640 20 reqs_thread_entry: start 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 20 init_complete bucket index max shards: 1 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 20 Filter name: none 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f2e5dffb640 20 reqs_thread_entry: start 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-22T09:53:59.315 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.313+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=209 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.782 : miss 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 20 rados->read ofs=0 len=0 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 20 rados_obj.operate() r=0 bl.length=431 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.782 info.flags=0x17 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.782 to cache LRU end 2024-09-22T09:53:59.316 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:530e834e-7701-4a35-ad82-1b0744ba8777.4617.782 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.314+0000 7f3032d26800 20 bucket index object: :.dir.530e834e-7701-4a35-ad82-1b0744ba8777.4617.782.0 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.315+0000 7f3032d26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.315+0000 7f3032d26800 1 NOTICE: finished all shards (0 entries found) 2024-09-22T09:53:59.317 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.316+0000 7f2ee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:53:59.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.318+0000 7f3032d26800 20 remove_watcher() i=0 2024-09-22T09:53:59.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.318+0000 7f3032d26800 2 removed watcher, disabling cache 2024-09-22T09:53:59.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.320+0000 7f3032d26800 20 remove_watcher() i=1 2024-09-22T09:53:59.322 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.321+0000 7f3032d26800 20 remove_watcher() i=2 2024-09-22T09:53:59.323 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.322+0000 7f3032d26800 20 remove_watcher() i=3 2024-09-22T09:53:59.324 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.323+0000 7f3032d26800 20 remove_watcher() i=4 2024-09-22T09:53:59.325 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.324+0000 7f3032d26800 20 remove_watcher() i=5 2024-09-22T09:53:59.326 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.325+0000 7f3032d26800 20 remove_watcher() i=6 2024-09-22T09:53:59.327 INFO:tasks.workunit.client.0.smithi039.stderr:2024-09-22T09:53:59.326+0000 7f3032d26800 20 remove_watcher() i=7 2024-09-22T09:53:59.339 INFO:tasks.workunit.client.0.smithi039.stderr:Deleting bucket versioning-bucket 2024-09-22T09:53:59.341 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:59.341 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:59.366 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-22T09:53:59.366 INFO:tasks.workunit.client.0.smithi039.stderr: warnings.warn( 2024-09-22T09:53:59.421 INFO:tasks.workunit.client.0.smithi039.stderr:Completed bucket versioning tests 2024-09-22T09:53:59.421 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-22T09:53:59.421 INFO:tasks.workunit.client.0.smithi039.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-22T09:53:59.421 INFO:tasks.workunit.client.0.smithi039.stdout:connected to https://localhost:443 2024-09-22T09:53:59.484 INFO:tasks.workunit.client.0.smithi039.stderr:+ deactivate 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ export PATH 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ hash -r 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' -n '' ']' 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset VIRTUAL_ENV 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ unset -f deactivate 2024-09-22T09:53:59.485 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo OK. 2024-09-22T09:53:59.486 INFO:tasks.workunit.client.0.smithi039.stdout:OK. 2024-09-22T09:53:59.487 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-22T09:53:59.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-22T09:53:59.569 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-22T09:53:59.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-22T09:53:59.945 DEBUG:teuthology.parallel:result is None 2024-09-22T09:53:59.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:53:59.985 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:53:59.985 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-22T09:54:00.055 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-22T09:54:00.055 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-22T09:54:00.064 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-22T09:54:00.073 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-22T09:54:00.073 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-22T09:54:00.074 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-22T09:54:00.159 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-22T09:54:00.159 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-22T09:54:00.217 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:54:00.217 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:54:00.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.253+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 realm 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:54:00.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.255+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.256+0000 7f7da0d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:54:00.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.256+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.257+0000 7f7da0d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:54:00.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.257+0000 7f7da0d28800 20 searching for the correct realm 2024-09-22T09:54:00.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.259+0000 7f7d9d2d7640 0 -- 172.21.15.39:0/2778436315 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f7d8802d060 msgr2=0x7f7d880663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:54:00.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.465+0000 7f7d97fff640 0 -- 172.21.15.39:0/2778436315 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f7d9804b960 msgr2=0x7f7d98002110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:54:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:54:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:54:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.671+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.672+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.672+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.672+0000 7f7da0d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.672+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 zone default found 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 4 Realm: () 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 zonegroup default 2024-09-22T09:54:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.673+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.674+0000 7f7da0d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.674+0000 7f7da0d28800 20 started sync module instance, tier type = 2024-09-22T09:54:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.674+0000 7f7da0d28800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=0 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=1 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=2 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=3 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=4 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=5 2024-09-22T09:54:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.683+0000 7f7da0d28800 20 add_watcher() i=6 2024-09-22T09:54:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.684+0000 7f7da0d28800 20 add_watcher() i=7 2024-09-22T09:54:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.684+0000 7f7da0d28800 2 all 8 watchers are set, enabling cache 2024-09-22T09:54:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.687+0000 7f7c52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:54:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.687+0000 7f7da0d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:54:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.687+0000 7f7da0d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:54:00.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.727+0000 7f7c51fe3640 20 reqs_thread_entry: start 2024-09-22T09:54:00.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 20 init_complete bucket index max shards: 1 2024-09-22T09:54:00.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 20 Filter name: none 2024-09-22T09:54:00.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7bc37fe640 20 reqs_thread_entry: start 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 20 rados->read ofs=0 len=0 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 20 rados_obj.operate() r=0 bl.length=482 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.728+0000 7f7da0d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-22T09:54:00.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.729+0000 7f7da0d28800 10 removing key index: ICZNIPKNVZEIUPDVHUPG 2024-09-22T09:54:00.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.730+0000 7f7da0d28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:ICZNIPKNVZEIUPDVHUPG, ofs0, ns] 2024-09-22T09:54:00.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.731+0000 7f7c73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281433164 cookie 94220193959312 notifier 9486 bl.length()=170 2024-09-22T09:54:00.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.732+0000 7f7da0d28800 10 removing email index: tester.client.0_test@test.test 2024-09-22T09:54:00.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.733+0000 7f7da0d28800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-22T09:54:00.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.733+0000 7f7c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431751 cookie 94220193971776 notifier 9486 bl.length()=181 2024-09-22T09:54:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.735+0000 7f7da0d28800 10 removing user buckets index 2024-09-22T09:54:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.736+0000 7f7da0d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-22T09:54:00.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.736+0000 7f7c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431848 cookie 94220193978928 notifier 9486 bl.length()=172 2024-09-22T09:54:00.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.737+0000 7f7da0d28800 10 removing user index: tester.client.0 2024-09-22T09:54:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.739+0000 7f7da0d28800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-22T09:54:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.739+0000 7f7da0d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-22T09:54:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.739+0000 7f7c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281432044 cookie 94220193974480 notifier 9486 bl.length()=164 2024-09-22T09:54:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.741+0000 7f7c52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:54:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.744+0000 7f7da0d28800 20 remove_watcher() i=0 2024-09-22T09:54:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.744+0000 7f7da0d28800 2 removed watcher, disabling cache 2024-09-22T09:54:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.745+0000 7f7da0d28800 20 remove_watcher() i=1 2024-09-22T09:54:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.746+0000 7f7da0d28800 20 remove_watcher() i=2 2024-09-22T09:54:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.747+0000 7f7da0d28800 20 remove_watcher() i=3 2024-09-22T09:54:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.749+0000 7f7da0d28800 20 remove_watcher() i=4 2024-09-22T09:54:00.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.750+0000 7f7da0d28800 20 remove_watcher() i=5 2024-09-22T09:54:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.751+0000 7f7da0d28800 20 remove_watcher() i=6 2024-09-22T09:54:00.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:00.752+0000 7f7da0d28800 20 remove_watcher() i=7 2024-09-22T09:54:00.766 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-22T09:54:00.779 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-22T09:54:00.792 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-22T09:54:00.850 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-22T09:54:00.860 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-22T09:54:00.860 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:54:00.867 INFO:tasks.rgw.client.0.smithi039.stdout:2024-09-22T09:54:00.863+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45049) UID: 0 2024-09-22T09:54:00.869 INFO:tasks.rgw.client.0.smithi039.stdout:2024-09-22T09:54:00.867+0000 a1c2240 -1 shutting down 2024-09-22T09:54:10.557 INFO:tasks.rgw.client.0.smithi039.stderr:==00:01:11:44.177 45053== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45053-by-root-on-??? 2024-09-22T09:54:10.557 INFO:tasks.rgw.client.0.smithi039.stderr:==00:01:11:44.177 45053== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45053-by-root-on-??? 2024-09-22T09:54:10.557 INFO:tasks.rgw.client.0.smithi039.stderr:==00:01:11:44.177 45053== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45053-by-root-on-??? 2024-09-22T09:54:11.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-22T09:54:13.064 INFO:tasks.rgw.client.0:Stopped 2024-09-22T09:54:13.064 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-22T09:54:13.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/vault-root-token 2024-09-22T09:54:13.182 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-22T09:54:13.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-22T09:54:13.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-22T09:54:13.264 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-22T09:54:13.364 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setuser ceph since I am not root 2024-09-22T09:54:13.364 INFO:teuthology.orchestra.run.smithi039.stderr:ignoring --setgroup ceph since I am not root 2024-09-22T09:54:13.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.399+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 realm 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.401+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.402+0000 7f728f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:54:13.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.402+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.403+0000 7f728f52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-22T09:54:13.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.403+0000 7f728f52e800 20 searching for the correct realm 2024-09-22T09:54:13.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.405+0000 7f728bade640 0 -- 172.21.15.39:0/2269114357 >> [v2:172.21.15.117:6800/575457324,v1:172.21.15.117:6801/575457324] conn(0x7f7280089070 msgr2=0x7f7280098920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-22T09:54:13.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.611+0000 7f728aadc640 0 -- 172.21.15.39:0/2269114357 >> [v2:172.21.15.39:6808/3239671675,v1:172.21.15.39:6809/3239671675] conn(0x7f728405c250 msgr2=0x7f728408e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-22T09:54:13.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got zonegroup_info.ffe40d26-8986-4e89-8238-5f965a742487 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got zone_info.530e834e-7701-4a35-ad82-1b0744ba8777 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.818+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 zone default found 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 4 Realm: () 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 4 ZoneGroup: default (ffe40d26-8986-4e89-8238-5f965a742487) 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 4 Zone: default (530e834e-7701-4a35-ad82-1b0744ba8777) 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-22T09:54:13.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 zonegroup default 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.819+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.820+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.820+0000 7f728f52e800 20 rados->read ofs=0 len=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.820+0000 7f728f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.820+0000 7f728f52e800 20 started sync module instance, tier type = 2024-09-22T09:54:13.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.820+0000 7f728f52e800 20 started zone id=530e834e-7701-4a35-ad82-1b0744ba8777 (name=default) with tier type = 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=0 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=1 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=2 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=3 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=4 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=5 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.831+0000 7f728f52e800 20 add_watcher() i=6 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.832+0000 7f728f52e800 20 add_watcher() i=7 2024-09-22T09:54:13.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.832+0000 7f728f52e800 2 all 8 watchers are set, enabling cache 2024-09-22T09:54:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.834+0000 7f7141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:54:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.834+0000 7f728f52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-22T09:54:13.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.834+0000 7f728f52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-22T09:54:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.876+0000 7f7140fe1640 20 reqs_thread_entry: start 2024-09-22T09:54:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.876+0000 7f728f52e800 20 init_complete bucket index max shards: 1 2024-09-22T09:54:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.876+0000 7f728f52e800 20 Filter name: none 2024-09-22T09:54:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.876+0000 7f70ba7fc640 20 reqs_thread_entry: start 2024-09-22T09:54:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.876+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-22T09:54:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.878+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.878+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:13.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5067231439081947665', time=2024-09-22T11:23:30.182865+0000, chain.objs.size()=3 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-FROZEN.2~rxq4-msihtr3hBsr-4t9bgokm2DcuZQ.1 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-FROZEN.2~rxq4-msihtr3hBsr-4t9bgokm2DcuZQ.2 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-FROZEN.2~rxq4-msihtr3hBsr-4t9bgokm2DcuZQ.3 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4173798282808818488', time=2024-09-22T11:23:46.264220+0000, chain.objs.size()=2 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.164__multipart_foo.2~IkPxGmZMgS0cSqFywjkBquTw6MK2va8.1 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.164__multipart_foo.2~IkPxGmZMgS0cSqFywjkBquTw6MK2va8.2 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7978741615055212182', time=2024-09-22T11:34:03.316645+0000, chain.objs.size()=6 2024-09-22T09:54:13.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.1 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.2 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.3 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.4 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.5 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.519__multipart_mymultipart.2~c7bnJOalEZ-DS4Lwpp-ODXX_LbbMazl.6 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~JGF8DztcTaGAfnGvQhlSmo-VsPEpdzl', time=2024-09-22T11:37:22.803470+0000, chain.objs.size()=2 2024-09-22T09:54:13.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.879+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.529__multipart_mymultipart.2~JGF8DztcTaGAfnGvQhlSmo-VsPEpdzl.1 2024-09-22T09:54:13.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.881+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.529__multipart_mymultipart.2~JGF8DztcTaGAfnGvQhlSmo-VsPEpdzl.2 2024-09-22T09:54:13.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.886+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.888+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-22T09:54:13.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.890+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_w4Rt1j-4Dc7zgA1wvnhvP848BgPDG8_', time=2024-09-22T11:23:10.593987+0000, chain.objs.size()=1 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.KqeopHZiedXB_Z4Ip-QMXHh530QpRIj_1 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3072044141376598231', time=2024-09-22T11:33:18.958605+0000, chain.objs.size()=6 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:13.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16382983163052668753', time=2024-09-22T11:39:03.703702+0000, chain.objs.size()=1 2024-09-22T09:54:13.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.891+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.561__multipart_mymultipart.2~nRuStKcHuCHQXI7ZlpzO38OEcqWE17-.1 2024-09-22T09:54:13.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.896+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.899+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-22T09:54:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.900+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.900+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6567033516943927614', time=2024-09-22T11:23:09.130905+0000, chain.objs.size()=2 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.7IkJAIhQ3wo5VqSKYFjJBI5luDGOIci_0 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.7IkJAIhQ3wo5VqSKYFjJBI5luDGOIci_1 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4601476492033189267', time=2024-09-22T11:33:19.326100+0000, chain.objs.size()=6 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:13.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5128570196022171436', time=2024-09-22T11:35:30.566652+0000, chain.objs.size()=6 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.1 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.atjKRV4fiZsQerGgHtCtDx8E7ROSfhOV.2 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.3 2024-09-22T09:54:13.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.901+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.4 2024-09-22T09:54:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.904+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.5 2024-09-22T09:54:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.904+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.6 2024-09-22T09:54:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.904+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~TuxuWbG3xj28WCJUKhRkW3yVZrvHFxg', time=2024-09-22T11:48:59.052728+0000, chain.objs.size()=1 2024-09-22T09:54:13.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.904+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.742__multipart_mymultipart.2~TuxuWbG3xj28WCJUKhRkW3yVZrvHFxg.1 2024-09-22T09:54:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.910+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.912+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-22T09:54:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.914+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.914+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~K7l7iMLAaHe6divzwYpb2zWdEkmDu9h', time=2024-09-22T11:24:33.841006+0000, chain.objs.size()=1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.201__multipart_mymultipart.2~K7l7iMLAaHe6divzwYpb2zWdEkmDu9h.1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G', time=2024-09-22T11:34:45.845353+0000, chain.objs.size()=1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.9891523438370152243', time=2024-09-22T11:36:33.803438+0000, chain.objs.size()=1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~7YN2UQT6Q7pvzcO5svnca6-V3-P4ecr.1 2024-09-22T09:54:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~E7iROtEXsEGZkL5gGM8_UdVRmmxvGAi', time=2024-09-22T11:37:31.891162+0000, chain.objs.size()=1 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.534__multipart_mymultipart.2~E7iROtEXsEGZkL5gGM8_UdVRmmxvGAi.1 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.18127899344894739428', time=2024-09-22T11:47:17.214385+0000, chain.objs.size()=6 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.1 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.2 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.3 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.4 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.5 2024-09-22T09:54:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.915+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.661__multipart_baz.2~wwzdilFM9Fghv1kIr43ne-GalXHbbmZ.6 2024-09-22T09:54:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.920+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.923+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-22T09:54:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.924+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.924+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:13.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='__dgF2JEI9rSMNGLdAByGIhCYF4MnVxx', time=2024-09-22T11:23:04.843850+0000, chain.objs.size()=1 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.tMiisRlnZYJ_559WBXhYhiECKeCUxRu_1 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13623501027460435560', time=2024-09-22T11:33:21.167579+0000, chain.objs.size()=1 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.511__multipart_mymultipart.2~JE-nYOsc_xc1-4trYpxp6sAtgUyKMyy.1 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12938158429547807371', time=2024-09-22T11:36:37.410379+0000, chain.objs.size()=2 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~hIBlwOsdpamGt0IYTU490DeNkdTOfPR.1 2024-09-22T09:54:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.925+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~hIBlwOsdpamGt0IYTU490DeNkdTOfPR.2 2024-09-22T09:54:13.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.928+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.930+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-22T09:54:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.931+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_9opyUgoEq0n6YYt9WU-OFtvkSIR2FK4', time=2024-09-22T11:23:39.937791+0000, chain.objs.size()=1 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.163__shadow_.SNe6DZl1XitQJ1drrna0Z8KwZt0cByT_0 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5707564510572379080', time=2024-09-22T11:34:35.129386+0000, chain.objs.size()=2 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.520__shadow:pCXvlAjIYPlYXLHFFRi4.T5pukxXHTh_.OuwpwM4FU1j3da31_na0rPeOqW9CKlL_1 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.520__shadow:pCXvlAjIYPlYXLHFFRi4.T5pukxXHTh_.OuwpwM4FU1j3da31_na0rPeOqW9CKlL_2 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.780662364780522717', time=2024-09-22T11:37:54.563865+0000, chain.objs.size()=1 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.536__multipart_mymultipart.2~RIHSiHuiGoGWESp11jvwEXifGLKwbpW.1 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~DQ2A53HdOu8eOFE7yCDPcddW90e6Cu_', time=2024-09-22T11:39:03.964210+0000, chain.objs.size()=1 2024-09-22T09:54:13.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.932+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.561__multipart_mymultipart.2~DQ2A53HdOu8eOFE7yCDPcddW90e6Cu_.1 2024-09-22T09:54:13.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.934+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.937+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-22T09:54:13.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.938+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:13.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_W3BQ0zcUOjqeFPXb1yUmnl00Jxye7u4', time=2024-09-22T11:23:39.964323+0000, chain.objs.size()=1 2024-09-22T09:54:13.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.163__shadow_.6hMRZrJFLgyirwclSx6iDiXmvIQnQi1_0 2024-09-22T09:54:13.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15542021910443842508', time=2024-09-22T11:33:32.439936+0000, chain.objs.size()=1 2024-09-22T09:54:13.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.939+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.518__multipart_mymultipart.2~iD7QAvyRna_4fA4ceEeykLGka9m6zkT.1 2024-09-22T09:54:13.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.940+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.943+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-22T09:54:13.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.944+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.944+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:13.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_0t3IF68gdt9SKQbyxTzf7-zy27AMuQf', time=2024-09-22T11:23:46.398065+0000, chain.objs.size()=2 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.165__shadow_.UaOsBquwcYRF9Ac9h-WXiz-Ge39I40Y_0 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.165__shadow_.UaOsBquwcYRF9Ac9h-WXiz-Ge39I40Y_1 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W', time=2024-09-22T11:46:07.273642+0000, chain.objs.size()=6 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.1 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.2 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.3 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.4 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.5 2024-09-22T09:54:13.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.945+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.625__multipart_multipart_enc.2~rSUAMNvVgWsmICT3LPjfcrYZwDzqL-W.6 2024-09-22T09:54:13.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.949+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.951+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-22T09:54:13.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.953+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.953+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.953+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:13.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.953+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG', time=2024-09-22T11:35:30.547347+0000, chain.objs.size()=1 2024-09-22T09:54:13.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.3 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15376259468637279440', time=2024-09-22T11:45:48.910305+0000, chain.objs.size()=6 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.1 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.2 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.3 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.4 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.5 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.623__multipart_multipart_enc.2~iFsxXIaMbVcK1uljr43PiAIb9uZafnQ.6 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15367310271603971962', time=2024-09-22T11:49:04.860274+0000, chain.objs.size()=3 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.743__multipart_mymultipart3.2~gF0mq4IolJHiadxN7EdKoItaQCODuHD.1 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.743__multipart_mymultipart3.2~gF0mq4IolJHiadxN7EdKoItaQCODuHD.2 2024-09-22T09:54:13.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.954+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.743__multipart_mymultipart3.2~gF0mq4IolJHiadxN7EdKoItaQCODuHD.3 2024-09-22T09:54:13.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.959+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.962+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-22T09:54:13.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.963+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.963+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_Kez4KIWWw3UYCWjOeCxcbLYc3J8PxK4', time=2024-09-22T11:23:11.957792+0000, chain.objs.size()=1 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.0O7wclH9YZk10fYJxW6NT2EC-X2x9QB_0 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_gj2ld2I2qs8YvmImuZrgZurlYx7RAbC', time=2024-09-22T11:23:31.907371+0000, chain.objs.size()=2 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.bkOpltEkxH1M9d7sxZwvgR-BLG7jofB_1 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.bkOpltEkxH1M9d7sxZwvgR-BLG7jofB_2 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_O07vBlNZs-9Mx6U_a85Mlj9NdYARBEo', time=2024-09-22T11:23:33.500753+0000, chain.objs.size()=1 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.Cl77VC5grucCsaILv9xVWjZifSjnSCP_0 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~Hnp-4Pv_HXRGtwvVE8QpXbJFjPCTnsz', time=2024-09-22T11:37:36.825991+0000, chain.objs.size()=1 2024-09-22T09:54:13.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.964+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.535__multipart_mymultipart.2~Hnp-4Pv_HXRGtwvVE8QpXbJFjPCTnsz.3 2024-09-22T09:54:13.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.966+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.968+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-22T09:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.970+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.970+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.970+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.970+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.17845383383025206253', time=2024-09-22T11:36:48.601815+0000, chain.objs.size()=1 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.971+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~nf8IneJZHbGXjtdZqlpSLs0VoLyU8Gq.1 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.971+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~wng1G349gz4MWnEh_dnPjOFS2MOr_hv', time=2024-09-22T11:37:28.956627+0000, chain.objs.size()=2 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.971+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.531__multipart_mymultipart.2~wng1G349gz4MWnEh_dnPjOFS2MOr_hv.1 2024-09-22T09:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.971+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.531__multipart_mymultipart.2~wng1G349gz4MWnEh_dnPjOFS2MOr_hv.2 2024-09-22T09:54:13.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.972+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.975+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-22T09:54:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.976+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.976+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.188443858404942041', time=2024-09-22T11:33:18.954856+0000, chain.objs.size()=6 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3487477092562179152', time=2024-09-22T11:34:35.345783+0000, chain.objs.size()=3 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~HjybPZMkcMVANtmw9_TbIpa77RSMBXs.1 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~HjybPZMkcMVANtmw9_TbIpa77RSMBXs.2 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~HjybPZMkcMVANtmw9_TbIpa77RSMBXs.3 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2131504452406322834', time=2024-09-22T11:35:08.894738+0000, chain.objs.size()=6 2024-09-22T09:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.UIivfga0BR95wuzmDBKTRrnbVhX6IwFR.1 2024-09-22T09:54:13.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.2 2024-09-22T09:54:13.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.977+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.3 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.4 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.5 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~xF61wxDuEas_vSRAhb5kWUizLWcfK4G.6 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12599870936010236452', time=2024-09-22T11:37:06.110831+0000, chain.objs.size()=2 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.524__shadow_.z0h-14mIBs4tSs_fVff1IMTvUdkMP9C_1 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.981+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.524__shadow_.z0h-14mIBs4tSs_fVff1IMTvUdkMP9C_2 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2882672249240843634', time=2024-09-22T11:43:10.057948+0000, chain.objs.size()=6 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.1 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.2 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.3 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.4 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.5 2024-09-22T09:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.982+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.615__multipart_multipart_enc.2~Hn82tCloqxYlZWzCIKx38hkDJbseOVP.6 2024-09-22T09:54:13.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.989+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:13.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.992+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-22T09:54:13.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:13.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:13.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:13.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15389720753102665484', time=2024-09-22T11:33:18.958778+0000, chain.objs.size()=6 2024-09-22T09:54:13.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:13.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13695792507014247584', time=2024-09-22T11:33:19.149854+0000, chain.objs.size()=6 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:13.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.994+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.997+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12243459462073431127', time=2024-09-22T11:37:19.340115+0000, chain.objs.size()=2 2024-09-22T09:54:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.997+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.528__multipart_mymultipart.2~J1uc0QWQrg2WAjwwjzE5E4kGtv7S7c6.1 2024-09-22T09:54:13.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:13.997+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.528__multipart_mymultipart.2~J1uc0QWQrg2WAjwwjzE5E4kGtv7S7c6.2 2024-09-22T09:54:14.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.001+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.003+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-22T09:54:14.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.004+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.004+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_g5bVCncVi4sl4DkYNd4UjWXeWiotTKx', time=2024-09-22T11:22:59.041343+0000, chain.objs.size()=1 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.f0CHnML2lplHCBO8Vf8h7xSax9MSO6c_0 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7253186426907535805', time=2024-09-22T11:32:36.891147+0000, chain.objs.size()=3 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_1 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_2 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_3 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.9561092566650350580', time=2024-09-22T11:34:30.845552+0000, chain.objs.size()=3 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~RqBXQwBx2hB3zpPHqn8w4OEx3xewYI1.1 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~RqBXQwBx2hB3zpPHqn8w4OEx3xewYI1.2 2024-09-22T09:54:14.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.005+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~RqBXQwBx2hB3zpPHqn8w4OEx3xewYI1.3 2024-09-22T09:54:14.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.007+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.010+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-22T09:54:14.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.011+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:14.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_ZltivshHxwByYvQBLB0U4MD7fjFrKsP', time=2024-09-22T11:23:11.903536+0000, chain.objs.size()=2 2024-09-22T09:54:14.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.otUtxlomq-mcKJr_25IETOvGLfYZaAZ_0 2024-09-22T09:54:14.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.otUtxlomq-mcKJr_25IETOvGLfYZaAZ_1 2024-09-22T09:54:14.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6183304707658043411', time=2024-09-22T11:33:27.702970+0000, chain.objs.size()=1 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.516__multipart_mymultipartcopy.2~Ye9Ttxl0Tp-_b4y11D3GMFQ2M-uioLS.1 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ', time=2024-09-22T11:35:08.874346+0000, chain.objs.size()=1 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~QQ-I-sqzrtjzZ7oks8TOYgae_od-DpZ.2 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.9829772309802891182', time=2024-09-22T11:36:16.608989+0000, chain.objs.size()=6 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.1 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.yKpohPfxXRJsYfqicriPjsyld-NnPQJL.2 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.8TULSNgH5OpKYts_De_t9tlwknIZe05P.3 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.4 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.5 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.6 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.11192039668926977196', time=2024-09-22T11:37:50.966333+0000, chain.objs.size()=4 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.535__multipart_mymultipart.2~Hnp-4Pv_HXRGtwvVE8QpXbJFjPCTnsz.1 2024-09-22T09:54:14.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.012+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.535__multipart_mymultipart.2~Hnp-4Pv_HXRGtwvVE8QpXbJFjPCTnsz.2 2024-09-22T09:54:14.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.015+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.535__multipart_mymultipart.1EIQ6530ayT_S69sH3Jtwe8aqgu1bZ19.3 2024-09-22T09:54:14.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.017+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.535__multipart_mymultipart.2~Hnp-4Pv_HXRGtwvVE8QpXbJFjPCTnsz.4 2024-09-22T09:54:14.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.020+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.022+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-22T09:54:14.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.023+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.024+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.024+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.025+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-22T09:54:14.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.026+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14197201353958611439', time=2024-09-22T11:22:45.820678+0000, chain.objs.size()=2 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.158__shadow_.hUHDTY-qHomyB33GWVW23BwESmmJ7Rz_0 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.158__shadow_.hUHDTY-qHomyB33GWVW23BwESmmJ7Rz_1 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7402655293146093035', time=2024-09-22T11:23:03.332261+0000, chain.objs.size()=2 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.h_YA1DSu3lA2HsQcsskVqMbgUehDNp5_0 2024-09-22T09:54:14.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.h_YA1DSu3lA2HsQcsskVqMbgUehDNp5_1 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_PKeDIaHtE3LTosiUPGVKyZ_2KdiG4W3', time=2024-09-22T11:23:33.446740+0000, chain.objs.size()=2 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.uNZ1G49gpkGtk3oMt4_YVJetBxuY4lc_0 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.uNZ1G49gpkGtk3oMt4_YVJetBxuY4lc_1 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y', time=2024-09-22T11:45:58.130773+0000, chain.objs.size()=6 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.1 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.2 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.3 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.4 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.5 2024-09-22T09:54:14.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.027+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.624__multipart_multipart_enc.2~0xbMLCzevp9e9uIf3mdmNKYpuB3S63y.6 2024-09-22T09:54:14.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.031+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12260177950671102969', time=2024-09-22T11:48:51.088835+0000, chain.objs.size()=10 2024-09-22T09:54:14.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.031+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.1 2024-09-22T09:54:14.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.031+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.2 2024-09-22T09:54:14.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.3 2024-09-22T09:54:14.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.4 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.5 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.6 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.7 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.8 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.9 2024-09-22T09:54:14.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.032+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.735__multipart_foo.2~zIjBKJokB7cATGio4yRSj8xTgwftH1p.10 2024-09-22T09:54:14.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.038+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.041+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-22T09:54:14.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.042+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-22T09:54:14.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_QO6ORLMBNcHoRKcixSSKE4VhcmCWTHh', time=2024-09-22T11:23:11.930871+0000, chain.objs.size()=2 2024-09-22T09:54:14.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.dA3cZhfK8c_Q3uEDqck4QBytxqFjSot_0 2024-09-22T09:54:14.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.160__shadow_.dA3cZhfK8c_Q3uEDqck4QBytxqFjSot_1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.1290319642852822030', time=2024-09-22T11:32:36.891759+0000, chain.objs.size()=3 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_2 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.486__shadow_.8AVCgUzAfbfZPMZjRM02GlEmWU86SQ4_3 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.572855+0000, chain.objs.size()=1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.576470+0000, chain.objs.size()=1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.2 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.579903+0000, chain.objs.size()=1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.3 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.583321+0000, chain.objs.size()=1 2024-09-22T09:54:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.4 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.586680+0000, chain.objs.size()=1 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.5 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr', time=2024-09-22T11:36:16.589893+0000, chain.objs.size()=1 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~2T6g85UPEyS9mSP7eom2mn48ZqxxDqr.6 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13138924213905211823', time=2024-09-22T11:40:44.391371+0000, chain.objs.size()=4 2024-09-22T09:54:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.043+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~CpSxSCp0ohBcX0jBsivLOkj0OFP4krK.1 2024-09-22T09:54:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.048+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~CpSxSCp0ohBcX0jBsivLOkj0OFP4krK.2 2024-09-22T09:54:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.050+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~CpSxSCp0ohBcX0jBsivLOkj0OFP4krK.3 2024-09-22T09:54:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.050+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~CpSxSCp0ohBcX0jBsivLOkj0OFP4krK.4 2024-09-22T09:54:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.050+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.14040109825339153844', time=2024-09-22T11:46:23.552982+0000, chain.objs.size()=1 2024-09-22T09:54:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.050+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.642__shadow_._U_CsdXyuFbahkT1ZW4BkjvzrDNoZ4j_1 2024-09-22T09:54:14.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.052+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.055+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-22T09:54:14.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.056+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.056+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_VlRQCwworgcWsXBFcJEmAXL4HttEnEn', time=2024-09-22T11:23:33.474919+0000, chain.objs.size()=2 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.bqOSUHBttfvTW6cbfToGqAH1JGqU4Yp_0 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.bqOSUHBttfvTW6cbfToGqAH1JGqU4Yp_1 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~zS2Sn6OL9W6duNoBNh9CbCTw2TPr8iT', time=2024-09-22T11:24:36.129840+0000, chain.objs.size()=1 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.202__multipart_mymultipart.2~zS2Sn6OL9W6duNoBNh9CbCTw2TPr8iT.1 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15590105091987106717', time=2024-09-22T11:42:08.613671+0000, chain.objs.size()=6 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.1 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.2 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.3 2024-09-22T09:54:14.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.4 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.5 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.613__multipart_multipart_enc.2~tFZgUxN58g3LZMR2S0kNZjvAS_oEKiM.6 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.10567626164325640333', time=2024-09-22T11:47:17.048821+0000, chain.objs.size()=6 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.1 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.2 2024-09-22T09:54:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.057+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.3 2024-09-22T09:54:14.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.060+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.4 2024-09-22T09:54:14.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.061+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.5 2024-09-22T09:54:14.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.062+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.660__multipart_bar.2~DTm_Imq6vdNzkfAZ1rWCz4cZKV2GhHd.6 2024-09-22T09:54:14.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.066+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.068+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-22T09:54:14.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.070+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.070+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.6754990560618645926', time=2024-09-22T11:22:54.737095+0000, chain.objs.size()=3 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-LUKEWARM.2~d9XRreqX1vCXb7YMyISKzDy3EHpGuEK.1 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-LUKEWARM.2~d9XRreqX1vCXb7YMyISKzDy3EHpGuEK.2 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-LUKEWARM.2~d9XRreqX1vCXb7YMyISKzDy3EHpGuEK.3 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4791754431790152219', time=2024-09-22T11:23:22.839704+0000, chain.objs.size()=3 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-LUKEWARM.2~KyByvXI5XAPSOwx812SFqJibqdso1In.1 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-LUKEWARM.2~KyByvXI5XAPSOwx812SFqJibqdso1In.2 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-LUKEWARM.2~KyByvXI5XAPSOwx812SFqJibqdso1In.3 2024-09-22T09:54:14.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12723162325780227180', time=2024-09-22T11:33:37.450952+0000, chain.objs.size()=1 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.518__multipart_mymultipart.2~2_Pqvpwi8ypfD2eq_NIKNShwhBn-eOh.1 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16385794558975880857', time=2024-09-22T11:47:49.982452+0000, chain.objs.size()=1 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.702__multipart_file1.2~_WeftJ2uhmypITMj-r-F35KDMBLwW_8.1 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4965088461974341953', time=2024-09-22T11:52:32.029828+0000, chain.objs.size()=3 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.779__shadow_.8uA85siuLf6MeoHQjs0YJAPTBOX4bkE_1 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.779__shadow_.8uA85siuLf6MeoHQjs0YJAPTBOX4bkE_2 2024-09-22T09:54:14.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.071+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.779__shadow_.8uA85siuLf6MeoHQjs0YJAPTBOX4bkE_3 2024-09-22T09:54:14.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.075+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.078+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-22T09:54:14.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.079+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.079+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_JBdN80P9hzm81gLs1ts7h6UorOIp0Ob', time=2024-09-22T11:23:46.424454+0000, chain.objs.size()=2 2024-09-22T09:54:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.165__shadow_.xap3Fd4JbaF5g1mqFzUyaF-jTiYg9Nh_0 2024-09-22T09:54:14.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.165__shadow_.xap3Fd4JbaF5g1mqFzUyaF-jTiYg9Nh_1 2024-09-22T09:54:14.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.11357137105005728407', time=2024-09-22T11:33:34.686096+0000, chain.objs.size()=1 2024-09-22T09:54:14.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.080+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.518__multipart_mymultipart.2~KvuK6jwqZBNCA8PTnERlBa_lc272qWr.1 2024-09-22T09:54:14.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.083+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.085+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-22T09:54:14.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.086+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.086+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:14.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.17459890133679525089', time=2024-09-22T11:23:15.884779+0000, chain.objs.size()=3 2024-09-22T09:54:14.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-STANDARD.2~-a2-DwrvZmjq3-cKX3qM0yv0_vxrOF0.1 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-STANDARD.2~-a2-DwrvZmjq3-cKX3qM0yv0_vxrOF0.2 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__multipart_foo-STANDARD.2~-a2-DwrvZmjq3-cKX3qM0yv0_vxrOF0.3 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY', time=2024-09-22T11:37:07.678195+0000, chain.objs.size()=10 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.1 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.2 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.3 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.4 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.5 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.6 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.7 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.8 2024-09-22T09:54:14.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.087+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.9 2024-09-22T09:54:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.091+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.526__multipart_mymultipart.2~tvJwwuRkzXaH0bYctpROW0t8hRr0PWY.10 2024-09-22T09:54:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.091+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16491726469917970591', time=2024-09-22T11:48:58.990949+0000, chain.objs.size()=1 2024-09-22T09:54:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.091+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.742__multipart_mymultipart3.2~a45V3CMEwRxWhFb0d8_zCY4TadKH-HN.1 2024-09-22T09:54:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.095+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.097+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-22T09:54:14.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.098+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.17951203993313801097', time=2024-09-22T11:22:54.768411+0000, chain.objs.size()=3 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-STANDARD.2~yudsSTm1shbGZKa-QcLMiXvkxXUMmUQ.1 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-STANDARD.2~yudsSTm1shbGZKa-QcLMiXvkxXUMmUQ.2 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-STANDARD.2~yudsSTm1shbGZKa-QcLMiXvkxXUMmUQ.3 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.12299942507886591349', time=2024-09-22T11:34:23.767955+0000, chain.objs.size()=3 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~3s0Iew9gZ9bItoNRTU79VaoYWAhGNWs.1 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~3s0Iew9gZ9bItoNRTU79VaoYWAhGNWs.2 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.521__multipart_mymultipart.2~3s0Iew9gZ9bItoNRTU79VaoYWAhGNWs.3 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3277304515332390205', time=2024-09-22T11:36:41.990489+0000, chain.objs.size()=3 2024-09-22T09:54:14.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~ANiPPW96G-nxWHgWapZP3w46Xw6KaNd.1 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~ANiPPW96G-nxWHgWapZP3w46Xw6KaNd.2 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~ANiPPW96G-nxWHgWapZP3w46Xw6KaNd.3 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.855701708604128487', time=2024-09-22T11:36:54.449479+0000, chain.objs.size()=2 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~TorfL42aK9U6GANYU4y3KasOioxRuy3.1 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~TorfL42aK9U6GANYU4y3KasOioxRuy3.2 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~YOZwOUXT3oR6fVcWAeHFg1ARQRhRKF4', time=2024-09-22T11:37:28.998818+0000, chain.objs.size()=1 2024-09-22T09:54:14.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.099+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.531__multipart_mymultipart2.2~YOZwOUXT3oR6fVcWAeHFg1ARQRhRKF4.1 2024-09-22T09:54:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5729981715895007751', time=2024-09-22T11:38:30.278754+0000, chain.objs.size()=1 2024-09-22T09:54:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.552__shadow_.O7tLdiZ_jlQUM151WJZ0eOISuwd4WlG_1 2024-09-22T09:54:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7623825254556374470', time=2024-09-22T11:38:46.770002+0000, chain.objs.size()=1 2024-09-22T09:54:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.555__shadow_.TQdYRMsC9383kL1DaTgtzWEBrUU9xb9_1 2024-09-22T09:54:14.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.13039648738317686905', time=2024-09-22T11:40:40.171149+0000, chain.objs.size()=4 2024-09-22T09:54:14.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~9kfnA1Lo7AMbR5uHvJrAH4tvEhXp-2f.1 2024-09-22T09:54:14.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~9kfnA1Lo7AMbR5uHvJrAH4tvEhXp-2f.2 2024-09-22T09:54:14.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~9kfnA1Lo7AMbR5uHvJrAH4tvEhXp-2f.3 2024-09-22T09:54:14.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.103+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~9kfnA1Lo7AMbR5uHvJrAH4tvEhXp-2f.4 2024-09-22T09:54:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.108+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.111+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-22T09:54:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.112+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.112+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15119578553551546040', time=2024-09-22T11:22:45.794287+0000, chain.objs.size()=2 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.158__shadow_.ZwxcpAw0Vg9jKaff4hMDcTWHcgxaPK0_0 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.158__shadow_.ZwxcpAw0Vg9jKaff4hMDcTWHcgxaPK0_1 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2302022362166303864', time=2024-09-22T11:33:19.330198+0000, chain.objs.size()=6 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.1 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.2 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.3 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.4 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.5 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.507__multipart_srcmultipart.2~HT1SSGGVkC9zMN9RA2pqRRJnEH4DvQ8.6 2024-09-22T09:54:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5058203375094486956', time=2024-09-22T11:36:58.628749+0000, chain.objs.size()=3 2024-09-22T09:54:14.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~kX85XvLOVP89RHQuvc6Njapca6tBeNo.1 2024-09-22T09:54:14.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~kX85XvLOVP89RHQuvc6Njapca6tBeNo.2 2024-09-22T09:54:14.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.113+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~kX85XvLOVP89RHQuvc6Njapca6tBeNo.3 2024-09-22T09:54:14.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.118+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.120+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-22T09:54:14.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.121+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-22T09:54:14.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA', time=2024-09-22T11:35:50.570308+0000, chain.objs.size()=1 2024-09-22T09:54:14.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.2 2024-09-22T09:54:14.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA', time=2024-09-22T11:35:50.574164+0000, chain.objs.size()=1 2024-09-22T09:54:14.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~ZcePagnAwQuoxBcKfaa0xBH_1lzk3VA.3 2024-09-22T09:54:14.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~fh6td4IUstmiEBY_5pV_zzPaEhVEz-T', time=2024-09-22T11:37:31.046566+0000, chain.objs.size()=1 2024-09-22T09:54:14.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.122+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.533__multipart_mymultipart.2~fh6td4IUstmiEBY_5pV_zzPaEhVEz-T.1 2024-09-22T09:54:14.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.124+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.126+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-22T09:54:14.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.127+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.166471205003622059', time=2024-09-22T11:22:54.709676+0000, chain.objs.size()=3 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-FROZEN.2~QRaOF0h-7YjUMZXGzp8rRw1Yn48GJCx.1 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-FROZEN.2~QRaOF0h-7YjUMZXGzp8rRw1Yn48GJCx.2 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:530e834e-7701-4a35-ad82-1b0744ba8777.4617.159__multipart_mymultipart-FROZEN.2~QRaOF0h-7YjUMZXGzp8rRw1Yn48GJCx.3 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.15900099904862289353', time=2024-09-22T11:33:38.286857+0000, chain.objs.size()=1 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.518__multipart_mymultipart.2~w3FXhIf9TaU309TBqBfq8mec7UoAYlQ.1 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.10082213784114092508', time=2024-09-22T11:37:06.290596+0000, chain.objs.size()=2 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~BUTjI0cXY6yLHiIjLoTQUQBFxe0UYr_.1 2024-09-22T09:54:14.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~BUTjI0cXY6yLHiIjLoTQUQBFxe0UYr_.2 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3525985694875165523', time=2024-09-22T11:37:14.162256+0000, chain.objs.size()=4 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.527__multipart_mymultipart.2~bREqq8doLfRUq0KmuYmtefNigHT0YPw.1 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.527__multipart_mymultipart.2~bREqq8doLfRUq0KmuYmtefNigHT0YPw.2 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.527__multipart_mymultipart.2~bREqq8doLfRUq0KmuYmtefNigHT0YPw.3 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.527__multipart_mymultipart.2~bREqq8doLfRUq0KmuYmtefNigHT0YPw.4 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7917542089159341407', time=2024-09-22T11:38:37.649663+0000, chain.objs.size()=1 2024-09-22T09:54:14.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.128+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.554__shadow_.zvMFk-rBuSqP-T_s5xKqWKbHFZTj-L6_1 2024-09-22T09:54:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.133+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.136+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-22T09:54:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.137+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.138+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.138+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.139+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-22T09:54:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.140+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.7432307519837835141', time=2024-09-22T11:30:44.634578+0000, chain.objs.size()=1 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.367__shadow_.xxBBOBIjl2NbeivBo7HXaocwQTLh6jJ_1 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.1826180811649259745', time=2024-09-22T11:37:02.964609+0000, chain.objs.size()=3 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~0pM-d2P2l7bFQo0XhLfWB2hrBkNuBKX.1 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~0pM-d2P2l7bFQo0XhLfWB2hrBkNuBKX.2 2024-09-22T09:54:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.141+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~0pM-d2P2l7bFQo0XhLfWB2hrBkNuBKX.3 2024-09-22T09:54:14.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.145+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.147+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-22T09:54:14.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.149+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.149+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.149+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.149+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.18346148334171194434', time=2024-09-22T11:33:25.068806+0000, chain.objs.size()=1 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.149+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.513__multipart_mymultipart.2~1cfCkwbaBSrT1_WfSE-zYjSOOY8r9Z0.1 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.10223029202786745320', time=2024-09-22T11:36:30.118896+0000, chain.objs.size()=6 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.kZwSSMjdcdvYpWpz5pFLmqvuLrzmBc3n.1 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.WDL7qdstvgSVUQINHfnjhl8MiTWfC762.2 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.F1ADDQKhxgr0kQEH5s3-3PBQClGGexTF.3 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.X2j9V_94sOGNT6jmqiXfY28Vc5Iqg2Jf.4 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.EGE7vygrcpflMQAIl9OiFVS-WdrlBGg8.5 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.clG-0DEGVME7g-ycg4MUaud5NuImjUVk.6 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~4LlmyA78ST1YeD-yvG4jQcqcProZDd2', time=2024-09-22T11:37:28.919950+0000, chain.objs.size()=1 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.531__multipart_mymultipart.2~4LlmyA78ST1YeD-yvG4jQcqcProZDd2.1 2024-09-22T09:54:14.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.2050647574952679845', time=2024-09-22T11:40:33.859146+0000, chain.objs.size()=4 2024-09-22T09:54:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~Z-oayjsD45ILFTJCDkrZdwsES2geEs_.1 2024-09-22T09:54:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~Z-oayjsD45ILFTJCDkrZdwsES2geEs_.2 2024-09-22T09:54:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~Z-oayjsD45ILFTJCDkrZdwsES2geEs_.3 2024-09-22T09:54:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.150+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.578__multipart_testobj.2~Z-oayjsD45ILFTJCDkrZdwsES2geEs_.4 2024-09-22T09:54:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.153+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.99135183677948140', time=2024-09-22T11:42:59.735958+0000, chain.objs.size()=6 2024-09-22T09:54:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.153+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.1 2024-09-22T09:54:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.153+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.2 2024-09-22T09:54:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.153+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.3 2024-09-22T09:54:14.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.155+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.4 2024-09-22T09:54:14.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.155+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.5 2024-09-22T09:54:14.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.155+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.614__multipart_multipart_enc.2~R6bbdmrNipnNX3dbeedqtMPfhJbgWDp.6 2024-09-22T09:54:14.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.160+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.163+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-22T09:54:14.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.164+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.164+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_lzZS12kAEbuazffsds2rR9zk9TG2uT-', time=2024-09-22T11:23:17.279536+0000, chain.objs.size()=1 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.GPNtVkXrkAeuiv5olC2wY1qKRO-0iE2_0 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5797183780437424436', time=2024-09-22T11:36:35.152507+0000, chain.objs.size()=2 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~Uq9XyySTE66yX4-U8PKIsYGmERBHhFt.1 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~Uq9XyySTE66yX4-U8PKIsYGmERBHhFt.2 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3324238096933070424', time=2024-09-22T11:36:39.729015+0000, chain.objs.size()=3 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~tA4yG30lgSiNThD5Y7aIP9rrhfwR4GB.1 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~tA4yG30lgSiNThD5Y7aIP9rrhfwR4GB.2 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~tA4yG30lgSiNThD5Y7aIP9rrhfwR4GB.3 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5164132782051031686', time=2024-09-22T11:36:42.199837+0000, chain.objs.size()=2 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~8teZMTa9iGTH-cq2ZE6R5XkiRKlwFnx.1 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.523__multipart_mymultipart.2~8teZMTa9iGTH-cq2ZE6R5XkiRKlwFnx.2 2024-09-22T09:54:14.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.10305637633149966817', time=2024-09-22T11:47:17.406262+0000, chain.objs.size()=6 2024-09-22T09:54:14.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.1 2024-09-22T09:54:14.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.2 2024-09-22T09:54:14.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.3 2024-09-22T09:54:14.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.165+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.4 2024-09-22T09:54:14.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.167+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.5 2024-09-22T09:54:14.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.168+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.662__multipart_foo.2~a_2HOpZPBVss-9D4V1KsrUiVQAQpZnV.6 2024-09-22T09:54:14.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.169+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.16516494711491668144', time=2024-09-22T11:47:57.888904+0000, chain.objs.size()=1 2024-09-22T09:54:14.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.169+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.711__multipart_file1.2~nL1viWmpE1CrMXhliAptbUc_eoYQ02s.1 2024-09-22T09:54:14.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.172+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.174+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-22T09:54:14.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.5929917695339837126', time=2024-09-22T11:36:51.262127+0000, chain.objs.size()=2 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~crGbW9_Fq9NrVOtlD6DuddmvSjgEVlt.1 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.525__multipart_mymultipart.2~crGbW9_Fq9NrVOtlD6DuddmvSjgEVlt.2 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.3296293642059188321', time=2024-09-22T11:39:04.377746+0000, chain.objs.size()=1 2024-09-22T09:54:14.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.176+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.561__multipart_mymultipart.r3yyZxUprVa3IcS5JEItly_7YvtIqX6a.1 2024-09-22T09:54:14.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.178+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.181+0000 7f728f52e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-22T09:54:14.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.182+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-22T09:54:14.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.182+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='_P3WLuOXeqpCcQMCrF9Yijt9lAORAGpG', time=2024-09-22T11:23:24.633421+0000, chain.objs.size()=2 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.Mfa-EF6WWRoZmHp3E-HSklejvwoTNv3_1 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.161__shadow_.Mfa-EF6WWRoZmHp3E-HSklejvwoTNv3_2 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.602479104639115', time=2024-09-22T11:35:50.593868+0000, chain.objs.size()=6 2024-09-22T09:54:14.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.1 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.2 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.pNZYvDZ3Yiy27RvBDSvJmexLV3BRD9G_.3 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.4 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.5 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.522__multipart_mymultipart.2~9TEKI7IFLTNfroxPzqmt9j7XYShA8qG.6 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='530e834e-7701-4a35-ad82-1b0744ba8777.4617.4671338701894429620', time=2024-09-22T11:39:11.799631+0000, chain.objs.size()=1 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.563__shadow_.ju3jQH95GgrWdTR-aDZYMxRxuvdtMJg_1 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 20 garbage collection: RGWGC::process iterating over entry tag='2~KBmfL-Li-hupoodc1wFR2Uy5ygsUM88', time=2024-09-22T11:48:59.068829+0000, chain.objs.size()=1 2024-09-22T09:54:14.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.183+0000 7f728f52e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:530e834e-7701-4a35-ad82-1b0744ba8777.4617.742__multipart_mymultipart2.2~KBmfL-Li-hupoodc1wFR2Uy5ygsUM88.1 2024-09-22T09:54:14.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.188+0000 7f728f52e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-22T09:54:14.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.191+0000 7f7141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-22T09:54:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.193+0000 7f728f52e800 20 remove_watcher() i=0 2024-09-22T09:54:14.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.193+0000 7f728f52e800 2 removed watcher, disabling cache 2024-09-22T09:54:14.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.194+0000 7f728f52e800 20 remove_watcher() i=1 2024-09-22T09:54:14.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.195+0000 7f728f52e800 20 remove_watcher() i=2 2024-09-22T09:54:14.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.196+0000 7f728f52e800 20 remove_watcher() i=3 2024-09-22T09:54:14.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.197+0000 7f728f52e800 20 remove_watcher() i=4 2024-09-22T09:54:14.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.198+0000 7f728f52e800 20 remove_watcher() i=5 2024-09-22T09:54:14.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.199+0000 7f728f52e800 20 remove_watcher() i=6 2024-09-22T09:54:14.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-22T09:54:14.200+0000 7f728f52e800 20 remove_watcher() i=7 2024-09-22T09:54:14.213 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-22T09:54:14.224 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-22T09:54:14.253 DEBUG:teuthology.orchestra.run.smithi039:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-22T09:54:14.322 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-22T09:54:14.392 DEBUG:teuthology.orchestra.run.smithi039:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-22T09:54:14.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-22T09:54:14.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo update-ca-trust 2024-09-22T09:54:15.602 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T09:54:15.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T09:54:15.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:54:15.955 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:15.967 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:54:15.970 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2426,"stamp":"2024-09-22T09:54:14.419148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680510898,"num_objects":774,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":774,"num_whiteouts":0,"num_read":189991,"num_read_kb":2910016,"num_write":128503,"num_write_kb":2504237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13206,"ondisk_log_size":13206,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389368,"kb_used_data":1018296,"kb_used_omap":12,"kb_used_meta":1370931,"kb_avail":752585352,"statfs":{"total":773094113280,"available":770647400448,"internally_reserved":0,"allocated":1042735104,"data_stored":1026849634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1403833905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1160,"num_objects":-8,"num_object_clones":0,"num_object_copies":-18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004713"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.684355+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.684355+0000","last_peered":"2024-09-22T09:51:12.684355+0000","last_clean":"2024-09-22T09:51:12.684355+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:51:12.684355+0000","last_undegraded":"2024-09-22T09:51:12.684355+0000","last_fullsized":"2024-09-22T09:51:12.684355+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.689100+0000","last_change":"2024-09-22T09:20:12.873395+0000","last_active":"2024-09-22T09:50:12.689100+0000","last_peered":"2024-09-22T09:50:12.689100+0000","last_clean":"2024-09-22T09:50:12.689100+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:50:12.689100+0000","last_undegraded":"2024-09-22T09:50:12.689100+0000","last_fullsized":"2024-09-22T09:50:12.689100+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:11.074090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558208+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:51:12.558208+0000","last_peered":"2024-09-22T09:51:12.558208+0000","last_clean":"2024-09-22T09:51:12.558208+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:51:12.558208+0000","last_undegraded":"2024-09-22T09:51:12.558208+0000","last_fullsized":"2024-09-22T09:51:12.558208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":8,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434594+0000","last_change":"2024-09-22T09:01:07.465099+0000","last_active":"2024-09-22T09:51:07.434594+0000","last_peered":"2024-09-22T09:51:07.434594+0000","last_clean":"2024-09-22T09:51:07.434594+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:51:07.434594+0000","last_undegraded":"2024-09-22T09:51:07.434594+0000","last_fullsized":"2024-09-22T09:51:07.434594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:59.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694907+0000","last_change":"2024-09-22T08:57:04.397022+0000","last_active":"2024-09-22T09:51:12.694907+0000","last_peered":"2024-09-22T09:51:12.694907+0000","last_clean":"2024-09-22T09:51:12.694907+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:51:12.694907+0000","last_undegraded":"2024-09-22T09:51:12.694907+0000","last_fullsized":"2024-09-22T09:51:12.694907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:59.048334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694918+0000","last_change":"2024-09-22T09:01:07.467647+0000","last_active":"2024-09-22T09:51:12.694918+0000","last_peered":"2024-09-22T09:51:12.694918+0000","last_clean":"2024-09-22T09:51:12.694918+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:51:12.694918+0000","last_undegraded":"2024-09-22T09:51:12.694918+0000","last_fullsized":"2024-09-22T09:51:12.694918+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:12.140780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632785,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":619,"num_write":2,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651709+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:49:37.651709+0000","last_peered":"2024-09-22T09:49:37.651709+0000","last_clean":"2024-09-22T09:49:37.651709+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:49:37.651709+0000","last_undegraded":"2024-09-22T09:49:37.651709+0000","last_fullsized":"2024-09-22T09:49:37.651709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:53.738400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651360+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:49:37.651360+0000","last_peered":"2024-09-22T09:49:37.651360+0000","last_clean":"2024-09-22T09:49:37.651360+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:49:37.651360+0000","last_undegraded":"2024-09-22T09:49:37.651360+0000","last_fullsized":"2024-09-22T09:49:37.651360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:52.455370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.656003+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:50:12.656003+0000","last_peered":"2024-09-22T09:50:12.656003+0000","last_clean":"2024-09-22T09:50:12.656003+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:50:12.656003+0000","last_undegraded":"2024-09-22T09:50:12.656003+0000","last_fullsized":"2024-09-22T09:50:12.656003+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.670273+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:49:37.670273+0000","last_peered":"2024-09-22T09:49:37.670273+0000","last_clean":"2024-09-22T09:49:37.670273+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:49:37.670273+0000","last_undegraded":"2024-09-22T09:49:37.670273+0000","last_fullsized":"2024-09-22T09:49:37.670273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:49.468579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650455+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:49:27.650455+0000","last_peered":"2024-09-22T09:49:27.650455+0000","last_clean":"2024-09-22T09:49:27.650455+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:49:27.650455+0000","last_undegraded":"2024-09-22T09:49:27.650455+0000","last_fullsized":"2024-09-22T09:49:27.650455+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651319+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:49:37.651319+0000","last_peered":"2024-09-22T09:49:37.651319+0000","last_clean":"2024-09-22T09:49:37.651319+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:49:37.651319+0000","last_undegraded":"2024-09-22T09:49:37.651319+0000","last_fullsized":"2024-09-22T09:49:37.651319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:53.670732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.663218+0000","last_change":"2024-09-22T09:01:11.514663+0000","last_active":"2024-09-22T09:49:32.663218+0000","last_peered":"2024-09-22T09:49:32.663218+0000","last_clean":"2024-09-22T09:49:32.663218+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:49:32.663218+0000","last_undegraded":"2024-09-22T09:49:32.663218+0000","last_fullsized":"2024-09-22T09:49:32.663218+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:31.564030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:42.545151+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:49:42.545151+0000","last_peered":"2024-09-22T09:49:42.545151+0000","last_clean":"2024-09-22T09:49:42.545151+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:49:42.545151+0000","last_undegraded":"2024-09-22T09:49:42.545151+0000","last_fullsized":"2024-09-22T09:49:42.545151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:19.067022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":260,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.663945+0000","last_change":"2024-09-22T08:57:04.396164+0000","last_active":"2024-09-22T09:49:37.663945+0000","last_peered":"2024-09-22T09:49:37.663945+0000","last_clean":"2024-09-22T09:49:37.663945+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:49:37.663945+0000","last_undegraded":"2024-09-22T09:49:37.663945+0000","last_fullsized":"2024-09-22T09:49:37.663945+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:24.400394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676766+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:51:12.676766+0000","last_peered":"2024-09-22T09:51:12.676766+0000","last_clean":"2024-09-22T09:51:12.676766+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:51:12.676766+0000","last_undegraded":"2024-09-22T09:51:12.676766+0000","last_fullsized":"2024-09-22T09:51:12.676766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663319+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:51:07.663319+0000","last_peered":"2024-09-22T09:51:07.663319+0000","last_clean":"2024-09-22T09:51:07.663319+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:51:07.663319+0000","last_undegraded":"2024-09-22T09:51:07.663319+0000","last_fullsized":"2024-09-22T09:51:07.663319+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429096+0000","last_change":"2024-09-22T08:57:04.400224+0000","last_active":"2024-09-22T09:50:17.429096+0000","last_peered":"2024-09-22T09:50:17.429096+0000","last_clean":"2024-09-22T09:50:17.429096+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:50:17.429096+0000","last_undegraded":"2024-09-22T09:50:17.429096+0000","last_fullsized":"2024-09-22T09:50:17.429096+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:47.678550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650766+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:49:32.650766+0000","last_peered":"2024-09-22T09:49:32.650766+0000","last_clean":"2024-09-22T09:49:32.650766+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:49:32.650766+0000","last_undegraded":"2024-09-22T09:49:32.650766+0000","last_fullsized":"2024-09-22T09:49:32.650766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:02.822384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675672+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:50:12.675672+0000","last_peered":"2024-09-22T09:50:12.675672+0000","last_clean":"2024-09-22T09:50:12.675672+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:50:12.675672+0000","last_undegraded":"2024-09-22T09:50:12.675672+0000","last_fullsized":"2024-09-22T09:50:12.675672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:26:14.614902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691085+0000","last_change":"2024-09-22T09:20:12.861108+0000","last_active":"2024-09-22T09:50:32.691085+0000","last_peered":"2024-09-22T09:50:32.691085+0000","last_clean":"2024-09-22T09:50:32.691085+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:50:32.691085+0000","last_undegraded":"2024-09-22T09:50:32.691085+0000","last_fullsized":"2024-09-22T09:50:32.691085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:55.356489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656729+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:50:17.656729+0000","last_peered":"2024-09-22T09:50:17.656729+0000","last_clean":"2024-09-22T09:50:17.656729+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:50:17.656729+0000","last_undegraded":"2024-09-22T09:50:17.656729+0000","last_fullsized":"2024-09-22T09:50:17.656729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.510433+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:49:27.510433+0000","last_peered":"2024-09-22T09:49:27.510433+0000","last_clean":"2024-09-22T09:49:27.510433+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:49:27.510433+0000","last_undegraded":"2024-09-22T09:49:27.510433+0000","last_fullsized":"2024-09-22T09:49:27.510433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650821+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:49:32.650821+0000","last_peered":"2024-09-22T09:49:32.650821+0000","last_clean":"2024-09-22T09:49:32.650821+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:49:32.650821+0000","last_undegraded":"2024-09-22T09:49:32.650821+0000","last_fullsized":"2024-09-22T09:49:32.650821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:42.484414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.684513+0000","last_change":"2024-09-22T09:01:07.465474+0000","last_active":"2024-09-22T09:49:27.684513+0000","last_peered":"2024-09-22T09:49:27.684513+0000","last_clean":"2024-09-22T09:49:27.684513+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:49:27.684513+0000","last_undegraded":"2024-09-22T09:49:27.684513+0000","last_fullsized":"2024-09-22T09:49:27.684513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:54.197542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.689645+0000","last_change":"2024-09-22T08:57:04.398115+0000","last_active":"2024-09-22T09:50:17.689645+0000","last_peered":"2024-09-22T09:50:17.689645+0000","last_clean":"2024-09-22T09:50:17.689645+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:50:17.689645+0000","last_undegraded":"2024-09-22T09:50:17.689645+0000","last_fullsized":"2024-09-22T09:50:17.689645+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:33.062709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.543852+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:49:32.543852+0000","last_peered":"2024-09-22T09:49:32.543852+0000","last_clean":"2024-09-22T09:49:32.543852+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:49:32.543852+0000","last_undegraded":"2024-09-22T09:49:32.543852+0000","last_fullsized":"2024-09-22T09:49:32.543852+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.506562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650577+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:49:27.650577+0000","last_peered":"2024-09-22T09:49:27.650577+0000","last_clean":"2024-09-22T09:49:27.650577+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:49:27.650577+0000","last_undegraded":"2024-09-22T09:49:27.650577+0000","last_fullsized":"2024-09-22T09:49:27.650577+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428515+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:50:12.428515+0000","last_peered":"2024-09-22T09:50:12.428515+0000","last_clean":"2024-09-22T09:50:12.428515+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:50:12.428515+0000","last_undegraded":"2024-09-22T09:50:12.428515+0000","last_fullsized":"2024-09-22T09:50:12.428515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:47.707645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'1","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.548961+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:50:07.548961+0000","last_peered":"2024-09-22T09:50:07.548961+0000","last_clean":"2024-09-22T09:50:07.548961+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:50:07.548961+0000","last_undegraded":"2024-09-22T09:50:07.548961+0000","last_fullsized":"2024-09-22T09:50:07.548961+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:52.131442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428446+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:50:12.428446+0000","last_peered":"2024-09-22T09:50:12.428446+0000","last_clean":"2024-09-22T09:50:12.428446+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:50:12.428446+0000","last_undegraded":"2024-09-22T09:50:12.428446+0000","last_fullsized":"2024-09-22T09:50:12.428446+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:49.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655114+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:50:07.655114+0000","last_peered":"2024-09-22T09:50:07.655114+0000","last_clean":"2024-09-22T09:50:07.655114+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:50:07.655114+0000","last_undegraded":"2024-09-22T09:50:07.655114+0000","last_fullsized":"2024-09-22T09:50:07.655114+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:28.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.655936+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:50:12.655936+0000","last_peered":"2024-09-22T09:50:12.655936+0000","last_clean":"2024-09-22T09:50:12.655936+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:50:12.655936+0000","last_undegraded":"2024-09-22T09:50:12.655936+0000","last_fullsized":"2024-09-22T09:50:12.655936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:02.097970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668153+0000","last_change":"2024-09-22T09:01:07.463162+0000","last_active":"2024-09-22T09:50:07.668153+0000","last_peered":"2024-09-22T09:50:07.668153+0000","last_clean":"2024-09-22T09:50:07.668153+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:50:07.668153+0000","last_undegraded":"2024-09-22T09:50:07.668153+0000","last_fullsized":"2024-09-22T09:50:07.668153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:40.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'3","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.668750+0000","last_change":"2024-09-22T09:01:11.517359+0000","last_active":"2024-09-22T09:50:12.668750+0000","last_peered":"2024-09-22T09:50:12.668750+0000","last_clean":"2024-09-22T09:50:12.668750+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:50:12.668750+0000","last_undegraded":"2024-09-22T09:50:12.668750+0000","last_fullsized":"2024-09-22T09:50:12.668750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:49.248745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.674907+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:50:07.674907+0000","last_peered":"2024-09-22T09:50:07.674907+0000","last_clean":"2024-09-22T09:50:07.674907+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:50:07.674907+0000","last_undegraded":"2024-09-22T09:50:07.674907+0000","last_fullsized":"2024-09-22T09:50:07.674907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:43.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691557+0000","last_change":"2024-09-22T09:20:12.858546+0000","last_active":"2024-09-22T09:50:37.691557+0000","last_peered":"2024-09-22T09:50:37.691557+0000","last_clean":"2024-09-22T09:50:37.691557+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:50:37.691557+0000","last_undegraded":"2024-09-22T09:50:37.691557+0000","last_fullsized":"2024-09-22T09:50:37.691557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:50.810813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659886+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:50:42.659886+0000","last_peered":"2024-09-22T09:50:42.659886+0000","last_clean":"2024-09-22T09:50:42.659886+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:50:42.659886+0000","last_undegraded":"2024-09-22T09:50:42.659886+0000","last_fullsized":"2024-09-22T09:50:42.659886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691594+0000","last_change":"2024-09-22T09:01:07.465057+0000","last_active":"2024-09-22T09:50:37.691594+0000","last_peered":"2024-09-22T09:50:37.691594+0000","last_clean":"2024-09-22T09:50:37.691594+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:50:37.691594+0000","last_undegraded":"2024-09-22T09:50:37.691594+0000","last_fullsized":"2024-09-22T09:50:37.691594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:51.656500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.683656+0000","last_change":"2024-09-22T08:57:04.397214+0000","last_active":"2024-09-22T09:51:07.683656+0000","last_peered":"2024-09-22T09:51:07.683656+0000","last_clean":"2024-09-22T09:51:07.683656+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:51:07.683656+0000","last_undegraded":"2024-09-22T09:51:07.683656+0000","last_fullsized":"2024-09-22T09:51:07.683656+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:24.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.671153+0000","last_change":"2024-09-22T09:20:12.869138+0000","last_active":"2024-09-22T09:50:32.671153+0000","last_peered":"2024-09-22T09:50:32.671153+0000","last_clean":"2024-09-22T09:50:32.671153+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:50:32.671153+0000","last_undegraded":"2024-09-22T09:50:32.671153+0000","last_fullsized":"2024-09-22T09:50:32.671153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:20.523450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433506+0000","last_change":"2024-09-22T09:01:11.518715+0000","last_active":"2024-09-22T09:50:57.433506+0000","last_peered":"2024-09-22T09:50:57.433506+0000","last_clean":"2024-09-22T09:50:57.433506+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:50:57.433506+0000","last_undegraded":"2024-09-22T09:50:57.433506+0000","last_fullsized":"2024-09-22T09:50:57.433506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:25.716417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582758,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.659427+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:50:37.659427+0000","last_peered":"2024-09-22T09:50:37.659427+0000","last_clean":"2024-09-22T09:50:37.659427+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:50:37.659427+0000","last_undegraded":"2024-09-22T09:50:37.659427+0000","last_fullsized":"2024-09-22T09:50:37.659427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676022+0000","last_change":"2024-09-22T08:57:04.395860+0000","last_active":"2024-09-22T09:51:07.676022+0000","last_peered":"2024-09-22T09:51:07.676022+0000","last_clean":"2024-09-22T09:51:07.676022+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:51:07.676022+0000","last_undegraded":"2024-09-22T09:51:07.676022+0000","last_fullsized":"2024-09-22T09:51:07.676022+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:13.903713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520070+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:50:32.520070+0000","last_peered":"2024-09-22T09:50:32.520070+0000","last_clean":"2024-09-22T09:50:32.520070+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:50:32.520070+0000","last_undegraded":"2024-09-22T09:50:32.520070+0000","last_fullsized":"2024-09-22T09:50:32.520070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:36.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'1","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:52.432911+0000","last_change":"2024-09-22T09:01:07.463902+0000","last_active":"2024-09-22T09:50:52.432911+0000","last_peered":"2024-09-22T09:50:52.432911+0000","last_clean":"2024-09-22T09:50:52.432911+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:50:52.432911+0000","last_undegraded":"2024-09-22T09:50:52.432911+0000","last_fullsized":"2024-09-22T09:50:52.432911+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:06.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.694357+0000","last_change":"2024-09-22T08:57:04.397359+0000","last_active":"2024-09-22T09:51:07.694357+0000","last_peered":"2024-09-22T09:51:07.694357+0000","last_clean":"2024-09-22T09:51:07.694357+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:51:07.694357+0000","last_undegraded":"2024-09-22T09:51:07.694357+0000","last_fullsized":"2024-09-22T09:51:07.694357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:55.654439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'8","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556776+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:51:02.556776+0000","last_peered":"2024-09-22T09:51:02.556776+0000","last_clean":"2024-09-22T09:51:02.556776+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:51:02.556776+0000","last_undegraded":"2024-09-22T09:51:02.556776+0000","last_fullsized":"2024-09-22T09:51:02.556776+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":122,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663336+0000","last_change":"2024-09-22T08:57:04.405441+0000","last_active":"2024-09-22T09:51:07.663336+0000","last_peered":"2024-09-22T09:51:07.663336+0000","last_clean":"2024-09-22T09:51:07.663336+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:51:07.663336+0000","last_undegraded":"2024-09-22T09:51:07.663336+0000","last_fullsized":"2024-09-22T09:51:07.663336+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:56.122641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433374+0000","last_change":"2024-09-22T09:01:07.462593+0000","last_active":"2024-09-22T09:50:57.433374+0000","last_peered":"2024-09-22T09:50:57.433374+0000","last_clean":"2024-09-22T09:50:57.433374+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:50:57.433374+0000","last_undegraded":"2024-09-22T09:50:57.433374+0000","last_fullsized":"2024-09-22T09:50:57.433374+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:03.677122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528666+0000","last_change":"2024-09-22T08:57:04.395828+0000","last_active":"2024-09-22T09:51:27.528666+0000","last_peered":"2024-09-22T09:51:27.528666+0000","last_clean":"2024-09-22T09:51:27.528666+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:51:27.528666+0000","last_undegraded":"2024-09-22T09:51:27.528666+0000","last_fullsized":"2024-09-22T09:51:27.528666+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:01.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431738+0000","last_change":"2024-09-22T09:01:11.516330+0000","last_active":"2024-09-22T09:50:42.431738+0000","last_peered":"2024-09-22T09:50:42.431738+0000","last_clean":"2024-09-22T09:50:42.431738+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:50:42.431738+0000","last_undegraded":"2024-09-22T09:50:42.431738+0000","last_fullsized":"2024-09-22T09:50:42.431738+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:46.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'13","reported_seq":84,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662571+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:51:02.662571+0000","last_peered":"2024-09-22T09:51:02.662571+0000","last_clean":"2024-09-22T09:51:02.662571+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:51:02.662571+0000","last_undegraded":"2024-09-22T09:51:02.662571+0000","last_fullsized":"2024-09-22T09:51:02.662571+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":32770,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.526385+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.526385+0000","last_peered":"2024-09-22T09:51:12.526385+0000","last_clean":"2024-09-22T09:51:12.526385+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:51:12.526385+0000","last_undegraded":"2024-09-22T09:51:12.526385+0000","last_fullsized":"2024-09-22T09:51:12.526385+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":74,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677517+0000","last_change":"2024-09-22T08:57:04.395126+0000","last_active":"2024-09-22T09:51:17.677517+0000","last_peered":"2024-09-22T09:51:17.677517+0000","last_clean":"2024-09-22T09:51:17.677517+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:51:17.677517+0000","last_undegraded":"2024-09-22T09:51:17.677517+0000","last_fullsized":"2024-09-22T09:51:17.677517+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:33.605027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663959+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:51:12.663959+0000","last_peered":"2024-09-22T09:51:12.663959+0000","last_clean":"2024-09-22T09:51:12.663959+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:51:12.663959+0000","last_undegraded":"2024-09-22T09:51:12.663959+0000","last_fullsized":"2024-09-22T09:51:12.663959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694882+0000","last_change":"2024-09-22T09:01:07.464584+0000","last_active":"2024-09-22T09:51:12.694882+0000","last_peered":"2024-09-22T09:51:12.694882+0000","last_clean":"2024-09-22T09:51:12.694882+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:51:12.694882+0000","last_undegraded":"2024-09-22T09:51:12.694882+0000","last_fullsized":"2024-09-22T09:51:12.694882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:12.421058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677612+0000","last_change":"2024-09-22T08:57:04.400659+0000","last_active":"2024-09-22T09:51:17.677612+0000","last_peered":"2024-09-22T09:51:17.677612+0000","last_clean":"2024-09-22T09:51:17.677612+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:51:17.677612+0000","last_undegraded":"2024-09-22T09:51:17.677612+0000","last_fullsized":"2024-09-22T09:51:17.677612+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.429612+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:50:22.429612+0000","last_peered":"2024-09-22T09:50:22.429612+0000","last_clean":"2024-09-22T09:50:22.429612+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:50:22.429612+0000","last_undegraded":"2024-09-22T09:50:22.429612+0000","last_fullsized":"2024-09-22T09:50:22.429612+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:16.516456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528740+0000","last_change":"2024-09-22T08:57:04.401962+0000","last_active":"2024-09-22T09:51:27.528740+0000","last_peered":"2024-09-22T09:51:27.528740+0000","last_clean":"2024-09-22T09:51:27.528740+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:51:27.528740+0000","last_undegraded":"2024-09-22T09:51:27.528740+0000","last_fullsized":"2024-09-22T09:51:27.528740+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:43.579055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.435663+0000","last_change":"2024-09-22T08:57:04.397895+0000","last_active":"2024-09-22T09:51:17.435663+0000","last_peered":"2024-09-22T09:51:17.435663+0000","last_clean":"2024-09-22T09:51:17.435663+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:51:17.435663+0000","last_undegraded":"2024-09-22T09:51:17.435663+0000","last_fullsized":"2024-09-22T09:51:17.435663+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:57.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691139+0000","last_change":"2024-09-22T09:20:12.868011+0000","last_active":"2024-09-22T09:50:32.691139+0000","last_peered":"2024-09-22T09:50:32.691139+0000","last_clean":"2024-09-22T09:50:32.691139+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:50:32.691139+0000","last_undegraded":"2024-09-22T09:50:32.691139+0000","last_fullsized":"2024-09-22T09:50:32.691139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:51.261678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.435132+0000","last_change":"2024-09-22T09:01:11.515368+0000","last_active":"2024-09-22T09:51:12.435132+0000","last_peered":"2024-09-22T09:51:12.435132+0000","last_clean":"2024-09-22T09:51:12.435132+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:51:12.435132+0000","last_undegraded":"2024-09-22T09:51:12.435132+0000","last_fullsized":"2024-09-22T09:51:12.435132+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:01.643271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658823+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:50:32.658823+0000","last_peered":"2024-09-22T09:50:32.658823+0000","last_clean":"2024-09-22T09:50:32.658823+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:50:32.658823+0000","last_undegraded":"2024-09-22T09:50:32.658823+0000","last_fullsized":"2024-09-22T09:50:32.658823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:55.492793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.558791+0000","last_change":"2024-09-22T08:57:04.398627+0000","last_active":"2024-09-22T09:51:17.558791+0000","last_peered":"2024-09-22T09:51:17.558791+0000","last_clean":"2024-09-22T09:51:17.558791+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:51:17.558791+0000","last_undegraded":"2024-09-22T09:51:17.558791+0000","last_fullsized":"2024-09-22T09:51:17.558791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:23.008984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676744+0000","last_change":"2024-09-22T09:01:11.522462+0000","last_active":"2024-09-22T09:51:12.676744+0000","last_peered":"2024-09-22T09:51:12.676744+0000","last_clean":"2024-09-22T09:51:12.676744+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:51:12.676744+0000","last_undegraded":"2024-09-22T09:51:12.676744+0000","last_fullsized":"2024-09-22T09:51:12.676744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:13.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434560+0000","last_change":"2024-09-22T09:01:07.463509+0000","last_active":"2024-09-22T09:51:07.434560+0000","last_peered":"2024-09-22T09:51:07.434560+0000","last_clean":"2024-09-22T09:51:07.434560+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:51:07.434560+0000","last_undegraded":"2024-09-22T09:51:07.434560+0000","last_fullsized":"2024-09-22T09:51:07.434560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:59.139960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677548+0000","last_change":"2024-09-22T08:57:04.386372+0000","last_active":"2024-09-22T09:51:17.677548+0000","last_peered":"2024-09-22T09:51:17.677548+0000","last_clean":"2024-09-22T09:51:17.677548+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:51:17.677548+0000","last_undegraded":"2024-09-22T09:51:17.677548+0000","last_fullsized":"2024-09-22T09:51:17.677548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:50.648447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558150+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:51:12.558150+0000","last_peered":"2024-09-22T09:51:12.558150+0000","last_clean":"2024-09-22T09:51:12.558150+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:51:12.558150+0000","last_undegraded":"2024-09-22T09:51:12.558150+0000","last_fullsized":"2024-09-22T09:51:12.558150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'8","reported_seq":75,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.675993+0000","last_change":"2024-09-22T09:01:07.457691+0000","last_active":"2024-09-22T09:51:07.675993+0000","last_peered":"2024-09-22T09:51:07.675993+0000","last_clean":"2024-09-22T09:51:07.675993+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:51:07.675993+0000","last_undegraded":"2024-09-22T09:51:07.675993+0000","last_fullsized":"2024-09-22T09:51:07.675993+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:44.440513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247844,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25607,"num_write":8,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'205","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524192+0000","last_change":"2024-09-22T08:42:13.423188+0000","last_active":"2024-09-22T09:50:57.524192+0000","last_peered":"2024-09-22T09:50:57.524192+0000","last_clean":"2024-09-22T09:50:57.524192+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:50:57.524192+0000","last_undegraded":"2024-09-22T09:50:57.524192+0000","last_fullsized":"2024-09-22T09:50:57.524192+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:47.101356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":13870,"num_write":989,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'141","reported_seq":767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.861787+0000","last_change":"2024-09-22T08:42:15.431071+0000","last_active":"2024-09-22T09:50:12.861787+0000","last_peered":"2024-09-22T09:50:12.861787+0000","last_clean":"2024-09-22T09:50:12.861787+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:50:12.861787+0000","last_undegraded":"2024-09-22T09:50:12.861787+0000","last_fullsized":"2024-09-22T09:50:12.861787+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:37.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'136","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433476+0000","last_change":"2024-09-22T08:42:46.096812+0000","last_active":"2024-09-22T09:50:57.433476+0000","last_peered":"2024-09-22T09:50:57.433476+0000","last_clean":"2024-09-22T09:50:57.433476+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:50:57.433476+0000","last_undegraded":"2024-09-22T09:50:57.433476+0000","last_fullsized":"2024-09-22T09:50:57.433476+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:57.098166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21059257,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":103374,"num_write":676,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.458574+0000","last_change":"2024-09-22T08:42:15.435522+0000","last_active":"2024-09-22T09:51:48.458574+0000","last_peered":"2024-09-22T09:51:48.458574+0000","last_clean":"2024-09-22T09:51:48.458574+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:51:48.458574+0000","last_undegraded":"2024-09-22T09:51:48.458574+0000","last_fullsized":"2024-09-22T09:51:48.458574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:45.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'206","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662676+0000","last_change":"2024-09-22T08:42:13.406564+0000","last_active":"2024-09-22T09:51:02.662676+0000","last_peered":"2024-09-22T09:51:02.662676+0000","last_clean":"2024-09-22T09:51:02.662676+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:51:02.662676+0000","last_undegraded":"2024-09-22T09:51:02.662676+0000","last_fullsized":"2024-09-22T09:51:02.662676+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:01.206591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374630,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":499,"num_read_kb":4356,"num_write":981,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545888+0000","last_change":"2024-09-22T08:42:15.422331+0000","last_active":"2024-09-22T09:49:47.545888+0000","last_peered":"2024-09-22T09:49:47.545888+0000","last_clean":"2024-09-22T09:49:47.545888+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:49:47.545888+0000","last_undegraded":"2024-09-22T09:49:47.545888+0000","last_fullsized":"2024-09-22T09:49:47.545888+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:17.082268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'206","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.508468+0000","last_change":"2024-09-22T08:42:13.412575+0000","last_active":"2024-09-22T09:51:13.508468+0000","last_peered":"2024-09-22T09:51:13.508468+0000","last_clean":"2024-09-22T09:51:13.508468+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:51:13.508468+0000","last_undegraded":"2024-09-22T09:51:13.508468+0000","last_fullsized":"2024-09-22T09:51:13.508468+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:29.683561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6331018,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":1081,"num_write":998,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.171752+0000","last_change":"2024-09-22T08:42:15.432415+0000","last_active":"2024-09-22T09:50:21.171752+0000","last_peered":"2024-09-22T09:50:21.171752+0000","last_clean":"2024-09-22T09:50:21.171752+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:50:21.171752+0000","last_undegraded":"2024-09-22T09:50:21.171752+0000","last_fullsized":"2024-09-22T09:50:21.171752+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.375014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'203","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:58.564083+0000","last_change":"2024-09-22T08:42:13.415020+0000","last_active":"2024-09-22T09:53:58.564083+0000","last_peered":"2024-09-22T09:53:58.564083+0000","last_clean":"2024-09-22T09:53:58.564083+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:53:58.564083+0000","last_undegraded":"2024-09-22T09:53:58.564083+0000","last_fullsized":"2024-09-22T09:53:58.564083+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:27.087793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":6282,"num_write":913,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":681,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.669900+0000","last_change":"2024-09-22T08:42:15.432007+0000","last_active":"2024-09-22T09:50:22.669900+0000","last_peered":"2024-09-22T09:50:22.669900+0000","last_clean":"2024-09-22T09:50:22.669900+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:50:22.669900+0000","last_undegraded":"2024-09-22T09:50:22.669900+0000","last_fullsized":"2024-09-22T09:50:22.669900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:22.641506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'215","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671676+0000","last_change":"2024-09-22T08:42:13.406807+0000","last_active":"2024-09-22T09:49:47.671676+0000","last_peered":"2024-09-22T09:49:47.671676+0000","last_clean":"2024-09-22T09:49:47.671676+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:49:47.671676+0000","last_undegraded":"2024-09-22T09:49:47.671676+0000","last_fullsized":"2024-09-22T09:49:47.671676+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:01.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":688,"num_read_kb":1734,"num_write":930,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4552","reported_seq":5321,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556891+0000","last_change":"2024-09-22T08:42:15.421948+0000","last_active":"2024-09-22T09:51:02.556891+0000","last_peered":"2024-09-22T09:51:02.556891+0000","last_clean":"2024-09-22T09:51:02.556891+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:51:02.556891+0000","last_undegraded":"2024-09-22T09:51:02.556891+0000","last_fullsized":"2024-09-22T09:51:02.556891+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":3000,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:54.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'321","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.765211+0000","last_change":"2024-09-22T08:42:13.413783+0000","last_active":"2024-09-22T09:52:19.765211+0000","last_peered":"2024-09-22T09:52:19.765211+0000","last_clean":"2024-09-22T09:52:19.765211+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:52:19.765211+0000","last_undegraded":"2024-09-22T09:52:19.765211+0000","last_fullsized":"2024-09-22T09:52:19.765211+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:22.263546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11561569,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":962,"num_read_kb":40392,"num_write":1275,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'116","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682868+0000","last_change":"2024-09-22T08:42:15.435779+0000","last_active":"2024-09-22T09:51:02.682868+0000","last_peered":"2024-09-22T09:51:02.682868+0000","last_clean":"2024-09-22T09:51:02.682868+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:51:02.682868+0000","last_undegraded":"2024-09-22T09:51:02.682868+0000","last_fullsized":"2024-09-22T09:51:02.682868+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:34.540861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'203","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.312026+0000","last_change":"2024-09-22T08:42:13.409600+0000","last_active":"2024-09-22T09:51:35.312026+0000","last_peered":"2024-09-22T09:51:35.312026+0000","last_clean":"2024-09-22T09:51:35.312026+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:51:35.312026+0000","last_undegraded":"2024-09-22T09:51:35.312026+0000","last_fullsized":"2024-09-22T09:51:35.312026+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:13:38.537153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459866,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":705,"num_read_kb":60138,"num_write":925,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.872378+0000","last_change":"2024-09-22T08:42:15.430810+0000","last_active":"2024-09-22T09:51:09.872378+0000","last_peered":"2024-09-22T09:51:09.872378+0000","last_clean":"2024-09-22T09:51:09.872378+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:51:09.872378+0000","last_undegraded":"2024-09-22T09:51:09.872378+0000","last_fullsized":"2024-09-22T09:51:09.872378+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:24.046046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547462+0000","last_change":"2024-09-22T08:42:15.423020+0000","last_active":"2024-09-22T09:49:57.547462+0000","last_peered":"2024-09-22T09:49:57.547462+0000","last_clean":"2024-09-22T09:49:57.547462+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:49:57.547462+0000","last_undegraded":"2024-09-22T09:49:57.547462+0000","last_fullsized":"2024-09-22T09:49:57.547462+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:37.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'215","reported_seq":848,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.795599+0000","last_change":"2024-09-22T08:42:13.423588+0000","last_active":"2024-09-22T09:51:09.795599+0000","last_peered":"2024-09-22T09:51:09.795599+0000","last_clean":"2024-09-22T09:51:09.795599+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:51:09.795599+0000","last_undegraded":"2024-09-22T09:51:09.795599+0000","last_fullsized":"2024-09-22T09:51:09.795599+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:30.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485787,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":599,"num_read_kb":44934,"num_write":914,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514762+0000","last_change":"2024-09-22T08:42:15.436779+0000","last_active":"2024-09-22T09:49:57.514762+0000","last_peered":"2024-09-22T09:49:57.514762+0000","last_clean":"2024-09-22T09:49:57.514762+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:49:57.514762+0000","last_undegraded":"2024-09-22T09:49:57.514762+0000","last_fullsized":"2024-09-22T09:49:57.514762+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:13.788611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'136","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.577926+0000","last_change":"2024-09-22T08:42:13.397442+0000","last_active":"2024-09-22T09:51:42.577926+0000","last_peered":"2024-09-22T09:51:42.577926+0000","last_clean":"2024-09-22T09:51:42.577926+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:51:42.577926+0000","last_undegraded":"2024-09-22T09:51:42.577926+0000","last_fullsized":"2024-09-22T09:51:42.577926+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242938,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":4340,"num_write":702,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:46.831407+0000","last_change":"2024-09-22T08:42:15.430118+0000","last_active":"2024-09-22T09:51:46.831407+0000","last_peered":"2024-09-22T09:51:46.831407+0000","last_clean":"2024-09-22T09:51:46.831407+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:51:46.831407+0000","last_undegraded":"2024-09-22T09:51:46.831407+0000","last_fullsized":"2024-09-22T09:51:46.831407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:28.368027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'197","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666687+0000","last_change":"2024-09-22T08:42:46.094591+0000","last_active":"2024-09-22T09:49:57.666687+0000","last_peered":"2024-09-22T09:49:57.666687+0000","last_clean":"2024-09-22T09:49:57.666687+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:49:57.666687+0000","last_undegraded":"2024-09-22T09:49:57.666687+0000","last_fullsized":"2024-09-22T09:49:57.666687+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:10.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569641,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":44793,"num_write":914,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'262","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:09.851927+0000","last_change":"2024-09-22T08:42:15.433496+0000","last_active":"2024-09-22T09:50:09.851927+0000","last_peered":"2024-09-22T09:50:09.851927+0000","last_clean":"2024-09-22T09:50:09.851927+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:50:09.851927+0000","last_undegraded":"2024-09-22T09:50:09.851927+0000","last_fullsized":"2024-09-22T09:50:09.851927+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:34.253039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'203","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547558+0000","last_change":"2024-09-22T08:42:13.419441+0000","last_active":"2024-09-22T09:49:57.547558+0000","last_peered":"2024-09-22T09:49:57.547558+0000","last_clean":"2024-09-22T09:49:57.547558+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:49:57.547558+0000","last_undegraded":"2024-09-22T09:49:57.547558+0000","last_fullsized":"2024-09-22T09:49:57.547558+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:02.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563032,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":637,"num_write":1011,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'334","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:56.563649+0000","last_change":"2024-09-22T08:42:15.431963+0000","last_active":"2024-09-22T09:51:56.563649+0000","last_peered":"2024-09-22T09:51:56.563649+0000","last_clean":"2024-09-22T09:51:56.563649+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:51:56.563649+0000","last_undegraded":"2024-09-22T09:51:56.563649+0000","last_fullsized":"2024-09-22T09:51:56.563649+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:19.216549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'227","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.016903+0000","last_change":"2024-09-22T08:42:13.415311+0000","last_active":"2024-09-22T09:52:32.016903+0000","last_peered":"2024-09-22T09:52:32.016903+0000","last_clean":"2024-09-22T09:52:32.016903+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:52:32.016903+0000","last_undegraded":"2024-09-22T09:52:32.016903+0000","last_fullsized":"2024-09-22T09:52:32.016903+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:24.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258177,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":35016,"num_write":915,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'67","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547581+0000","last_change":"2024-09-22T08:42:15.436918+0000","last_active":"2024-09-22T09:49:57.547581+0000","last_peered":"2024-09-22T09:49:57.547581+0000","last_clean":"2024-09-22T09:49:57.547581+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:49:57.547581+0000","last_undegraded":"2024-09-22T09:49:57.547581+0000","last_fullsized":"2024-09-22T09:49:57.547581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:11.373207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'200","reported_seq":1063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.503387+0000","last_change":"2024-09-22T08:42:13.420123+0000","last_active":"2024-09-22T09:50:50.503387+0000","last_peered":"2024-09-22T09:50:50.503387+0000","last_clean":"2024-09-22T09:50:50.503387+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:50:50.503387+0000","last_undegraded":"2024-09-22T09:50:50.503387+0000","last_fullsized":"2024-09-22T09:50:50.503387+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:04.931071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751322,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":71433,"num_write":1016,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'127","reported_seq":637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.786070+0000","last_change":"2024-09-22T08:42:23.524985+0000","last_active":"2024-09-22T09:52:36.786070+0000","last_peered":"2024-09-22T09:52:36.786070+0000","last_clean":"2024-09-22T09:52:36.786070+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:52:36.786070+0000","last_undegraded":"2024-09-22T09:52:36.786070+0000","last_fullsized":"2024-09-22T09:52:36.786070+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:48.897187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655253+0000","last_change":"2024-09-22T08:42:15.440938+0000","last_active":"2024-09-22T09:50:07.655253+0000","last_peered":"2024-09-22T09:50:07.655253+0000","last_clean":"2024-09-22T09:50:07.655253+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:50:07.655253+0000","last_undegraded":"2024-09-22T09:50:07.655253+0000","last_fullsized":"2024-09-22T09:50:07.655253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:37.823594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'243","reported_seq":944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514032+0000","last_change":"2024-09-22T08:42:13.421758+0000","last_active":"2024-09-22T09:49:52.514032+0000","last_peered":"2024-09-22T09:49:52.514032+0000","last_clean":"2024-09-22T09:49:52.514032+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:49:52.514032+0000","last_undegraded":"2024-09-22T09:49:52.514032+0000","last_fullsized":"2024-09-22T09:49:52.514032+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:55.196735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81664,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":75224,"num_write":1092,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673256+0000","last_change":"2024-09-22T08:42:17.436026+0000","last_active":"2024-09-22T09:49:57.673256+0000","last_peered":"2024-09-22T09:49:57.673256+0000","last_clean":"2024-09-22T09:49:57.673256+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:49:57.673256+0000","last_undegraded":"2024-09-22T09:49:57.673256+0000","last_fullsized":"2024-09-22T09:49:57.673256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:39.444676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'212","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.573790+0000","last_change":"2024-09-22T08:42:19.458164+0000","last_active":"2024-09-22T09:52:52.573790+0000","last_peered":"2024-09-22T09:52:52.573790+0000","last_clean":"2024-09-22T09:52:52.573790+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:52:52.573790+0000","last_undegraded":"2024-09-22T09:52:52.573790+0000","last_fullsized":"2024-09-22T09:52:52.573790+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:13.853175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15363,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":282,"num_read_kb":359,"num_write":168,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515692+0000","last_change":"2024-09-22T08:42:21.476835+0000","last_active":"2024-09-22T09:50:02.515692+0000","last_peered":"2024-09-22T09:50:02.515692+0000","last_clean":"2024-09-22T09:50:02.515692+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:50:02.515692+0000","last_undegraded":"2024-09-22T09:50:02.515692+0000","last_fullsized":"2024-09-22T09:50:02.515692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:23.164486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'141","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.326568+0000","last_change":"2024-09-22T08:42:23.525612+0000","last_active":"2024-09-22T09:51:11.326568+0000","last_peered":"2024-09-22T09:51:11.326568+0000","last_clean":"2024-09-22T09:51:11.326568+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:51:11.326568+0000","last_undegraded":"2024-09-22T09:51:11.326568+0000","last_fullsized":"2024-09-22T09:51:11.326568+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:43.028034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673203+0000","last_change":"2024-09-22T08:42:15.433777+0000","last_active":"2024-09-22T09:49:57.673203+0000","last_peered":"2024-09-22T09:49:57.673203+0000","last_clean":"2024-09-22T09:49:57.673203+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:49:57.673203+0000","last_undegraded":"2024-09-22T09:49:57.673203+0000","last_fullsized":"2024-09-22T09:49:57.673203+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:47.845777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'198","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.654080+0000","last_change":"2024-09-22T08:42:13.409995+0000","last_active":"2024-09-22T09:49:57.654080+0000","last_peered":"2024-09-22T09:49:57.654080+0000","last_clean":"2024-09-22T09:49:57.654080+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:49:57.654080+0000","last_undegraded":"2024-09-22T09:49:57.654080+0000","last_fullsized":"2024-09-22T09:49:57.654080+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:32.859795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110244,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":43802,"num_write":906,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655271+0000","last_change":"2024-09-22T08:42:17.438392+0000","last_active":"2024-09-22T09:50:07.655271+0000","last_peered":"2024-09-22T09:50:07.655271+0000","last_clean":"2024-09-22T09:50:07.655271+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:50:07.655271+0000","last_undegraded":"2024-09-22T09:50:07.655271+0000","last_fullsized":"2024-09-22T09:50:07.655271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:33.187002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'99","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.845043+0000","last_change":"2024-09-22T08:42:19.453384+0000","last_active":"2024-09-22T09:52:52.845043+0000","last_peered":"2024-09-22T09:52:52.845043+0000","last_clean":"2024-09-22T09:52:52.845043+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:52:52.845043+0000","last_undegraded":"2024-09-22T09:52:52.845043+0000","last_fullsized":"2024-09-22T09:52:52.845043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:58.602109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.548236+0000","last_change":"2024-09-22T08:42:21.479500+0000","last_active":"2024-09-22T09:50:02.548236+0000","last_peered":"2024-09-22T09:50:02.548236+0000","last_clean":"2024-09-22T09:50:02.548236+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:50:02.548236+0000","last_undegraded":"2024-09-22T09:50:02.548236+0000","last_fullsized":"2024-09-22T09:50:02.548236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:12.904978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'108","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.888189+0000","last_change":"2024-09-22T08:42:23.524672+0000","last_active":"2024-09-22T09:51:39.888189+0000","last_peered":"2024-09-22T09:51:39.888189+0000","last_clean":"2024-09-22T09:51:39.888189+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:51:39.888189+0000","last_undegraded":"2024-09-22T09:51:39.888189+0000","last_fullsized":"2024-09-22T09:51:39.888189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:49.539509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":746,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.900800+0000","last_change":"2024-09-22T08:42:15.431967+0000","last_active":"2024-09-22T09:51:39.900800+0000","last_peered":"2024-09-22T09:51:39.900800+0000","last_clean":"2024-09-22T09:51:39.900800+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:51:39.900800+0000","last_undegraded":"2024-09-22T09:51:39.900800+0000","last_fullsized":"2024-09-22T09:51:39.900800+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:21.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'242","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.690577+0000","last_change":"2024-09-22T08:42:46.096752+0000","last_active":"2024-09-22T09:50:27.690577+0000","last_peered":"2024-09-22T09:50:27.690577+0000","last_clean":"2024-09-22T09:50:27.690577+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:50:27.690577+0000","last_undegraded":"2024-09-22T09:50:27.690577+0000","last_fullsized":"2024-09-22T09:50:27.690577+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:52.050611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26247569,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":41488,"num_write":1118,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"36'4","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.244745+0000","last_change":"2024-09-22T08:42:17.436896+0000","last_active":"2024-09-22T09:54:00.244745+0000","last_peered":"2024-09-22T09:54:00.244745+0000","last_clean":"2024-09-22T09:54:00.244745+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:00.244745+0000","last_undegraded":"2024-09-22T09:54:00.244745+0000","last_fullsized":"2024-09-22T09:54:00.244745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:50.909668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'142","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.882035+0000","last_change":"2024-09-22T08:42:19.453227+0000","last_active":"2024-09-22T09:52:52.882035+0000","last_peered":"2024-09-22T09:52:52.882035+0000","last_clean":"2024-09-22T09:52:52.882035+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:52:52.882035+0000","last_undegraded":"2024-09-22T09:52:52.882035+0000","last_fullsized":"2024-09-22T09:52:52.882035+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.144959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'743","reported_seq":2932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790557+0000","last_change":"2024-09-22T08:42:21.477386+0000","last_active":"2024-09-22T09:54:03.790557+0000","last_peered":"2024-09-22T09:54:03.790557+0000","last_clean":"2024-09-22T09:54:03.790557+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:03.790557+0000","last_undegraded":"2024-09-22T09:54:03.790557+0000","last_fullsized":"2024-09-22T09:54:03.790557+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:26.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'218","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.675764+0000","last_change":"2024-09-22T08:42:23.578386+0000","last_active":"2024-09-22T09:52:36.675764+0000","last_peered":"2024-09-22T09:52:36.675764+0000","last_clean":"2024-09-22T09:52:36.675764+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:52:36.675764+0000","last_undegraded":"2024-09-22T09:52:36.675764+0000","last_fullsized":"2024-09-22T09:52:36.675764+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:30.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.329583+0000","last_change":"2024-09-22T08:42:15.435930+0000","last_active":"2024-09-22T09:50:15.329583+0000","last_peered":"2024-09-22T09:50:15.329583+0000","last_clean":"2024-09-22T09:50:15.329583+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:50:15.329583+0000","last_undegraded":"2024-09-22T09:50:15.329583+0000","last_fullsized":"2024-09-22T09:50:15.329583+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:06.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'173","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666614+0000","last_change":"2024-09-22T08:42:13.400466+0000","last_active":"2024-09-22T09:49:57.666614+0000","last_peered":"2024-09-22T09:49:57.666614+0000","last_clean":"2024-09-22T09:49:57.666614+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:49:57.666614+0000","last_undegraded":"2024-09-22T09:49:57.666614+0000","last_fullsized":"2024-09-22T09:49:57.666614+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:24.218589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11590790,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":536,"num_read_kb":49818,"num_write":841,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673308+0000","last_change":"2024-09-22T08:42:17.435623+0000","last_active":"2024-09-22T09:49:57.673308+0000","last_peered":"2024-09-22T09:49:57.673308+0000","last_clean":"2024-09-22T09:49:57.673308+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:49:57.673308+0000","last_undegraded":"2024-09-22T09:49:57.673308+0000","last_fullsized":"2024-09-22T09:49:57.673308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:28.519736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'146","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.887895+0000","last_change":"2024-09-22T08:42:19.456582+0000","last_active":"2024-09-22T09:52:52.887895+0000","last_peered":"2024-09-22T09:52:52.887895+0000","last_clean":"2024-09-22T09:52:52.887895+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:52:52.887895+0000","last_undegraded":"2024-09-22T09:52:52.887895+0000","last_fullsized":"2024-09-22T09:52:52.887895+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:38.574953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":255,"num_write":106,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'752","reported_seq":2397,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782892+0000","last_change":"2024-09-22T08:42:21.478967+0000","last_active":"2024-09-22T09:54:03.782892+0000","last_peered":"2024-09-22T09:54:03.782892+0000","last_clean":"2024-09-22T09:54:03.782892+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:03.782892+0000","last_undegraded":"2024-09-22T09:54:03.782892+0000","last_fullsized":"2024-09-22T09:54:03.782892+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:49.086596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687895+0000","last_change":"2024-09-22T08:42:15.434568+0000","last_active":"2024-09-22T09:51:37.687895+0000","last_peered":"2024-09-22T09:51:37.687895+0000","last_clean":"2024-09-22T09:51:37.687895+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:51:37.687895+0000","last_undegraded":"2024-09-22T09:51:37.687895+0000","last_fullsized":"2024-09-22T09:51:37.687895+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:47.411833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'186","reported_seq":806,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:06.030411+0000","last_change":"2024-09-22T08:42:46.096820+0000","last_active":"2024-09-22T09:51:06.030411+0000","last_peered":"2024-09-22T09:51:06.030411+0000","last_clean":"2024-09-22T09:51:06.030411+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:51:06.030411+0000","last_undegraded":"2024-09-22T09:51:06.030411+0000","last_fullsized":"2024-09-22T09:51:06.030411+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:26.829701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5318948,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":37265,"num_write":896,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.530209+0000","last_change":"2024-09-22T08:42:17.428741+0000","last_active":"2024-09-22T09:51:37.530209+0000","last_peered":"2024-09-22T09:51:37.530209+0000","last_clean":"2024-09-22T09:51:37.530209+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:51:37.530209+0000","last_undegraded":"2024-09-22T09:51:37.530209+0000","last_fullsized":"2024-09-22T09:51:37.530209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.400097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'248","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.707978+0000","last_change":"2024-09-22T08:42:19.453085+0000","last_active":"2024-09-22T09:53:57.707978+0000","last_peered":"2024-09-22T09:53:57.707978+0000","last_clean":"2024-09-22T09:53:57.707978+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:53:57.707978+0000","last_undegraded":"2024-09-22T09:53:57.707978+0000","last_fullsized":"2024-09-22T09:53:57.707978+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:18.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":346,"num_read_kb":397,"num_write":206,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426203+0000","last_change":"2024-09-22T08:42:21.473910+0000","last_active":"2024-09-22T09:49:52.426203+0000","last_peered":"2024-09-22T09:49:52.426203+0000","last_clean":"2024-09-22T09:49:52.426203+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:49:52.426203+0000","last_undegraded":"2024-09-22T09:49:52.426203+0000","last_fullsized":"2024-09-22T09:49:52.426203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:39.543682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'582","reported_seq":1405,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.730090+0000","last_change":"2024-09-22T08:42:23.524686+0000","last_active":"2024-09-22T09:54:00.730090+0000","last_peered":"2024-09-22T09:54:00.730090+0000","last_clean":"2024-09-22T09:54:00.730090+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:00.730090+0000","last_undegraded":"2024-09-22T09:54:00.730090+0000","last_fullsized":"2024-09-22T09:54:00.730090+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:20.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.561618+0000","last_change":"2024-09-22T08:42:15.437596+0000","last_active":"2024-09-22T09:51:37.561618+0000","last_peered":"2024-09-22T09:51:37.561618+0000","last_clean":"2024-09-22T09:51:37.561618+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:51:37.561618+0000","last_undegraded":"2024-09-22T09:51:37.561618+0000","last_fullsized":"2024-09-22T09:51:37.561618+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:39.538847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'225","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533591+0000","last_change":"2024-09-22T08:42:13.415541+0000","last_active":"2024-09-22T09:51:57.533591+0000","last_peered":"2024-09-22T09:51:57.533591+0000","last_clean":"2024-09-22T09:51:57.533591+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:51:57.533591+0000","last_undegraded":"2024-09-22T09:51:57.533591+0000","last_fullsized":"2024-09-22T09:51:57.533591+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:48:38.008511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11135054,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":642,"num_read_kb":43078,"num_write":992,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697218+0000","last_change":"2024-09-22T08:42:17.437870+0000","last_active":"2024-09-22T09:51:37.697218+0000","last_peered":"2024-09-22T09:51:37.697218+0000","last_clean":"2024-09-22T09:51:37.697218+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:51:37.697218+0000","last_undegraded":"2024-09-22T09:51:37.697218+0000","last_fullsized":"2024-09-22T09:51:37.697218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:56.092607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'148","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.869599+0000","last_change":"2024-09-22T08:42:19.453046+0000","last_active":"2024-09-22T09:52:52.869599+0000","last_peered":"2024-09-22T09:52:52.869599+0000","last_clean":"2024-09-22T09:52:52.869599+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:52:52.869599+0000","last_undegraded":"2024-09-22T09:52:52.869599+0000","last_fullsized":"2024-09-22T09:52:52.869599+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:19.048949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":209,"num_write":100,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2542","reported_seq":4378,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.695093+0000","last_change":"2024-09-22T08:42:23.525193+0000","last_active":"2024-09-22T09:53:22.695093+0000","last_peered":"2024-09-22T09:53:22.695093+0000","last_clean":"2024-09-22T09:53:22.695093+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:53:22.695093+0000","last_undegraded":"2024-09-22T09:53:22.695093+0000","last_fullsized":"2024-09-22T09:53:22.695093+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:05.078232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1200,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681284+0000","last_change":"2024-09-22T08:42:15.439516+0000","last_active":"2024-09-22T09:51:42.681284+0000","last_peered":"2024-09-22T09:51:42.681284+0000","last_clean":"2024-09-22T09:51:42.681284+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:51:42.681284+0000","last_undegraded":"2024-09-22T09:51:42.681284+0000","last_fullsized":"2024-09-22T09:51:42.681284+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:06.792912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'237","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533551+0000","last_change":"2024-09-22T08:42:13.422752+0000","last_active":"2024-09-22T09:51:57.533551+0000","last_peered":"2024-09-22T09:51:57.533551+0000","last_clean":"2024-09-22T09:51:57.533551+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:51:57.533551+0000","last_undegraded":"2024-09-22T09:51:57.533551+0000","last_fullsized":"2024-09-22T09:51:57.533551+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.596026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16090748,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":591,"num_read_kb":17575,"num_write":1014,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686455+0000","last_change":"2024-09-22T08:42:17.437867+0000","last_active":"2024-09-22T09:49:47.686455+0000","last_peered":"2024-09-22T09:49:47.686455+0000","last_clean":"2024-09-22T09:49:47.686455+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:49:47.686455+0000","last_undegraded":"2024-09-22T09:49:47.686455+0000","last_fullsized":"2024-09-22T09:49:47.686455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:57.450851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'194","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.550842+0000","last_change":"2024-09-22T08:42:19.455781+0000","last_active":"2024-09-22T09:53:52.550842+0000","last_peered":"2024-09-22T09:53:52.550842+0000","last_clean":"2024-09-22T09:53:52.550842+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:53:52.550842+0000","last_undegraded":"2024-09-22T09:53:52.550842+0000","last_fullsized":"2024-09-22T09:53:52.550842+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:37:46.879916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":313,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'755","reported_seq":2721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782626+0000","last_change":"2024-09-22T08:42:21.480118+0000","last_active":"2024-09-22T09:54:03.782626+0000","last_peered":"2024-09-22T09:54:03.782626+0000","last_clean":"2024-09-22T09:54:03.782626+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:03.782626+0000","last_undegraded":"2024-09-22T09:54:03.782626+0000","last_fullsized":"2024-09-22T09:54:03.782626+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:26.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'119","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.314868+0000","last_change":"2024-09-22T08:42:23.527331+0000","last_active":"2024-09-22T09:53:59.314868+0000","last_peered":"2024-09-22T09:53:59.314868+0000","last_clean":"2024-09-22T09:53:59.314868+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:53:59.314868+0000","last_undegraded":"2024-09-22T09:53:59.314868+0000","last_fullsized":"2024-09-22T09:53:59.314868+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:06.830634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.581065+0000","last_change":"2024-09-22T08:42:15.435714+0000","last_active":"2024-09-22T09:51:13.581065+0000","last_peered":"2024-09-22T09:51:13.581065+0000","last_clean":"2024-09-22T09:51:13.581065+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:51:13.581065+0000","last_undegraded":"2024-09-22T09:51:13.581065+0000","last_fullsized":"2024-09-22T09:51:13.581065+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:25.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'206","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671732+0000","last_change":"2024-09-22T08:42:13.403452+0000","last_active":"2024-09-22T09:49:47.671732+0000","last_peered":"2024-09-22T09:49:47.671732+0000","last_clean":"2024-09-22T09:49:47.671732+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:49:47.671732+0000","last_undegraded":"2024-09-22T09:49:47.671732+0000","last_fullsized":"2024-09-22T09:49:47.671732+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:14.603364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299561,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":60855,"num_write":911,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697795+0000","last_change":"2024-09-22T08:42:17.435826+0000","last_active":"2024-09-22T09:51:42.697795+0000","last_peered":"2024-09-22T09:51:42.697795+0000","last_clean":"2024-09-22T09:51:42.697795+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:51:42.697795+0000","last_undegraded":"2024-09-22T09:51:42.697795+0000","last_fullsized":"2024-09-22T09:51:42.697795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:56.041489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.695871+0000","last_change":"2024-09-22T08:42:19.452009+0000","last_active":"2024-09-22T09:54:00.695871+0000","last_peered":"2024-09-22T09:54:00.695871+0000","last_clean":"2024-09-22T09:54:00.695871+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:00.695871+0000","last_undegraded":"2024-09-22T09:54:00.695871+0000","last_fullsized":"2024-09-22T09:54:00.695871+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:46.201887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":279,"num_read_kb":351,"num_write":136,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697752+0000","last_change":"2024-09-22T08:42:21.479365+0000","last_active":"2024-09-22T09:51:42.697752+0000","last_peered":"2024-09-22T09:51:42.697752+0000","last_clean":"2024-09-22T09:51:42.697752+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:51:42.697752+0000","last_undegraded":"2024-09-22T09:51:42.697752+0000","last_fullsized":"2024-09-22T09:51:42.697752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.054664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'142","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.315438+0000","last_change":"2024-09-22T08:42:23.525367+0000","last_active":"2024-09-22T09:53:59.315438+0000","last_peered":"2024-09-22T09:53:59.315438+0000","last_clean":"2024-09-22T09:53:59.315438+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:53:59.315438+0000","last_undegraded":"2024-09-22T09:53:59.315438+0000","last_fullsized":"2024-09-22T09:53:59.315438+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:24.183213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545943+0000","last_change":"2024-09-22T08:42:15.430534+0000","last_active":"2024-09-22T09:49:47.545943+0000","last_peered":"2024-09-22T09:49:47.545943+0000","last_clean":"2024-09-22T09:49:47.545943+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:49:47.545943+0000","last_undegraded":"2024-09-22T09:49:47.545943+0000","last_fullsized":"2024-09-22T09:49:47.545943+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:45.930207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'363","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:51.846880+0000","last_change":"2024-09-22T08:42:13.401775+0000","last_active":"2024-09-22T09:53:51.846880+0000","last_peered":"2024-09-22T09:53:51.846880+0000","last_clean":"2024-09-22T09:53:51.846880+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:53:51.846880+0000","last_undegraded":"2024-09-22T09:53:51.846880+0000","last_fullsized":"2024-09-22T09:53:51.846880+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:19.013414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31394,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":7434,"num_write":1384,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686491+0000","last_change":"2024-09-22T08:42:17.438355+0000","last_active":"2024-09-22T09:49:47.686491+0000","last_peered":"2024-09-22T09:49:47.686491+0000","last_clean":"2024-09-22T09:49:47.686491+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:49:47.686491+0000","last_undegraded":"2024-09-22T09:49:47.686491+0000","last_fullsized":"2024-09-22T09:49:47.686491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.597938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'162","reported_seq":748,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.912530+0000","last_change":"2024-09-22T08:42:19.454917+0000","last_active":"2024-09-22T09:52:52.912530+0000","last_peered":"2024-09-22T09:52:52.912530+0000","last_clean":"2024-09-22T09:52:52.912530+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:52:52.912530+0000","last_undegraded":"2024-09-22T09:52:52.912530+0000","last_fullsized":"2024-09-22T09:52:52.912530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:48.566070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":251,"num_write":178,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654973+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:50:02.654973+0000","last_peered":"2024-09-22T09:50:02.654973+0000","last_clean":"2024-09-22T09:50:02.654973+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:50:02.654973+0000","last_undegraded":"2024-09-22T09:50:02.654973+0000","last_fullsized":"2024-09-22T09:50:02.654973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:44.790859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674614+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:52:37.674614+0000","last_peered":"2024-09-22T09:52:37.674614+0000","last_clean":"2024-09-22T09:52:37.674614+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:52:37.674614+0000","last_undegraded":"2024-09-22T09:52:37.674614+0000","last_fullsized":"2024-09-22T09:52:37.674614+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:23.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.083868+0000","last_change":"2024-09-22T08:42:15.429567+0000","last_active":"2024-09-22T09:52:32.083868+0000","last_peered":"2024-09-22T09:52:32.083868+0000","last_clean":"2024-09-22T09:52:32.083868+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:52:32.083868+0000","last_undegraded":"2024-09-22T09:52:32.083868+0000","last_fullsized":"2024-09-22T09:52:32.083868+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:58.301320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'231","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.767112+0000","last_change":"2024-09-22T08:42:13.403639+0000","last_active":"2024-09-22T09:52:19.767112+0000","last_peered":"2024-09-22T09:52:19.767112+0000","last_clean":"2024-09-22T09:52:19.767112+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:52:19.767112+0000","last_undegraded":"2024-09-22T09:52:19.767112+0000","last_fullsized":"2024-09-22T09:52:19.767112+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:45.735642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22046937,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":761,"num_read_kb":42930,"num_write":1120,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425560+0000","last_change":"2024-09-22T08:42:17.436642+0000","last_active":"2024-09-22T09:49:47.425560+0000","last_peered":"2024-09-22T09:49:47.425560+0000","last_clean":"2024-09-22T09:49:47.425560+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:49:47.425560+0000","last_undegraded":"2024-09-22T09:49:47.425560+0000","last_fullsized":"2024-09-22T09:49:47.425560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:56.592253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'190","reported_seq":790,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.960456+0000","last_change":"2024-09-22T08:42:19.451872+0000","last_active":"2024-09-22T09:52:52.960456+0000","last_peered":"2024-09-22T09:52:52.960456+0000","last_clean":"2024-09-22T09:52:52.960456+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:52:52.960456+0000","last_undegraded":"2024-09-22T09:52:52.960456+0000","last_fullsized":"2024-09-22T09:52:52.960456+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:10.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":249,"num_read_kb":310,"num_write":142,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'718","reported_seq":2491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.783109+0000","last_change":"2024-09-22T08:42:21.477749+0000","last_active":"2024-09-22T09:54:03.783109+0000","last_peered":"2024-09-22T09:54:03.783109+0000","last_clean":"2024-09-22T09:54:03.783109+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:03.783109+0000","last_undegraded":"2024-09-22T09:54:03.783109+0000","last_fullsized":"2024-09-22T09:54:03.783109+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:54:39.808571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'139","reported_seq":639,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:34.236678+0000","last_change":"2024-09-22T08:42:23.527200+0000","last_active":"2024-09-22T09:52:34.236678+0000","last_peered":"2024-09-22T09:52:34.236678+0000","last_clean":"2024-09-22T09:52:34.236678+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:52:34.236678+0000","last_undegraded":"2024-09-22T09:52:34.236678+0000","last_fullsized":"2024-09-22T09:52:34.236678+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:36.368516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.583270+0000","last_change":"2024-09-22T08:42:15.434596+0000","last_active":"2024-09-22T09:50:50.583270+0000","last_peered":"2024-09-22T09:50:50.583270+0000","last_clean":"2024-09-22T09:50:50.583270+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:50:50.583270+0000","last_undegraded":"2024-09-22T09:50:50.583270+0000","last_fullsized":"2024-09-22T09:50:50.583270+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:08.897077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'256","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653785+0000","last_change":"2024-09-22T08:42:46.165164+0000","last_active":"2024-09-22T09:49:57.653785+0000","last_peered":"2024-09-22T09:49:57.653785+0000","last_clean":"2024-09-22T09:49:57.653785+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:49:57.653785+0000","last_undegraded":"2024-09-22T09:49:57.653785+0000","last_fullsized":"2024-09-22T09:49:57.653785+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:28.663766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485776,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1201,"num_read_kb":6055,"num_write":1101,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1448,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.257154+0000","last_change":"2024-09-22T08:42:17.433014+0000","last_active":"2024-09-22T09:54:00.257154+0000","last_peered":"2024-09-22T09:54:00.257154+0000","last_clean":"2024-09-22T09:54:00.257154+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:00.257154+0000","last_undegraded":"2024-09-22T09:54:00.257154+0000","last_fullsized":"2024-09-22T09:54:00.257154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:41.112528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'132","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.816417+0000","last_change":"2024-09-22T08:42:19.457240+0000","last_active":"2024-09-22T09:52:52.816417+0000","last_peered":"2024-09-22T09:52:52.816417+0000","last_clean":"2024-09-22T09:52:52.816417+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:52:52.816417+0000","last_undegraded":"2024-09-22T09:52:52.816417+0000","last_fullsized":"2024-09-22T09:52:52.816417+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:43.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'754","reported_seq":2727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790782+0000","last_change":"2024-09-22T08:42:21.479394+0000","last_active":"2024-09-22T09:54:03.790782+0000","last_peered":"2024-09-22T09:54:03.790782+0000","last_clean":"2024-09-22T09:54:03.790782+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:03.790782+0000","last_undegraded":"2024-09-22T09:54:03.790782+0000","last_fullsized":"2024-09-22T09:54:03.790782+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:36.701700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'118","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558129+0000","last_change":"2024-09-22T08:42:23.526928+0000","last_active":"2024-09-22T09:51:12.558129+0000","last_peered":"2024-09-22T09:51:12.558129+0000","last_clean":"2024-09-22T09:51:12.558129+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:51:12.558129+0000","last_undegraded":"2024-09-22T09:51:12.558129+0000","last_fullsized":"2024-09-22T09:51:12.558129+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:16.995273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.427871+0000","last_change":"2024-09-22T08:42:15.434196+0000","last_active":"2024-09-22T09:50:07.427871+0000","last_peered":"2024-09-22T09:50:07.427871+0000","last_clean":"2024-09-22T09:50:07.427871+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:50:07.427871+0000","last_undegraded":"2024-09-22T09:50:07.427871+0000","last_fullsized":"2024-09-22T09:50:07.427871+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:29.967093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'182","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.665992+0000","last_change":"2024-09-22T08:42:13.403505+0000","last_active":"2024-09-22T09:51:32.665992+0000","last_peered":"2024-09-22T09:51:32.665992+0000","last_clean":"2024-09-22T09:51:32.665992+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:51:32.665992+0000","last_undegraded":"2024-09-22T09:51:32.665992+0000","last_fullsized":"2024-09-22T09:51:32.665992+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:50:46.095633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14980326,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":701,"num_read_kb":142631,"num_write":841,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545984+0000","last_change":"2024-09-22T08:42:17.428207+0000","last_active":"2024-09-22T09:49:47.545984+0000","last_peered":"2024-09-22T09:49:47.545984+0000","last_clean":"2024-09-22T09:49:47.545984+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:49:47.545984+0000","last_undegraded":"2024-09-22T09:49:47.545984+0000","last_fullsized":"2024-09-22T09:49:47.545984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:36.330654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.907443+0000","last_change":"2024-09-22T08:42:19.459817+0000","last_active":"2024-09-22T09:52:52.907443+0000","last_peered":"2024-09-22T09:52:52.907443+0000","last_clean":"2024-09-22T09:52:52.907443+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:52:52.907443+0000","last_undegraded":"2024-09-22T09:52:52.907443+0000","last_fullsized":"2024-09-22T09:52:52.907443+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:06.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":313,"num_read_kb":355,"num_write":182,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.666030+0000","last_change":"2024-09-22T08:42:21.481035+0000","last_active":"2024-09-22T09:49:52.666030+0000","last_peered":"2024-09-22T09:49:52.666030+0000","last_clean":"2024-09-22T09:49:52.666030+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:49:52.666030+0000","last_undegraded":"2024-09-22T09:49:52.666030+0000","last_fullsized":"2024-09-22T09:49:52.666030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:13.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'130","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.452137+0000","last_change":"2024-09-22T08:42:23.529103+0000","last_active":"2024-09-22T09:51:48.452137+0000","last_peered":"2024-09-22T09:51:48.452137+0000","last_clean":"2024-09-22T09:51:48.452137+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:51:48.452137+0000","last_undegraded":"2024-09-22T09:51:48.452137+0000","last_fullsized":"2024-09-22T09:51:48.452137+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:43.270586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676034+0000","last_change":"2024-09-22T08:42:15.435903+0000","last_active":"2024-09-22T09:51:07.676034+0000","last_peered":"2024-09-22T09:51:07.676034+0000","last_clean":"2024-09-22T09:51:07.676034+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:51:07.676034+0000","last_undegraded":"2024-09-22T09:51:07.676034+0000","last_fullsized":"2024-09-22T09:51:07.676034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:50.676641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.535997+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T09:52:12.535997+0000","last_peered":"2024-09-22T09:52:12.535997+0000","last_clean":"2024-09-22T09:52:12.535997+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:52:12.535997+0000","last_undegraded":"2024-09-22T09:52:12.535997+0000","last_fullsized":"2024-09-22T09:52:12.535997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680619+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T09:50:47.680619+0000","last_peered":"2024-09-22T09:50:47.680619+0000","last_clean":"2024-09-22T09:50:47.680619+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:50:47.680619+0000","last_undegraded":"2024-09-22T09:50:47.680619+0000","last_fullsized":"2024-09-22T09:50:47.680619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'251","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661666+0000","last_change":"2024-09-22T08:42:46.093573+0000","last_active":"2024-09-22T09:50:57.661666+0000","last_peered":"2024-09-22T09:50:57.661666+0000","last_clean":"2024-09-22T09:50:57.661666+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:50:57.661666+0000","last_undegraded":"2024-09-22T09:50:57.661666+0000","last_fullsized":"2024-09-22T09:50:57.661666+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:55.591787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6682307,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19728,"num_write":1077,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524909+0000","last_change":"2024-09-22T08:42:17.430962+0000","last_active":"2024-09-22T09:51:02.524909+0000","last_peered":"2024-09-22T09:51:02.524909+0000","last_clean":"2024-09-22T09:51:02.524909+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:51:02.524909+0000","last_undegraded":"2024-09-22T09:51:02.524909+0000","last_fullsized":"2024-09-22T09:51:02.524909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:38.741426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'310","reported_seq":1011,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.713968+0000","last_change":"2024-09-22T08:42:19.458458+0000","last_active":"2024-09-22T09:54:00.713968+0000","last_peered":"2024-09-22T09:54:00.713968+0000","last_clean":"2024-09-22T09:54:00.713968+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:00.713968+0000","last_undegraded":"2024-09-22T09:54:00.713968+0000","last_fullsized":"2024-09-22T09:54:00.713968+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:21.464285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":700,"num_write":484,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.668007+0000","last_change":"2024-09-22T08:42:21.476608+0000","last_active":"2024-09-22T09:51:42.668007+0000","last_peered":"2024-09-22T09:51:42.668007+0000","last_clean":"2024-09-22T09:51:42.668007+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:51:42.668007+0000","last_undegraded":"2024-09-22T09:51:42.668007+0000","last_fullsized":"2024-09-22T09:51:42.668007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:00.388229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'205","reported_seq":913,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.706774+0000","last_change":"2024-09-22T08:42:23.527973+0000","last_active":"2024-09-22T09:52:36.706774+0000","last_peered":"2024-09-22T09:52:36.706774+0000","last_clean":"2024-09-22T09:52:36.706774+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:52:36.706774+0000","last_undegraded":"2024-09-22T09:52:36.706774+0000","last_fullsized":"2024-09-22T09:52:36.706774+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:38.241959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'136","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667317+0000","last_change":"2024-09-22T08:42:46.096326+0000","last_active":"2024-09-22T09:51:37.667317+0000","last_peered":"2024-09-22T09:51:37.667317+0000","last_clean":"2024-09-22T09:51:37.667317+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:51:37.667317+0000","last_undegraded":"2024-09-22T09:51:37.667317+0000","last_fullsized":"2024-09-22T09:51:37.667317+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:21.464651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.517955+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T09:50:17.517955+0000","last_peered":"2024-09-22T09:50:17.517955+0000","last_clean":"2024-09-22T09:50:17.517955+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:50:17.517955+0000","last_undegraded":"2024-09-22T09:50:17.517955+0000","last_fullsized":"2024-09-22T09:50:17.517955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'208","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662541+0000","last_change":"2024-09-22T08:42:13.420863+0000","last_active":"2024-09-22T09:51:02.662541+0000","last_peered":"2024-09-22T09:51:02.662541+0000","last_clean":"2024-09-22T09:51:02.662541+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:51:02.662541+0000","last_undegraded":"2024-09-22T09:51:02.662541+0000","last_fullsized":"2024-09-22T09:51:02.662541+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:47.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294213,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":134895,"num_write":906,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.688003+0000","last_change":"2024-09-22T08:42:17.440799+0000","last_active":"2024-09-22T09:51:37.688003+0000","last_peered":"2024-09-22T09:51:37.688003+0000","last_clean":"2024-09-22T09:51:37.688003+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:51:37.688003+0000","last_undegraded":"2024-09-22T09:51:37.688003+0000","last_fullsized":"2024-09-22T09:51:37.688003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:27.078620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'886","reported_seq":2685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.768544+0000","last_change":"2024-09-22T08:42:19.455687+0000","last_active":"2024-09-22T09:54:03.768544+0000","last_peered":"2024-09-22T09:54:03.768544+0000","last_clean":"2024-09-22T09:54:03.768544+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:03.768544+0000","last_undegraded":"2024-09-22T09:54:03.768544+0000","last_fullsized":"2024-09-22T09:54:03.768544+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":801,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.282664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1245,"num_read_kb":1438,"num_write":372,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.527988+0000","last_change":"2024-09-22T08:42:21.476397+0000","last_active":"2024-09-22T09:51:22.527988+0000","last_peered":"2024-09-22T09:51:22.527988+0000","last_clean":"2024-09-22T09:51:22.527988+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:51:22.527988+0000","last_undegraded":"2024-09-22T09:51:22.527988+0000","last_fullsized":"2024-09-22T09:51:22.527988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:11.328442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'234","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.082338+0000","last_change":"2024-09-22T08:42:23.576879+0000","last_active":"2024-09-22T09:50:32.082338+0000","last_peered":"2024-09-22T09:50:32.082338+0000","last_clean":"2024-09-22T09:50:32.082338+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:50:32.082338+0000","last_undegraded":"2024-09-22T09:50:32.082338+0000","last_fullsized":"2024-09-22T09:50:32.082338+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:21.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438071+0000","last_change":"2024-09-22T08:42:15.437627+0000","last_active":"2024-09-22T09:51:37.438071+0000","last_peered":"2024-09-22T09:51:37.438071+0000","last_clean":"2024-09-22T09:51:37.438071+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:51:37.438071+0000","last_undegraded":"2024-09-22T09:51:37.438071+0000","last_fullsized":"2024-09-22T09:51:37.438071+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:22.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.692480+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T09:50:47.692480+0000","last_peered":"2024-09-22T09:50:47.692480+0000","last_clean":"2024-09-22T09:50:47.692480+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:50:47.692480+0000","last_undegraded":"2024-09-22T09:50:47.692480+0000","last_fullsized":"2024-09-22T09:50:47.692480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'194","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430645+0000","last_change":"2024-09-22T08:42:13.407521+0000","last_active":"2024-09-22T09:50:32.430645+0000","last_peered":"2024-09-22T09:50:32.430645+0000","last_clean":"2024-09-22T09:50:32.430645+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:50:32.430645+0000","last_undegraded":"2024-09-22T09:50:32.430645+0000","last_fullsized":"2024-09-22T09:50:32.430645+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:16.981459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546972,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":559,"num_read_kb":19334,"num_write":880,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697276+0000","last_change":"2024-09-22T08:42:17.436489+0000","last_active":"2024-09-22T09:51:37.697276+0000","last_peered":"2024-09-22T09:51:37.697276+0000","last_clean":"2024-09-22T09:51:37.697276+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:51:37.697276+0000","last_undegraded":"2024-09-22T09:51:37.697276+0000","last_fullsized":"2024-09-22T09:51:37.697276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:43.716495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'282","reported_seq":1698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.992925+0000","last_change":"2024-09-22T08:42:19.458357+0000","last_active":"2024-09-22T09:53:57.992925+0000","last_peered":"2024-09-22T09:53:57.992925+0000","last_clean":"2024-09-22T09:53:57.992925+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:53:57.992925+0000","last_undegraded":"2024-09-22T09:53:57.992925+0000","last_fullsized":"2024-09-22T09:53:57.992925+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:59.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663363+0000","last_change":"2024-09-22T08:42:21.479092+0000","last_active":"2024-09-22T09:51:07.663363+0000","last_peered":"2024-09-22T09:51:07.663363+0000","last_clean":"2024-09-22T09:51:07.663363+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:51:07.663363+0000","last_undegraded":"2024-09-22T09:51:07.663363+0000","last_fullsized":"2024-09-22T09:51:07.663363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:10.715693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.853797+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:35.853797+0000","last_peered":"2024-09-22T09:52:35.853797+0000","last_clean":"2024-09-22T09:52:35.853797+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:35.853797+0000","last_undegraded":"2024-09-22T09:52:35.853797+0000","last_fullsized":"2024-09-22T09:52:35.853797+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:52.995365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.434014+0000","last_change":"2024-09-22T08:42:15.430662+0000","last_active":"2024-09-22T09:51:02.434014+0000","last_peered":"2024-09-22T09:51:02.434014+0000","last_clean":"2024-09-22T09:51:02.434014+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:51:02.434014+0000","last_undegraded":"2024-09-22T09:51:02.434014+0000","last_fullsized":"2024-09-22T09:51:02.434014+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:01.989354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680585+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T09:50:47.680585+0000","last_peered":"2024-09-22T09:50:47.680585+0000","last_clean":"2024-09-22T09:50:47.680585+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:50:47.680585+0000","last_undegraded":"2024-09-22T09:50:47.680585+0000","last_fullsized":"2024-09-22T09:50:47.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'220","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556862+0000","last_change":"2024-09-22T08:42:13.416911+0000","last_active":"2024-09-22T09:51:02.556862+0000","last_peered":"2024-09-22T09:51:02.556862+0000","last_clean":"2024-09-22T09:51:02.556862+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:51:02.556862+0000","last_undegraded":"2024-09-22T09:51:02.556862+0000","last_fullsized":"2024-09-22T09:51:02.556862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:31.168513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392059,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":567,"num_read_kb":44921,"num_write":1096,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663982+0000","last_change":"2024-09-22T08:42:17.437159+0000","last_active":"2024-09-22T09:51:12.663982+0000","last_peered":"2024-09-22T09:51:12.663982+0000","last_clean":"2024-09-22T09:51:12.663982+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:51:12.663982+0000","last_undegraded":"2024-09-22T09:51:12.663982+0000","last_fullsized":"2024-09-22T09:51:12.663982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.902285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'158","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.565701+0000","last_change":"2024-09-22T08:42:19.456365+0000","last_active":"2024-09-22T09:53:52.565701+0000","last_peered":"2024-09-22T09:53:52.565701+0000","last_clean":"2024-09-22T09:53:52.565701+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:53:52.565701+0000","last_undegraded":"2024-09-22T09:53:52.565701+0000","last_fullsized":"2024-09-22T09:53:52.565701+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:24.107895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681332+0000","last_change":"2024-09-22T08:42:21.479775+0000","last_active":"2024-09-22T09:51:42.681332+0000","last_peered":"2024-09-22T09:51:42.681332+0000","last_clean":"2024-09-22T09:51:42.681332+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:51:42.681332+0000","last_undegraded":"2024-09-22T09:51:42.681332+0000","last_fullsized":"2024-09-22T09:51:42.681332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:27.626455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'121","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.689264+0000","last_change":"2024-09-22T08:42:23.527151+0000","last_active":"2024-09-22T09:51:47.689264+0000","last_peered":"2024-09-22T09:51:47.689264+0000","last_clean":"2024-09-22T09:51:47.689264+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:51:47.689264+0000","last_undegraded":"2024-09-22T09:51:47.689264+0000","last_fullsized":"2024-09-22T09:51:47.689264+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:36.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.433983+0000","last_change":"2024-09-22T08:42:15.437662+0000","last_active":"2024-09-22T09:51:02.433983+0000","last_peered":"2024-09-22T09:51:02.433983+0000","last_clean":"2024-09-22T09:51:02.433983+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:51:02.433983+0000","last_undegraded":"2024-09-22T09:51:02.433983+0000","last_fullsized":"2024-09-22T09:51:02.433983+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:44.376313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'188","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:49.774854+0000","last_change":"2024-09-22T08:42:13.406072+0000","last_active":"2024-09-22T09:53:49.774854+0000","last_peered":"2024-09-22T09:53:49.774854+0000","last_clean":"2024-09-22T09:53:49.774854+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:53:49.774854+0000","last_undegraded":"2024-09-22T09:53:49.774854+0000","last_fullsized":"2024-09-22T09:53:49.774854+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:34:54.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":36411,"num_write":934,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.432285+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T09:50:47.432285+0000","last_peered":"2024-09-22T09:50:47.432285+0000","last_clean":"2024-09-22T09:50:47.432285+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:50:47.432285+0000","last_undegraded":"2024-09-22T09:50:47.432285+0000","last_fullsized":"2024-09-22T09:50:47.432285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662643+0000","last_change":"2024-09-22T08:42:17.436067+0000","last_active":"2024-09-22T09:51:02.662643+0000","last_peered":"2024-09-22T09:51:02.662643+0000","last_clean":"2024-09-22T09:51:02.662643+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:51:02.662643+0000","last_undegraded":"2024-09-22T09:51:02.662643+0000","last_fullsized":"2024-09-22T09:51:02.662643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:08.963170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'350","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.705822+0000","last_change":"2024-09-22T08:42:19.456910+0000","last_active":"2024-09-22T09:54:00.705822+0000","last_peered":"2024-09-22T09:54:00.705822+0000","last_clean":"2024-09-22T09:54:00.705822+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:00.705822+0000","last_undegraded":"2024-09-22T09:54:00.705822+0000","last_fullsized":"2024-09-22T09:54:00.705822+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:35.309371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24760,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1176,"num_read_kb":1299,"num_write":1762,"num_write_kb":1579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557458+0000","last_change":"2024-09-22T08:42:21.481570+0000","last_active":"2024-09-22T09:51:07.557458+0000","last_peered":"2024-09-22T09:51:07.557458+0000","last_clean":"2024-09-22T09:51:07.557458+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:51:07.557458+0000","last_undegraded":"2024-09-22T09:51:07.557458+0000","last_fullsized":"2024-09-22T09:51:07.557458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:52.544367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.135926+0000","last_change":"2024-09-22T08:42:23.578322+0000","last_active":"2024-09-22T09:52:33.135926+0000","last_peered":"2024-09-22T09:52:33.135926+0000","last_clean":"2024-09-22T09:52:33.135926+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:52:33.135926+0000","last_undegraded":"2024-09-22T09:52:33.135926+0000","last_fullsized":"2024-09-22T09:52:33.135926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:06.092146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662627+0000","last_change":"2024-09-22T08:42:15.425980+0000","last_active":"2024-09-22T09:51:02.662627+0000","last_peered":"2024-09-22T09:51:02.662627+0000","last_clean":"2024-09-22T09:51:02.662627+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:51:02.662627+0000","last_undegraded":"2024-09-22T09:51:02.662627+0000","last_fullsized":"2024-09-22T09:51:02.662627+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:08.622112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'219","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:02.447621+0000","last_change":"2024-09-22T08:42:13.422109+0000","last_active":"2024-09-22T09:53:02.447621+0000","last_peered":"2024-09-22T09:53:02.447621+0000","last_clean":"2024-09-22T09:53:02.447621+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:53:02.447621+0000","last_undegraded":"2024-09-22T09:53:02.447621+0000","last_fullsized":"2024-09-22T09:53:02.447621+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:30.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236610,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1845,"num_write":1045,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524935+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T09:51:02.524935+0000","last_peered":"2024-09-22T09:51:02.524935+0000","last_clean":"2024-09-22T09:51:02.524935+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:51:02.524935+0000","last_undegraded":"2024-09-22T09:51:02.524935+0000","last_fullsized":"2024-09-22T09:51:02.524935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675254+0000","last_change":"2024-09-22T08:42:17.436017+0000","last_active":"2024-09-22T09:51:02.675254+0000","last_peered":"2024-09-22T09:51:02.675254+0000","last_clean":"2024-09-22T09:51:02.675254+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:51:02.675254+0000","last_undegraded":"2024-09-22T09:51:02.675254+0000","last_fullsized":"2024-09-22T09:51:02.675254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:52.183670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'215","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.922563+0000","last_change":"2024-09-22T08:42:19.456840+0000","last_active":"2024-09-22T09:52:52.922563+0000","last_peered":"2024-09-22T09:52:52.922563+0000","last_clean":"2024-09-22T09:52:52.922563+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:52:52.922563+0000","last_undegraded":"2024-09-22T09:52:52.922563+0000","last_fullsized":"2024-09-22T09:52:52.922563+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:19.484900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'761","reported_seq":4641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.789752+0000","last_change":"2024-09-22T08:42:21.481370+0000","last_active":"2024-09-22T09:54:03.789752+0000","last_peered":"2024-09-22T09:54:03.789752+0000","last_clean":"2024-09-22T09:54:03.789752+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:03.789752+0000","last_undegraded":"2024-09-22T09:54:03.789752+0000","last_fullsized":"2024-09-22T09:54:03.789752+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":701,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:26.631766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.133370+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:52:33.133370+0000","last_peered":"2024-09-22T09:52:33.133370+0000","last_clean":"2024-09-22T09:52:33.133370+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:52:33.133370+0000","last_undegraded":"2024-09-22T09:52:33.133370+0000","last_fullsized":"2024-09-22T09:52:33.133370+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.457091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658056+0000","last_change":"2024-09-22T08:42:15.435920+0000","last_active":"2024-09-22T09:50:27.658056+0000","last_peered":"2024-09-22T09:50:27.658056+0000","last_clean":"2024-09-22T09:50:27.658056+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:50:27.658056+0000","last_undegraded":"2024-09-22T09:50:27.658056+0000","last_fullsized":"2024-09-22T09:50:27.658056+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:21.159641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666115+0000","last_change":"2024-09-22T08:42:13.414597+0000","last_active":"2024-09-22T09:51:32.666115+0000","last_peered":"2024-09-22T09:51:32.666115+0000","last_clean":"2024-09-22T09:51:32.666115+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:51:32.666115+0000","last_undegraded":"2024-09-22T09:51:32.666115+0000","last_fullsized":"2024-09-22T09:51:32.666115+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:34.931040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.436368+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T09:51:22.436368+0000","last_peered":"2024-09-22T09:51:22.436368+0000","last_clean":"2024-09-22T09:51:22.436368+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:51:22.436368+0000","last_undegraded":"2024-09-22T09:51:22.436368+0000","last_fullsized":"2024-09-22T09:51:22.436368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556800+0000","last_change":"2024-09-22T08:42:17.440772+0000","last_active":"2024-09-22T09:51:02.556800+0000","last_peered":"2024-09-22T09:51:02.556800+0000","last_clean":"2024-09-22T09:51:02.556800+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:51:02.556800+0000","last_undegraded":"2024-09-22T09:51:02.556800+0000","last_fullsized":"2024-09-22T09:51:02.556800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:54.715553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'134","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.892504+0000","last_change":"2024-09-22T08:42:19.457603+0000","last_active":"2024-09-22T09:52:52.892504+0000","last_peered":"2024-09-22T09:52:52.892504+0000","last_clean":"2024-09-22T09:52:52.892504+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:52:52.892504+0000","last_undegraded":"2024-09-22T09:52:52.892504+0000","last_fullsized":"2024-09-22T09:52:52.892504+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:47.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'752","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782873+0000","last_change":"2024-09-22T08:42:21.478082+0000","last_active":"2024-09-22T09:54:03.782873+0000","last_peered":"2024-09-22T09:54:03.782873+0000","last_clean":"2024-09-22T09:54:03.782873+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:03.782873+0000","last_undegraded":"2024-09-22T09:54:03.782873+0000","last_fullsized":"2024-09-22T09:54:03.782873+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:57.519253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'148","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.332706+0000","last_change":"2024-09-22T08:42:23.525171+0000","last_active":"2024-09-22T09:51:11.332706+0000","last_peered":"2024-09-22T09:51:11.332706+0000","last_clean":"2024-09-22T09:51:11.332706+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:51:11.332706+0000","last_undegraded":"2024-09-22T09:51:11.332706+0000","last_fullsized":"2024-09-22T09:51:11.332706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:04.949992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556810+0000","last_change":"2024-09-22T08:42:15.426476+0000","last_active":"2024-09-22T09:51:02.556810+0000","last_peered":"2024-09-22T09:51:02.556810+0000","last_clean":"2024-09-22T09:51:02.556810+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:51:02.556810+0000","last_undegraded":"2024-09-22T09:51:02.556810+0000","last_fullsized":"2024-09-22T09:51:02.556810+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:40.091111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'187","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667284+0000","last_change":"2024-09-22T08:42:13.412711+0000","last_active":"2024-09-22T09:51:37.667284+0000","last_peered":"2024-09-22T09:51:37.667284+0000","last_clean":"2024-09-22T09:51:37.667284+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:51:37.667284+0000","last_undegraded":"2024-09-22T09:51:37.667284+0000","last_fullsized":"2024-09-22T09:51:37.667284+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266062,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":406,"num_write":847,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.678442+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T09:51:22.678442+0000","last_peered":"2024-09-22T09:51:22.678442+0000","last_clean":"2024-09-22T09:51:22.678442+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:51:22.678442+0000","last_undegraded":"2024-09-22T09:51:22.678442+0000","last_fullsized":"2024-09-22T09:51:22.678442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658036+0000","last_change":"2024-09-22T08:42:17.440887+0000","last_active":"2024-09-22T09:50:27.658036+0000","last_peered":"2024-09-22T09:50:27.658036+0000","last_clean":"2024-09-22T09:50:27.658036+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:50:27.658036+0000","last_undegraded":"2024-09-22T09:50:27.658036+0000","last_fullsized":"2024-09-22T09:50:27.658036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:14.170224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'345","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.702399+0000","last_change":"2024-09-22T08:42:19.455440+0000","last_active":"2024-09-22T09:54:00.702399+0000","last_peered":"2024-09-22T09:54:00.702399+0000","last_clean":"2024-09-22T09:54:00.702399+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:00.702399+0000","last_undegraded":"2024-09-22T09:54:00.702399+0000","last_fullsized":"2024-09-22T09:54:00.702399+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:31.127669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34966,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":508,"num_read_kb":712,"num_write":272,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662903+0000","last_change":"2024-09-22T08:42:21.481354+0000","last_active":"2024-09-22T09:51:07.662903+0000","last_peered":"2024-09-22T09:51:07.662903+0000","last_clean":"2024-09-22T09:51:07.662903+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:51:07.662903+0000","last_undegraded":"2024-09-22T09:51:07.662903+0000","last_fullsized":"2024-09-22T09:51:07.662903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:55.654023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'92","reported_seq":590,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.904200+0000","last_change":"2024-09-22T08:42:23.528079+0000","last_active":"2024-09-22T09:50:17.904200+0000","last_peered":"2024-09-22T09:50:17.904200+0000","last_clean":"2024-09-22T09:50:17.904200+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:50:17.904200+0000","last_undegraded":"2024-09-22T09:50:17.904200+0000","last_fullsized":"2024-09-22T09:50:17.904200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:28.365018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547536+0000","last_change":"2024-09-22T08:42:15.426467+0000","last_active":"2024-09-22T09:49:57.547536+0000","last_peered":"2024-09-22T09:49:57.547536+0000","last_clean":"2024-09-22T09:49:57.547536+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:49:57.547536+0000","last_undegraded":"2024-09-22T09:49:57.547536+0000","last_fullsized":"2024-09-22T09:49:57.547536+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:10.885001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'191","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.549844+0000","last_change":"2024-09-22T08:42:13.418044+0000","last_active":"2024-09-22T09:50:12.549844+0000","last_peered":"2024-09-22T09:50:12.549844+0000","last_clean":"2024-09-22T09:50:12.549844+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:50:12.549844+0000","last_undegraded":"2024-09-22T09:50:12.549844+0000","last_fullsized":"2024-09-22T09:50:12.549844+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:06.417643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21018941,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":56883,"num_write":849,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426786+0000","last_change":"2024-09-22T08:42:17.434551+0000","last_active":"2024-09-22T09:49:57.426786+0000","last_peered":"2024-09-22T09:49:57.426786+0000","last_clean":"2024-09-22T09:49:57.426786+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:49:57.426786+0000","last_undegraded":"2024-09-22T09:49:57.426786+0000","last_fullsized":"2024-09-22T09:49:57.426786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:49.306717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'167","reported_seq":749,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.927346+0000","last_change":"2024-09-22T08:42:19.459166+0000","last_active":"2024-09-22T09:52:52.927346+0000","last_peered":"2024-09-22T09:52:52.927346+0000","last_clean":"2024-09-22T09:52:52.927346+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:52:52.927346+0000","last_undegraded":"2024-09-22T09:52:52.927346+0000","last_fullsized":"2024-09-22T09:52:52.927346+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:04.933821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":130,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654407+0000","last_change":"2024-09-22T08:42:21.480559+0000","last_active":"2024-09-22T09:50:02.654407+0000","last_peered":"2024-09-22T09:50:02.654407+0000","last_clean":"2024-09-22T09:50:02.654407+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:50:02.654407+0000","last_undegraded":"2024-09-22T09:50:02.654407+0000","last_fullsized":"2024-09-22T09:50:02.654407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:57.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:00.060711+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:51:00.060711+0000","last_peered":"2024-09-22T09:51:00.060711+0000","last_clean":"2024-09-22T09:51:00.060711+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:51:00.060711+0000","last_undegraded":"2024-09-22T09:51:00.060711+0000","last_fullsized":"2024-09-22T09:51:00.060711+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:00.026997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426814+0000","last_change":"2024-09-22T08:42:15.435296+0000","last_active":"2024-09-22T09:49:57.426814+0000","last_peered":"2024-09-22T09:49:57.426814+0000","last_clean":"2024-09-22T09:49:57.426814+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:49:57.426814+0000","last_undegraded":"2024-09-22T09:49:57.426814+0000","last_fullsized":"2024-09-22T09:49:57.426814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:37.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514089+0000","last_change":"2024-09-22T08:42:13.414954+0000","last_active":"2024-09-22T09:49:52.514089+0000","last_peered":"2024-09-22T09:49:52.514089+0000","last_clean":"2024-09-22T09:49:52.514089+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:49:52.514089+0000","last_undegraded":"2024-09-22T09:49:52.514089+0000","last_fullsized":"2024-09-22T09:49:52.514089+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:55.273095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16394947,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":586,"num_read_kb":50629,"num_write":1049,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653853+0000","last_change":"2024-09-22T08:42:17.440629+0000","last_active":"2024-09-22T09:49:57.653853+0000","last_peered":"2024-09-22T09:49:57.653853+0000","last_clean":"2024-09-22T09:49:57.653853+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:49:57.653853+0000","last_undegraded":"2024-09-22T09:49:57.653853+0000","last_fullsized":"2024-09-22T09:49:57.653853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:13.561126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'53","reported_seq":565,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.547272+0000","last_change":"2024-09-22T08:42:19.456534+0000","last_active":"2024-09-22T09:52:52.547272+0000","last_peered":"2024-09-22T09:52:52.547272+0000","last_clean":"2024-09-22T09:52:52.547272+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:52:52.547272+0000","last_undegraded":"2024-09-22T09:52:52.547272+0000","last_fullsized":"2024-09-22T09:52:52.547272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:45.983322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515570+0000","last_change":"2024-09-22T08:42:21.476849+0000","last_active":"2024-09-22T09:50:02.515570+0000","last_peered":"2024-09-22T09:50:02.515570+0000","last_clean":"2024-09-22T09:50:02.515570+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:50:02.515570+0000","last_undegraded":"2024-09-22T09:50:02.515570+0000","last_fullsized":"2024-09-22T09:50:02.515570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:43.656268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.634796+0000","last_change":"2024-09-22T08:42:23.526388+0000","last_active":"2024-09-22T09:52:35.634796+0000","last_peered":"2024-09-22T09:52:35.634796+0000","last_clean":"2024-09-22T09:52:35.634796+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:52:35.634796+0000","last_undegraded":"2024-09-22T09:52:35.634796+0000","last_fullsized":"2024-09-22T09:52:35.634796+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:29.029640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.665914+0000","last_change":"2024-09-22T08:42:15.438483+0000","last_active":"2024-09-22T09:52:36.665914+0000","last_peered":"2024-09-22T09:52:36.665914+0000","last_clean":"2024-09-22T09:52:36.665914+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:52:36.665914+0000","last_undegraded":"2024-09-22T09:52:36.665914+0000","last_fullsized":"2024-09-22T09:52:36.665914+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.521372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'203","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673275+0000","last_change":"2024-09-22T08:42:13.413578+0000","last_active":"2024-09-22T09:49:57.673275+0000","last_peered":"2024-09-22T09:49:57.673275+0000","last_clean":"2024-09-22T09:49:57.673275+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:49:57.673275+0000","last_undegraded":"2024-09-22T09:49:57.673275+0000","last_fullsized":"2024-09-22T09:49:57.673275+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:00.034449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267605,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":27137,"num_write":991,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514721+0000","last_change":"2024-09-22T08:42:17.430472+0000","last_active":"2024-09-22T09:49:57.514721+0000","last_peered":"2024-09-22T09:49:57.514721+0000","last_clean":"2024-09-22T09:49:57.514721+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:49:57.514721+0000","last_undegraded":"2024-09-22T09:49:57.514721+0000","last_fullsized":"2024-09-22T09:49:57.514721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:35.687053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'193","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.415565+0000","last_change":"2024-09-22T08:42:19.459846+0000","last_active":"2024-09-22T09:53:59.415565+0000","last_peered":"2024-09-22T09:53:59.415565+0000","last_clean":"2024-09-22T09:53:59.415565+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:53:59.415565+0000","last_undegraded":"2024-09-22T09:53:59.415565+0000","last_fullsized":"2024-09-22T09:53:59.415565+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:37.691592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":310,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.667537+0000","last_change":"2024-09-22T08:42:21.479495+0000","last_active":"2024-09-22T09:50:02.667537+0000","last_peered":"2024-09-22T09:50:02.667537+0000","last_clean":"2024-09-22T09:50:02.667537+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:50:02.667537+0000","last_undegraded":"2024-09-22T09:50:02.667537+0000","last_fullsized":"2024-09-22T09:50:02.667537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:56.016803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'184","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.144194+0000","last_change":"2024-09-22T08:42:23.527658+0000","last_active":"2024-09-22T09:50:22.144194+0000","last_peered":"2024-09-22T09:50:22.144194+0000","last_clean":"2024-09-22T09:50:22.144194+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:50:22.144194+0000","last_undegraded":"2024-09-22T09:50:22.144194+0000","last_fullsized":"2024-09-22T09:50:22.144194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:34.867859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'173","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653721+0000","last_change":"2024-09-22T08:42:15.440994+0000","last_active":"2024-09-22T09:49:57.653721+0000","last_peered":"2024-09-22T09:49:57.653721+0000","last_clean":"2024-09-22T09:49:57.653721+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:49:57.653721+0000","last_undegraded":"2024-09-22T09:49:57.653721+0000","last_fullsized":"2024-09-22T09:49:57.653721+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:06.924407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'200","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:56.590917+0000","last_change":"2024-09-22T08:42:13.421739+0000","last_active":"2024-09-22T09:50:56.590917+0000","last_peered":"2024-09-22T09:50:56.590917+0000","last_clean":"2024-09-22T09:50:56.590917+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:50:56.590917+0000","last_undegraded":"2024-09-22T09:50:56.590917+0000","last_fullsized":"2024-09-22T09:50:56.590917+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:25:10.061779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10786420,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":41854,"num_write":1016,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666642+0000","last_change":"2024-09-22T08:42:17.428665+0000","last_active":"2024-09-22T09:49:57.666642+0000","last_peered":"2024-09-22T09:49:57.666642+0000","last_clean":"2024-09-22T09:49:57.666642+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:49:57.666642+0000","last_undegraded":"2024-09-22T09:49:57.666642+0000","last_fullsized":"2024-09-22T09:49:57.666642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:34.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'144","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.714713+0000","last_change":"2024-09-22T08:42:19.453111+0000","last_active":"2024-09-22T09:52:52.714713+0000","last_peered":"2024-09-22T09:52:52.714713+0000","last_clean":"2024-09-22T09:52:52.714713+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:52:52.714713+0000","last_undegraded":"2024-09-22T09:52:52.714713+0000","last_fullsized":"2024-09-22T09:52:52.714713+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:24.508041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":204,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654861+0000","last_change":"2024-09-22T08:42:21.475223+0000","last_active":"2024-09-22T09:50:02.654861+0000","last_peered":"2024-09-22T09:50:02.654861+0000","last_clean":"2024-09-22T09:50:02.654861+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:50:02.654861+0000","last_undegraded":"2024-09-22T09:50:02.654861+0000","last_fullsized":"2024-09-22T09:50:02.654861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:09.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675311+0000","last_change":"2024-09-22T08:42:15.431489+0000","last_active":"2024-09-22T09:51:02.675311+0000","last_peered":"2024-09-22T09:51:02.675311+0000","last_clean":"2024-09-22T09:51:02.675311+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:51:02.675311+0000","last_undegraded":"2024-09-22T09:51:02.675311+0000","last_fullsized":"2024-09-22T09:51:02.675311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:58.608179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'198","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:26.664923+0000","last_change":"2024-09-22T08:42:13.403630+0000","last_active":"2024-09-22T09:50:26.664923+0000","last_peered":"2024-09-22T09:50:26.664923+0000","last_clean":"2024-09-22T09:50:26.664923+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:50:26.664923+0000","last_undegraded":"2024-09-22T09:50:26.664923+0000","last_fullsized":"2024-09-22T09:50:26.664923+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:49.925047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16345112,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":68522,"num_write":909,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658194+0000","last_change":"2024-09-22T08:42:17.438090+0000","last_active":"2024-09-22T09:50:27.658194+0000","last_peered":"2024-09-22T09:50:27.658194+0000","last_clean":"2024-09-22T09:50:27.658194+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:50:27.658194+0000","last_undegraded":"2024-09-22T09:50:27.658194+0000","last_fullsized":"2024-09-22T09:50:27.658194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:49.781681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.698391+0000","last_change":"2024-09-22T08:42:19.455805+0000","last_active":"2024-09-22T09:54:00.698391+0000","last_peered":"2024-09-22T09:54:00.698391+0000","last_clean":"2024-09-22T09:54:00.698391+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:00.698391+0000","last_undegraded":"2024-09-22T09:54:00.698391+0000","last_fullsized":"2024-09-22T09:54:00.698391+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:46.845015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30397,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":501,"num_write":220,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.672389+0000","last_change":"2024-09-22T08:42:21.482536+0000","last_active":"2024-09-22T09:49:52.672389+0000","last_peered":"2024-09-22T09:49:52.672389+0000","last_clean":"2024-09-22T09:49:52.672389+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:49:52.672389+0000","last_undegraded":"2024-09-22T09:49:52.672389+0000","last_fullsized":"2024-09-22T09:49:52.672389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:16.490768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.317977+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:50:15.317977+0000","last_peered":"2024-09-22T09:50:15.317977+0000","last_clean":"2024-09-22T09:50:15.317977+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:50:15.317977+0000","last_undegraded":"2024-09-22T09:50:15.317977+0000","last_fullsized":"2024-09-22T09:50:15.317977+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:49.491628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658171+0000","last_change":"2024-09-22T08:42:15.427151+0000","last_active":"2024-09-22T09:50:27.658171+0000","last_peered":"2024-09-22T09:50:27.658171+0000","last_clean":"2024-09-22T09:50:27.658171+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:50:27.658171+0000","last_undegraded":"2024-09-22T09:50:27.658171+0000","last_fullsized":"2024-09-22T09:50:27.658171+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:08.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'216","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428487+0000","last_change":"2024-09-22T08:42:13.408621+0000","last_active":"2024-09-22T09:50:12.428487+0000","last_peered":"2024-09-22T09:50:12.428487+0000","last_clean":"2024-09-22T09:50:12.428487+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:50:12.428487+0000","last_undegraded":"2024-09-22T09:50:12.428487+0000","last_fullsized":"2024-09-22T09:50:12.428487+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:38.944084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2123947,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":678,"num_read_kb":5102,"num_write":1152,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675298+0000","last_change":"2024-09-22T08:42:17.432901+0000","last_active":"2024-09-22T09:51:02.675298+0000","last_peered":"2024-09-22T09:51:02.675298+0000","last_clean":"2024-09-22T09:51:02.675298+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:51:02.675298+0000","last_undegraded":"2024-09-22T09:51:02.675298+0000","last_fullsized":"2024-09-22T09:51:02.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:54.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'202","reported_seq":797,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.798953+0000","last_change":"2024-09-22T08:42:19.454425+0000","last_active":"2024-09-22T09:52:52.798953+0000","last_peered":"2024-09-22T09:52:52.798953+0000","last_clean":"2024-09-22T09:52:52.798953+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:52:52.798953+0000","last_undegraded":"2024-09-22T09:52:52.798953+0000","last_fullsized":"2024-09-22T09:52:52.798953+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:32.598763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7943,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":326,"num_write":180,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426248+0000","last_change":"2024-09-22T08:42:21.476913+0000","last_active":"2024-09-22T09:49:52.426248+0000","last_peered":"2024-09-22T09:49:52.426248+0000","last_clean":"2024-09-22T09:49:52.426248+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:49:52.426248+0000","last_undegraded":"2024-09-22T09:49:52.426248+0000","last_fullsized":"2024-09-22T09:49:52.426248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:43.637608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'167","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.287498+0000","last_change":"2024-09-22T08:42:23.524343+0000","last_active":"2024-09-22T09:52:35.287498+0000","last_peered":"2024-09-22T09:52:35.287498+0000","last_clean":"2024-09-22T09:52:35.287498+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:52:35.287498+0000","last_undegraded":"2024-09-22T09:52:35.287498+0000","last_fullsized":"2024-09-22T09:52:35.287498+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:59.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652648+0000","last_change":"2024-09-22T08:42:15.441307+0000","last_active":"2024-09-22T09:49:47.652648+0000","last_peered":"2024-09-22T09:49:47.652648+0000","last_clean":"2024-09-22T09:49:47.652648+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:49:47.652648+0000","last_undegraded":"2024-09-22T09:49:47.652648+0000","last_fullsized":"2024-09-22T09:49:47.652648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:01.398679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'189","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545846+0000","last_change":"2024-09-22T08:42:13.403394+0000","last_active":"2024-09-22T09:49:47.545846+0000","last_peered":"2024-09-22T09:49:47.545846+0000","last_clean":"2024-09-22T09:49:47.545846+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:49:47.545846+0000","last_undegraded":"2024-09-22T09:49:47.545846+0000","last_fullsized":"2024-09-22T09:49:47.545846+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:07.863561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29587,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1207,"num_read_kb":5814,"num_write":978,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545954+0000","last_change":"2024-09-22T08:42:17.435464+0000","last_active":"2024-09-22T09:49:47.545954+0000","last_peered":"2024-09-22T09:49:47.545954+0000","last_clean":"2024-09-22T09:49:47.545954+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:49:47.545954+0000","last_undegraded":"2024-09-22T09:49:47.545954+0000","last_fullsized":"2024-09-22T09:49:47.545954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:38.411752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'156","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.560516+0000","last_change":"2024-09-22T08:42:19.458421+0000","last_active":"2024-09-22T09:53:12.560516+0000","last_peered":"2024-09-22T09:53:12.560516+0000","last_clean":"2024-09-22T09:53:12.560516+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:53:12.560516+0000","last_undegraded":"2024-09-22T09:53:12.560516+0000","last_fullsized":"2024-09-22T09:53:12.560516+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:17.997133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12957,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":277,"num_write":116,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431784+0000","last_change":"2024-09-22T08:42:21.482356+0000","last_active":"2024-09-22T09:50:42.431784+0000","last_peered":"2024-09-22T09:50:42.431784+0000","last_clean":"2024-09-22T09:50:42.431784+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:50:42.431784+0000","last_undegraded":"2024-09-22T09:50:42.431784+0000","last_fullsized":"2024-09-22T09:50:42.431784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:32.679904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'112","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.729613+0000","last_change":"2024-09-22T08:42:23.524273+0000","last_active":"2024-09-22T09:54:00.729613+0000","last_peered":"2024-09-22T09:54:00.729613+0000","last_clean":"2024-09-22T09:54:00.729613+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:00.729613+0000","last_undegraded":"2024-09-22T09:54:00.729613+0000","last_fullsized":"2024-09-22T09:54:00.729613+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:17.604133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686473+0000","last_change":"2024-09-22T08:42:15.435809+0000","last_active":"2024-09-22T09:49:47.686473+0000","last_peered":"2024-09-22T09:49:47.686473+0000","last_clean":"2024-09-22T09:49:47.686473+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:49:47.686473+0000","last_undegraded":"2024-09-22T09:49:47.686473+0000","last_fullsized":"2024-09-22T09:49:47.686473+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:40.478687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'235","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:19.479556+0000","last_change":"2024-09-22T08:42:13.413803+0000","last_active":"2024-09-22T09:51:19.479556+0000","last_peered":"2024-09-22T09:51:19.479556+0000","last_clean":"2024-09-22T09:51:19.479556+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:51:19.479556+0000","last_undegraded":"2024-09-22T09:51:19.479556+0000","last_fullsized":"2024-09-22T09:51:19.479556+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:20.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290233,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":123234,"num_write":1013,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425590+0000","last_change":"2024-09-22T08:42:17.435752+0000","last_active":"2024-09-22T09:49:47.425590+0000","last_peered":"2024-09-22T09:49:47.425590+0000","last_clean":"2024-09-22T09:49:47.425590+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:49:47.425590+0000","last_undegraded":"2024-09-22T09:49:47.425590+0000","last_fullsized":"2024-09-22T09:49:47.425590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:10.922721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'121","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.915476+0000","last_change":"2024-09-22T08:42:19.453093+0000","last_active":"2024-09-22T09:52:52.915476+0000","last_peered":"2024-09-22T09:52:52.915476+0000","last_clean":"2024-09-22T09:52:52.915476+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:52:52.915476+0000","last_undegraded":"2024-09-22T09:52:52.915476+0000","last_fullsized":"2024-09-22T09:52:52.915476+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:18.283880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'756","reported_seq":4728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790790+0000","last_change":"2024-09-22T08:42:21.480171+0000","last_active":"2024-09-22T09:54:03.790790+0000","last_peered":"2024-09-22T09:54:03.790790+0000","last_clean":"2024-09-22T09:54:03.790790+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:03.790790+0000","last_undegraded":"2024-09-22T09:54:03.790790+0000","last_fullsized":"2024-09-22T09:54:03.790790+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:05.223141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.660200+0000","last_change":"2024-09-22T08:42:23.528243+0000","last_active":"2024-09-22T09:52:36.660200+0000","last_peered":"2024-09-22T09:52:36.660200+0000","last_clean":"2024-09-22T09:52:36.660200+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:52:36.660200+0000","last_undegraded":"2024-09-22T09:52:36.660200+0000","last_fullsized":"2024-09-22T09:52:36.660200+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:46.020648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545909+0000","last_change":"2024-09-22T08:42:46.084787+0000","last_active":"2024-09-22T09:49:47.545909+0000","last_peered":"2024-09-22T09:49:47.545909+0000","last_clean":"2024-09-22T09:49:47.545909+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:49:47.545909+0000","last_undegraded":"2024-09-22T09:49:47.545909+0000","last_fullsized":"2024-09-22T09:49:47.545909+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:31.609602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'288","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.260177+0000","last_change":"2024-09-22T08:42:46.086633+0000","last_active":"2024-09-22T09:51:11.260177+0000","last_peered":"2024-09-22T09:51:11.260177+0000","last_clean":"2024-09-22T09:51:11.260177+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:51:11.260177+0000","last_undegraded":"2024-09-22T09:51:11.260177+0000","last_fullsized":"2024-09-22T09:51:11.260177+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:16.757938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324323,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1299,"num_read_kb":50200,"num_write":1262,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.246095+0000","last_change":"2024-09-22T08:42:17.430502+0000","last_active":"2024-09-22T09:54:00.246095+0000","last_peered":"2024-09-22T09:54:00.246095+0000","last_clean":"2024-09-22T09:54:00.246095+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:00.246095+0000","last_undegraded":"2024-09-22T09:54:00.246095+0000","last_fullsized":"2024-09-22T09:54:00.246095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:02.208302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'210","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.941440+0000","last_change":"2024-09-22T08:42:19.455535+0000","last_active":"2024-09-22T09:52:52.941440+0000","last_peered":"2024-09-22T09:52:52.941440+0000","last_clean":"2024-09-22T09:52:52.941440+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:52:52.941440+0000","last_undegraded":"2024-09-22T09:52:52.941440+0000","last_fullsized":"2024-09-22T09:52:52.941440+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:46.902494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7279,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":309,"num_write":158,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654816+0000","last_change":"2024-09-22T08:42:21.476713+0000","last_active":"2024-09-22T09:50:02.654816+0000","last_peered":"2024-09-22T09:50:02.654816+0000","last_clean":"2024-09-22T09:50:02.654816+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:50:02.654816+0000","last_undegraded":"2024-09-22T09:50:02.654816+0000","last_fullsized":"2024-09-22T09:50:02.654816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:07.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'140","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539387+0000","last_change":"2024-09-22T08:42:23.517176+0000","last_active":"2024-09-22T09:52:32.539387+0000","last_peered":"2024-09-22T09:52:32.539387+0000","last_clean":"2024-09-22T09:52:32.539387+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:52:32.539387+0000","last_undegraded":"2024-09-22T09:52:32.539387+0000","last_fullsized":"2024-09-22T09:52:32.539387+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":763,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.383248+0000","last_change":"2024-09-22T08:42:15.431566+0000","last_active":"2024-09-22T09:51:28.383248+0000","last_peered":"2024-09-22T09:51:28.383248+0000","last_clean":"2024-09-22T09:51:28.383248+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:51:28.383248+0000","last_undegraded":"2024-09-22T09:51:28.383248+0000","last_fullsized":"2024-09-22T09:51:28.383248+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:38.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'210","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:59.997385+0000","last_change":"2024-09-22T08:42:46.088505+0000","last_active":"2024-09-22T09:50:59.997385+0000","last_peered":"2024-09-22T09:50:59.997385+0000","last_clean":"2024-09-22T09:50:59.997385+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:50:59.997385+0000","last_undegraded":"2024-09-22T09:50:59.997385+0000","last_fullsized":"2024-09-22T09:50:59.997385+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:58.102532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10731717,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":26654,"num_write":907,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671704+0000","last_change":"2024-09-22T08:42:17.434837+0000","last_active":"2024-09-22T09:49:47.671704+0000","last_peered":"2024-09-22T09:49:47.671704+0000","last_clean":"2024-09-22T09:49:47.671704+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:49:47.671704+0000","last_undegraded":"2024-09-22T09:49:47.671704+0000","last_fullsized":"2024-09-22T09:49:47.671704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:44.721168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'140","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.500608+0000","last_change":"2024-09-22T08:42:19.455628+0000","last_active":"2024-09-22T09:52:52.500608+0000","last_peered":"2024-09-22T09:52:52.500608+0000","last_clean":"2024-09-22T09:52:52.500608+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:52:52.500608+0000","last_undegraded":"2024-09-22T09:52:52.500608+0000","last_fullsized":"2024-09-22T09:52:52.500608+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:09.361619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12014,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":188,"num_read_kb":248,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668079+0000","last_change":"2024-09-22T08:42:21.476902+0000","last_active":"2024-09-22T09:50:07.668079+0000","last_peered":"2024-09-22T09:50:07.668079+0000","last_clean":"2024-09-22T09:50:07.668079+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:50:07.668079+0000","last_undegraded":"2024-09-22T09:50:07.668079+0000","last_fullsized":"2024-09-22T09:50:07.668079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:29.159677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.376679+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:51:35.376679+0000","last_peered":"2024-09-22T09:51:35.376679+0000","last_clean":"2024-09-22T09:51:35.376679+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:51:35.376679+0000","last_undegraded":"2024-09-22T09:51:35.376679+0000","last_fullsized":"2024-09-22T09:51:35.376679+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.855073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655142+0000","last_change":"2024-09-22T08:42:15.439064+0000","last_active":"2024-09-22T09:50:07.655142+0000","last_peered":"2024-09-22T09:50:07.655142+0000","last_clean":"2024-09-22T09:50:07.655142+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:50:07.655142+0000","last_undegraded":"2024-09-22T09:50:07.655142+0000","last_fullsized":"2024-09-22T09:50:07.655142+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:36.078212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'272","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657511+0000","last_change":"2024-09-22T08:42:13.405170+0000","last_active":"2024-09-22T09:50:22.657511+0000","last_peered":"2024-09-22T09:50:22.657511+0000","last_clean":"2024-09-22T09:50:22.657511+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:50:22.657511+0000","last_undegraded":"2024-09-22T09:50:22.657511+0000","last_fullsized":"2024-09-22T09:50:22.657511+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:38.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5302814,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":35485,"num_write":1183,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547433+0000","last_change":"2024-09-22T08:42:17.428752+0000","last_active":"2024-09-22T09:49:57.547433+0000","last_peered":"2024-09-22T09:49:57.547433+0000","last_clean":"2024-09-22T09:49:57.547433+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:49:57.547433+0000","last_undegraded":"2024-09-22T09:49:57.547433+0000","last_fullsized":"2024-09-22T09:49:57.547433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:24.944481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'111","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.679823+0000","last_change":"2024-09-22T08:42:19.453726+0000","last_active":"2024-09-22T09:52:52.679823+0000","last_peered":"2024-09-22T09:52:52.679823+0000","last_clean":"2024-09-22T09:52:52.679823+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:52:52.679823+0000","last_undegraded":"2024-09-22T09:52:52.679823+0000","last_fullsized":"2024-09-22T09:52:52.679823+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:05.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16619,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":237,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.546807+0000","last_change":"2024-09-22T08:42:21.478595+0000","last_active":"2024-09-22T09:49:52.546807+0000","last_peered":"2024-09-22T09:49:52.546807+0000","last_clean":"2024-09-22T09:49:52.546807+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:49:52.546807+0000","last_undegraded":"2024-09-22T09:49:52.546807+0000","last_fullsized":"2024-09-22T09:49:52.546807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:19.682078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'159","reported_seq":1627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.954159+0000","last_change":"2024-09-22T08:42:23.526111+0000","last_active":"2024-09-22T09:52:32.954159+0000","last_peered":"2024-09-22T09:52:32.954159+0000","last_clean":"2024-09-22T09:52:32.954159+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:52:32.954159+0000","last_undegraded":"2024-09-22T09:52:32.954159+0000","last_fullsized":"2024-09-22T09:52:32.954159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:23.624323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5257,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547451+0000","last_change":"2024-09-22T08:42:15.428024+0000","last_active":"2024-09-22T09:49:57.547451+0000","last_peered":"2024-09-22T09:49:57.547451+0000","last_clean":"2024-09-22T09:49:57.547451+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:49:57.547451+0000","last_undegraded":"2024-09-22T09:49:57.547451+0000","last_fullsized":"2024-09-22T09:49:57.547451+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:35.144593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'232","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662743+0000","last_change":"2024-09-22T08:42:13.422788+0000","last_active":"2024-09-22T09:51:02.662743+0000","last_peered":"2024-09-22T09:51:02.662743+0000","last_clean":"2024-09-22T09:51:02.662743+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:51:02.662743+0000","last_undegraded":"2024-09-22T09:51:02.662743+0000","last_fullsized":"2024-09-22T09:51:02.662743+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:52.150990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15884519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":597,"num_read_kb":45002,"num_write":1092,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429129+0000","last_change":"2024-09-22T08:42:17.443746+0000","last_active":"2024-09-22T09:50:17.429129+0000","last_peered":"2024-09-22T09:50:17.429129+0000","last_clean":"2024-09-22T09:50:17.429129+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:50:17.429129+0000","last_undegraded":"2024-09-22T09:50:17.429129+0000","last_fullsized":"2024-09-22T09:50:17.429129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:19.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'214","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.729377+0000","last_change":"2024-09-22T08:42:19.454027+0000","last_active":"2024-09-22T09:52:52.729377+0000","last_peered":"2024-09-22T09:52:52.729377+0000","last_clean":"2024-09-22T09:52:52.729377+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:52:52.729377+0000","last_undegraded":"2024-09-22T09:52:52.729377+0000","last_fullsized":"2024-09-22T09:52:52.729377+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:10.523969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146257,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":312,"num_read_kb":767,"num_write":212,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.653425+0000","last_change":"2024-09-22T08:42:21.477428+0000","last_active":"2024-09-22T09:49:52.653425+0000","last_peered":"2024-09-22T09:49:52.653425+0000","last_clean":"2024-09-22T09:49:52.653425+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:49:52.653425+0000","last_undegraded":"2024-09-22T09:49:52.653425+0000","last_fullsized":"2024-09-22T09:49:52.653425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:24.672129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'126","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.396183+0000","last_change":"2024-09-22T08:42:23.527124+0000","last_active":"2024-09-22T09:53:59.396183+0000","last_peered":"2024-09-22T09:53:59.396183+0000","last_clean":"2024-09-22T09:53:59.396183+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:53:59.396183+0000","last_undegraded":"2024-09-22T09:53:59.396183+0000","last_fullsized":"2024-09-22T09:53:59.396183+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:53.459446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438059+0000","last_change":"2024-09-22T08:42:15.436664+0000","last_active":"2024-09-22T09:51:37.438059+0000","last_peered":"2024-09-22T09:51:37.438059+0000","last_clean":"2024-09-22T09:51:37.438059+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:51:37.438059+0000","last_undegraded":"2024-09-22T09:51:37.438059+0000","last_fullsized":"2024-09-22T09:51:37.438059+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:03.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675198+0000","last_change":"2024-09-22T08:42:13.411262+0000","last_active":"2024-09-22T09:51:02.675198+0000","last_peered":"2024-09-22T09:51:02.675198+0000","last_clean":"2024-09-22T09:51:02.675198+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:51:02.675198+0000","last_undegraded":"2024-09-22T09:51:02.675198+0000","last_fullsized":"2024-09-22T09:51:02.675198+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:13.868253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10537104,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":68297,"num_write":935,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438046+0000","last_change":"2024-09-22T08:42:15.434625+0000","last_active":"2024-09-22T09:51:37.438046+0000","last_peered":"2024-09-22T09:51:37.438046+0000","last_clean":"2024-09-22T09:51:37.438046+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:51:37.438046+0000","last_undegraded":"2024-09-22T09:51:37.438046+0000","last_fullsized":"2024-09-22T09:51:37.438046+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:41.767444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.693374+0000","last_change":"2024-09-22T08:42:13.390383+0000","last_active":"2024-09-22T09:50:57.693374+0000","last_peered":"2024-09-22T09:50:57.693374+0000","last_clean":"2024-09-22T09:50:57.693374+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:50:57.693374+0000","last_undegraded":"2024-09-22T09:50:57.693374+0000","last_fullsized":"2024-09-22T09:50:57.693374+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:49.173702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268101,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":8670,"num_write":930,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687969+0000","last_change":"2024-09-22T08:42:15.434734+0000","last_active":"2024-09-22T09:51:37.687969+0000","last_peered":"2024-09-22T09:51:37.687969+0000","last_clean":"2024-09-22T09:51:37.687969+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:51:37.687969+0000","last_undegraded":"2024-09-22T09:51:37.687969+0000","last_fullsized":"2024-09-22T09:51:37.687969+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:30.081403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'195","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682799+0000","last_change":"2024-09-22T08:42:13.405053+0000","last_active":"2024-09-22T09:51:02.682799+0000","last_peered":"2024-09-22T09:51:02.682799+0000","last_clean":"2024-09-22T09:51:02.682799+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:51:02.682799+0000","last_undegraded":"2024-09-22T09:51:02.682799+0000","last_fullsized":"2024-09-22T09:51:02.682799+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:50.824870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4127,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":609,"num_read_kb":540,"num_write":1013,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438008+0000","last_change":"2024-09-22T08:42:15.431647+0000","last_active":"2024-09-22T09:51:37.438008+0000","last_peered":"2024-09-22T09:51:37.438008+0000","last_clean":"2024-09-22T09:51:37.438008+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:51:37.438008+0000","last_undegraded":"2024-09-22T09:51:37.438008+0000","last_fullsized":"2024-09-22T09:51:37.438008+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:55.015297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'203","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663931+0000","last_change":"2024-09-22T08:42:13.415007+0000","last_active":"2024-09-22T09:51:12.663931+0000","last_peered":"2024-09-22T09:51:12.663931+0000","last_clean":"2024-09-22T09:51:12.663931+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:51:12.663931+0000","last_undegraded":"2024-09-22T09:51:12.663931+0000","last_fullsized":"2024-09-22T09:51:12.663931+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:14.358684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54426,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":18552,"num_write":936,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663562+0000","last_change":"2024-09-22T08:42:15.436338+0000","last_active":"2024-09-22T09:51:12.663562+0000","last_peered":"2024-09-22T09:51:12.663562+0000","last_clean":"2024-09-22T09:51:12.663562+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:51:12.663562+0000","last_undegraded":"2024-09-22T09:51:12.663562+0000","last_fullsized":"2024-09-22T09:51:12.663562+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:58.108852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'220","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666067+0000","last_change":"2024-09-22T08:42:13.406108+0000","last_active":"2024-09-22T09:51:32.666067+0000","last_peered":"2024-09-22T09:51:32.666067+0000","last_clean":"2024-09-22T09:51:32.666067+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:51:32.666067+0000","last_undegraded":"2024-09-22T09:51:32.666067+0000","last_fullsized":"2024-09-22T09:51:32.666067+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:52.215127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243409,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":30794,"num_write":964,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'219","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.656045+0000","last_change":"2024-09-22T08:42:15.433745+0000","last_active":"2024-09-22T09:51:42.656045+0000","last_peered":"2024-09-22T09:51:42.656045+0000","last_clean":"2024-09-22T09:51:42.656045+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:51:42.656045+0000","last_undegraded":"2024-09-22T09:51:42.656045+0000","last_fullsized":"2024-09-22T09:51:42.656045+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:09.992145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'275","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.437474+0000","last_change":"2024-09-22T08:42:13.422466+0000","last_active":"2024-09-22T09:51:32.437474+0000","last_peered":"2024-09-22T09:51:32.437474+0000","last_clean":"2024-09-22T09:51:32.437474+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:51:32.437474+0000","last_undegraded":"2024-09-22T09:51:32.437474+0000","last_fullsized":"2024-09-22T09:51:32.437474+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:03.795312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487837,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":750,"num_read_kb":37020,"num_write":1214,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662275+0000","last_change":"2024-09-22T08:42:15.440845+0000","last_active":"2024-09-22T09:51:02.662275+0000","last_peered":"2024-09-22T09:51:02.662275+0000","last_clean":"2024-09-22T09:51:02.662275+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:51:02.662275+0000","last_undegraded":"2024-09-22T09:51:02.662275+0000","last_fullsized":"2024-09-22T09:51:02.662275+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:42.146384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'206","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680426+0000","last_change":"2024-09-22T08:42:13.407850+0000","last_active":"2024-09-22T09:51:37.680426+0000","last_peered":"2024-09-22T09:51:37.680426+0000","last_clean":"2024-09-22T09:51:37.680426+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:51:37.680426+0000","last_undegraded":"2024-09-22T09:51:37.680426+0000","last_fullsized":"2024-09-22T09:51:37.680426+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.638315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563136,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":7650,"num_write":1034,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675220+0000","last_change":"2024-09-22T08:42:15.429000+0000","last_active":"2024-09-22T09:51:02.675220+0000","last_peered":"2024-09-22T09:51:02.675220+0000","last_clean":"2024-09-22T09:51:02.675220+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:51:02.675220+0000","last_undegraded":"2024-09-22T09:51:02.675220+0000","last_fullsized":"2024-09-22T09:51:02.675220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.839044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666130+0000","last_change":"2024-09-22T08:42:13.415853+0000","last_active":"2024-09-22T09:51:32.666130+0000","last_peered":"2024-09-22T09:51:32.666130+0000","last_clean":"2024-09-22T09:51:32.666130+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:51:32.666130+0000","last_undegraded":"2024-09-22T09:51:32.666130+0000","last_fullsized":"2024-09-22T09:51:32.666130+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:53.049074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244238,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":20476,"num_write":1021,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.397601+0000","last_change":"2024-09-22T08:42:15.440719+0000","last_active":"2024-09-22T09:53:59.397601+0000","last_peered":"2024-09-22T09:53:59.397601+0000","last_clean":"2024-09-22T09:53:59.397601+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:53:59.397601+0000","last_undegraded":"2024-09-22T09:53:59.397601+0000","last_fullsized":"2024-09-22T09:53:59.397601+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:13.105481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'183","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:54.968519+0000","last_change":"2024-09-22T08:42:13.411004+0000","last_active":"2024-09-22T09:53:54.968519+0000","last_peered":"2024-09-22T09:53:54.968519+0000","last_clean":"2024-09-22T09:53:54.968519+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:53:54.968519+0000","last_undegraded":"2024-09-22T09:53:54.968519+0000","last_fullsized":"2024-09-22T09:53:54.968519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:46.465435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513032,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":7230,"num_write":904,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.157183+0000","last_change":"2024-09-22T08:42:15.428553+0000","last_active":"2024-09-22T09:50:22.157183+0000","last_peered":"2024-09-22T09:50:22.157183+0000","last_clean":"2024-09-22T09:50:22.157183+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:50:22.157183+0000","last_undegraded":"2024-09-22T09:50:22.157183+0000","last_fullsized":"2024-09-22T09:50:22.157183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:18.827032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'224","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669346+0000","last_change":"2024-09-22T08:42:13.407996+0000","last_active":"2024-09-22T09:51:57.669346+0000","last_peered":"2024-09-22T09:51:57.669346+0000","last_clean":"2024-09-22T09:51:57.669346+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:51:57.669346+0000","last_undegraded":"2024-09-22T09:51:57.669346+0000","last_fullsized":"2024-09-22T09:51:57.669346+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:37.268934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509892,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1621,"num_read_kb":135465,"num_write":992,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'142","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.686967+0000","last_change":"2024-09-22T08:42:15.433622+0000","last_active":"2024-09-22T09:49:52.686967+0000","last_peered":"2024-09-22T09:49:52.686967+0000","last_clean":"2024-09-22T09:49:52.686967+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:49:52.686967+0000","last_undegraded":"2024-09-22T09:49:52.686967+0000","last_fullsized":"2024-09-22T09:49:52.686967+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:44.943406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'177","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.020929+0000","last_change":"2024-09-22T08:42:13.402320+0000","last_active":"2024-09-22T09:50:12.020929+0000","last_peered":"2024-09-22T09:50:12.020929+0000","last_clean":"2024-09-22T09:50:12.020929+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:50:12.020929+0000","last_undegraded":"2024-09-22T09:50:12.020929+0000","last_fullsized":"2024-09-22T09:50:12.020929+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:31.569406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5659775,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":433,"num_read_kb":30385,"num_write":835,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545931+0000","last_change":"2024-09-22T08:42:15.428668+0000","last_active":"2024-09-22T09:49:47.545931+0000","last_peered":"2024-09-22T09:49:47.545931+0000","last_clean":"2024-09-22T09:49:47.545931+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:49:47.545931+0000","last_undegraded":"2024-09-22T09:49:47.545931+0000","last_fullsized":"2024-09-22T09:49:47.545931+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:57.959775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'190","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652896+0000","last_change":"2024-09-22T08:42:13.405602+0000","last_active":"2024-09-22T09:49:47.652896+0000","last_peered":"2024-09-22T09:49:47.652896+0000","last_clean":"2024-09-22T09:49:47.652896+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:49:47.652896+0000","last_undegraded":"2024-09-22T09:49:47.652896+0000","last_fullsized":"2024-09-22T09:49:47.652896+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:20.603994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5324486,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":23430,"num_write":909,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.513374+0000","last_change":"2024-09-22T08:42:15.438409+0000","last_active":"2024-09-22T09:49:47.513374+0000","last_peered":"2024-09-22T09:49:47.513374+0000","last_clean":"2024-09-22T09:49:47.513374+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:49:47.513374+0000","last_undegraded":"2024-09-22T09:49:47.513374+0000","last_fullsized":"2024-09-22T09:49:47.513374+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.728188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'211","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.665417+0000","last_change":"2024-09-22T08:42:13.406750+0000","last_active":"2024-09-22T09:49:47.665417+0000","last_peered":"2024-09-22T09:49:47.665417+0000","last_clean":"2024-09-22T09:49:47.665417+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:49:47.665417+0000","last_undegraded":"2024-09-22T09:49:47.665417+0000","last_fullsized":"2024-09-22T09:49:47.665417+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:31.322960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":16539,"num_write":977,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.382202+0000","last_change":"2024-09-22T08:42:15.435371+0000","last_active":"2024-09-22T09:51:35.382202+0000","last_peered":"2024-09-22T09:51:35.382202+0000","last_clean":"2024-09-22T09:51:35.382202+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:51:35.382202+0000","last_undegraded":"2024-09-22T09:51:35.382202+0000","last_fullsized":"2024-09-22T09:51:35.382202+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:25.479186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'190","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.303905+0000","last_change":"2024-09-22T08:42:13.416475+0000","last_active":"2024-09-22T09:51:28.303905+0000","last_peered":"2024-09-22T09:51:28.303905+0000","last_clean":"2024-09-22T09:51:28.303905+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:51:28.303905+0000","last_undegraded":"2024-09-22T09:51:28.303905+0000","last_fullsized":"2024-09-22T09:51:28.303905+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:13.725268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511517,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":32139,"num_write":904,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652546+0000","last_change":"2024-09-22T08:42:15.436821+0000","last_active":"2024-09-22T09:49:47.652546+0000","last_peered":"2024-09-22T09:49:47.652546+0000","last_clean":"2024-09-22T09:49:47.652546+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:49:47.652546+0000","last_undegraded":"2024-09-22T09:49:47.652546+0000","last_fullsized":"2024-09-22T09:49:47.652546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:30.622726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'201","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:23.345932+0000","last_change":"2024-09-22T08:42:13.400175+0000","last_active":"2024-09-22T09:51:23.345932+0000","last_peered":"2024-09-22T09:51:23.345932+0000","last_clean":"2024-09-22T09:51:23.345932+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:51:23.345932+0000","last_undegraded":"2024-09-22T09:51:23.345932+0000","last_fullsized":"2024-09-22T09:51:23.345932+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:35.492802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6061192,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":31835,"num_write":1009,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.532605+0000","last_change":"2024-09-22T08:42:15.433332+0000","last_active":"2024-09-22T09:51:52.532605+0000","last_peered":"2024-09-22T09:51:52.532605+0000","last_clean":"2024-09-22T09:51:52.532605+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:51:52.532605+0000","last_undegraded":"2024-09-22T09:51:52.532605+0000","last_fullsized":"2024-09-22T09:51:52.532605+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:33.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'224","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.823125+0000","last_change":"2024-09-22T08:42:13.417006+0000","last_active":"2024-09-22T09:51:39.823125+0000","last_peered":"2024-09-22T09:51:39.823125+0000","last_clean":"2024-09-22T09:51:39.823125+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:51:39.823125+0000","last_undegraded":"2024-09-22T09:51:39.823125+0000","last_fullsized":"2024-09-22T09:51:39.823125+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:01.120483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15749336,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":662,"num_read_kb":33540,"num_write":1135,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'199","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.099498+0000","last_change":"2024-09-22T08:42:13.414146+0000","last_active":"2024-09-22T09:50:21.099498+0000","last_peered":"2024-09-22T09:50:21.099498+0000","last_clean":"2024-09-22T09:50:21.099498+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:50:21.099498+0000","last_undegraded":"2024-09-22T09:50:21.099498+0000","last_fullsized":"2024-09-22T09:50:21.099498+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:45.228462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10508441,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":16611,"num_write":905,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655515+0000","last_change":"2024-09-22T08:42:15.431931+0000","last_active":"2024-09-22T09:50:07.655515+0000","last_peered":"2024-09-22T09:50:07.655515+0000","last_clean":"2024-09-22T09:50:07.655515+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:50:07.655515+0000","last_undegraded":"2024-09-22T09:50:07.655515+0000","last_fullsized":"2024-09-22T09:50:07.655515+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:55.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'224","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426140+0000","last_change":"2024-09-22T08:42:13.421991+0000","last_active":"2024-09-22T09:49:52.426140+0000","last_peered":"2024-09-22T09:49:52.426140+0000","last_clean":"2024-09-22T09:49:52.426140+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:49:52.426140+0000","last_undegraded":"2024-09-22T09:49:52.426140+0000","last_fullsized":"2024-09-22T09:49:52.426140+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926338,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":653,"num_read_kb":76384,"num_write":1021,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673291+0000","last_change":"2024-09-22T08:42:15.433648+0000","last_active":"2024-09-22T09:49:57.673291+0000","last_peered":"2024-09-22T09:49:57.673291+0000","last_clean":"2024-09-22T09:49:57.673291+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:49:57.673291+0000","last_undegraded":"2024-09-22T09:49:57.673291+0000","last_fullsized":"2024-09-22T09:49:57.673291+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:57.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1596,"ondisk_log_size":1596,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":390,"ondisk_log_size":390,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":464513,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":9727,"num_read_kb":11902,"num_write":6883,"num_write_kb":3179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":192276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1805,"ondisk_log_size":1805,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3773,"ondisk_log_size":3773,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":533460138,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42187,"num_read_kb":2399793,"num_write":63093,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":715456512,"data_stored":715456512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4338,"ondisk_log_size":4338,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":120,"num_read_kb":189640,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189064,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543016,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346644,"kb_used_data":103044,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94025196,"statfs":{"total":96636764160,"available":96281800704,"internally_reserved":0,"allocated":105517056,"data_stored":103464448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543016,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414580,"kb_used_data":148772,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957260,"statfs":{"total":96636764160,"available":96212234240,"internally_reserved":0,"allocated":152342528,"data_stored":150381183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543018,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213764,"kb_used_data":120180,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94158076,"statfs":{"total":96636764160,"available":96417869824,"internally_reserved":0,"allocated":123064320,"data_stored":121014480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543017,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254368,"kb_used_data":146832,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117472,"statfs":{"total":96636764160,"available":96376291328,"internally_reserved":0,"allocated":150355968,"data_stored":148445373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543016,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356132,"kb_used_data":130580,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94015708,"statfs":{"total":96636764160,"available":96272084992,"internally_reserved":0,"allocated":133713920,"data_stored":131707867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543020,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179808,"kb_used_data":108368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94192032,"statfs":{"total":96636764160,"available":96452640768,"internally_reserved":0,"allocated":110968832,"data_stored":109048955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543016,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264916,"kb_used_data":135236,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94106924,"statfs":{"total":96636764160,"available":96365490176,"internally_reserved":0,"allocated":138481664,"data_stored":136503112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543018,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359156,"kb_used_data":125284,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94012684,"statfs":{"total":96636764160,"available":96268988416,"internally_reserved":0,"allocated":128290816,"data_stored":126284216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92995584,"data_stored":92995584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84254720,"data_stored":84254720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80138240,"data_stored":80138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":112041984,"data_stored":112041984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":87261184,"data_stored":87261184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":97763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90554368,"data_stored":90554368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":26679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":25842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":26841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":33446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":39804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17412096,"data_stored":17410001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26222592,"data_stored":26219364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20976484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3153920,"data_stored":3150692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17883136,"data_stored":17879178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3731456,"data_stored":3730091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:54:15.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:54:16.343 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:54:16.356 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2426,"stamp":"2024-09-22T09:54:14.419148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680510898,"num_objects":774,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":774,"num_whiteouts":0,"num_read":189991,"num_read_kb":2910016,"num_write":128503,"num_write_kb":2504237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13206,"ondisk_log_size":13206,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389368,"kb_used_data":1018296,"kb_used_omap":12,"kb_used_meta":1370931,"kb_avail":752585352,"statfs":{"total":773094113280,"available":770647400448,"internally_reserved":0,"allocated":1042735104,"data_stored":1026849634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1403833905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1160,"num_objects":-8,"num_object_clones":0,"num_object_copies":-18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":87,"num_read_kb":88,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004713"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.684355+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.684355+0000","last_peered":"2024-09-22T09:51:12.684355+0000","last_clean":"2024-09-22T09:51:12.684355+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:51:12.684355+0000","last_undegraded":"2024-09-22T09:51:12.684355+0000","last_fullsized":"2024-09-22T09:51:12.684355+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.689100+0000","last_change":"2024-09-22T09:20:12.873395+0000","last_active":"2024-09-22T09:50:12.689100+0000","last_peered":"2024-09-22T09:50:12.689100+0000","last_clean":"2024-09-22T09:50:12.689100+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:50:12.689100+0000","last_undegraded":"2024-09-22T09:50:12.689100+0000","last_fullsized":"2024-09-22T09:50:12.689100+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:11.074090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558208+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:51:12.558208+0000","last_peered":"2024-09-22T09:51:12.558208+0000","last_clean":"2024-09-22T09:51:12.558208+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:51:12.558208+0000","last_undegraded":"2024-09-22T09:51:12.558208+0000","last_fullsized":"2024-09-22T09:51:12.558208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":8,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434594+0000","last_change":"2024-09-22T09:01:07.465099+0000","last_active":"2024-09-22T09:51:07.434594+0000","last_peered":"2024-09-22T09:51:07.434594+0000","last_clean":"2024-09-22T09:51:07.434594+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:51:07.434594+0000","last_undegraded":"2024-09-22T09:51:07.434594+0000","last_fullsized":"2024-09-22T09:51:07.434594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:59.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694907+0000","last_change":"2024-09-22T08:57:04.397022+0000","last_active":"2024-09-22T09:51:12.694907+0000","last_peered":"2024-09-22T09:51:12.694907+0000","last_clean":"2024-09-22T09:51:12.694907+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:51:12.694907+0000","last_undegraded":"2024-09-22T09:51:12.694907+0000","last_fullsized":"2024-09-22T09:51:12.694907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:59.048334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694918+0000","last_change":"2024-09-22T09:01:07.467647+0000","last_active":"2024-09-22T09:51:12.694918+0000","last_peered":"2024-09-22T09:51:12.694918+0000","last_clean":"2024-09-22T09:51:12.694918+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:51:12.694918+0000","last_undegraded":"2024-09-22T09:51:12.694918+0000","last_fullsized":"2024-09-22T09:51:12.694918+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:12.140780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632785,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":619,"num_write":2,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651709+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:49:37.651709+0000","last_peered":"2024-09-22T09:49:37.651709+0000","last_clean":"2024-09-22T09:49:37.651709+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:49:37.651709+0000","last_undegraded":"2024-09-22T09:49:37.651709+0000","last_fullsized":"2024-09-22T09:49:37.651709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:53.738400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651360+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:49:37.651360+0000","last_peered":"2024-09-22T09:49:37.651360+0000","last_clean":"2024-09-22T09:49:37.651360+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:49:37.651360+0000","last_undegraded":"2024-09-22T09:49:37.651360+0000","last_fullsized":"2024-09-22T09:49:37.651360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:52.455370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.656003+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:50:12.656003+0000","last_peered":"2024-09-22T09:50:12.656003+0000","last_clean":"2024-09-22T09:50:12.656003+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:50:12.656003+0000","last_undegraded":"2024-09-22T09:50:12.656003+0000","last_fullsized":"2024-09-22T09:50:12.656003+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.670273+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:49:37.670273+0000","last_peered":"2024-09-22T09:49:37.670273+0000","last_clean":"2024-09-22T09:49:37.670273+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:49:37.670273+0000","last_undegraded":"2024-09-22T09:49:37.670273+0000","last_fullsized":"2024-09-22T09:49:37.670273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:49.468579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650455+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:49:27.650455+0000","last_peered":"2024-09-22T09:49:27.650455+0000","last_clean":"2024-09-22T09:49:27.650455+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:49:27.650455+0000","last_undegraded":"2024-09-22T09:49:27.650455+0000","last_fullsized":"2024-09-22T09:49:27.650455+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651319+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:49:37.651319+0000","last_peered":"2024-09-22T09:49:37.651319+0000","last_clean":"2024-09-22T09:49:37.651319+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:49:37.651319+0000","last_undegraded":"2024-09-22T09:49:37.651319+0000","last_fullsized":"2024-09-22T09:49:37.651319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:53.670732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.663218+0000","last_change":"2024-09-22T09:01:11.514663+0000","last_active":"2024-09-22T09:49:32.663218+0000","last_peered":"2024-09-22T09:49:32.663218+0000","last_clean":"2024-09-22T09:49:32.663218+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:49:32.663218+0000","last_undegraded":"2024-09-22T09:49:32.663218+0000","last_fullsized":"2024-09-22T09:49:32.663218+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:31.564030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:42.545151+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:49:42.545151+0000","last_peered":"2024-09-22T09:49:42.545151+0000","last_clean":"2024-09-22T09:49:42.545151+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:49:42.545151+0000","last_undegraded":"2024-09-22T09:49:42.545151+0000","last_fullsized":"2024-09-22T09:49:42.545151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:19.067022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":260,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.663945+0000","last_change":"2024-09-22T08:57:04.396164+0000","last_active":"2024-09-22T09:49:37.663945+0000","last_peered":"2024-09-22T09:49:37.663945+0000","last_clean":"2024-09-22T09:49:37.663945+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:49:37.663945+0000","last_undegraded":"2024-09-22T09:49:37.663945+0000","last_fullsized":"2024-09-22T09:49:37.663945+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:24.400394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676766+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:51:12.676766+0000","last_peered":"2024-09-22T09:51:12.676766+0000","last_clean":"2024-09-22T09:51:12.676766+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:51:12.676766+0000","last_undegraded":"2024-09-22T09:51:12.676766+0000","last_fullsized":"2024-09-22T09:51:12.676766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663319+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:51:07.663319+0000","last_peered":"2024-09-22T09:51:07.663319+0000","last_clean":"2024-09-22T09:51:07.663319+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:51:07.663319+0000","last_undegraded":"2024-09-22T09:51:07.663319+0000","last_fullsized":"2024-09-22T09:51:07.663319+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429096+0000","last_change":"2024-09-22T08:57:04.400224+0000","last_active":"2024-09-22T09:50:17.429096+0000","last_peered":"2024-09-22T09:50:17.429096+0000","last_clean":"2024-09-22T09:50:17.429096+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:50:17.429096+0000","last_undegraded":"2024-09-22T09:50:17.429096+0000","last_fullsized":"2024-09-22T09:50:17.429096+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:47.678550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650766+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:49:32.650766+0000","last_peered":"2024-09-22T09:49:32.650766+0000","last_clean":"2024-09-22T09:49:32.650766+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:49:32.650766+0000","last_undegraded":"2024-09-22T09:49:32.650766+0000","last_fullsized":"2024-09-22T09:49:32.650766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:02.822384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675672+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:50:12.675672+0000","last_peered":"2024-09-22T09:50:12.675672+0000","last_clean":"2024-09-22T09:50:12.675672+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:50:12.675672+0000","last_undegraded":"2024-09-22T09:50:12.675672+0000","last_fullsized":"2024-09-22T09:50:12.675672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:26:14.614902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691085+0000","last_change":"2024-09-22T09:20:12.861108+0000","last_active":"2024-09-22T09:50:32.691085+0000","last_peered":"2024-09-22T09:50:32.691085+0000","last_clean":"2024-09-22T09:50:32.691085+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:50:32.691085+0000","last_undegraded":"2024-09-22T09:50:32.691085+0000","last_fullsized":"2024-09-22T09:50:32.691085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:55.356489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656729+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:50:17.656729+0000","last_peered":"2024-09-22T09:50:17.656729+0000","last_clean":"2024-09-22T09:50:17.656729+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:50:17.656729+0000","last_undegraded":"2024-09-22T09:50:17.656729+0000","last_fullsized":"2024-09-22T09:50:17.656729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.510433+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:49:27.510433+0000","last_peered":"2024-09-22T09:49:27.510433+0000","last_clean":"2024-09-22T09:49:27.510433+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:49:27.510433+0000","last_undegraded":"2024-09-22T09:49:27.510433+0000","last_fullsized":"2024-09-22T09:49:27.510433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650821+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:49:32.650821+0000","last_peered":"2024-09-22T09:49:32.650821+0000","last_clean":"2024-09-22T09:49:32.650821+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:49:32.650821+0000","last_undegraded":"2024-09-22T09:49:32.650821+0000","last_fullsized":"2024-09-22T09:49:32.650821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:42.484414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.684513+0000","last_change":"2024-09-22T09:01:07.465474+0000","last_active":"2024-09-22T09:49:27.684513+0000","last_peered":"2024-09-22T09:49:27.684513+0000","last_clean":"2024-09-22T09:49:27.684513+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:49:27.684513+0000","last_undegraded":"2024-09-22T09:49:27.684513+0000","last_fullsized":"2024-09-22T09:49:27.684513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:54.197542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.689645+0000","last_change":"2024-09-22T08:57:04.398115+0000","last_active":"2024-09-22T09:50:17.689645+0000","last_peered":"2024-09-22T09:50:17.689645+0000","last_clean":"2024-09-22T09:50:17.689645+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:50:17.689645+0000","last_undegraded":"2024-09-22T09:50:17.689645+0000","last_fullsized":"2024-09-22T09:50:17.689645+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:33.062709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.543852+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:49:32.543852+0000","last_peered":"2024-09-22T09:49:32.543852+0000","last_clean":"2024-09-22T09:49:32.543852+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:49:32.543852+0000","last_undegraded":"2024-09-22T09:49:32.543852+0000","last_fullsized":"2024-09-22T09:49:32.543852+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.506562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650577+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:49:27.650577+0000","last_peered":"2024-09-22T09:49:27.650577+0000","last_clean":"2024-09-22T09:49:27.650577+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:49:27.650577+0000","last_undegraded":"2024-09-22T09:49:27.650577+0000","last_fullsized":"2024-09-22T09:49:27.650577+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428515+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:50:12.428515+0000","last_peered":"2024-09-22T09:50:12.428515+0000","last_clean":"2024-09-22T09:50:12.428515+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:50:12.428515+0000","last_undegraded":"2024-09-22T09:50:12.428515+0000","last_fullsized":"2024-09-22T09:50:12.428515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:47.707645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'1","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.548961+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:50:07.548961+0000","last_peered":"2024-09-22T09:50:07.548961+0000","last_clean":"2024-09-22T09:50:07.548961+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:50:07.548961+0000","last_undegraded":"2024-09-22T09:50:07.548961+0000","last_fullsized":"2024-09-22T09:50:07.548961+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:52.131442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428446+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:50:12.428446+0000","last_peered":"2024-09-22T09:50:12.428446+0000","last_clean":"2024-09-22T09:50:12.428446+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:50:12.428446+0000","last_undegraded":"2024-09-22T09:50:12.428446+0000","last_fullsized":"2024-09-22T09:50:12.428446+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:49.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655114+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:50:07.655114+0000","last_peered":"2024-09-22T09:50:07.655114+0000","last_clean":"2024-09-22T09:50:07.655114+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:50:07.655114+0000","last_undegraded":"2024-09-22T09:50:07.655114+0000","last_fullsized":"2024-09-22T09:50:07.655114+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:28.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.655936+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:50:12.655936+0000","last_peered":"2024-09-22T09:50:12.655936+0000","last_clean":"2024-09-22T09:50:12.655936+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:50:12.655936+0000","last_undegraded":"2024-09-22T09:50:12.655936+0000","last_fullsized":"2024-09-22T09:50:12.655936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:02.097970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668153+0000","last_change":"2024-09-22T09:01:07.463162+0000","last_active":"2024-09-22T09:50:07.668153+0000","last_peered":"2024-09-22T09:50:07.668153+0000","last_clean":"2024-09-22T09:50:07.668153+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:50:07.668153+0000","last_undegraded":"2024-09-22T09:50:07.668153+0000","last_fullsized":"2024-09-22T09:50:07.668153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:40.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'3","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.668750+0000","last_change":"2024-09-22T09:01:11.517359+0000","last_active":"2024-09-22T09:50:12.668750+0000","last_peered":"2024-09-22T09:50:12.668750+0000","last_clean":"2024-09-22T09:50:12.668750+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:50:12.668750+0000","last_undegraded":"2024-09-22T09:50:12.668750+0000","last_fullsized":"2024-09-22T09:50:12.668750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:49.248745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.674907+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:50:07.674907+0000","last_peered":"2024-09-22T09:50:07.674907+0000","last_clean":"2024-09-22T09:50:07.674907+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:50:07.674907+0000","last_undegraded":"2024-09-22T09:50:07.674907+0000","last_fullsized":"2024-09-22T09:50:07.674907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:43.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691557+0000","last_change":"2024-09-22T09:20:12.858546+0000","last_active":"2024-09-22T09:50:37.691557+0000","last_peered":"2024-09-22T09:50:37.691557+0000","last_clean":"2024-09-22T09:50:37.691557+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:50:37.691557+0000","last_undegraded":"2024-09-22T09:50:37.691557+0000","last_fullsized":"2024-09-22T09:50:37.691557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:50.810813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659886+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:50:42.659886+0000","last_peered":"2024-09-22T09:50:42.659886+0000","last_clean":"2024-09-22T09:50:42.659886+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:50:42.659886+0000","last_undegraded":"2024-09-22T09:50:42.659886+0000","last_fullsized":"2024-09-22T09:50:42.659886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691594+0000","last_change":"2024-09-22T09:01:07.465057+0000","last_active":"2024-09-22T09:50:37.691594+0000","last_peered":"2024-09-22T09:50:37.691594+0000","last_clean":"2024-09-22T09:50:37.691594+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:50:37.691594+0000","last_undegraded":"2024-09-22T09:50:37.691594+0000","last_fullsized":"2024-09-22T09:50:37.691594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:51.656500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.683656+0000","last_change":"2024-09-22T08:57:04.397214+0000","last_active":"2024-09-22T09:51:07.683656+0000","last_peered":"2024-09-22T09:51:07.683656+0000","last_clean":"2024-09-22T09:51:07.683656+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:51:07.683656+0000","last_undegraded":"2024-09-22T09:51:07.683656+0000","last_fullsized":"2024-09-22T09:51:07.683656+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:24.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.671153+0000","last_change":"2024-09-22T09:20:12.869138+0000","last_active":"2024-09-22T09:50:32.671153+0000","last_peered":"2024-09-22T09:50:32.671153+0000","last_clean":"2024-09-22T09:50:32.671153+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:50:32.671153+0000","last_undegraded":"2024-09-22T09:50:32.671153+0000","last_fullsized":"2024-09-22T09:50:32.671153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:20.523450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433506+0000","last_change":"2024-09-22T09:01:11.518715+0000","last_active":"2024-09-22T09:50:57.433506+0000","last_peered":"2024-09-22T09:50:57.433506+0000","last_clean":"2024-09-22T09:50:57.433506+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:50:57.433506+0000","last_undegraded":"2024-09-22T09:50:57.433506+0000","last_fullsized":"2024-09-22T09:50:57.433506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:25.716417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582758,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.659427+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:50:37.659427+0000","last_peered":"2024-09-22T09:50:37.659427+0000","last_clean":"2024-09-22T09:50:37.659427+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:50:37.659427+0000","last_undegraded":"2024-09-22T09:50:37.659427+0000","last_fullsized":"2024-09-22T09:50:37.659427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676022+0000","last_change":"2024-09-22T08:57:04.395860+0000","last_active":"2024-09-22T09:51:07.676022+0000","last_peered":"2024-09-22T09:51:07.676022+0000","last_clean":"2024-09-22T09:51:07.676022+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:51:07.676022+0000","last_undegraded":"2024-09-22T09:51:07.676022+0000","last_fullsized":"2024-09-22T09:51:07.676022+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:13.903713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520070+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:50:32.520070+0000","last_peered":"2024-09-22T09:50:32.520070+0000","last_clean":"2024-09-22T09:50:32.520070+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:50:32.520070+0000","last_undegraded":"2024-09-22T09:50:32.520070+0000","last_fullsized":"2024-09-22T09:50:32.520070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:36.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'1","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:52.432911+0000","last_change":"2024-09-22T09:01:07.463902+0000","last_active":"2024-09-22T09:50:52.432911+0000","last_peered":"2024-09-22T09:50:52.432911+0000","last_clean":"2024-09-22T09:50:52.432911+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:50:52.432911+0000","last_undegraded":"2024-09-22T09:50:52.432911+0000","last_fullsized":"2024-09-22T09:50:52.432911+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:06.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.694357+0000","last_change":"2024-09-22T08:57:04.397359+0000","last_active":"2024-09-22T09:51:07.694357+0000","last_peered":"2024-09-22T09:51:07.694357+0000","last_clean":"2024-09-22T09:51:07.694357+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:51:07.694357+0000","last_undegraded":"2024-09-22T09:51:07.694357+0000","last_fullsized":"2024-09-22T09:51:07.694357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:55.654439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'8","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556776+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:51:02.556776+0000","last_peered":"2024-09-22T09:51:02.556776+0000","last_clean":"2024-09-22T09:51:02.556776+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:51:02.556776+0000","last_undegraded":"2024-09-22T09:51:02.556776+0000","last_fullsized":"2024-09-22T09:51:02.556776+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":122,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663336+0000","last_change":"2024-09-22T08:57:04.405441+0000","last_active":"2024-09-22T09:51:07.663336+0000","last_peered":"2024-09-22T09:51:07.663336+0000","last_clean":"2024-09-22T09:51:07.663336+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:51:07.663336+0000","last_undegraded":"2024-09-22T09:51:07.663336+0000","last_fullsized":"2024-09-22T09:51:07.663336+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:56.122641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433374+0000","last_change":"2024-09-22T09:01:07.462593+0000","last_active":"2024-09-22T09:50:57.433374+0000","last_peered":"2024-09-22T09:50:57.433374+0000","last_clean":"2024-09-22T09:50:57.433374+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:50:57.433374+0000","last_undegraded":"2024-09-22T09:50:57.433374+0000","last_fullsized":"2024-09-22T09:50:57.433374+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:03.677122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528666+0000","last_change":"2024-09-22T08:57:04.395828+0000","last_active":"2024-09-22T09:51:27.528666+0000","last_peered":"2024-09-22T09:51:27.528666+0000","last_clean":"2024-09-22T09:51:27.528666+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:51:27.528666+0000","last_undegraded":"2024-09-22T09:51:27.528666+0000","last_fullsized":"2024-09-22T09:51:27.528666+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:01.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431738+0000","last_change":"2024-09-22T09:01:11.516330+0000","last_active":"2024-09-22T09:50:42.431738+0000","last_peered":"2024-09-22T09:50:42.431738+0000","last_clean":"2024-09-22T09:50:42.431738+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:50:42.431738+0000","last_undegraded":"2024-09-22T09:50:42.431738+0000","last_fullsized":"2024-09-22T09:50:42.431738+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:46.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'13","reported_seq":84,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662571+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:51:02.662571+0000","last_peered":"2024-09-22T09:51:02.662571+0000","last_clean":"2024-09-22T09:51:02.662571+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:51:02.662571+0000","last_undegraded":"2024-09-22T09:51:02.662571+0000","last_fullsized":"2024-09-22T09:51:02.662571+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":32770,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.526385+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.526385+0000","last_peered":"2024-09-22T09:51:12.526385+0000","last_clean":"2024-09-22T09:51:12.526385+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:51:12.526385+0000","last_undegraded":"2024-09-22T09:51:12.526385+0000","last_fullsized":"2024-09-22T09:51:12.526385+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":74,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677517+0000","last_change":"2024-09-22T08:57:04.395126+0000","last_active":"2024-09-22T09:51:17.677517+0000","last_peered":"2024-09-22T09:51:17.677517+0000","last_clean":"2024-09-22T09:51:17.677517+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:51:17.677517+0000","last_undegraded":"2024-09-22T09:51:17.677517+0000","last_fullsized":"2024-09-22T09:51:17.677517+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:33.605027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663959+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:51:12.663959+0000","last_peered":"2024-09-22T09:51:12.663959+0000","last_clean":"2024-09-22T09:51:12.663959+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:51:12.663959+0000","last_undegraded":"2024-09-22T09:51:12.663959+0000","last_fullsized":"2024-09-22T09:51:12.663959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694882+0000","last_change":"2024-09-22T09:01:07.464584+0000","last_active":"2024-09-22T09:51:12.694882+0000","last_peered":"2024-09-22T09:51:12.694882+0000","last_clean":"2024-09-22T09:51:12.694882+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:51:12.694882+0000","last_undegraded":"2024-09-22T09:51:12.694882+0000","last_fullsized":"2024-09-22T09:51:12.694882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:12.421058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677612+0000","last_change":"2024-09-22T08:57:04.400659+0000","last_active":"2024-09-22T09:51:17.677612+0000","last_peered":"2024-09-22T09:51:17.677612+0000","last_clean":"2024-09-22T09:51:17.677612+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:51:17.677612+0000","last_undegraded":"2024-09-22T09:51:17.677612+0000","last_fullsized":"2024-09-22T09:51:17.677612+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.429612+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:50:22.429612+0000","last_peered":"2024-09-22T09:50:22.429612+0000","last_clean":"2024-09-22T09:50:22.429612+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:50:22.429612+0000","last_undegraded":"2024-09-22T09:50:22.429612+0000","last_fullsized":"2024-09-22T09:50:22.429612+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:16.516456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528740+0000","last_change":"2024-09-22T08:57:04.401962+0000","last_active":"2024-09-22T09:51:27.528740+0000","last_peered":"2024-09-22T09:51:27.528740+0000","last_clean":"2024-09-22T09:51:27.528740+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:51:27.528740+0000","last_undegraded":"2024-09-22T09:51:27.528740+0000","last_fullsized":"2024-09-22T09:51:27.528740+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:43.579055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.435663+0000","last_change":"2024-09-22T08:57:04.397895+0000","last_active":"2024-09-22T09:51:17.435663+0000","last_peered":"2024-09-22T09:51:17.435663+0000","last_clean":"2024-09-22T09:51:17.435663+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:51:17.435663+0000","last_undegraded":"2024-09-22T09:51:17.435663+0000","last_fullsized":"2024-09-22T09:51:17.435663+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:57.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691139+0000","last_change":"2024-09-22T09:20:12.868011+0000","last_active":"2024-09-22T09:50:32.691139+0000","last_peered":"2024-09-22T09:50:32.691139+0000","last_clean":"2024-09-22T09:50:32.691139+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:50:32.691139+0000","last_undegraded":"2024-09-22T09:50:32.691139+0000","last_fullsized":"2024-09-22T09:50:32.691139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:51.261678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.435132+0000","last_change":"2024-09-22T09:01:11.515368+0000","last_active":"2024-09-22T09:51:12.435132+0000","last_peered":"2024-09-22T09:51:12.435132+0000","last_clean":"2024-09-22T09:51:12.435132+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:51:12.435132+0000","last_undegraded":"2024-09-22T09:51:12.435132+0000","last_fullsized":"2024-09-22T09:51:12.435132+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:01.643271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658823+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:50:32.658823+0000","last_peered":"2024-09-22T09:50:32.658823+0000","last_clean":"2024-09-22T09:50:32.658823+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:50:32.658823+0000","last_undegraded":"2024-09-22T09:50:32.658823+0000","last_fullsized":"2024-09-22T09:50:32.658823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:55.492793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.558791+0000","last_change":"2024-09-22T08:57:04.398627+0000","last_active":"2024-09-22T09:51:17.558791+0000","last_peered":"2024-09-22T09:51:17.558791+0000","last_clean":"2024-09-22T09:51:17.558791+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:51:17.558791+0000","last_undegraded":"2024-09-22T09:51:17.558791+0000","last_fullsized":"2024-09-22T09:51:17.558791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:23.008984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676744+0000","last_change":"2024-09-22T09:01:11.522462+0000","last_active":"2024-09-22T09:51:12.676744+0000","last_peered":"2024-09-22T09:51:12.676744+0000","last_clean":"2024-09-22T09:51:12.676744+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:51:12.676744+0000","last_undegraded":"2024-09-22T09:51:12.676744+0000","last_fullsized":"2024-09-22T09:51:12.676744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:13.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434560+0000","last_change":"2024-09-22T09:01:07.463509+0000","last_active":"2024-09-22T09:51:07.434560+0000","last_peered":"2024-09-22T09:51:07.434560+0000","last_clean":"2024-09-22T09:51:07.434560+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:51:07.434560+0000","last_undegraded":"2024-09-22T09:51:07.434560+0000","last_fullsized":"2024-09-22T09:51:07.434560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:59.139960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677548+0000","last_change":"2024-09-22T08:57:04.386372+0000","last_active":"2024-09-22T09:51:17.677548+0000","last_peered":"2024-09-22T09:51:17.677548+0000","last_clean":"2024-09-22T09:51:17.677548+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:51:17.677548+0000","last_undegraded":"2024-09-22T09:51:17.677548+0000","last_fullsized":"2024-09-22T09:51:17.677548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:50.648447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558150+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:51:12.558150+0000","last_peered":"2024-09-22T09:51:12.558150+0000","last_clean":"2024-09-22T09:51:12.558150+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:51:12.558150+0000","last_undegraded":"2024-09-22T09:51:12.558150+0000","last_fullsized":"2024-09-22T09:51:12.558150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'8","reported_seq":75,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.675993+0000","last_change":"2024-09-22T09:01:07.457691+0000","last_active":"2024-09-22T09:51:07.675993+0000","last_peered":"2024-09-22T09:51:07.675993+0000","last_clean":"2024-09-22T09:51:07.675993+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:51:07.675993+0000","last_undegraded":"2024-09-22T09:51:07.675993+0000","last_fullsized":"2024-09-22T09:51:07.675993+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:44.440513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247844,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25607,"num_write":8,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'205","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524192+0000","last_change":"2024-09-22T08:42:13.423188+0000","last_active":"2024-09-22T09:50:57.524192+0000","last_peered":"2024-09-22T09:50:57.524192+0000","last_clean":"2024-09-22T09:50:57.524192+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:50:57.524192+0000","last_undegraded":"2024-09-22T09:50:57.524192+0000","last_fullsized":"2024-09-22T09:50:57.524192+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:47.101356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":13870,"num_write":989,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'141","reported_seq":767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.861787+0000","last_change":"2024-09-22T08:42:15.431071+0000","last_active":"2024-09-22T09:50:12.861787+0000","last_peered":"2024-09-22T09:50:12.861787+0000","last_clean":"2024-09-22T09:50:12.861787+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:50:12.861787+0000","last_undegraded":"2024-09-22T09:50:12.861787+0000","last_fullsized":"2024-09-22T09:50:12.861787+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:37.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'136","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433476+0000","last_change":"2024-09-22T08:42:46.096812+0000","last_active":"2024-09-22T09:50:57.433476+0000","last_peered":"2024-09-22T09:50:57.433476+0000","last_clean":"2024-09-22T09:50:57.433476+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:50:57.433476+0000","last_undegraded":"2024-09-22T09:50:57.433476+0000","last_fullsized":"2024-09-22T09:50:57.433476+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:57.098166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21059257,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":103374,"num_write":676,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.458574+0000","last_change":"2024-09-22T08:42:15.435522+0000","last_active":"2024-09-22T09:51:48.458574+0000","last_peered":"2024-09-22T09:51:48.458574+0000","last_clean":"2024-09-22T09:51:48.458574+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:51:48.458574+0000","last_undegraded":"2024-09-22T09:51:48.458574+0000","last_fullsized":"2024-09-22T09:51:48.458574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:45.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'206","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662676+0000","last_change":"2024-09-22T08:42:13.406564+0000","last_active":"2024-09-22T09:51:02.662676+0000","last_peered":"2024-09-22T09:51:02.662676+0000","last_clean":"2024-09-22T09:51:02.662676+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:51:02.662676+0000","last_undegraded":"2024-09-22T09:51:02.662676+0000","last_fullsized":"2024-09-22T09:51:02.662676+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:01.206591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374630,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":499,"num_read_kb":4356,"num_write":981,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545888+0000","last_change":"2024-09-22T08:42:15.422331+0000","last_active":"2024-09-22T09:49:47.545888+0000","last_peered":"2024-09-22T09:49:47.545888+0000","last_clean":"2024-09-22T09:49:47.545888+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:49:47.545888+0000","last_undegraded":"2024-09-22T09:49:47.545888+0000","last_fullsized":"2024-09-22T09:49:47.545888+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:17.082268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'206","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.508468+0000","last_change":"2024-09-22T08:42:13.412575+0000","last_active":"2024-09-22T09:51:13.508468+0000","last_peered":"2024-09-22T09:51:13.508468+0000","last_clean":"2024-09-22T09:51:13.508468+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:51:13.508468+0000","last_undegraded":"2024-09-22T09:51:13.508468+0000","last_fullsized":"2024-09-22T09:51:13.508468+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:29.683561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6331018,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":1081,"num_write":998,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.171752+0000","last_change":"2024-09-22T08:42:15.432415+0000","last_active":"2024-09-22T09:50:21.171752+0000","last_peered":"2024-09-22T09:50:21.171752+0000","last_clean":"2024-09-22T09:50:21.171752+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:50:21.171752+0000","last_undegraded":"2024-09-22T09:50:21.171752+0000","last_fullsized":"2024-09-22T09:50:21.171752+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.375014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'203","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:58.564083+0000","last_change":"2024-09-22T08:42:13.415020+0000","last_active":"2024-09-22T09:53:58.564083+0000","last_peered":"2024-09-22T09:53:58.564083+0000","last_clean":"2024-09-22T09:53:58.564083+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:53:58.564083+0000","last_undegraded":"2024-09-22T09:53:58.564083+0000","last_fullsized":"2024-09-22T09:53:58.564083+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:27.087793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":6282,"num_write":913,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":681,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.669900+0000","last_change":"2024-09-22T08:42:15.432007+0000","last_active":"2024-09-22T09:50:22.669900+0000","last_peered":"2024-09-22T09:50:22.669900+0000","last_clean":"2024-09-22T09:50:22.669900+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:50:22.669900+0000","last_undegraded":"2024-09-22T09:50:22.669900+0000","last_fullsized":"2024-09-22T09:50:22.669900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:22.641506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'215","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671676+0000","last_change":"2024-09-22T08:42:13.406807+0000","last_active":"2024-09-22T09:49:47.671676+0000","last_peered":"2024-09-22T09:49:47.671676+0000","last_clean":"2024-09-22T09:49:47.671676+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:49:47.671676+0000","last_undegraded":"2024-09-22T09:49:47.671676+0000","last_fullsized":"2024-09-22T09:49:47.671676+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:01.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":688,"num_read_kb":1734,"num_write":930,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4552","reported_seq":5321,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556891+0000","last_change":"2024-09-22T08:42:15.421948+0000","last_active":"2024-09-22T09:51:02.556891+0000","last_peered":"2024-09-22T09:51:02.556891+0000","last_clean":"2024-09-22T09:51:02.556891+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:51:02.556891+0000","last_undegraded":"2024-09-22T09:51:02.556891+0000","last_fullsized":"2024-09-22T09:51:02.556891+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":3000,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:54.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'321","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.765211+0000","last_change":"2024-09-22T08:42:13.413783+0000","last_active":"2024-09-22T09:52:19.765211+0000","last_peered":"2024-09-22T09:52:19.765211+0000","last_clean":"2024-09-22T09:52:19.765211+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:52:19.765211+0000","last_undegraded":"2024-09-22T09:52:19.765211+0000","last_fullsized":"2024-09-22T09:52:19.765211+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:22.263546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11561569,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":962,"num_read_kb":40392,"num_write":1275,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'116","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682868+0000","last_change":"2024-09-22T08:42:15.435779+0000","last_active":"2024-09-22T09:51:02.682868+0000","last_peered":"2024-09-22T09:51:02.682868+0000","last_clean":"2024-09-22T09:51:02.682868+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:51:02.682868+0000","last_undegraded":"2024-09-22T09:51:02.682868+0000","last_fullsized":"2024-09-22T09:51:02.682868+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:34.540861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'203","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.312026+0000","last_change":"2024-09-22T08:42:13.409600+0000","last_active":"2024-09-22T09:51:35.312026+0000","last_peered":"2024-09-22T09:51:35.312026+0000","last_clean":"2024-09-22T09:51:35.312026+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:51:35.312026+0000","last_undegraded":"2024-09-22T09:51:35.312026+0000","last_fullsized":"2024-09-22T09:51:35.312026+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:13:38.537153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459866,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":705,"num_read_kb":60138,"num_write":925,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.872378+0000","last_change":"2024-09-22T08:42:15.430810+0000","last_active":"2024-09-22T09:51:09.872378+0000","last_peered":"2024-09-22T09:51:09.872378+0000","last_clean":"2024-09-22T09:51:09.872378+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:51:09.872378+0000","last_undegraded":"2024-09-22T09:51:09.872378+0000","last_fullsized":"2024-09-22T09:51:09.872378+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:24.046046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547462+0000","last_change":"2024-09-22T08:42:15.423020+0000","last_active":"2024-09-22T09:49:57.547462+0000","last_peered":"2024-09-22T09:49:57.547462+0000","last_clean":"2024-09-22T09:49:57.547462+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:49:57.547462+0000","last_undegraded":"2024-09-22T09:49:57.547462+0000","last_fullsized":"2024-09-22T09:49:57.547462+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:37.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'215","reported_seq":848,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.795599+0000","last_change":"2024-09-22T08:42:13.423588+0000","last_active":"2024-09-22T09:51:09.795599+0000","last_peered":"2024-09-22T09:51:09.795599+0000","last_clean":"2024-09-22T09:51:09.795599+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:51:09.795599+0000","last_undegraded":"2024-09-22T09:51:09.795599+0000","last_fullsized":"2024-09-22T09:51:09.795599+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:30.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485787,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":599,"num_read_kb":44934,"num_write":914,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514762+0000","last_change":"2024-09-22T08:42:15.436779+0000","last_active":"2024-09-22T09:49:57.514762+0000","last_peered":"2024-09-22T09:49:57.514762+0000","last_clean":"2024-09-22T09:49:57.514762+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:49:57.514762+0000","last_undegraded":"2024-09-22T09:49:57.514762+0000","last_fullsized":"2024-09-22T09:49:57.514762+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:13.788611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'136","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.577926+0000","last_change":"2024-09-22T08:42:13.397442+0000","last_active":"2024-09-22T09:51:42.577926+0000","last_peered":"2024-09-22T09:51:42.577926+0000","last_clean":"2024-09-22T09:51:42.577926+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:51:42.577926+0000","last_undegraded":"2024-09-22T09:51:42.577926+0000","last_fullsized":"2024-09-22T09:51:42.577926+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242938,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":4340,"num_write":702,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:46.831407+0000","last_change":"2024-09-22T08:42:15.430118+0000","last_active":"2024-09-22T09:51:46.831407+0000","last_peered":"2024-09-22T09:51:46.831407+0000","last_clean":"2024-09-22T09:51:46.831407+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:51:46.831407+0000","last_undegraded":"2024-09-22T09:51:46.831407+0000","last_fullsized":"2024-09-22T09:51:46.831407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:28.368027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'197","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666687+0000","last_change":"2024-09-22T08:42:46.094591+0000","last_active":"2024-09-22T09:49:57.666687+0000","last_peered":"2024-09-22T09:49:57.666687+0000","last_clean":"2024-09-22T09:49:57.666687+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:49:57.666687+0000","last_undegraded":"2024-09-22T09:49:57.666687+0000","last_fullsized":"2024-09-22T09:49:57.666687+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:10.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569641,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":44793,"num_write":914,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'262","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:09.851927+0000","last_change":"2024-09-22T08:42:15.433496+0000","last_active":"2024-09-22T09:50:09.851927+0000","last_peered":"2024-09-22T09:50:09.851927+0000","last_clean":"2024-09-22T09:50:09.851927+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:50:09.851927+0000","last_undegraded":"2024-09-22T09:50:09.851927+0000","last_fullsized":"2024-09-22T09:50:09.851927+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:34.253039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'203","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547558+0000","last_change":"2024-09-22T08:42:13.419441+0000","last_active":"2024-09-22T09:49:57.547558+0000","last_peered":"2024-09-22T09:49:57.547558+0000","last_clean":"2024-09-22T09:49:57.547558+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:49:57.547558+0000","last_undegraded":"2024-09-22T09:49:57.547558+0000","last_fullsized":"2024-09-22T09:49:57.547558+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:02.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563032,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":637,"num_write":1011,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'334","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:56.563649+0000","last_change":"2024-09-22T08:42:15.431963+0000","last_active":"2024-09-22T09:51:56.563649+0000","last_peered":"2024-09-22T09:51:56.563649+0000","last_clean":"2024-09-22T09:51:56.563649+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:51:56.563649+0000","last_undegraded":"2024-09-22T09:51:56.563649+0000","last_fullsized":"2024-09-22T09:51:56.563649+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:19.216549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'227","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.016903+0000","last_change":"2024-09-22T08:42:13.415311+0000","last_active":"2024-09-22T09:52:32.016903+0000","last_peered":"2024-09-22T09:52:32.016903+0000","last_clean":"2024-09-22T09:52:32.016903+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:52:32.016903+0000","last_undegraded":"2024-09-22T09:52:32.016903+0000","last_fullsized":"2024-09-22T09:52:32.016903+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:24.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258177,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":35016,"num_write":915,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'67","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547581+0000","last_change":"2024-09-22T08:42:15.436918+0000","last_active":"2024-09-22T09:49:57.547581+0000","last_peered":"2024-09-22T09:49:57.547581+0000","last_clean":"2024-09-22T09:49:57.547581+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:49:57.547581+0000","last_undegraded":"2024-09-22T09:49:57.547581+0000","last_fullsized":"2024-09-22T09:49:57.547581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:11.373207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'200","reported_seq":1063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.503387+0000","last_change":"2024-09-22T08:42:13.420123+0000","last_active":"2024-09-22T09:50:50.503387+0000","last_peered":"2024-09-22T09:50:50.503387+0000","last_clean":"2024-09-22T09:50:50.503387+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:50:50.503387+0000","last_undegraded":"2024-09-22T09:50:50.503387+0000","last_fullsized":"2024-09-22T09:50:50.503387+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:04.931071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751322,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":71433,"num_write":1016,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'127","reported_seq":637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.786070+0000","last_change":"2024-09-22T08:42:23.524985+0000","last_active":"2024-09-22T09:52:36.786070+0000","last_peered":"2024-09-22T09:52:36.786070+0000","last_clean":"2024-09-22T09:52:36.786070+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:52:36.786070+0000","last_undegraded":"2024-09-22T09:52:36.786070+0000","last_fullsized":"2024-09-22T09:52:36.786070+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:48.897187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655253+0000","last_change":"2024-09-22T08:42:15.440938+0000","last_active":"2024-09-22T09:50:07.655253+0000","last_peered":"2024-09-22T09:50:07.655253+0000","last_clean":"2024-09-22T09:50:07.655253+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:50:07.655253+0000","last_undegraded":"2024-09-22T09:50:07.655253+0000","last_fullsized":"2024-09-22T09:50:07.655253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:37.823594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'243","reported_seq":944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514032+0000","last_change":"2024-09-22T08:42:13.421758+0000","last_active":"2024-09-22T09:49:52.514032+0000","last_peered":"2024-09-22T09:49:52.514032+0000","last_clean":"2024-09-22T09:49:52.514032+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:49:52.514032+0000","last_undegraded":"2024-09-22T09:49:52.514032+0000","last_fullsized":"2024-09-22T09:49:52.514032+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:55.196735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81664,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":75224,"num_write":1092,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673256+0000","last_change":"2024-09-22T08:42:17.436026+0000","last_active":"2024-09-22T09:49:57.673256+0000","last_peered":"2024-09-22T09:49:57.673256+0000","last_clean":"2024-09-22T09:49:57.673256+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:49:57.673256+0000","last_undegraded":"2024-09-22T09:49:57.673256+0000","last_fullsized":"2024-09-22T09:49:57.673256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:39.444676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'212","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.573790+0000","last_change":"2024-09-22T08:42:19.458164+0000","last_active":"2024-09-22T09:52:52.573790+0000","last_peered":"2024-09-22T09:52:52.573790+0000","last_clean":"2024-09-22T09:52:52.573790+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:52:52.573790+0000","last_undegraded":"2024-09-22T09:52:52.573790+0000","last_fullsized":"2024-09-22T09:52:52.573790+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:13.853175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15363,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":282,"num_read_kb":359,"num_write":168,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515692+0000","last_change":"2024-09-22T08:42:21.476835+0000","last_active":"2024-09-22T09:50:02.515692+0000","last_peered":"2024-09-22T09:50:02.515692+0000","last_clean":"2024-09-22T09:50:02.515692+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:50:02.515692+0000","last_undegraded":"2024-09-22T09:50:02.515692+0000","last_fullsized":"2024-09-22T09:50:02.515692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:23.164486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'141","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.326568+0000","last_change":"2024-09-22T08:42:23.525612+0000","last_active":"2024-09-22T09:51:11.326568+0000","last_peered":"2024-09-22T09:51:11.326568+0000","last_clean":"2024-09-22T09:51:11.326568+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:51:11.326568+0000","last_undegraded":"2024-09-22T09:51:11.326568+0000","last_fullsized":"2024-09-22T09:51:11.326568+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:43.028034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673203+0000","last_change":"2024-09-22T08:42:15.433777+0000","last_active":"2024-09-22T09:49:57.673203+0000","last_peered":"2024-09-22T09:49:57.673203+0000","last_clean":"2024-09-22T09:49:57.673203+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:49:57.673203+0000","last_undegraded":"2024-09-22T09:49:57.673203+0000","last_fullsized":"2024-09-22T09:49:57.673203+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:47.845777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'198","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.654080+0000","last_change":"2024-09-22T08:42:13.409995+0000","last_active":"2024-09-22T09:49:57.654080+0000","last_peered":"2024-09-22T09:49:57.654080+0000","last_clean":"2024-09-22T09:49:57.654080+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:49:57.654080+0000","last_undegraded":"2024-09-22T09:49:57.654080+0000","last_fullsized":"2024-09-22T09:49:57.654080+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:32.859795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110244,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":43802,"num_write":906,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655271+0000","last_change":"2024-09-22T08:42:17.438392+0000","last_active":"2024-09-22T09:50:07.655271+0000","last_peered":"2024-09-22T09:50:07.655271+0000","last_clean":"2024-09-22T09:50:07.655271+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:50:07.655271+0000","last_undegraded":"2024-09-22T09:50:07.655271+0000","last_fullsized":"2024-09-22T09:50:07.655271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:33.187002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'99","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.845043+0000","last_change":"2024-09-22T08:42:19.453384+0000","last_active":"2024-09-22T09:52:52.845043+0000","last_peered":"2024-09-22T09:52:52.845043+0000","last_clean":"2024-09-22T09:52:52.845043+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:52:52.845043+0000","last_undegraded":"2024-09-22T09:52:52.845043+0000","last_fullsized":"2024-09-22T09:52:52.845043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:58.602109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.548236+0000","last_change":"2024-09-22T08:42:21.479500+0000","last_active":"2024-09-22T09:50:02.548236+0000","last_peered":"2024-09-22T09:50:02.548236+0000","last_clean":"2024-09-22T09:50:02.548236+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:50:02.548236+0000","last_undegraded":"2024-09-22T09:50:02.548236+0000","last_fullsized":"2024-09-22T09:50:02.548236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:12.904978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'108","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.888189+0000","last_change":"2024-09-22T08:42:23.524672+0000","last_active":"2024-09-22T09:51:39.888189+0000","last_peered":"2024-09-22T09:51:39.888189+0000","last_clean":"2024-09-22T09:51:39.888189+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:51:39.888189+0000","last_undegraded":"2024-09-22T09:51:39.888189+0000","last_fullsized":"2024-09-22T09:51:39.888189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:49.539509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":746,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.900800+0000","last_change":"2024-09-22T08:42:15.431967+0000","last_active":"2024-09-22T09:51:39.900800+0000","last_peered":"2024-09-22T09:51:39.900800+0000","last_clean":"2024-09-22T09:51:39.900800+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:51:39.900800+0000","last_undegraded":"2024-09-22T09:51:39.900800+0000","last_fullsized":"2024-09-22T09:51:39.900800+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:21.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'242","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.690577+0000","last_change":"2024-09-22T08:42:46.096752+0000","last_active":"2024-09-22T09:50:27.690577+0000","last_peered":"2024-09-22T09:50:27.690577+0000","last_clean":"2024-09-22T09:50:27.690577+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:50:27.690577+0000","last_undegraded":"2024-09-22T09:50:27.690577+0000","last_fullsized":"2024-09-22T09:50:27.690577+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:52.050611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26247569,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":41488,"num_write":1118,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"36'4","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.244745+0000","last_change":"2024-09-22T08:42:17.436896+0000","last_active":"2024-09-22T09:54:00.244745+0000","last_peered":"2024-09-22T09:54:00.244745+0000","last_clean":"2024-09-22T09:54:00.244745+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:00.244745+0000","last_undegraded":"2024-09-22T09:54:00.244745+0000","last_fullsized":"2024-09-22T09:54:00.244745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:50.909668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'142","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.882035+0000","last_change":"2024-09-22T08:42:19.453227+0000","last_active":"2024-09-22T09:52:52.882035+0000","last_peered":"2024-09-22T09:52:52.882035+0000","last_clean":"2024-09-22T09:52:52.882035+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:52:52.882035+0000","last_undegraded":"2024-09-22T09:52:52.882035+0000","last_fullsized":"2024-09-22T09:52:52.882035+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.144959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'743","reported_seq":2932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790557+0000","last_change":"2024-09-22T08:42:21.477386+0000","last_active":"2024-09-22T09:54:03.790557+0000","last_peered":"2024-09-22T09:54:03.790557+0000","last_clean":"2024-09-22T09:54:03.790557+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:03.790557+0000","last_undegraded":"2024-09-22T09:54:03.790557+0000","last_fullsized":"2024-09-22T09:54:03.790557+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:26.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'218","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.675764+0000","last_change":"2024-09-22T08:42:23.578386+0000","last_active":"2024-09-22T09:52:36.675764+0000","last_peered":"2024-09-22T09:52:36.675764+0000","last_clean":"2024-09-22T09:52:36.675764+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:52:36.675764+0000","last_undegraded":"2024-09-22T09:52:36.675764+0000","last_fullsized":"2024-09-22T09:52:36.675764+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:30.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.329583+0000","last_change":"2024-09-22T08:42:15.435930+0000","last_active":"2024-09-22T09:50:15.329583+0000","last_peered":"2024-09-22T09:50:15.329583+0000","last_clean":"2024-09-22T09:50:15.329583+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:50:15.329583+0000","last_undegraded":"2024-09-22T09:50:15.329583+0000","last_fullsized":"2024-09-22T09:50:15.329583+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:06.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'173","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666614+0000","last_change":"2024-09-22T08:42:13.400466+0000","last_active":"2024-09-22T09:49:57.666614+0000","last_peered":"2024-09-22T09:49:57.666614+0000","last_clean":"2024-09-22T09:49:57.666614+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:49:57.666614+0000","last_undegraded":"2024-09-22T09:49:57.666614+0000","last_fullsized":"2024-09-22T09:49:57.666614+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:24.218589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11590790,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":536,"num_read_kb":49818,"num_write":841,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673308+0000","last_change":"2024-09-22T08:42:17.435623+0000","last_active":"2024-09-22T09:49:57.673308+0000","last_peered":"2024-09-22T09:49:57.673308+0000","last_clean":"2024-09-22T09:49:57.673308+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:49:57.673308+0000","last_undegraded":"2024-09-22T09:49:57.673308+0000","last_fullsized":"2024-09-22T09:49:57.673308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:28.519736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'146","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.887895+0000","last_change":"2024-09-22T08:42:19.456582+0000","last_active":"2024-09-22T09:52:52.887895+0000","last_peered":"2024-09-22T09:52:52.887895+0000","last_clean":"2024-09-22T09:52:52.887895+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:52:52.887895+0000","last_undegraded":"2024-09-22T09:52:52.887895+0000","last_fullsized":"2024-09-22T09:52:52.887895+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:38.574953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":255,"num_write":106,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'752","reported_seq":2397,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782892+0000","last_change":"2024-09-22T08:42:21.478967+0000","last_active":"2024-09-22T09:54:03.782892+0000","last_peered":"2024-09-22T09:54:03.782892+0000","last_clean":"2024-09-22T09:54:03.782892+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:03.782892+0000","last_undegraded":"2024-09-22T09:54:03.782892+0000","last_fullsized":"2024-09-22T09:54:03.782892+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:49.086596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687895+0000","last_change":"2024-09-22T08:42:15.434568+0000","last_active":"2024-09-22T09:51:37.687895+0000","last_peered":"2024-09-22T09:51:37.687895+0000","last_clean":"2024-09-22T09:51:37.687895+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:51:37.687895+0000","last_undegraded":"2024-09-22T09:51:37.687895+0000","last_fullsized":"2024-09-22T09:51:37.687895+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:47.411833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'186","reported_seq":806,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:06.030411+0000","last_change":"2024-09-22T08:42:46.096820+0000","last_active":"2024-09-22T09:51:06.030411+0000","last_peered":"2024-09-22T09:51:06.030411+0000","last_clean":"2024-09-22T09:51:06.030411+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:51:06.030411+0000","last_undegraded":"2024-09-22T09:51:06.030411+0000","last_fullsized":"2024-09-22T09:51:06.030411+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:26.829701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5318948,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":37265,"num_write":896,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.530209+0000","last_change":"2024-09-22T08:42:17.428741+0000","last_active":"2024-09-22T09:51:37.530209+0000","last_peered":"2024-09-22T09:51:37.530209+0000","last_clean":"2024-09-22T09:51:37.530209+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:51:37.530209+0000","last_undegraded":"2024-09-22T09:51:37.530209+0000","last_fullsized":"2024-09-22T09:51:37.530209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.400097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'248","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.707978+0000","last_change":"2024-09-22T08:42:19.453085+0000","last_active":"2024-09-22T09:53:57.707978+0000","last_peered":"2024-09-22T09:53:57.707978+0000","last_clean":"2024-09-22T09:53:57.707978+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:53:57.707978+0000","last_undegraded":"2024-09-22T09:53:57.707978+0000","last_fullsized":"2024-09-22T09:53:57.707978+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:18.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":346,"num_read_kb":397,"num_write":206,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426203+0000","last_change":"2024-09-22T08:42:21.473910+0000","last_active":"2024-09-22T09:49:52.426203+0000","last_peered":"2024-09-22T09:49:52.426203+0000","last_clean":"2024-09-22T09:49:52.426203+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:49:52.426203+0000","last_undegraded":"2024-09-22T09:49:52.426203+0000","last_fullsized":"2024-09-22T09:49:52.426203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:39.543682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'582","reported_seq":1405,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.730090+0000","last_change":"2024-09-22T08:42:23.524686+0000","last_active":"2024-09-22T09:54:00.730090+0000","last_peered":"2024-09-22T09:54:00.730090+0000","last_clean":"2024-09-22T09:54:00.730090+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:00.730090+0000","last_undegraded":"2024-09-22T09:54:00.730090+0000","last_fullsized":"2024-09-22T09:54:00.730090+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:20.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.561618+0000","last_change":"2024-09-22T08:42:15.437596+0000","last_active":"2024-09-22T09:51:37.561618+0000","last_peered":"2024-09-22T09:51:37.561618+0000","last_clean":"2024-09-22T09:51:37.561618+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:51:37.561618+0000","last_undegraded":"2024-09-22T09:51:37.561618+0000","last_fullsized":"2024-09-22T09:51:37.561618+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:39.538847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'225","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533591+0000","last_change":"2024-09-22T08:42:13.415541+0000","last_active":"2024-09-22T09:51:57.533591+0000","last_peered":"2024-09-22T09:51:57.533591+0000","last_clean":"2024-09-22T09:51:57.533591+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:51:57.533591+0000","last_undegraded":"2024-09-22T09:51:57.533591+0000","last_fullsized":"2024-09-22T09:51:57.533591+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:48:38.008511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11135054,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":642,"num_read_kb":43078,"num_write":992,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697218+0000","last_change":"2024-09-22T08:42:17.437870+0000","last_active":"2024-09-22T09:51:37.697218+0000","last_peered":"2024-09-22T09:51:37.697218+0000","last_clean":"2024-09-22T09:51:37.697218+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:51:37.697218+0000","last_undegraded":"2024-09-22T09:51:37.697218+0000","last_fullsized":"2024-09-22T09:51:37.697218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:56.092607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'148","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.869599+0000","last_change":"2024-09-22T08:42:19.453046+0000","last_active":"2024-09-22T09:52:52.869599+0000","last_peered":"2024-09-22T09:52:52.869599+0000","last_clean":"2024-09-22T09:52:52.869599+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:52:52.869599+0000","last_undegraded":"2024-09-22T09:52:52.869599+0000","last_fullsized":"2024-09-22T09:52:52.869599+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:19.048949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":209,"num_write":100,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2542","reported_seq":4378,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.695093+0000","last_change":"2024-09-22T08:42:23.525193+0000","last_active":"2024-09-22T09:53:22.695093+0000","last_peered":"2024-09-22T09:53:22.695093+0000","last_clean":"2024-09-22T09:53:22.695093+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:53:22.695093+0000","last_undegraded":"2024-09-22T09:53:22.695093+0000","last_fullsized":"2024-09-22T09:53:22.695093+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:05.078232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1200,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681284+0000","last_change":"2024-09-22T08:42:15.439516+0000","last_active":"2024-09-22T09:51:42.681284+0000","last_peered":"2024-09-22T09:51:42.681284+0000","last_clean":"2024-09-22T09:51:42.681284+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:51:42.681284+0000","last_undegraded":"2024-09-22T09:51:42.681284+0000","last_fullsized":"2024-09-22T09:51:42.681284+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:06.792912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'237","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533551+0000","last_change":"2024-09-22T08:42:13.422752+0000","last_active":"2024-09-22T09:51:57.533551+0000","last_peered":"2024-09-22T09:51:57.533551+0000","last_clean":"2024-09-22T09:51:57.533551+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:51:57.533551+0000","last_undegraded":"2024-09-22T09:51:57.533551+0000","last_fullsized":"2024-09-22T09:51:57.533551+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.596026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16090748,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":591,"num_read_kb":17575,"num_write":1014,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686455+0000","last_change":"2024-09-22T08:42:17.437867+0000","last_active":"2024-09-22T09:49:47.686455+0000","last_peered":"2024-09-22T09:49:47.686455+0000","last_clean":"2024-09-22T09:49:47.686455+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:49:47.686455+0000","last_undegraded":"2024-09-22T09:49:47.686455+0000","last_fullsized":"2024-09-22T09:49:47.686455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:57.450851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'194","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.550842+0000","last_change":"2024-09-22T08:42:19.455781+0000","last_active":"2024-09-22T09:53:52.550842+0000","last_peered":"2024-09-22T09:53:52.550842+0000","last_clean":"2024-09-22T09:53:52.550842+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:53:52.550842+0000","last_undegraded":"2024-09-22T09:53:52.550842+0000","last_fullsized":"2024-09-22T09:53:52.550842+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:37:46.879916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":313,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'755","reported_seq":2721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782626+0000","last_change":"2024-09-22T08:42:21.480118+0000","last_active":"2024-09-22T09:54:03.782626+0000","last_peered":"2024-09-22T09:54:03.782626+0000","last_clean":"2024-09-22T09:54:03.782626+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:03.782626+0000","last_undegraded":"2024-09-22T09:54:03.782626+0000","last_fullsized":"2024-09-22T09:54:03.782626+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:26.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'119","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.314868+0000","last_change":"2024-09-22T08:42:23.527331+0000","last_active":"2024-09-22T09:53:59.314868+0000","last_peered":"2024-09-22T09:53:59.314868+0000","last_clean":"2024-09-22T09:53:59.314868+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:53:59.314868+0000","last_undegraded":"2024-09-22T09:53:59.314868+0000","last_fullsized":"2024-09-22T09:53:59.314868+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:06.830634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.581065+0000","last_change":"2024-09-22T08:42:15.435714+0000","last_active":"2024-09-22T09:51:13.581065+0000","last_peered":"2024-09-22T09:51:13.581065+0000","last_clean":"2024-09-22T09:51:13.581065+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:51:13.581065+0000","last_undegraded":"2024-09-22T09:51:13.581065+0000","last_fullsized":"2024-09-22T09:51:13.581065+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:25.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'206","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671732+0000","last_change":"2024-09-22T08:42:13.403452+0000","last_active":"2024-09-22T09:49:47.671732+0000","last_peered":"2024-09-22T09:49:47.671732+0000","last_clean":"2024-09-22T09:49:47.671732+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:49:47.671732+0000","last_undegraded":"2024-09-22T09:49:47.671732+0000","last_fullsized":"2024-09-22T09:49:47.671732+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:14.603364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299561,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":60855,"num_write":911,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697795+0000","last_change":"2024-09-22T08:42:17.435826+0000","last_active":"2024-09-22T09:51:42.697795+0000","last_peered":"2024-09-22T09:51:42.697795+0000","last_clean":"2024-09-22T09:51:42.697795+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:51:42.697795+0000","last_undegraded":"2024-09-22T09:51:42.697795+0000","last_fullsized":"2024-09-22T09:51:42.697795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:56.041489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.695871+0000","last_change":"2024-09-22T08:42:19.452009+0000","last_active":"2024-09-22T09:54:00.695871+0000","last_peered":"2024-09-22T09:54:00.695871+0000","last_clean":"2024-09-22T09:54:00.695871+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:00.695871+0000","last_undegraded":"2024-09-22T09:54:00.695871+0000","last_fullsized":"2024-09-22T09:54:00.695871+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:46.201887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":279,"num_read_kb":351,"num_write":136,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697752+0000","last_change":"2024-09-22T08:42:21.479365+0000","last_active":"2024-09-22T09:51:42.697752+0000","last_peered":"2024-09-22T09:51:42.697752+0000","last_clean":"2024-09-22T09:51:42.697752+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:51:42.697752+0000","last_undegraded":"2024-09-22T09:51:42.697752+0000","last_fullsized":"2024-09-22T09:51:42.697752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.054664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'142","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.315438+0000","last_change":"2024-09-22T08:42:23.525367+0000","last_active":"2024-09-22T09:53:59.315438+0000","last_peered":"2024-09-22T09:53:59.315438+0000","last_clean":"2024-09-22T09:53:59.315438+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:53:59.315438+0000","last_undegraded":"2024-09-22T09:53:59.315438+0000","last_fullsized":"2024-09-22T09:53:59.315438+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:24.183213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545943+0000","last_change":"2024-09-22T08:42:15.430534+0000","last_active":"2024-09-22T09:49:47.545943+0000","last_peered":"2024-09-22T09:49:47.545943+0000","last_clean":"2024-09-22T09:49:47.545943+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:49:47.545943+0000","last_undegraded":"2024-09-22T09:49:47.545943+0000","last_fullsized":"2024-09-22T09:49:47.545943+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:45.930207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'363","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:51.846880+0000","last_change":"2024-09-22T08:42:13.401775+0000","last_active":"2024-09-22T09:53:51.846880+0000","last_peered":"2024-09-22T09:53:51.846880+0000","last_clean":"2024-09-22T09:53:51.846880+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:53:51.846880+0000","last_undegraded":"2024-09-22T09:53:51.846880+0000","last_fullsized":"2024-09-22T09:53:51.846880+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:19.013414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31394,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":7434,"num_write":1384,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686491+0000","last_change":"2024-09-22T08:42:17.438355+0000","last_active":"2024-09-22T09:49:47.686491+0000","last_peered":"2024-09-22T09:49:47.686491+0000","last_clean":"2024-09-22T09:49:47.686491+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:49:47.686491+0000","last_undegraded":"2024-09-22T09:49:47.686491+0000","last_fullsized":"2024-09-22T09:49:47.686491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.597938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'162","reported_seq":748,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.912530+0000","last_change":"2024-09-22T08:42:19.454917+0000","last_active":"2024-09-22T09:52:52.912530+0000","last_peered":"2024-09-22T09:52:52.912530+0000","last_clean":"2024-09-22T09:52:52.912530+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:52:52.912530+0000","last_undegraded":"2024-09-22T09:52:52.912530+0000","last_fullsized":"2024-09-22T09:52:52.912530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:48.566070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":251,"num_write":178,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654973+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:50:02.654973+0000","last_peered":"2024-09-22T09:50:02.654973+0000","last_clean":"2024-09-22T09:50:02.654973+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:50:02.654973+0000","last_undegraded":"2024-09-22T09:50:02.654973+0000","last_fullsized":"2024-09-22T09:50:02.654973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:44.790859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674614+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:52:37.674614+0000","last_peered":"2024-09-22T09:52:37.674614+0000","last_clean":"2024-09-22T09:52:37.674614+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:52:37.674614+0000","last_undegraded":"2024-09-22T09:52:37.674614+0000","last_fullsized":"2024-09-22T09:52:37.674614+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:23.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.083868+0000","last_change":"2024-09-22T08:42:15.429567+0000","last_active":"2024-09-22T09:52:32.083868+0000","last_peered":"2024-09-22T09:52:32.083868+0000","last_clean":"2024-09-22T09:52:32.083868+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:52:32.083868+0000","last_undegraded":"2024-09-22T09:52:32.083868+0000","last_fullsized":"2024-09-22T09:52:32.083868+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:58.301320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'231","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.767112+0000","last_change":"2024-09-22T08:42:13.403639+0000","last_active":"2024-09-22T09:52:19.767112+0000","last_peered":"2024-09-22T09:52:19.767112+0000","last_clean":"2024-09-22T09:52:19.767112+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:52:19.767112+0000","last_undegraded":"2024-09-22T09:52:19.767112+0000","last_fullsized":"2024-09-22T09:52:19.767112+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:45.735642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22046937,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":761,"num_read_kb":42930,"num_write":1120,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425560+0000","last_change":"2024-09-22T08:42:17.436642+0000","last_active":"2024-09-22T09:49:47.425560+0000","last_peered":"2024-09-22T09:49:47.425560+0000","last_clean":"2024-09-22T09:49:47.425560+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:49:47.425560+0000","last_undegraded":"2024-09-22T09:49:47.425560+0000","last_fullsized":"2024-09-22T09:49:47.425560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:56.592253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'190","reported_seq":790,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.960456+0000","last_change":"2024-09-22T08:42:19.451872+0000","last_active":"2024-09-22T09:52:52.960456+0000","last_peered":"2024-09-22T09:52:52.960456+0000","last_clean":"2024-09-22T09:52:52.960456+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:52:52.960456+0000","last_undegraded":"2024-09-22T09:52:52.960456+0000","last_fullsized":"2024-09-22T09:52:52.960456+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:10.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":249,"num_read_kb":310,"num_write":142,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'718","reported_seq":2491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.783109+0000","last_change":"2024-09-22T08:42:21.477749+0000","last_active":"2024-09-22T09:54:03.783109+0000","last_peered":"2024-09-22T09:54:03.783109+0000","last_clean":"2024-09-22T09:54:03.783109+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:03.783109+0000","last_undegraded":"2024-09-22T09:54:03.783109+0000","last_fullsized":"2024-09-22T09:54:03.783109+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:54:39.808571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'139","reported_seq":639,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:34.236678+0000","last_change":"2024-09-22T08:42:23.527200+0000","last_active":"2024-09-22T09:52:34.236678+0000","last_peered":"2024-09-22T09:52:34.236678+0000","last_clean":"2024-09-22T09:52:34.236678+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:52:34.236678+0000","last_undegraded":"2024-09-22T09:52:34.236678+0000","last_fullsized":"2024-09-22T09:52:34.236678+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:36.368516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.583270+0000","last_change":"2024-09-22T08:42:15.434596+0000","last_active":"2024-09-22T09:50:50.583270+0000","last_peered":"2024-09-22T09:50:50.583270+0000","last_clean":"2024-09-22T09:50:50.583270+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:50:50.583270+0000","last_undegraded":"2024-09-22T09:50:50.583270+0000","last_fullsized":"2024-09-22T09:50:50.583270+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:08.897077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'256","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653785+0000","last_change":"2024-09-22T08:42:46.165164+0000","last_active":"2024-09-22T09:49:57.653785+0000","last_peered":"2024-09-22T09:49:57.653785+0000","last_clean":"2024-09-22T09:49:57.653785+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:49:57.653785+0000","last_undegraded":"2024-09-22T09:49:57.653785+0000","last_fullsized":"2024-09-22T09:49:57.653785+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:28.663766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485776,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1201,"num_read_kb":6055,"num_write":1101,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1448,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.257154+0000","last_change":"2024-09-22T08:42:17.433014+0000","last_active":"2024-09-22T09:54:00.257154+0000","last_peered":"2024-09-22T09:54:00.257154+0000","last_clean":"2024-09-22T09:54:00.257154+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:00.257154+0000","last_undegraded":"2024-09-22T09:54:00.257154+0000","last_fullsized":"2024-09-22T09:54:00.257154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:41.112528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'132","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.816417+0000","last_change":"2024-09-22T08:42:19.457240+0000","last_active":"2024-09-22T09:52:52.816417+0000","last_peered":"2024-09-22T09:52:52.816417+0000","last_clean":"2024-09-22T09:52:52.816417+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:52:52.816417+0000","last_undegraded":"2024-09-22T09:52:52.816417+0000","last_fullsized":"2024-09-22T09:52:52.816417+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:43.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'754","reported_seq":2727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790782+0000","last_change":"2024-09-22T08:42:21.479394+0000","last_active":"2024-09-22T09:54:03.790782+0000","last_peered":"2024-09-22T09:54:03.790782+0000","last_clean":"2024-09-22T09:54:03.790782+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:03.790782+0000","last_undegraded":"2024-09-22T09:54:03.790782+0000","last_fullsized":"2024-09-22T09:54:03.790782+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:36.701700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'118","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558129+0000","last_change":"2024-09-22T08:42:23.526928+0000","last_active":"2024-09-22T09:51:12.558129+0000","last_peered":"2024-09-22T09:51:12.558129+0000","last_clean":"2024-09-22T09:51:12.558129+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:51:12.558129+0000","last_undegraded":"2024-09-22T09:51:12.558129+0000","last_fullsized":"2024-09-22T09:51:12.558129+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:16.995273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.427871+0000","last_change":"2024-09-22T08:42:15.434196+0000","last_active":"2024-09-22T09:50:07.427871+0000","last_peered":"2024-09-22T09:50:07.427871+0000","last_clean":"2024-09-22T09:50:07.427871+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:50:07.427871+0000","last_undegraded":"2024-09-22T09:50:07.427871+0000","last_fullsized":"2024-09-22T09:50:07.427871+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:29.967093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'182","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.665992+0000","last_change":"2024-09-22T08:42:13.403505+0000","last_active":"2024-09-22T09:51:32.665992+0000","last_peered":"2024-09-22T09:51:32.665992+0000","last_clean":"2024-09-22T09:51:32.665992+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:51:32.665992+0000","last_undegraded":"2024-09-22T09:51:32.665992+0000","last_fullsized":"2024-09-22T09:51:32.665992+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:50:46.095633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14980326,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":701,"num_read_kb":142631,"num_write":841,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545984+0000","last_change":"2024-09-22T08:42:17.428207+0000","last_active":"2024-09-22T09:49:47.545984+0000","last_peered":"2024-09-22T09:49:47.545984+0000","last_clean":"2024-09-22T09:49:47.545984+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:49:47.545984+0000","last_undegraded":"2024-09-22T09:49:47.545984+0000","last_fullsized":"2024-09-22T09:49:47.545984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:36.330654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.907443+0000","last_change":"2024-09-22T08:42:19.459817+0000","last_active":"2024-09-22T09:52:52.907443+0000","last_peered":"2024-09-22T09:52:52.907443+0000","last_clean":"2024-09-22T09:52:52.907443+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:52:52.907443+0000","last_undegraded":"2024-09-22T09:52:52.907443+0000","last_fullsized":"2024-09-22T09:52:52.907443+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:06.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":313,"num_read_kb":355,"num_write":182,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.666030+0000","last_change":"2024-09-22T08:42:21.481035+0000","last_active":"2024-09-22T09:49:52.666030+0000","last_peered":"2024-09-22T09:49:52.666030+0000","last_clean":"2024-09-22T09:49:52.666030+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:49:52.666030+0000","last_undegraded":"2024-09-22T09:49:52.666030+0000","last_fullsized":"2024-09-22T09:49:52.666030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:13.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'130","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.452137+0000","last_change":"2024-09-22T08:42:23.529103+0000","last_active":"2024-09-22T09:51:48.452137+0000","last_peered":"2024-09-22T09:51:48.452137+0000","last_clean":"2024-09-22T09:51:48.452137+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:51:48.452137+0000","last_undegraded":"2024-09-22T09:51:48.452137+0000","last_fullsized":"2024-09-22T09:51:48.452137+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:43.270586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676034+0000","last_change":"2024-09-22T08:42:15.435903+0000","last_active":"2024-09-22T09:51:07.676034+0000","last_peered":"2024-09-22T09:51:07.676034+0000","last_clean":"2024-09-22T09:51:07.676034+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:51:07.676034+0000","last_undegraded":"2024-09-22T09:51:07.676034+0000","last_fullsized":"2024-09-22T09:51:07.676034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:50.676641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.535997+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T09:52:12.535997+0000","last_peered":"2024-09-22T09:52:12.535997+0000","last_clean":"2024-09-22T09:52:12.535997+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:52:12.535997+0000","last_undegraded":"2024-09-22T09:52:12.535997+0000","last_fullsized":"2024-09-22T09:52:12.535997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680619+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T09:50:47.680619+0000","last_peered":"2024-09-22T09:50:47.680619+0000","last_clean":"2024-09-22T09:50:47.680619+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:50:47.680619+0000","last_undegraded":"2024-09-22T09:50:47.680619+0000","last_fullsized":"2024-09-22T09:50:47.680619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'251","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661666+0000","last_change":"2024-09-22T08:42:46.093573+0000","last_active":"2024-09-22T09:50:57.661666+0000","last_peered":"2024-09-22T09:50:57.661666+0000","last_clean":"2024-09-22T09:50:57.661666+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:50:57.661666+0000","last_undegraded":"2024-09-22T09:50:57.661666+0000","last_fullsized":"2024-09-22T09:50:57.661666+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:55.591787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6682307,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19728,"num_write":1077,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524909+0000","last_change":"2024-09-22T08:42:17.430962+0000","last_active":"2024-09-22T09:51:02.524909+0000","last_peered":"2024-09-22T09:51:02.524909+0000","last_clean":"2024-09-22T09:51:02.524909+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:51:02.524909+0000","last_undegraded":"2024-09-22T09:51:02.524909+0000","last_fullsized":"2024-09-22T09:51:02.524909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:38.741426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'310","reported_seq":1011,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.713968+0000","last_change":"2024-09-22T08:42:19.458458+0000","last_active":"2024-09-22T09:54:00.713968+0000","last_peered":"2024-09-22T09:54:00.713968+0000","last_clean":"2024-09-22T09:54:00.713968+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:00.713968+0000","last_undegraded":"2024-09-22T09:54:00.713968+0000","last_fullsized":"2024-09-22T09:54:00.713968+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:21.464285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":700,"num_write":484,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.668007+0000","last_change":"2024-09-22T08:42:21.476608+0000","last_active":"2024-09-22T09:51:42.668007+0000","last_peered":"2024-09-22T09:51:42.668007+0000","last_clean":"2024-09-22T09:51:42.668007+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:51:42.668007+0000","last_undegraded":"2024-09-22T09:51:42.668007+0000","last_fullsized":"2024-09-22T09:51:42.668007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:00.388229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'205","reported_seq":913,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.706774+0000","last_change":"2024-09-22T08:42:23.527973+0000","last_active":"2024-09-22T09:52:36.706774+0000","last_peered":"2024-09-22T09:52:36.706774+0000","last_clean":"2024-09-22T09:52:36.706774+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:52:36.706774+0000","last_undegraded":"2024-09-22T09:52:36.706774+0000","last_fullsized":"2024-09-22T09:52:36.706774+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:38.241959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'136","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667317+0000","last_change":"2024-09-22T08:42:46.096326+0000","last_active":"2024-09-22T09:51:37.667317+0000","last_peered":"2024-09-22T09:51:37.667317+0000","last_clean":"2024-09-22T09:51:37.667317+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:51:37.667317+0000","last_undegraded":"2024-09-22T09:51:37.667317+0000","last_fullsized":"2024-09-22T09:51:37.667317+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:21.464651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.517955+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T09:50:17.517955+0000","last_peered":"2024-09-22T09:50:17.517955+0000","last_clean":"2024-09-22T09:50:17.517955+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:50:17.517955+0000","last_undegraded":"2024-09-22T09:50:17.517955+0000","last_fullsized":"2024-09-22T09:50:17.517955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'208","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662541+0000","last_change":"2024-09-22T08:42:13.420863+0000","last_active":"2024-09-22T09:51:02.662541+0000","last_peered":"2024-09-22T09:51:02.662541+0000","last_clean":"2024-09-22T09:51:02.662541+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:51:02.662541+0000","last_undegraded":"2024-09-22T09:51:02.662541+0000","last_fullsized":"2024-09-22T09:51:02.662541+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:47.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294213,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":134895,"num_write":906,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.688003+0000","last_change":"2024-09-22T08:42:17.440799+0000","last_active":"2024-09-22T09:51:37.688003+0000","last_peered":"2024-09-22T09:51:37.688003+0000","last_clean":"2024-09-22T09:51:37.688003+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:51:37.688003+0000","last_undegraded":"2024-09-22T09:51:37.688003+0000","last_fullsized":"2024-09-22T09:51:37.688003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:27.078620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'886","reported_seq":2685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.768544+0000","last_change":"2024-09-22T08:42:19.455687+0000","last_active":"2024-09-22T09:54:03.768544+0000","last_peered":"2024-09-22T09:54:03.768544+0000","last_clean":"2024-09-22T09:54:03.768544+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:03.768544+0000","last_undegraded":"2024-09-22T09:54:03.768544+0000","last_fullsized":"2024-09-22T09:54:03.768544+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":801,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.282664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1245,"num_read_kb":1438,"num_write":372,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.527988+0000","last_change":"2024-09-22T08:42:21.476397+0000","last_active":"2024-09-22T09:51:22.527988+0000","last_peered":"2024-09-22T09:51:22.527988+0000","last_clean":"2024-09-22T09:51:22.527988+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:51:22.527988+0000","last_undegraded":"2024-09-22T09:51:22.527988+0000","last_fullsized":"2024-09-22T09:51:22.527988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:11.328442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'234","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.082338+0000","last_change":"2024-09-22T08:42:23.576879+0000","last_active":"2024-09-22T09:50:32.082338+0000","last_peered":"2024-09-22T09:50:32.082338+0000","last_clean":"2024-09-22T09:50:32.082338+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:50:32.082338+0000","last_undegraded":"2024-09-22T09:50:32.082338+0000","last_fullsized":"2024-09-22T09:50:32.082338+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:21.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438071+0000","last_change":"2024-09-22T08:42:15.437627+0000","last_active":"2024-09-22T09:51:37.438071+0000","last_peered":"2024-09-22T09:51:37.438071+0000","last_clean":"2024-09-22T09:51:37.438071+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:51:37.438071+0000","last_undegraded":"2024-09-22T09:51:37.438071+0000","last_fullsized":"2024-09-22T09:51:37.438071+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:22.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.692480+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T09:50:47.692480+0000","last_peered":"2024-09-22T09:50:47.692480+0000","last_clean":"2024-09-22T09:50:47.692480+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:50:47.692480+0000","last_undegraded":"2024-09-22T09:50:47.692480+0000","last_fullsized":"2024-09-22T09:50:47.692480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'194","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430645+0000","last_change":"2024-09-22T08:42:13.407521+0000","last_active":"2024-09-22T09:50:32.430645+0000","last_peered":"2024-09-22T09:50:32.430645+0000","last_clean":"2024-09-22T09:50:32.430645+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:50:32.430645+0000","last_undegraded":"2024-09-22T09:50:32.430645+0000","last_fullsized":"2024-09-22T09:50:32.430645+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:16.981459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546972,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":559,"num_read_kb":19334,"num_write":880,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697276+0000","last_change":"2024-09-22T08:42:17.436489+0000","last_active":"2024-09-22T09:51:37.697276+0000","last_peered":"2024-09-22T09:51:37.697276+0000","last_clean":"2024-09-22T09:51:37.697276+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:51:37.697276+0000","last_undegraded":"2024-09-22T09:51:37.697276+0000","last_fullsized":"2024-09-22T09:51:37.697276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:43.716495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'282","reported_seq":1698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.992925+0000","last_change":"2024-09-22T08:42:19.458357+0000","last_active":"2024-09-22T09:53:57.992925+0000","last_peered":"2024-09-22T09:53:57.992925+0000","last_clean":"2024-09-22T09:53:57.992925+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:53:57.992925+0000","last_undegraded":"2024-09-22T09:53:57.992925+0000","last_fullsized":"2024-09-22T09:53:57.992925+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:59.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663363+0000","last_change":"2024-09-22T08:42:21.479092+0000","last_active":"2024-09-22T09:51:07.663363+0000","last_peered":"2024-09-22T09:51:07.663363+0000","last_clean":"2024-09-22T09:51:07.663363+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:51:07.663363+0000","last_undegraded":"2024-09-22T09:51:07.663363+0000","last_fullsized":"2024-09-22T09:51:07.663363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:10.715693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.853797+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:35.853797+0000","last_peered":"2024-09-22T09:52:35.853797+0000","last_clean":"2024-09-22T09:52:35.853797+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:35.853797+0000","last_undegraded":"2024-09-22T09:52:35.853797+0000","last_fullsized":"2024-09-22T09:52:35.853797+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:52.995365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.434014+0000","last_change":"2024-09-22T08:42:15.430662+0000","last_active":"2024-09-22T09:51:02.434014+0000","last_peered":"2024-09-22T09:51:02.434014+0000","last_clean":"2024-09-22T09:51:02.434014+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:51:02.434014+0000","last_undegraded":"2024-09-22T09:51:02.434014+0000","last_fullsized":"2024-09-22T09:51:02.434014+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:01.989354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680585+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T09:50:47.680585+0000","last_peered":"2024-09-22T09:50:47.680585+0000","last_clean":"2024-09-22T09:50:47.680585+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:50:47.680585+0000","last_undegraded":"2024-09-22T09:50:47.680585+0000","last_fullsized":"2024-09-22T09:50:47.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'220","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556862+0000","last_change":"2024-09-22T08:42:13.416911+0000","last_active":"2024-09-22T09:51:02.556862+0000","last_peered":"2024-09-22T09:51:02.556862+0000","last_clean":"2024-09-22T09:51:02.556862+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:51:02.556862+0000","last_undegraded":"2024-09-22T09:51:02.556862+0000","last_fullsized":"2024-09-22T09:51:02.556862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:31.168513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392059,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":567,"num_read_kb":44921,"num_write":1096,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663982+0000","last_change":"2024-09-22T08:42:17.437159+0000","last_active":"2024-09-22T09:51:12.663982+0000","last_peered":"2024-09-22T09:51:12.663982+0000","last_clean":"2024-09-22T09:51:12.663982+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:51:12.663982+0000","last_undegraded":"2024-09-22T09:51:12.663982+0000","last_fullsized":"2024-09-22T09:51:12.663982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.902285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'158","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.565701+0000","last_change":"2024-09-22T08:42:19.456365+0000","last_active":"2024-09-22T09:53:52.565701+0000","last_peered":"2024-09-22T09:53:52.565701+0000","last_clean":"2024-09-22T09:53:52.565701+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:53:52.565701+0000","last_undegraded":"2024-09-22T09:53:52.565701+0000","last_fullsized":"2024-09-22T09:53:52.565701+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:24.107895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681332+0000","last_change":"2024-09-22T08:42:21.479775+0000","last_active":"2024-09-22T09:51:42.681332+0000","last_peered":"2024-09-22T09:51:42.681332+0000","last_clean":"2024-09-22T09:51:42.681332+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:51:42.681332+0000","last_undegraded":"2024-09-22T09:51:42.681332+0000","last_fullsized":"2024-09-22T09:51:42.681332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:27.626455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'121","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.689264+0000","last_change":"2024-09-22T08:42:23.527151+0000","last_active":"2024-09-22T09:51:47.689264+0000","last_peered":"2024-09-22T09:51:47.689264+0000","last_clean":"2024-09-22T09:51:47.689264+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:51:47.689264+0000","last_undegraded":"2024-09-22T09:51:47.689264+0000","last_fullsized":"2024-09-22T09:51:47.689264+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:36.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.433983+0000","last_change":"2024-09-22T08:42:15.437662+0000","last_active":"2024-09-22T09:51:02.433983+0000","last_peered":"2024-09-22T09:51:02.433983+0000","last_clean":"2024-09-22T09:51:02.433983+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:51:02.433983+0000","last_undegraded":"2024-09-22T09:51:02.433983+0000","last_fullsized":"2024-09-22T09:51:02.433983+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:44.376313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'188","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:49.774854+0000","last_change":"2024-09-22T08:42:13.406072+0000","last_active":"2024-09-22T09:53:49.774854+0000","last_peered":"2024-09-22T09:53:49.774854+0000","last_clean":"2024-09-22T09:53:49.774854+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:53:49.774854+0000","last_undegraded":"2024-09-22T09:53:49.774854+0000","last_fullsized":"2024-09-22T09:53:49.774854+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:34:54.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":36411,"num_write":934,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.432285+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T09:50:47.432285+0000","last_peered":"2024-09-22T09:50:47.432285+0000","last_clean":"2024-09-22T09:50:47.432285+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:50:47.432285+0000","last_undegraded":"2024-09-22T09:50:47.432285+0000","last_fullsized":"2024-09-22T09:50:47.432285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662643+0000","last_change":"2024-09-22T08:42:17.436067+0000","last_active":"2024-09-22T09:51:02.662643+0000","last_peered":"2024-09-22T09:51:02.662643+0000","last_clean":"2024-09-22T09:51:02.662643+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:51:02.662643+0000","last_undegraded":"2024-09-22T09:51:02.662643+0000","last_fullsized":"2024-09-22T09:51:02.662643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:08.963170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'350","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.705822+0000","last_change":"2024-09-22T08:42:19.456910+0000","last_active":"2024-09-22T09:54:00.705822+0000","last_peered":"2024-09-22T09:54:00.705822+0000","last_clean":"2024-09-22T09:54:00.705822+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:00.705822+0000","last_undegraded":"2024-09-22T09:54:00.705822+0000","last_fullsized":"2024-09-22T09:54:00.705822+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:35.309371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24760,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1176,"num_read_kb":1299,"num_write":1762,"num_write_kb":1579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557458+0000","last_change":"2024-09-22T08:42:21.481570+0000","last_active":"2024-09-22T09:51:07.557458+0000","last_peered":"2024-09-22T09:51:07.557458+0000","last_clean":"2024-09-22T09:51:07.557458+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:51:07.557458+0000","last_undegraded":"2024-09-22T09:51:07.557458+0000","last_fullsized":"2024-09-22T09:51:07.557458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:52.544367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.135926+0000","last_change":"2024-09-22T08:42:23.578322+0000","last_active":"2024-09-22T09:52:33.135926+0000","last_peered":"2024-09-22T09:52:33.135926+0000","last_clean":"2024-09-22T09:52:33.135926+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:52:33.135926+0000","last_undegraded":"2024-09-22T09:52:33.135926+0000","last_fullsized":"2024-09-22T09:52:33.135926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:06.092146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662627+0000","last_change":"2024-09-22T08:42:15.425980+0000","last_active":"2024-09-22T09:51:02.662627+0000","last_peered":"2024-09-22T09:51:02.662627+0000","last_clean":"2024-09-22T09:51:02.662627+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:51:02.662627+0000","last_undegraded":"2024-09-22T09:51:02.662627+0000","last_fullsized":"2024-09-22T09:51:02.662627+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:08.622112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'219","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:02.447621+0000","last_change":"2024-09-22T08:42:13.422109+0000","last_active":"2024-09-22T09:53:02.447621+0000","last_peered":"2024-09-22T09:53:02.447621+0000","last_clean":"2024-09-22T09:53:02.447621+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:53:02.447621+0000","last_undegraded":"2024-09-22T09:53:02.447621+0000","last_fullsized":"2024-09-22T09:53:02.447621+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:30.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236610,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1845,"num_write":1045,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524935+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T09:51:02.524935+0000","last_peered":"2024-09-22T09:51:02.524935+0000","last_clean":"2024-09-22T09:51:02.524935+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:51:02.524935+0000","last_undegraded":"2024-09-22T09:51:02.524935+0000","last_fullsized":"2024-09-22T09:51:02.524935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675254+0000","last_change":"2024-09-22T08:42:17.436017+0000","last_active":"2024-09-22T09:51:02.675254+0000","last_peered":"2024-09-22T09:51:02.675254+0000","last_clean":"2024-09-22T09:51:02.675254+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:51:02.675254+0000","last_undegraded":"2024-09-22T09:51:02.675254+0000","last_fullsized":"2024-09-22T09:51:02.675254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:52.183670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'215","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.922563+0000","last_change":"2024-09-22T08:42:19.456840+0000","last_active":"2024-09-22T09:52:52.922563+0000","last_peered":"2024-09-22T09:52:52.922563+0000","last_clean":"2024-09-22T09:52:52.922563+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:52:52.922563+0000","last_undegraded":"2024-09-22T09:52:52.922563+0000","last_fullsized":"2024-09-22T09:52:52.922563+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:19.484900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'761","reported_seq":4641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.789752+0000","last_change":"2024-09-22T08:42:21.481370+0000","last_active":"2024-09-22T09:54:03.789752+0000","last_peered":"2024-09-22T09:54:03.789752+0000","last_clean":"2024-09-22T09:54:03.789752+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:03.789752+0000","last_undegraded":"2024-09-22T09:54:03.789752+0000","last_fullsized":"2024-09-22T09:54:03.789752+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":701,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:26.631766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.133370+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:52:33.133370+0000","last_peered":"2024-09-22T09:52:33.133370+0000","last_clean":"2024-09-22T09:52:33.133370+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:52:33.133370+0000","last_undegraded":"2024-09-22T09:52:33.133370+0000","last_fullsized":"2024-09-22T09:52:33.133370+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.457091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658056+0000","last_change":"2024-09-22T08:42:15.435920+0000","last_active":"2024-09-22T09:50:27.658056+0000","last_peered":"2024-09-22T09:50:27.658056+0000","last_clean":"2024-09-22T09:50:27.658056+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:50:27.658056+0000","last_undegraded":"2024-09-22T09:50:27.658056+0000","last_fullsized":"2024-09-22T09:50:27.658056+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:21.159641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666115+0000","last_change":"2024-09-22T08:42:13.414597+0000","last_active":"2024-09-22T09:51:32.666115+0000","last_peered":"2024-09-22T09:51:32.666115+0000","last_clean":"2024-09-22T09:51:32.666115+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:51:32.666115+0000","last_undegraded":"2024-09-22T09:51:32.666115+0000","last_fullsized":"2024-09-22T09:51:32.666115+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:34.931040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.436368+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T09:51:22.436368+0000","last_peered":"2024-09-22T09:51:22.436368+0000","last_clean":"2024-09-22T09:51:22.436368+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:51:22.436368+0000","last_undegraded":"2024-09-22T09:51:22.436368+0000","last_fullsized":"2024-09-22T09:51:22.436368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556800+0000","last_change":"2024-09-22T08:42:17.440772+0000","last_active":"2024-09-22T09:51:02.556800+0000","last_peered":"2024-09-22T09:51:02.556800+0000","last_clean":"2024-09-22T09:51:02.556800+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:51:02.556800+0000","last_undegraded":"2024-09-22T09:51:02.556800+0000","last_fullsized":"2024-09-22T09:51:02.556800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:54.715553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'134","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.892504+0000","last_change":"2024-09-22T08:42:19.457603+0000","last_active":"2024-09-22T09:52:52.892504+0000","last_peered":"2024-09-22T09:52:52.892504+0000","last_clean":"2024-09-22T09:52:52.892504+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:52:52.892504+0000","last_undegraded":"2024-09-22T09:52:52.892504+0000","last_fullsized":"2024-09-22T09:52:52.892504+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:47.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'752","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782873+0000","last_change":"2024-09-22T08:42:21.478082+0000","last_active":"2024-09-22T09:54:03.782873+0000","last_peered":"2024-09-22T09:54:03.782873+0000","last_clean":"2024-09-22T09:54:03.782873+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:03.782873+0000","last_undegraded":"2024-09-22T09:54:03.782873+0000","last_fullsized":"2024-09-22T09:54:03.782873+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:57.519253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'148","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.332706+0000","last_change":"2024-09-22T08:42:23.525171+0000","last_active":"2024-09-22T09:51:11.332706+0000","last_peered":"2024-09-22T09:51:11.332706+0000","last_clean":"2024-09-22T09:51:11.332706+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:51:11.332706+0000","last_undegraded":"2024-09-22T09:51:11.332706+0000","last_fullsized":"2024-09-22T09:51:11.332706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:04.949992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556810+0000","last_change":"2024-09-22T08:42:15.426476+0000","last_active":"2024-09-22T09:51:02.556810+0000","last_peered":"2024-09-22T09:51:02.556810+0000","last_clean":"2024-09-22T09:51:02.556810+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:51:02.556810+0000","last_undegraded":"2024-09-22T09:51:02.556810+0000","last_fullsized":"2024-09-22T09:51:02.556810+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:40.091111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'187","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667284+0000","last_change":"2024-09-22T08:42:13.412711+0000","last_active":"2024-09-22T09:51:37.667284+0000","last_peered":"2024-09-22T09:51:37.667284+0000","last_clean":"2024-09-22T09:51:37.667284+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:51:37.667284+0000","last_undegraded":"2024-09-22T09:51:37.667284+0000","last_fullsized":"2024-09-22T09:51:37.667284+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266062,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":406,"num_write":847,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.678442+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T09:51:22.678442+0000","last_peered":"2024-09-22T09:51:22.678442+0000","last_clean":"2024-09-22T09:51:22.678442+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:51:22.678442+0000","last_undegraded":"2024-09-22T09:51:22.678442+0000","last_fullsized":"2024-09-22T09:51:22.678442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658036+0000","last_change":"2024-09-22T08:42:17.440887+0000","last_active":"2024-09-22T09:50:27.658036+0000","last_peered":"2024-09-22T09:50:27.658036+0000","last_clean":"2024-09-22T09:50:27.658036+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:50:27.658036+0000","last_undegraded":"2024-09-22T09:50:27.658036+0000","last_fullsized":"2024-09-22T09:50:27.658036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:14.170224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'345","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.702399+0000","last_change":"2024-09-22T08:42:19.455440+0000","last_active":"2024-09-22T09:54:00.702399+0000","last_peered":"2024-09-22T09:54:00.702399+0000","last_clean":"2024-09-22T09:54:00.702399+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:00.702399+0000","last_undegraded":"2024-09-22T09:54:00.702399+0000","last_fullsized":"2024-09-22T09:54:00.702399+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:31.127669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34966,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":508,"num_read_kb":712,"num_write":272,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662903+0000","last_change":"2024-09-22T08:42:21.481354+0000","last_active":"2024-09-22T09:51:07.662903+0000","last_peered":"2024-09-22T09:51:07.662903+0000","last_clean":"2024-09-22T09:51:07.662903+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:51:07.662903+0000","last_undegraded":"2024-09-22T09:51:07.662903+0000","last_fullsized":"2024-09-22T09:51:07.662903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:55.654023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'92","reported_seq":590,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.904200+0000","last_change":"2024-09-22T08:42:23.528079+0000","last_active":"2024-09-22T09:50:17.904200+0000","last_peered":"2024-09-22T09:50:17.904200+0000","last_clean":"2024-09-22T09:50:17.904200+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:50:17.904200+0000","last_undegraded":"2024-09-22T09:50:17.904200+0000","last_fullsized":"2024-09-22T09:50:17.904200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:28.365018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547536+0000","last_change":"2024-09-22T08:42:15.426467+0000","last_active":"2024-09-22T09:49:57.547536+0000","last_peered":"2024-09-22T09:49:57.547536+0000","last_clean":"2024-09-22T09:49:57.547536+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:49:57.547536+0000","last_undegraded":"2024-09-22T09:49:57.547536+0000","last_fullsized":"2024-09-22T09:49:57.547536+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:10.885001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'191","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.549844+0000","last_change":"2024-09-22T08:42:13.418044+0000","last_active":"2024-09-22T09:50:12.549844+0000","last_peered":"2024-09-22T09:50:12.549844+0000","last_clean":"2024-09-22T09:50:12.549844+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:50:12.549844+0000","last_undegraded":"2024-09-22T09:50:12.549844+0000","last_fullsized":"2024-09-22T09:50:12.549844+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:06.417643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21018941,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":56883,"num_write":849,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426786+0000","last_change":"2024-09-22T08:42:17.434551+0000","last_active":"2024-09-22T09:49:57.426786+0000","last_peered":"2024-09-22T09:49:57.426786+0000","last_clean":"2024-09-22T09:49:57.426786+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:49:57.426786+0000","last_undegraded":"2024-09-22T09:49:57.426786+0000","last_fullsized":"2024-09-22T09:49:57.426786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:49.306717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'167","reported_seq":749,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.927346+0000","last_change":"2024-09-22T08:42:19.459166+0000","last_active":"2024-09-22T09:52:52.927346+0000","last_peered":"2024-09-22T09:52:52.927346+0000","last_clean":"2024-09-22T09:52:52.927346+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:52:52.927346+0000","last_undegraded":"2024-09-22T09:52:52.927346+0000","last_fullsized":"2024-09-22T09:52:52.927346+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:04.933821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":130,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654407+0000","last_change":"2024-09-22T08:42:21.480559+0000","last_active":"2024-09-22T09:50:02.654407+0000","last_peered":"2024-09-22T09:50:02.654407+0000","last_clean":"2024-09-22T09:50:02.654407+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:50:02.654407+0000","last_undegraded":"2024-09-22T09:50:02.654407+0000","last_fullsized":"2024-09-22T09:50:02.654407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:57.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:00.060711+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:51:00.060711+0000","last_peered":"2024-09-22T09:51:00.060711+0000","last_clean":"2024-09-22T09:51:00.060711+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:51:00.060711+0000","last_undegraded":"2024-09-22T09:51:00.060711+0000","last_fullsized":"2024-09-22T09:51:00.060711+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:00.026997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426814+0000","last_change":"2024-09-22T08:42:15.435296+0000","last_active":"2024-09-22T09:49:57.426814+0000","last_peered":"2024-09-22T09:49:57.426814+0000","last_clean":"2024-09-22T09:49:57.426814+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:49:57.426814+0000","last_undegraded":"2024-09-22T09:49:57.426814+0000","last_fullsized":"2024-09-22T09:49:57.426814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:37.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514089+0000","last_change":"2024-09-22T08:42:13.414954+0000","last_active":"2024-09-22T09:49:52.514089+0000","last_peered":"2024-09-22T09:49:52.514089+0000","last_clean":"2024-09-22T09:49:52.514089+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:49:52.514089+0000","last_undegraded":"2024-09-22T09:49:52.514089+0000","last_fullsized":"2024-09-22T09:49:52.514089+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:55.273095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16394947,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":586,"num_read_kb":50629,"num_write":1049,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653853+0000","last_change":"2024-09-22T08:42:17.440629+0000","last_active":"2024-09-22T09:49:57.653853+0000","last_peered":"2024-09-22T09:49:57.653853+0000","last_clean":"2024-09-22T09:49:57.653853+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:49:57.653853+0000","last_undegraded":"2024-09-22T09:49:57.653853+0000","last_fullsized":"2024-09-22T09:49:57.653853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:13.561126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'53","reported_seq":565,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.547272+0000","last_change":"2024-09-22T08:42:19.456534+0000","last_active":"2024-09-22T09:52:52.547272+0000","last_peered":"2024-09-22T09:52:52.547272+0000","last_clean":"2024-09-22T09:52:52.547272+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:52:52.547272+0000","last_undegraded":"2024-09-22T09:52:52.547272+0000","last_fullsized":"2024-09-22T09:52:52.547272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:45.983322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515570+0000","last_change":"2024-09-22T08:42:21.476849+0000","last_active":"2024-09-22T09:50:02.515570+0000","last_peered":"2024-09-22T09:50:02.515570+0000","last_clean":"2024-09-22T09:50:02.515570+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:50:02.515570+0000","last_undegraded":"2024-09-22T09:50:02.515570+0000","last_fullsized":"2024-09-22T09:50:02.515570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:43.656268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.634796+0000","last_change":"2024-09-22T08:42:23.526388+0000","last_active":"2024-09-22T09:52:35.634796+0000","last_peered":"2024-09-22T09:52:35.634796+0000","last_clean":"2024-09-22T09:52:35.634796+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:52:35.634796+0000","last_undegraded":"2024-09-22T09:52:35.634796+0000","last_fullsized":"2024-09-22T09:52:35.634796+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:29.029640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.665914+0000","last_change":"2024-09-22T08:42:15.438483+0000","last_active":"2024-09-22T09:52:36.665914+0000","last_peered":"2024-09-22T09:52:36.665914+0000","last_clean":"2024-09-22T09:52:36.665914+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:52:36.665914+0000","last_undegraded":"2024-09-22T09:52:36.665914+0000","last_fullsized":"2024-09-22T09:52:36.665914+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.521372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'203","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673275+0000","last_change":"2024-09-22T08:42:13.413578+0000","last_active":"2024-09-22T09:49:57.673275+0000","last_peered":"2024-09-22T09:49:57.673275+0000","last_clean":"2024-09-22T09:49:57.673275+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:49:57.673275+0000","last_undegraded":"2024-09-22T09:49:57.673275+0000","last_fullsized":"2024-09-22T09:49:57.673275+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:00.034449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267605,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":27137,"num_write":991,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514721+0000","last_change":"2024-09-22T08:42:17.430472+0000","last_active":"2024-09-22T09:49:57.514721+0000","last_peered":"2024-09-22T09:49:57.514721+0000","last_clean":"2024-09-22T09:49:57.514721+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:49:57.514721+0000","last_undegraded":"2024-09-22T09:49:57.514721+0000","last_fullsized":"2024-09-22T09:49:57.514721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:35.687053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'193","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.415565+0000","last_change":"2024-09-22T08:42:19.459846+0000","last_active":"2024-09-22T09:53:59.415565+0000","last_peered":"2024-09-22T09:53:59.415565+0000","last_clean":"2024-09-22T09:53:59.415565+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:53:59.415565+0000","last_undegraded":"2024-09-22T09:53:59.415565+0000","last_fullsized":"2024-09-22T09:53:59.415565+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:37.691592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":310,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.667537+0000","last_change":"2024-09-22T08:42:21.479495+0000","last_active":"2024-09-22T09:50:02.667537+0000","last_peered":"2024-09-22T09:50:02.667537+0000","last_clean":"2024-09-22T09:50:02.667537+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:50:02.667537+0000","last_undegraded":"2024-09-22T09:50:02.667537+0000","last_fullsized":"2024-09-22T09:50:02.667537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:56.016803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'184","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.144194+0000","last_change":"2024-09-22T08:42:23.527658+0000","last_active":"2024-09-22T09:50:22.144194+0000","last_peered":"2024-09-22T09:50:22.144194+0000","last_clean":"2024-09-22T09:50:22.144194+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:50:22.144194+0000","last_undegraded":"2024-09-22T09:50:22.144194+0000","last_fullsized":"2024-09-22T09:50:22.144194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:34.867859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'173","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653721+0000","last_change":"2024-09-22T08:42:15.440994+0000","last_active":"2024-09-22T09:49:57.653721+0000","last_peered":"2024-09-22T09:49:57.653721+0000","last_clean":"2024-09-22T09:49:57.653721+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:49:57.653721+0000","last_undegraded":"2024-09-22T09:49:57.653721+0000","last_fullsized":"2024-09-22T09:49:57.653721+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:06.924407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'200","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:56.590917+0000","last_change":"2024-09-22T08:42:13.421739+0000","last_active":"2024-09-22T09:50:56.590917+0000","last_peered":"2024-09-22T09:50:56.590917+0000","last_clean":"2024-09-22T09:50:56.590917+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:50:56.590917+0000","last_undegraded":"2024-09-22T09:50:56.590917+0000","last_fullsized":"2024-09-22T09:50:56.590917+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:25:10.061779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10786420,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":41854,"num_write":1016,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666642+0000","last_change":"2024-09-22T08:42:17.428665+0000","last_active":"2024-09-22T09:49:57.666642+0000","last_peered":"2024-09-22T09:49:57.666642+0000","last_clean":"2024-09-22T09:49:57.666642+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:49:57.666642+0000","last_undegraded":"2024-09-22T09:49:57.666642+0000","last_fullsized":"2024-09-22T09:49:57.666642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:34.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'144","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.714713+0000","last_change":"2024-09-22T08:42:19.453111+0000","last_active":"2024-09-22T09:52:52.714713+0000","last_peered":"2024-09-22T09:52:52.714713+0000","last_clean":"2024-09-22T09:52:52.714713+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:52:52.714713+0000","last_undegraded":"2024-09-22T09:52:52.714713+0000","last_fullsized":"2024-09-22T09:52:52.714713+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:24.508041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":204,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654861+0000","last_change":"2024-09-22T08:42:21.475223+0000","last_active":"2024-09-22T09:50:02.654861+0000","last_peered":"2024-09-22T09:50:02.654861+0000","last_clean":"2024-09-22T09:50:02.654861+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:50:02.654861+0000","last_undegraded":"2024-09-22T09:50:02.654861+0000","last_fullsized":"2024-09-22T09:50:02.654861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:09.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675311+0000","last_change":"2024-09-22T08:42:15.431489+0000","last_active":"2024-09-22T09:51:02.675311+0000","last_peered":"2024-09-22T09:51:02.675311+0000","last_clean":"2024-09-22T09:51:02.675311+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:51:02.675311+0000","last_undegraded":"2024-09-22T09:51:02.675311+0000","last_fullsized":"2024-09-22T09:51:02.675311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:58.608179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'198","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:26.664923+0000","last_change":"2024-09-22T08:42:13.403630+0000","last_active":"2024-09-22T09:50:26.664923+0000","last_peered":"2024-09-22T09:50:26.664923+0000","last_clean":"2024-09-22T09:50:26.664923+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:50:26.664923+0000","last_undegraded":"2024-09-22T09:50:26.664923+0000","last_fullsized":"2024-09-22T09:50:26.664923+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:49.925047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16345112,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":68522,"num_write":909,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658194+0000","last_change":"2024-09-22T08:42:17.438090+0000","last_active":"2024-09-22T09:50:27.658194+0000","last_peered":"2024-09-22T09:50:27.658194+0000","last_clean":"2024-09-22T09:50:27.658194+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:50:27.658194+0000","last_undegraded":"2024-09-22T09:50:27.658194+0000","last_fullsized":"2024-09-22T09:50:27.658194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:49.781681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.698391+0000","last_change":"2024-09-22T08:42:19.455805+0000","last_active":"2024-09-22T09:54:00.698391+0000","last_peered":"2024-09-22T09:54:00.698391+0000","last_clean":"2024-09-22T09:54:00.698391+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:00.698391+0000","last_undegraded":"2024-09-22T09:54:00.698391+0000","last_fullsized":"2024-09-22T09:54:00.698391+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:46.845015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30397,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":501,"num_write":220,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.672389+0000","last_change":"2024-09-22T08:42:21.482536+0000","last_active":"2024-09-22T09:49:52.672389+0000","last_peered":"2024-09-22T09:49:52.672389+0000","last_clean":"2024-09-22T09:49:52.672389+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:49:52.672389+0000","last_undegraded":"2024-09-22T09:49:52.672389+0000","last_fullsized":"2024-09-22T09:49:52.672389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:16.490768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.317977+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:50:15.317977+0000","last_peered":"2024-09-22T09:50:15.317977+0000","last_clean":"2024-09-22T09:50:15.317977+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:50:15.317977+0000","last_undegraded":"2024-09-22T09:50:15.317977+0000","last_fullsized":"2024-09-22T09:50:15.317977+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:49.491628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658171+0000","last_change":"2024-09-22T08:42:15.427151+0000","last_active":"2024-09-22T09:50:27.658171+0000","last_peered":"2024-09-22T09:50:27.658171+0000","last_clean":"2024-09-22T09:50:27.658171+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:50:27.658171+0000","last_undegraded":"2024-09-22T09:50:27.658171+0000","last_fullsized":"2024-09-22T09:50:27.658171+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:08.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'216","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428487+0000","last_change":"2024-09-22T08:42:13.408621+0000","last_active":"2024-09-22T09:50:12.428487+0000","last_peered":"2024-09-22T09:50:12.428487+0000","last_clean":"2024-09-22T09:50:12.428487+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:50:12.428487+0000","last_undegraded":"2024-09-22T09:50:12.428487+0000","last_fullsized":"2024-09-22T09:50:12.428487+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:38.944084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2123947,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":678,"num_read_kb":5102,"num_write":1152,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675298+0000","last_change":"2024-09-22T08:42:17.432901+0000","last_active":"2024-09-22T09:51:02.675298+0000","last_peered":"2024-09-22T09:51:02.675298+0000","last_clean":"2024-09-22T09:51:02.675298+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:51:02.675298+0000","last_undegraded":"2024-09-22T09:51:02.675298+0000","last_fullsized":"2024-09-22T09:51:02.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:54.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'202","reported_seq":797,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.798953+0000","last_change":"2024-09-22T08:42:19.454425+0000","last_active":"2024-09-22T09:52:52.798953+0000","last_peered":"2024-09-22T09:52:52.798953+0000","last_clean":"2024-09-22T09:52:52.798953+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:52:52.798953+0000","last_undegraded":"2024-09-22T09:52:52.798953+0000","last_fullsized":"2024-09-22T09:52:52.798953+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:32.598763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7943,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":326,"num_write":180,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426248+0000","last_change":"2024-09-22T08:42:21.476913+0000","last_active":"2024-09-22T09:49:52.426248+0000","last_peered":"2024-09-22T09:49:52.426248+0000","last_clean":"2024-09-22T09:49:52.426248+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:49:52.426248+0000","last_undegraded":"2024-09-22T09:49:52.426248+0000","last_fullsized":"2024-09-22T09:49:52.426248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:43.637608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'167","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.287498+0000","last_change":"2024-09-22T08:42:23.524343+0000","last_active":"2024-09-22T09:52:35.287498+0000","last_peered":"2024-09-22T09:52:35.287498+0000","last_clean":"2024-09-22T09:52:35.287498+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:52:35.287498+0000","last_undegraded":"2024-09-22T09:52:35.287498+0000","last_fullsized":"2024-09-22T09:52:35.287498+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:59.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652648+0000","last_change":"2024-09-22T08:42:15.441307+0000","last_active":"2024-09-22T09:49:47.652648+0000","last_peered":"2024-09-22T09:49:47.652648+0000","last_clean":"2024-09-22T09:49:47.652648+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:49:47.652648+0000","last_undegraded":"2024-09-22T09:49:47.652648+0000","last_fullsized":"2024-09-22T09:49:47.652648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:01.398679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'189","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545846+0000","last_change":"2024-09-22T08:42:13.403394+0000","last_active":"2024-09-22T09:49:47.545846+0000","last_peered":"2024-09-22T09:49:47.545846+0000","last_clean":"2024-09-22T09:49:47.545846+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:49:47.545846+0000","last_undegraded":"2024-09-22T09:49:47.545846+0000","last_fullsized":"2024-09-22T09:49:47.545846+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:07.863561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29587,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1207,"num_read_kb":5814,"num_write":978,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545954+0000","last_change":"2024-09-22T08:42:17.435464+0000","last_active":"2024-09-22T09:49:47.545954+0000","last_peered":"2024-09-22T09:49:47.545954+0000","last_clean":"2024-09-22T09:49:47.545954+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:49:47.545954+0000","last_undegraded":"2024-09-22T09:49:47.545954+0000","last_fullsized":"2024-09-22T09:49:47.545954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:38.411752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'156","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.560516+0000","last_change":"2024-09-22T08:42:19.458421+0000","last_active":"2024-09-22T09:53:12.560516+0000","last_peered":"2024-09-22T09:53:12.560516+0000","last_clean":"2024-09-22T09:53:12.560516+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:53:12.560516+0000","last_undegraded":"2024-09-22T09:53:12.560516+0000","last_fullsized":"2024-09-22T09:53:12.560516+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:17.997133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12957,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":277,"num_write":116,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431784+0000","last_change":"2024-09-22T08:42:21.482356+0000","last_active":"2024-09-22T09:50:42.431784+0000","last_peered":"2024-09-22T09:50:42.431784+0000","last_clean":"2024-09-22T09:50:42.431784+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:50:42.431784+0000","last_undegraded":"2024-09-22T09:50:42.431784+0000","last_fullsized":"2024-09-22T09:50:42.431784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:32.679904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'112","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.729613+0000","last_change":"2024-09-22T08:42:23.524273+0000","last_active":"2024-09-22T09:54:00.729613+0000","last_peered":"2024-09-22T09:54:00.729613+0000","last_clean":"2024-09-22T09:54:00.729613+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:00.729613+0000","last_undegraded":"2024-09-22T09:54:00.729613+0000","last_fullsized":"2024-09-22T09:54:00.729613+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:17.604133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686473+0000","last_change":"2024-09-22T08:42:15.435809+0000","last_active":"2024-09-22T09:49:47.686473+0000","last_peered":"2024-09-22T09:49:47.686473+0000","last_clean":"2024-09-22T09:49:47.686473+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:49:47.686473+0000","last_undegraded":"2024-09-22T09:49:47.686473+0000","last_fullsized":"2024-09-22T09:49:47.686473+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:40.478687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'235","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:19.479556+0000","last_change":"2024-09-22T08:42:13.413803+0000","last_active":"2024-09-22T09:51:19.479556+0000","last_peered":"2024-09-22T09:51:19.479556+0000","last_clean":"2024-09-22T09:51:19.479556+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:51:19.479556+0000","last_undegraded":"2024-09-22T09:51:19.479556+0000","last_fullsized":"2024-09-22T09:51:19.479556+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:20.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290233,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":123234,"num_write":1013,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425590+0000","last_change":"2024-09-22T08:42:17.435752+0000","last_active":"2024-09-22T09:49:47.425590+0000","last_peered":"2024-09-22T09:49:47.425590+0000","last_clean":"2024-09-22T09:49:47.425590+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:49:47.425590+0000","last_undegraded":"2024-09-22T09:49:47.425590+0000","last_fullsized":"2024-09-22T09:49:47.425590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:10.922721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'121","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.915476+0000","last_change":"2024-09-22T08:42:19.453093+0000","last_active":"2024-09-22T09:52:52.915476+0000","last_peered":"2024-09-22T09:52:52.915476+0000","last_clean":"2024-09-22T09:52:52.915476+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:52:52.915476+0000","last_undegraded":"2024-09-22T09:52:52.915476+0000","last_fullsized":"2024-09-22T09:52:52.915476+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:18.283880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'756","reported_seq":4728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790790+0000","last_change":"2024-09-22T08:42:21.480171+0000","last_active":"2024-09-22T09:54:03.790790+0000","last_peered":"2024-09-22T09:54:03.790790+0000","last_clean":"2024-09-22T09:54:03.790790+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:03.790790+0000","last_undegraded":"2024-09-22T09:54:03.790790+0000","last_fullsized":"2024-09-22T09:54:03.790790+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:05.223141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.660200+0000","last_change":"2024-09-22T08:42:23.528243+0000","last_active":"2024-09-22T09:52:36.660200+0000","last_peered":"2024-09-22T09:52:36.660200+0000","last_clean":"2024-09-22T09:52:36.660200+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:52:36.660200+0000","last_undegraded":"2024-09-22T09:52:36.660200+0000","last_fullsized":"2024-09-22T09:52:36.660200+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:46.020648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545909+0000","last_change":"2024-09-22T08:42:46.084787+0000","last_active":"2024-09-22T09:49:47.545909+0000","last_peered":"2024-09-22T09:49:47.545909+0000","last_clean":"2024-09-22T09:49:47.545909+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:49:47.545909+0000","last_undegraded":"2024-09-22T09:49:47.545909+0000","last_fullsized":"2024-09-22T09:49:47.545909+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:31.609602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'288","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.260177+0000","last_change":"2024-09-22T08:42:46.086633+0000","last_active":"2024-09-22T09:51:11.260177+0000","last_peered":"2024-09-22T09:51:11.260177+0000","last_clean":"2024-09-22T09:51:11.260177+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:51:11.260177+0000","last_undegraded":"2024-09-22T09:51:11.260177+0000","last_fullsized":"2024-09-22T09:51:11.260177+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:16.757938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324323,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1299,"num_read_kb":50200,"num_write":1262,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.246095+0000","last_change":"2024-09-22T08:42:17.430502+0000","last_active":"2024-09-22T09:54:00.246095+0000","last_peered":"2024-09-22T09:54:00.246095+0000","last_clean":"2024-09-22T09:54:00.246095+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:00.246095+0000","last_undegraded":"2024-09-22T09:54:00.246095+0000","last_fullsized":"2024-09-22T09:54:00.246095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:02.208302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'210","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.941440+0000","last_change":"2024-09-22T08:42:19.455535+0000","last_active":"2024-09-22T09:52:52.941440+0000","last_peered":"2024-09-22T09:52:52.941440+0000","last_clean":"2024-09-22T09:52:52.941440+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:52:52.941440+0000","last_undegraded":"2024-09-22T09:52:52.941440+0000","last_fullsized":"2024-09-22T09:52:52.941440+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:46.902494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7279,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":309,"num_write":158,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654816+0000","last_change":"2024-09-22T08:42:21.476713+0000","last_active":"2024-09-22T09:50:02.654816+0000","last_peered":"2024-09-22T09:50:02.654816+0000","last_clean":"2024-09-22T09:50:02.654816+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:50:02.654816+0000","last_undegraded":"2024-09-22T09:50:02.654816+0000","last_fullsized":"2024-09-22T09:50:02.654816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:07.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'140","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539387+0000","last_change":"2024-09-22T08:42:23.517176+0000","last_active":"2024-09-22T09:52:32.539387+0000","last_peered":"2024-09-22T09:52:32.539387+0000","last_clean":"2024-09-22T09:52:32.539387+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:52:32.539387+0000","last_undegraded":"2024-09-22T09:52:32.539387+0000","last_fullsized":"2024-09-22T09:52:32.539387+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":763,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.383248+0000","last_change":"2024-09-22T08:42:15.431566+0000","last_active":"2024-09-22T09:51:28.383248+0000","last_peered":"2024-09-22T09:51:28.383248+0000","last_clean":"2024-09-22T09:51:28.383248+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:51:28.383248+0000","last_undegraded":"2024-09-22T09:51:28.383248+0000","last_fullsized":"2024-09-22T09:51:28.383248+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:38.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'210","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:59.997385+0000","last_change":"2024-09-22T08:42:46.088505+0000","last_active":"2024-09-22T09:50:59.997385+0000","last_peered":"2024-09-22T09:50:59.997385+0000","last_clean":"2024-09-22T09:50:59.997385+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:50:59.997385+0000","last_undegraded":"2024-09-22T09:50:59.997385+0000","last_fullsized":"2024-09-22T09:50:59.997385+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:58.102532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10731717,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":26654,"num_write":907,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671704+0000","last_change":"2024-09-22T08:42:17.434837+0000","last_active":"2024-09-22T09:49:47.671704+0000","last_peered":"2024-09-22T09:49:47.671704+0000","last_clean":"2024-09-22T09:49:47.671704+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:49:47.671704+0000","last_undegraded":"2024-09-22T09:49:47.671704+0000","last_fullsized":"2024-09-22T09:49:47.671704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:44.721168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'140","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.500608+0000","last_change":"2024-09-22T08:42:19.455628+0000","last_active":"2024-09-22T09:52:52.500608+0000","last_peered":"2024-09-22T09:52:52.500608+0000","last_clean":"2024-09-22T09:52:52.500608+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:52:52.500608+0000","last_undegraded":"2024-09-22T09:52:52.500608+0000","last_fullsized":"2024-09-22T09:52:52.500608+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:09.361619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12014,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":188,"num_read_kb":248,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668079+0000","last_change":"2024-09-22T08:42:21.476902+0000","last_active":"2024-09-22T09:50:07.668079+0000","last_peered":"2024-09-22T09:50:07.668079+0000","last_clean":"2024-09-22T09:50:07.668079+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:50:07.668079+0000","last_undegraded":"2024-09-22T09:50:07.668079+0000","last_fullsized":"2024-09-22T09:50:07.668079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:29.159677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.376679+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:51:35.376679+0000","last_peered":"2024-09-22T09:51:35.376679+0000","last_clean":"2024-09-22T09:51:35.376679+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:51:35.376679+0000","last_undegraded":"2024-09-22T09:51:35.376679+0000","last_fullsized":"2024-09-22T09:51:35.376679+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.855073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655142+0000","last_change":"2024-09-22T08:42:15.439064+0000","last_active":"2024-09-22T09:50:07.655142+0000","last_peered":"2024-09-22T09:50:07.655142+0000","last_clean":"2024-09-22T09:50:07.655142+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:50:07.655142+0000","last_undegraded":"2024-09-22T09:50:07.655142+0000","last_fullsized":"2024-09-22T09:50:07.655142+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:36.078212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'272","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657511+0000","last_change":"2024-09-22T08:42:13.405170+0000","last_active":"2024-09-22T09:50:22.657511+0000","last_peered":"2024-09-22T09:50:22.657511+0000","last_clean":"2024-09-22T09:50:22.657511+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:50:22.657511+0000","last_undegraded":"2024-09-22T09:50:22.657511+0000","last_fullsized":"2024-09-22T09:50:22.657511+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:38.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5302814,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":35485,"num_write":1183,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547433+0000","last_change":"2024-09-22T08:42:17.428752+0000","last_active":"2024-09-22T09:49:57.547433+0000","last_peered":"2024-09-22T09:49:57.547433+0000","last_clean":"2024-09-22T09:49:57.547433+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:49:57.547433+0000","last_undegraded":"2024-09-22T09:49:57.547433+0000","last_fullsized":"2024-09-22T09:49:57.547433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:24.944481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'111","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.679823+0000","last_change":"2024-09-22T08:42:19.453726+0000","last_active":"2024-09-22T09:52:52.679823+0000","last_peered":"2024-09-22T09:52:52.679823+0000","last_clean":"2024-09-22T09:52:52.679823+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:52:52.679823+0000","last_undegraded":"2024-09-22T09:52:52.679823+0000","last_fullsized":"2024-09-22T09:52:52.679823+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:05.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16619,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":237,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.546807+0000","last_change":"2024-09-22T08:42:21.478595+0000","last_active":"2024-09-22T09:49:52.546807+0000","last_peered":"2024-09-22T09:49:52.546807+0000","last_clean":"2024-09-22T09:49:52.546807+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:49:52.546807+0000","last_undegraded":"2024-09-22T09:49:52.546807+0000","last_fullsized":"2024-09-22T09:49:52.546807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:19.682078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'159","reported_seq":1627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.954159+0000","last_change":"2024-09-22T08:42:23.526111+0000","last_active":"2024-09-22T09:52:32.954159+0000","last_peered":"2024-09-22T09:52:32.954159+0000","last_clean":"2024-09-22T09:52:32.954159+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:52:32.954159+0000","last_undegraded":"2024-09-22T09:52:32.954159+0000","last_fullsized":"2024-09-22T09:52:32.954159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:23.624323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5257,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547451+0000","last_change":"2024-09-22T08:42:15.428024+0000","last_active":"2024-09-22T09:49:57.547451+0000","last_peered":"2024-09-22T09:49:57.547451+0000","last_clean":"2024-09-22T09:49:57.547451+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:49:57.547451+0000","last_undegraded":"2024-09-22T09:49:57.547451+0000","last_fullsized":"2024-09-22T09:49:57.547451+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:35.144593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'232","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662743+0000","last_change":"2024-09-22T08:42:13.422788+0000","last_active":"2024-09-22T09:51:02.662743+0000","last_peered":"2024-09-22T09:51:02.662743+0000","last_clean":"2024-09-22T09:51:02.662743+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:51:02.662743+0000","last_undegraded":"2024-09-22T09:51:02.662743+0000","last_fullsized":"2024-09-22T09:51:02.662743+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:52.150990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15884519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":597,"num_read_kb":45002,"num_write":1092,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429129+0000","last_change":"2024-09-22T08:42:17.443746+0000","last_active":"2024-09-22T09:50:17.429129+0000","last_peered":"2024-09-22T09:50:17.429129+0000","last_clean":"2024-09-22T09:50:17.429129+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:50:17.429129+0000","last_undegraded":"2024-09-22T09:50:17.429129+0000","last_fullsized":"2024-09-22T09:50:17.429129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:19.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'214","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.729377+0000","last_change":"2024-09-22T08:42:19.454027+0000","last_active":"2024-09-22T09:52:52.729377+0000","last_peered":"2024-09-22T09:52:52.729377+0000","last_clean":"2024-09-22T09:52:52.729377+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:52:52.729377+0000","last_undegraded":"2024-09-22T09:52:52.729377+0000","last_fullsized":"2024-09-22T09:52:52.729377+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:10.523969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146257,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":312,"num_read_kb":767,"num_write":212,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.653425+0000","last_change":"2024-09-22T08:42:21.477428+0000","last_active":"2024-09-22T09:49:52.653425+0000","last_peered":"2024-09-22T09:49:52.653425+0000","last_clean":"2024-09-22T09:49:52.653425+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:49:52.653425+0000","last_undegraded":"2024-09-22T09:49:52.653425+0000","last_fullsized":"2024-09-22T09:49:52.653425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:24.672129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'126","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.396183+0000","last_change":"2024-09-22T08:42:23.527124+0000","last_active":"2024-09-22T09:53:59.396183+0000","last_peered":"2024-09-22T09:53:59.396183+0000","last_clean":"2024-09-22T09:53:59.396183+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:53:59.396183+0000","last_undegraded":"2024-09-22T09:53:59.396183+0000","last_fullsized":"2024-09-22T09:53:59.396183+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:53.459446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438059+0000","last_change":"2024-09-22T08:42:15.436664+0000","last_active":"2024-09-22T09:51:37.438059+0000","last_peered":"2024-09-22T09:51:37.438059+0000","last_clean":"2024-09-22T09:51:37.438059+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:51:37.438059+0000","last_undegraded":"2024-09-22T09:51:37.438059+0000","last_fullsized":"2024-09-22T09:51:37.438059+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:03.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675198+0000","last_change":"2024-09-22T08:42:13.411262+0000","last_active":"2024-09-22T09:51:02.675198+0000","last_peered":"2024-09-22T09:51:02.675198+0000","last_clean":"2024-09-22T09:51:02.675198+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:51:02.675198+0000","last_undegraded":"2024-09-22T09:51:02.675198+0000","last_fullsized":"2024-09-22T09:51:02.675198+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:13.868253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10537104,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":68297,"num_write":935,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438046+0000","last_change":"2024-09-22T08:42:15.434625+0000","last_active":"2024-09-22T09:51:37.438046+0000","last_peered":"2024-09-22T09:51:37.438046+0000","last_clean":"2024-09-22T09:51:37.438046+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:51:37.438046+0000","last_undegraded":"2024-09-22T09:51:37.438046+0000","last_fullsized":"2024-09-22T09:51:37.438046+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:41.767444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.693374+0000","last_change":"2024-09-22T08:42:13.390383+0000","last_active":"2024-09-22T09:50:57.693374+0000","last_peered":"2024-09-22T09:50:57.693374+0000","last_clean":"2024-09-22T09:50:57.693374+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:50:57.693374+0000","last_undegraded":"2024-09-22T09:50:57.693374+0000","last_fullsized":"2024-09-22T09:50:57.693374+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:49.173702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268101,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":8670,"num_write":930,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687969+0000","last_change":"2024-09-22T08:42:15.434734+0000","last_active":"2024-09-22T09:51:37.687969+0000","last_peered":"2024-09-22T09:51:37.687969+0000","last_clean":"2024-09-22T09:51:37.687969+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:51:37.687969+0000","last_undegraded":"2024-09-22T09:51:37.687969+0000","last_fullsized":"2024-09-22T09:51:37.687969+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:30.081403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'195","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682799+0000","last_change":"2024-09-22T08:42:13.405053+0000","last_active":"2024-09-22T09:51:02.682799+0000","last_peered":"2024-09-22T09:51:02.682799+0000","last_clean":"2024-09-22T09:51:02.682799+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:51:02.682799+0000","last_undegraded":"2024-09-22T09:51:02.682799+0000","last_fullsized":"2024-09-22T09:51:02.682799+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:50.824870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4127,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":609,"num_read_kb":540,"num_write":1013,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438008+0000","last_change":"2024-09-22T08:42:15.431647+0000","last_active":"2024-09-22T09:51:37.438008+0000","last_peered":"2024-09-22T09:51:37.438008+0000","last_clean":"2024-09-22T09:51:37.438008+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:51:37.438008+0000","last_undegraded":"2024-09-22T09:51:37.438008+0000","last_fullsized":"2024-09-22T09:51:37.438008+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:55.015297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'203","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663931+0000","last_change":"2024-09-22T08:42:13.415007+0000","last_active":"2024-09-22T09:51:12.663931+0000","last_peered":"2024-09-22T09:51:12.663931+0000","last_clean":"2024-09-22T09:51:12.663931+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:51:12.663931+0000","last_undegraded":"2024-09-22T09:51:12.663931+0000","last_fullsized":"2024-09-22T09:51:12.663931+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:14.358684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54426,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":18552,"num_write":936,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663562+0000","last_change":"2024-09-22T08:42:15.436338+0000","last_active":"2024-09-22T09:51:12.663562+0000","last_peered":"2024-09-22T09:51:12.663562+0000","last_clean":"2024-09-22T09:51:12.663562+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:51:12.663562+0000","last_undegraded":"2024-09-22T09:51:12.663562+0000","last_fullsized":"2024-09-22T09:51:12.663562+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:58.108852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'220","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666067+0000","last_change":"2024-09-22T08:42:13.406108+0000","last_active":"2024-09-22T09:51:32.666067+0000","last_peered":"2024-09-22T09:51:32.666067+0000","last_clean":"2024-09-22T09:51:32.666067+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:51:32.666067+0000","last_undegraded":"2024-09-22T09:51:32.666067+0000","last_fullsized":"2024-09-22T09:51:32.666067+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:52.215127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243409,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":30794,"num_write":964,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'219","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.656045+0000","last_change":"2024-09-22T08:42:15.433745+0000","last_active":"2024-09-22T09:51:42.656045+0000","last_peered":"2024-09-22T09:51:42.656045+0000","last_clean":"2024-09-22T09:51:42.656045+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:51:42.656045+0000","last_undegraded":"2024-09-22T09:51:42.656045+0000","last_fullsized":"2024-09-22T09:51:42.656045+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:09.992145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'275","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.437474+0000","last_change":"2024-09-22T08:42:13.422466+0000","last_active":"2024-09-22T09:51:32.437474+0000","last_peered":"2024-09-22T09:51:32.437474+0000","last_clean":"2024-09-22T09:51:32.437474+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:51:32.437474+0000","last_undegraded":"2024-09-22T09:51:32.437474+0000","last_fullsized":"2024-09-22T09:51:32.437474+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:03.795312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487837,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":750,"num_read_kb":37020,"num_write":1214,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662275+0000","last_change":"2024-09-22T08:42:15.440845+0000","last_active":"2024-09-22T09:51:02.662275+0000","last_peered":"2024-09-22T09:51:02.662275+0000","last_clean":"2024-09-22T09:51:02.662275+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:51:02.662275+0000","last_undegraded":"2024-09-22T09:51:02.662275+0000","last_fullsized":"2024-09-22T09:51:02.662275+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:42.146384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'206","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680426+0000","last_change":"2024-09-22T08:42:13.407850+0000","last_active":"2024-09-22T09:51:37.680426+0000","last_peered":"2024-09-22T09:51:37.680426+0000","last_clean":"2024-09-22T09:51:37.680426+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:51:37.680426+0000","last_undegraded":"2024-09-22T09:51:37.680426+0000","last_fullsized":"2024-09-22T09:51:37.680426+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.638315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563136,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":7650,"num_write":1034,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675220+0000","last_change":"2024-09-22T08:42:15.429000+0000","last_active":"2024-09-22T09:51:02.675220+0000","last_peered":"2024-09-22T09:51:02.675220+0000","last_clean":"2024-09-22T09:51:02.675220+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:51:02.675220+0000","last_undegraded":"2024-09-22T09:51:02.675220+0000","last_fullsized":"2024-09-22T09:51:02.675220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.839044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666130+0000","last_change":"2024-09-22T08:42:13.415853+0000","last_active":"2024-09-22T09:51:32.666130+0000","last_peered":"2024-09-22T09:51:32.666130+0000","last_clean":"2024-09-22T09:51:32.666130+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:51:32.666130+0000","last_undegraded":"2024-09-22T09:51:32.666130+0000","last_fullsized":"2024-09-22T09:51:32.666130+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:53.049074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244238,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":20476,"num_write":1021,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.397601+0000","last_change":"2024-09-22T08:42:15.440719+0000","last_active":"2024-09-22T09:53:59.397601+0000","last_peered":"2024-09-22T09:53:59.397601+0000","last_clean":"2024-09-22T09:53:59.397601+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:53:59.397601+0000","last_undegraded":"2024-09-22T09:53:59.397601+0000","last_fullsized":"2024-09-22T09:53:59.397601+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:13.105481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'183","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:54.968519+0000","last_change":"2024-09-22T08:42:13.411004+0000","last_active":"2024-09-22T09:53:54.968519+0000","last_peered":"2024-09-22T09:53:54.968519+0000","last_clean":"2024-09-22T09:53:54.968519+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:53:54.968519+0000","last_undegraded":"2024-09-22T09:53:54.968519+0000","last_fullsized":"2024-09-22T09:53:54.968519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:46.465435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513032,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":7230,"num_write":904,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.157183+0000","last_change":"2024-09-22T08:42:15.428553+0000","last_active":"2024-09-22T09:50:22.157183+0000","last_peered":"2024-09-22T09:50:22.157183+0000","last_clean":"2024-09-22T09:50:22.157183+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:50:22.157183+0000","last_undegraded":"2024-09-22T09:50:22.157183+0000","last_fullsized":"2024-09-22T09:50:22.157183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:18.827032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'224","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669346+0000","last_change":"2024-09-22T08:42:13.407996+0000","last_active":"2024-09-22T09:51:57.669346+0000","last_peered":"2024-09-22T09:51:57.669346+0000","last_clean":"2024-09-22T09:51:57.669346+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:51:57.669346+0000","last_undegraded":"2024-09-22T09:51:57.669346+0000","last_fullsized":"2024-09-22T09:51:57.669346+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:37.268934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509892,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1621,"num_read_kb":135465,"num_write":992,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'142","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.686967+0000","last_change":"2024-09-22T08:42:15.433622+0000","last_active":"2024-09-22T09:49:52.686967+0000","last_peered":"2024-09-22T09:49:52.686967+0000","last_clean":"2024-09-22T09:49:52.686967+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:49:52.686967+0000","last_undegraded":"2024-09-22T09:49:52.686967+0000","last_fullsized":"2024-09-22T09:49:52.686967+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:44.943406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'177","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.020929+0000","last_change":"2024-09-22T08:42:13.402320+0000","last_active":"2024-09-22T09:50:12.020929+0000","last_peered":"2024-09-22T09:50:12.020929+0000","last_clean":"2024-09-22T09:50:12.020929+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:50:12.020929+0000","last_undegraded":"2024-09-22T09:50:12.020929+0000","last_fullsized":"2024-09-22T09:50:12.020929+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:31.569406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5659775,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":433,"num_read_kb":30385,"num_write":835,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545931+0000","last_change":"2024-09-22T08:42:15.428668+0000","last_active":"2024-09-22T09:49:47.545931+0000","last_peered":"2024-09-22T09:49:47.545931+0000","last_clean":"2024-09-22T09:49:47.545931+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:49:47.545931+0000","last_undegraded":"2024-09-22T09:49:47.545931+0000","last_fullsized":"2024-09-22T09:49:47.545931+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:57.959775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'190","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652896+0000","last_change":"2024-09-22T08:42:13.405602+0000","last_active":"2024-09-22T09:49:47.652896+0000","last_peered":"2024-09-22T09:49:47.652896+0000","last_clean":"2024-09-22T09:49:47.652896+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:49:47.652896+0000","last_undegraded":"2024-09-22T09:49:47.652896+0000","last_fullsized":"2024-09-22T09:49:47.652896+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:20.603994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5324486,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":23430,"num_write":909,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.513374+0000","last_change":"2024-09-22T08:42:15.438409+0000","last_active":"2024-09-22T09:49:47.513374+0000","last_peered":"2024-09-22T09:49:47.513374+0000","last_clean":"2024-09-22T09:49:47.513374+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:49:47.513374+0000","last_undegraded":"2024-09-22T09:49:47.513374+0000","last_fullsized":"2024-09-22T09:49:47.513374+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.728188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'211","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.665417+0000","last_change":"2024-09-22T08:42:13.406750+0000","last_active":"2024-09-22T09:49:47.665417+0000","last_peered":"2024-09-22T09:49:47.665417+0000","last_clean":"2024-09-22T09:49:47.665417+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:49:47.665417+0000","last_undegraded":"2024-09-22T09:49:47.665417+0000","last_fullsized":"2024-09-22T09:49:47.665417+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:31.322960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":16539,"num_write":977,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.382202+0000","last_change":"2024-09-22T08:42:15.435371+0000","last_active":"2024-09-22T09:51:35.382202+0000","last_peered":"2024-09-22T09:51:35.382202+0000","last_clean":"2024-09-22T09:51:35.382202+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:51:35.382202+0000","last_undegraded":"2024-09-22T09:51:35.382202+0000","last_fullsized":"2024-09-22T09:51:35.382202+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:25.479186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'190","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.303905+0000","last_change":"2024-09-22T08:42:13.416475+0000","last_active":"2024-09-22T09:51:28.303905+0000","last_peered":"2024-09-22T09:51:28.303905+0000","last_clean":"2024-09-22T09:51:28.303905+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:51:28.303905+0000","last_undegraded":"2024-09-22T09:51:28.303905+0000","last_fullsized":"2024-09-22T09:51:28.303905+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:13.725268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511517,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":32139,"num_write":904,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652546+0000","last_change":"2024-09-22T08:42:15.436821+0000","last_active":"2024-09-22T09:49:47.652546+0000","last_peered":"2024-09-22T09:49:47.652546+0000","last_clean":"2024-09-22T09:49:47.652546+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:49:47.652546+0000","last_undegraded":"2024-09-22T09:49:47.652546+0000","last_fullsized":"2024-09-22T09:49:47.652546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:30.622726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'201","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:23.345932+0000","last_change":"2024-09-22T08:42:13.400175+0000","last_active":"2024-09-22T09:51:23.345932+0000","last_peered":"2024-09-22T09:51:23.345932+0000","last_clean":"2024-09-22T09:51:23.345932+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:51:23.345932+0000","last_undegraded":"2024-09-22T09:51:23.345932+0000","last_fullsized":"2024-09-22T09:51:23.345932+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:35.492802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6061192,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":31835,"num_write":1009,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.532605+0000","last_change":"2024-09-22T08:42:15.433332+0000","last_active":"2024-09-22T09:51:52.532605+0000","last_peered":"2024-09-22T09:51:52.532605+0000","last_clean":"2024-09-22T09:51:52.532605+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:51:52.532605+0000","last_undegraded":"2024-09-22T09:51:52.532605+0000","last_fullsized":"2024-09-22T09:51:52.532605+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:33.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'224","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.823125+0000","last_change":"2024-09-22T08:42:13.417006+0000","last_active":"2024-09-22T09:51:39.823125+0000","last_peered":"2024-09-22T09:51:39.823125+0000","last_clean":"2024-09-22T09:51:39.823125+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:51:39.823125+0000","last_undegraded":"2024-09-22T09:51:39.823125+0000","last_fullsized":"2024-09-22T09:51:39.823125+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:01.120483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15749336,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":662,"num_read_kb":33540,"num_write":1135,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'199","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.099498+0000","last_change":"2024-09-22T08:42:13.414146+0000","last_active":"2024-09-22T09:50:21.099498+0000","last_peered":"2024-09-22T09:50:21.099498+0000","last_clean":"2024-09-22T09:50:21.099498+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:50:21.099498+0000","last_undegraded":"2024-09-22T09:50:21.099498+0000","last_fullsized":"2024-09-22T09:50:21.099498+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:45.228462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10508441,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":16611,"num_write":905,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655515+0000","last_change":"2024-09-22T08:42:15.431931+0000","last_active":"2024-09-22T09:50:07.655515+0000","last_peered":"2024-09-22T09:50:07.655515+0000","last_clean":"2024-09-22T09:50:07.655515+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:50:07.655515+0000","last_undegraded":"2024-09-22T09:50:07.655515+0000","last_fullsized":"2024-09-22T09:50:07.655515+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:55.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'224","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426140+0000","last_change":"2024-09-22T08:42:13.421991+0000","last_active":"2024-09-22T09:49:52.426140+0000","last_peered":"2024-09-22T09:49:52.426140+0000","last_clean":"2024-09-22T09:49:52.426140+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:49:52.426140+0000","last_undegraded":"2024-09-22T09:49:52.426140+0000","last_fullsized":"2024-09-22T09:49:52.426140+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926338,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":653,"num_read_kb":76384,"num_write":1021,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673291+0000","last_change":"2024-09-22T08:42:15.433648+0000","last_active":"2024-09-22T09:49:57.673291+0000","last_peered":"2024-09-22T09:49:57.673291+0000","last_clean":"2024-09-22T09:49:57.673291+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:49:57.673291+0000","last_undegraded":"2024-09-22T09:49:57.673291+0000","last_fullsized":"2024-09-22T09:49:57.673291+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:57.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1596,"ondisk_log_size":1596,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":390,"ondisk_log_size":390,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":464513,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":9727,"num_read_kb":11902,"num_write":6883,"num_write_kb":3179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":192276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1805,"ondisk_log_size":1805,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3773,"ondisk_log_size":3773,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":533460138,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42187,"num_read_kb":2399793,"num_write":63093,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":715456512,"data_stored":715456512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4338,"ondisk_log_size":4338,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":120,"num_read_kb":189640,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189064,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543016,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346644,"kb_used_data":103044,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94025196,"statfs":{"total":96636764160,"available":96281800704,"internally_reserved":0,"allocated":105517056,"data_stored":103464448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543016,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414580,"kb_used_data":148772,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957260,"statfs":{"total":96636764160,"available":96212234240,"internally_reserved":0,"allocated":152342528,"data_stored":150381183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543018,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213764,"kb_used_data":120180,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94158076,"statfs":{"total":96636764160,"available":96417869824,"internally_reserved":0,"allocated":123064320,"data_stored":121014480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543017,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254368,"kb_used_data":146832,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117472,"statfs":{"total":96636764160,"available":96376291328,"internally_reserved":0,"allocated":150355968,"data_stored":148445373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543016,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356132,"kb_used_data":130580,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94015708,"statfs":{"total":96636764160,"available":96272084992,"internally_reserved":0,"allocated":133713920,"data_stored":131707867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543020,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179808,"kb_used_data":108368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94192032,"statfs":{"total":96636764160,"available":96452640768,"internally_reserved":0,"allocated":110968832,"data_stored":109048955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543016,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264916,"kb_used_data":135236,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94106924,"statfs":{"total":96636764160,"available":96365490176,"internally_reserved":0,"allocated":138481664,"data_stored":136503112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543018,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359156,"kb_used_data":125284,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94012684,"statfs":{"total":96636764160,"available":96268988416,"internally_reserved":0,"allocated":128290816,"data_stored":126284216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92995584,"data_stored":92995584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84254720,"data_stored":84254720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80138240,"data_stored":80138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":112041984,"data_stored":112041984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":87261184,"data_stored":87261184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":97763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90554368,"data_stored":90554368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":26679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":25842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":26841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":33446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":39804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17412096,"data_stored":17410001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26222592,"data_stored":26219364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20976484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3153920,"data_stored":3150692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17883136,"data_stored":17879178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3731456,"data_stored":3730091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:54:16.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T09:54:16.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:54:16.729 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:16.741 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:54:16.744 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2427,"stamp":"2024-09-22T09:54:16.420228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":680510898,"num_objects":774,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":774,"num_whiteouts":0,"num_read":189991,"num_read_kb":2910016,"num_write":128503,"num_write_kb":2504237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13206,"ondisk_log_size":13206,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2389368,"kb_used_data":1018296,"kb_used_omap":12,"kb_used_meta":1370931,"kb_avail":752585352,"statfs":{"total":773094113280,"available":770647400448,"internally_reserved":0,"allocated":1042735104,"data_stored":1026849634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1403833905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005359"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.684355+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.684355+0000","last_peered":"2024-09-22T09:51:12.684355+0000","last_clean":"2024-09-22T09:51:12.684355+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:51:12.684355+0000","last_undegraded":"2024-09-22T09:51:12.684355+0000","last_fullsized":"2024-09-22T09:51:12.684355+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.689100+0000","last_change":"2024-09-22T09:20:12.873395+0000","last_active":"2024-09-22T09:50:12.689100+0000","last_peered":"2024-09-22T09:50:12.689100+0000","last_clean":"2024-09-22T09:50:12.689100+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:50:12.689100+0000","last_undegraded":"2024-09-22T09:50:12.689100+0000","last_fullsized":"2024-09-22T09:50:12.689100+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:11.074090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558208+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:51:12.558208+0000","last_peered":"2024-09-22T09:51:12.558208+0000","last_clean":"2024-09-22T09:51:12.558208+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:51:12.558208+0000","last_undegraded":"2024-09-22T09:51:12.558208+0000","last_fullsized":"2024-09-22T09:51:12.558208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":8,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434594+0000","last_change":"2024-09-22T09:01:07.465099+0000","last_active":"2024-09-22T09:51:07.434594+0000","last_peered":"2024-09-22T09:51:07.434594+0000","last_clean":"2024-09-22T09:51:07.434594+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:51:07.434594+0000","last_undegraded":"2024-09-22T09:51:07.434594+0000","last_fullsized":"2024-09-22T09:51:07.434594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:59.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694907+0000","last_change":"2024-09-22T08:57:04.397022+0000","last_active":"2024-09-22T09:51:12.694907+0000","last_peered":"2024-09-22T09:51:12.694907+0000","last_clean":"2024-09-22T09:51:12.694907+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:51:12.694907+0000","last_undegraded":"2024-09-22T09:51:12.694907+0000","last_fullsized":"2024-09-22T09:51:12.694907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:59.048334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694918+0000","last_change":"2024-09-22T09:01:07.467647+0000","last_active":"2024-09-22T09:51:12.694918+0000","last_peered":"2024-09-22T09:51:12.694918+0000","last_clean":"2024-09-22T09:51:12.694918+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:51:12.694918+0000","last_undegraded":"2024-09-22T09:51:12.694918+0000","last_fullsized":"2024-09-22T09:51:12.694918+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:12.140780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632785,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":619,"num_write":2,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651709+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:49:37.651709+0000","last_peered":"2024-09-22T09:49:37.651709+0000","last_clean":"2024-09-22T09:49:37.651709+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:49:37.651709+0000","last_undegraded":"2024-09-22T09:49:37.651709+0000","last_fullsized":"2024-09-22T09:49:37.651709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:53.738400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651360+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:49:37.651360+0000","last_peered":"2024-09-22T09:49:37.651360+0000","last_clean":"2024-09-22T09:49:37.651360+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:49:37.651360+0000","last_undegraded":"2024-09-22T09:49:37.651360+0000","last_fullsized":"2024-09-22T09:49:37.651360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:52.455370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.656003+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:50:12.656003+0000","last_peered":"2024-09-22T09:50:12.656003+0000","last_clean":"2024-09-22T09:50:12.656003+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:50:12.656003+0000","last_undegraded":"2024-09-22T09:50:12.656003+0000","last_fullsized":"2024-09-22T09:50:12.656003+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.670273+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:49:37.670273+0000","last_peered":"2024-09-22T09:49:37.670273+0000","last_clean":"2024-09-22T09:49:37.670273+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:49:37.670273+0000","last_undegraded":"2024-09-22T09:49:37.670273+0000","last_fullsized":"2024-09-22T09:49:37.670273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:49.468579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650455+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:49:27.650455+0000","last_peered":"2024-09-22T09:49:27.650455+0000","last_clean":"2024-09-22T09:49:27.650455+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:49:27.650455+0000","last_undegraded":"2024-09-22T09:49:27.650455+0000","last_fullsized":"2024-09-22T09:49:27.650455+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651319+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:49:37.651319+0000","last_peered":"2024-09-22T09:49:37.651319+0000","last_clean":"2024-09-22T09:49:37.651319+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:49:37.651319+0000","last_undegraded":"2024-09-22T09:49:37.651319+0000","last_fullsized":"2024-09-22T09:49:37.651319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:53.670732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'4","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.663218+0000","last_change":"2024-09-22T09:01:11.514663+0000","last_active":"2024-09-22T09:49:32.663218+0000","last_peered":"2024-09-22T09:49:32.663218+0000","last_clean":"2024-09-22T09:49:32.663218+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:49:32.663218+0000","last_undegraded":"2024-09-22T09:49:32.663218+0000","last_fullsized":"2024-09-22T09:49:32.663218+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:31.564030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:42.545151+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:49:42.545151+0000","last_peered":"2024-09-22T09:49:42.545151+0000","last_clean":"2024-09-22T09:49:42.545151+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:49:42.545151+0000","last_undegraded":"2024-09-22T09:49:42.545151+0000","last_fullsized":"2024-09-22T09:49:42.545151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:19.067022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":260,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.663945+0000","last_change":"2024-09-22T08:57:04.396164+0000","last_active":"2024-09-22T09:49:37.663945+0000","last_peered":"2024-09-22T09:49:37.663945+0000","last_clean":"2024-09-22T09:49:37.663945+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:49:37.663945+0000","last_undegraded":"2024-09-22T09:49:37.663945+0000","last_fullsized":"2024-09-22T09:49:37.663945+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:24.400394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676766+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:51:12.676766+0000","last_peered":"2024-09-22T09:51:12.676766+0000","last_clean":"2024-09-22T09:51:12.676766+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:51:12.676766+0000","last_undegraded":"2024-09-22T09:51:12.676766+0000","last_fullsized":"2024-09-22T09:51:12.676766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'4","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663319+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:51:07.663319+0000","last_peered":"2024-09-22T09:51:07.663319+0000","last_clean":"2024-09-22T09:51:07.663319+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:51:07.663319+0000","last_undegraded":"2024-09-22T09:51:07.663319+0000","last_fullsized":"2024-09-22T09:51:07.663319+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429096+0000","last_change":"2024-09-22T08:57:04.400224+0000","last_active":"2024-09-22T09:50:17.429096+0000","last_peered":"2024-09-22T09:50:17.429096+0000","last_clean":"2024-09-22T09:50:17.429096+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:50:17.429096+0000","last_undegraded":"2024-09-22T09:50:17.429096+0000","last_fullsized":"2024-09-22T09:50:17.429096+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:47.678550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650766+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:49:32.650766+0000","last_peered":"2024-09-22T09:49:32.650766+0000","last_clean":"2024-09-22T09:49:32.650766+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:49:32.650766+0000","last_undegraded":"2024-09-22T09:49:32.650766+0000","last_fullsized":"2024-09-22T09:49:32.650766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:02.822384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675672+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:50:12.675672+0000","last_peered":"2024-09-22T09:50:12.675672+0000","last_clean":"2024-09-22T09:50:12.675672+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:50:12.675672+0000","last_undegraded":"2024-09-22T09:50:12.675672+0000","last_fullsized":"2024-09-22T09:50:12.675672+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:26:14.614902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691085+0000","last_change":"2024-09-22T09:20:12.861108+0000","last_active":"2024-09-22T09:50:32.691085+0000","last_peered":"2024-09-22T09:50:32.691085+0000","last_clean":"2024-09-22T09:50:32.691085+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:50:32.691085+0000","last_undegraded":"2024-09-22T09:50:32.691085+0000","last_fullsized":"2024-09-22T09:50:32.691085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:55.356489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656729+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:50:17.656729+0000","last_peered":"2024-09-22T09:50:17.656729+0000","last_clean":"2024-09-22T09:50:17.656729+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:50:17.656729+0000","last_undegraded":"2024-09-22T09:50:17.656729+0000","last_fullsized":"2024-09-22T09:50:17.656729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.510433+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:49:27.510433+0000","last_peered":"2024-09-22T09:49:27.510433+0000","last_clean":"2024-09-22T09:49:27.510433+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:49:27.510433+0000","last_undegraded":"2024-09-22T09:49:27.510433+0000","last_fullsized":"2024-09-22T09:49:27.510433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650821+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:49:32.650821+0000","last_peered":"2024-09-22T09:49:32.650821+0000","last_clean":"2024-09-22T09:49:32.650821+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:49:32.650821+0000","last_undegraded":"2024-09-22T09:49:32.650821+0000","last_fullsized":"2024-09-22T09:49:32.650821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:42.484414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'4","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.684513+0000","last_change":"2024-09-22T09:01:07.465474+0000","last_active":"2024-09-22T09:49:27.684513+0000","last_peered":"2024-09-22T09:49:27.684513+0000","last_clean":"2024-09-22T09:49:27.684513+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:49:27.684513+0000","last_undegraded":"2024-09-22T09:49:27.684513+0000","last_fullsized":"2024-09-22T09:49:27.684513+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:54.197542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.689645+0000","last_change":"2024-09-22T08:57:04.398115+0000","last_active":"2024-09-22T09:50:17.689645+0000","last_peered":"2024-09-22T09:50:17.689645+0000","last_clean":"2024-09-22T09:50:17.689645+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:50:17.689645+0000","last_undegraded":"2024-09-22T09:50:17.689645+0000","last_fullsized":"2024-09-22T09:50:17.689645+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:33.062709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.543852+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:49:32.543852+0000","last_peered":"2024-09-22T09:49:32.543852+0000","last_clean":"2024-09-22T09:49:32.543852+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:49:32.543852+0000","last_undegraded":"2024-09-22T09:49:32.543852+0000","last_fullsized":"2024-09-22T09:49:32.543852+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.506562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'2","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:27.650577+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:49:27.650577+0000","last_peered":"2024-09-22T09:49:27.650577+0000","last_clean":"2024-09-22T09:49:27.650577+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:49:27.650577+0000","last_undegraded":"2024-09-22T09:49:27.650577+0000","last_fullsized":"2024-09-22T09:49:27.650577+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428515+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:50:12.428515+0000","last_peered":"2024-09-22T09:50:12.428515+0000","last_clean":"2024-09-22T09:50:12.428515+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:50:12.428515+0000","last_undegraded":"2024-09-22T09:50:12.428515+0000","last_fullsized":"2024-09-22T09:50:12.428515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:47.707645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'1","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.548961+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:50:07.548961+0000","last_peered":"2024-09-22T09:50:07.548961+0000","last_clean":"2024-09-22T09:50:07.548961+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:50:07.548961+0000","last_undegraded":"2024-09-22T09:50:07.548961+0000","last_fullsized":"2024-09-22T09:50:07.548961+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:52.131442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'2","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428446+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:50:12.428446+0000","last_peered":"2024-09-22T09:50:12.428446+0000","last_clean":"2024-09-22T09:50:12.428446+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:50:12.428446+0000","last_undegraded":"2024-09-22T09:50:12.428446+0000","last_fullsized":"2024-09-22T09:50:12.428446+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:49.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655114+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:50:07.655114+0000","last_peered":"2024-09-22T09:50:07.655114+0000","last_clean":"2024-09-22T09:50:07.655114+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:50:07.655114+0000","last_undegraded":"2024-09-22T09:50:07.655114+0000","last_fullsized":"2024-09-22T09:50:07.655114+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:28.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.655936+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:50:12.655936+0000","last_peered":"2024-09-22T09:50:12.655936+0000","last_clean":"2024-09-22T09:50:12.655936+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:50:12.655936+0000","last_undegraded":"2024-09-22T09:50:12.655936+0000","last_fullsized":"2024-09-22T09:50:12.655936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:02.097970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668153+0000","last_change":"2024-09-22T09:01:07.463162+0000","last_active":"2024-09-22T09:50:07.668153+0000","last_peered":"2024-09-22T09:50:07.668153+0000","last_clean":"2024-09-22T09:50:07.668153+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:50:07.668153+0000","last_undegraded":"2024-09-22T09:50:07.668153+0000","last_fullsized":"2024-09-22T09:50:07.668153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:40.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'3","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.668750+0000","last_change":"2024-09-22T09:01:11.517359+0000","last_active":"2024-09-22T09:50:12.668750+0000","last_peered":"2024-09-22T09:50:12.668750+0000","last_clean":"2024-09-22T09:50:12.668750+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:50:12.668750+0000","last_undegraded":"2024-09-22T09:50:12.668750+0000","last_fullsized":"2024-09-22T09:50:12.668750+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:49.248745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'9","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.674907+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:50:07.674907+0000","last_peered":"2024-09-22T09:50:07.674907+0000","last_clean":"2024-09-22T09:50:07.674907+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:50:07.674907+0000","last_undegraded":"2024-09-22T09:50:07.674907+0000","last_fullsized":"2024-09-22T09:50:07.674907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:43.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":16386,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691557+0000","last_change":"2024-09-22T09:20:12.858546+0000","last_active":"2024-09-22T09:50:37.691557+0000","last_peered":"2024-09-22T09:50:37.691557+0000","last_clean":"2024-09-22T09:50:37.691557+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:50:37.691557+0000","last_undegraded":"2024-09-22T09:50:37.691557+0000","last_fullsized":"2024-09-22T09:50:37.691557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:50.810813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'1","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659886+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:50:42.659886+0000","last_peered":"2024-09-22T09:50:42.659886+0000","last_clean":"2024-09-22T09:50:42.659886+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:50:42.659886+0000","last_undegraded":"2024-09-22T09:50:42.659886+0000","last_fullsized":"2024-09-22T09:50:42.659886+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691594+0000","last_change":"2024-09-22T09:01:07.465057+0000","last_active":"2024-09-22T09:50:37.691594+0000","last_peered":"2024-09-22T09:50:37.691594+0000","last_clean":"2024-09-22T09:50:37.691594+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:50:37.691594+0000","last_undegraded":"2024-09-22T09:50:37.691594+0000","last_fullsized":"2024-09-22T09:50:37.691594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:51.656500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.683656+0000","last_change":"2024-09-22T08:57:04.397214+0000","last_active":"2024-09-22T09:51:07.683656+0000","last_peered":"2024-09-22T09:51:07.683656+0000","last_clean":"2024-09-22T09:51:07.683656+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:51:07.683656+0000","last_undegraded":"2024-09-22T09:51:07.683656+0000","last_fullsized":"2024-09-22T09:51:07.683656+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:24.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.671153+0000","last_change":"2024-09-22T09:20:12.869138+0000","last_active":"2024-09-22T09:50:32.671153+0000","last_peered":"2024-09-22T09:50:32.671153+0000","last_clean":"2024-09-22T09:50:32.671153+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:50:32.671153+0000","last_undegraded":"2024-09-22T09:50:32.671153+0000","last_fullsized":"2024-09-22T09:50:32.671153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:20.523450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'5","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433506+0000","last_change":"2024-09-22T09:01:11.518715+0000","last_active":"2024-09-22T09:50:57.433506+0000","last_peered":"2024-09-22T09:50:57.433506+0000","last_clean":"2024-09-22T09:50:57.433506+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:50:57.433506+0000","last_undegraded":"2024-09-22T09:50:57.433506+0000","last_fullsized":"2024-09-22T09:50:57.433506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:25.716417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582758,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.659427+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:50:37.659427+0000","last_peered":"2024-09-22T09:50:37.659427+0000","last_clean":"2024-09-22T09:50:37.659427+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:50:37.659427+0000","last_undegraded":"2024-09-22T09:50:37.659427+0000","last_fullsized":"2024-09-22T09:50:37.659427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676022+0000","last_change":"2024-09-22T08:57:04.395860+0000","last_active":"2024-09-22T09:51:07.676022+0000","last_peered":"2024-09-22T09:51:07.676022+0000","last_clean":"2024-09-22T09:51:07.676022+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:51:07.676022+0000","last_undegraded":"2024-09-22T09:51:07.676022+0000","last_fullsized":"2024-09-22T09:51:07.676022+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:13.903713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520070+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:50:32.520070+0000","last_peered":"2024-09-22T09:50:32.520070+0000","last_clean":"2024-09-22T09:50:32.520070+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:50:32.520070+0000","last_undegraded":"2024-09-22T09:50:32.520070+0000","last_fullsized":"2024-09-22T09:50:32.520070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:36.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'1","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:52.432911+0000","last_change":"2024-09-22T09:01:07.463902+0000","last_active":"2024-09-22T09:50:52.432911+0000","last_peered":"2024-09-22T09:50:52.432911+0000","last_clean":"2024-09-22T09:50:52.432911+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:50:52.432911+0000","last_undegraded":"2024-09-22T09:50:52.432911+0000","last_fullsized":"2024-09-22T09:50:52.432911+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:06.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.694357+0000","last_change":"2024-09-22T08:57:04.397359+0000","last_active":"2024-09-22T09:51:07.694357+0000","last_peered":"2024-09-22T09:51:07.694357+0000","last_clean":"2024-09-22T09:51:07.694357+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:51:07.694357+0000","last_undegraded":"2024-09-22T09:51:07.694357+0000","last_fullsized":"2024-09-22T09:51:07.694357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:55.654439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'8","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556776+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:51:02.556776+0000","last_peered":"2024-09-22T09:51:02.556776+0000","last_clean":"2024-09-22T09:51:02.556776+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:51:02.556776+0000","last_undegraded":"2024-09-22T09:51:02.556776+0000","last_fullsized":"2024-09-22T09:51:02.556776+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":122,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663336+0000","last_change":"2024-09-22T08:57:04.405441+0000","last_active":"2024-09-22T09:51:07.663336+0000","last_peered":"2024-09-22T09:51:07.663336+0000","last_clean":"2024-09-22T09:51:07.663336+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:51:07.663336+0000","last_undegraded":"2024-09-22T09:51:07.663336+0000","last_fullsized":"2024-09-22T09:51:07.663336+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:56.122641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433374+0000","last_change":"2024-09-22T09:01:07.462593+0000","last_active":"2024-09-22T09:50:57.433374+0000","last_peered":"2024-09-22T09:50:57.433374+0000","last_clean":"2024-09-22T09:50:57.433374+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:50:57.433374+0000","last_undegraded":"2024-09-22T09:50:57.433374+0000","last_fullsized":"2024-09-22T09:50:57.433374+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:03.677122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528666+0000","last_change":"2024-09-22T08:57:04.395828+0000","last_active":"2024-09-22T09:51:27.528666+0000","last_peered":"2024-09-22T09:51:27.528666+0000","last_clean":"2024-09-22T09:51:27.528666+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:51:27.528666+0000","last_undegraded":"2024-09-22T09:51:27.528666+0000","last_fullsized":"2024-09-22T09:51:27.528666+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:01.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431738+0000","last_change":"2024-09-22T09:01:11.516330+0000","last_active":"2024-09-22T09:50:42.431738+0000","last_peered":"2024-09-22T09:50:42.431738+0000","last_clean":"2024-09-22T09:50:42.431738+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:50:42.431738+0000","last_undegraded":"2024-09-22T09:50:42.431738+0000","last_fullsized":"2024-09-22T09:50:42.431738+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:46.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'13","reported_seq":84,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662571+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:51:02.662571+0000","last_peered":"2024-09-22T09:51:02.662571+0000","last_clean":"2024-09-22T09:51:02.662571+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:51:02.662571+0000","last_undegraded":"2024-09-22T09:51:02.662571+0000","last_fullsized":"2024-09-22T09:51:02.662571+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":32770,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'1","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.526385+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:51:12.526385+0000","last_peered":"2024-09-22T09:51:12.526385+0000","last_clean":"2024-09-22T09:51:12.526385+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:51:12.526385+0000","last_undegraded":"2024-09-22T09:51:12.526385+0000","last_fullsized":"2024-09-22T09:51:12.526385+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":74,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677517+0000","last_change":"2024-09-22T08:57:04.395126+0000","last_active":"2024-09-22T09:51:17.677517+0000","last_peered":"2024-09-22T09:51:17.677517+0000","last_clean":"2024-09-22T09:51:17.677517+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:51:17.677517+0000","last_undegraded":"2024-09-22T09:51:17.677517+0000","last_fullsized":"2024-09-22T09:51:17.677517+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:33.605027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663959+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:51:12.663959+0000","last_peered":"2024-09-22T09:51:12.663959+0000","last_clean":"2024-09-22T09:51:12.663959+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:51:12.663959+0000","last_undegraded":"2024-09-22T09:51:12.663959+0000","last_fullsized":"2024-09-22T09:51:12.663959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694882+0000","last_change":"2024-09-22T09:01:07.464584+0000","last_active":"2024-09-22T09:51:12.694882+0000","last_peered":"2024-09-22T09:51:12.694882+0000","last_clean":"2024-09-22T09:51:12.694882+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:51:12.694882+0000","last_undegraded":"2024-09-22T09:51:12.694882+0000","last_fullsized":"2024-09-22T09:51:12.694882+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:12.421058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677612+0000","last_change":"2024-09-22T08:57:04.400659+0000","last_active":"2024-09-22T09:51:17.677612+0000","last_peered":"2024-09-22T09:51:17.677612+0000","last_clean":"2024-09-22T09:51:17.677612+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:51:17.677612+0000","last_undegraded":"2024-09-22T09:51:17.677612+0000","last_fullsized":"2024-09-22T09:51:17.677612+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.429612+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:50:22.429612+0000","last_peered":"2024-09-22T09:50:22.429612+0000","last_clean":"2024-09-22T09:50:22.429612+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:50:22.429612+0000","last_undegraded":"2024-09-22T09:50:22.429612+0000","last_fullsized":"2024-09-22T09:50:22.429612+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:16.516456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528740+0000","last_change":"2024-09-22T08:57:04.401962+0000","last_active":"2024-09-22T09:51:27.528740+0000","last_peered":"2024-09-22T09:51:27.528740+0000","last_clean":"2024-09-22T09:51:27.528740+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:51:27.528740+0000","last_undegraded":"2024-09-22T09:51:27.528740+0000","last_fullsized":"2024-09-22T09:51:27.528740+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:43.579055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.435663+0000","last_change":"2024-09-22T08:57:04.397895+0000","last_active":"2024-09-22T09:51:17.435663+0000","last_peered":"2024-09-22T09:51:17.435663+0000","last_clean":"2024-09-22T09:51:17.435663+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:51:17.435663+0000","last_undegraded":"2024-09-22T09:51:17.435663+0000","last_fullsized":"2024-09-22T09:51:17.435663+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:57.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691139+0000","last_change":"2024-09-22T09:20:12.868011+0000","last_active":"2024-09-22T09:50:32.691139+0000","last_peered":"2024-09-22T09:50:32.691139+0000","last_clean":"2024-09-22T09:50:32.691139+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:50:32.691139+0000","last_undegraded":"2024-09-22T09:50:32.691139+0000","last_fullsized":"2024-09-22T09:50:32.691139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:51.261678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.435132+0000","last_change":"2024-09-22T09:01:11.515368+0000","last_active":"2024-09-22T09:51:12.435132+0000","last_peered":"2024-09-22T09:51:12.435132+0000","last_clean":"2024-09-22T09:51:12.435132+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:51:12.435132+0000","last_undegraded":"2024-09-22T09:51:12.435132+0000","last_fullsized":"2024-09-22T09:51:12.435132+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:01.643271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658823+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:50:32.658823+0000","last_peered":"2024-09-22T09:50:32.658823+0000","last_clean":"2024-09-22T09:50:32.658823+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:50:32.658823+0000","last_undegraded":"2024-09-22T09:50:32.658823+0000","last_fullsized":"2024-09-22T09:50:32.658823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:55.492793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.558791+0000","last_change":"2024-09-22T08:57:04.398627+0000","last_active":"2024-09-22T09:51:17.558791+0000","last_peered":"2024-09-22T09:51:17.558791+0000","last_clean":"2024-09-22T09:51:17.558791+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:51:17.558791+0000","last_undegraded":"2024-09-22T09:51:17.558791+0000","last_fullsized":"2024-09-22T09:51:17.558791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:23.008984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676744+0000","last_change":"2024-09-22T09:01:11.522462+0000","last_active":"2024-09-22T09:51:12.676744+0000","last_peered":"2024-09-22T09:51:12.676744+0000","last_clean":"2024-09-22T09:51:12.676744+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:51:12.676744+0000","last_undegraded":"2024-09-22T09:51:12.676744+0000","last_fullsized":"2024-09-22T09:51:12.676744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:13.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434560+0000","last_change":"2024-09-22T09:01:07.463509+0000","last_active":"2024-09-22T09:51:07.434560+0000","last_peered":"2024-09-22T09:51:07.434560+0000","last_clean":"2024-09-22T09:51:07.434560+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:51:07.434560+0000","last_undegraded":"2024-09-22T09:51:07.434560+0000","last_fullsized":"2024-09-22T09:51:07.434560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:59.139960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677548+0000","last_change":"2024-09-22T08:57:04.386372+0000","last_active":"2024-09-22T09:51:17.677548+0000","last_peered":"2024-09-22T09:51:17.677548+0000","last_clean":"2024-09-22T09:51:17.677548+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:51:17.677548+0000","last_undegraded":"2024-09-22T09:51:17.677548+0000","last_fullsized":"2024-09-22T09:51:17.677548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:50.648447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'1","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558150+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:51:12.558150+0000","last_peered":"2024-09-22T09:51:12.558150+0000","last_clean":"2024-09-22T09:51:12.558150+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:51:12.558150+0000","last_undegraded":"2024-09-22T09:51:12.558150+0000","last_fullsized":"2024-09-22T09:51:12.558150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1142,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'8","reported_seq":75,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.675993+0000","last_change":"2024-09-22T09:01:07.457691+0000","last_active":"2024-09-22T09:51:07.675993+0000","last_peered":"2024-09-22T09:51:07.675993+0000","last_clean":"2024-09-22T09:51:07.675993+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:51:07.675993+0000","last_undegraded":"2024-09-22T09:51:07.675993+0000","last_fullsized":"2024-09-22T09:51:07.675993+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:44.440513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247844,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":25607,"num_write":8,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'205","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524192+0000","last_change":"2024-09-22T08:42:13.423188+0000","last_active":"2024-09-22T09:50:57.524192+0000","last_peered":"2024-09-22T09:50:57.524192+0000","last_clean":"2024-09-22T09:50:57.524192+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:50:57.524192+0000","last_undegraded":"2024-09-22T09:50:57.524192+0000","last_fullsized":"2024-09-22T09:50:57.524192+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:47.101356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":13870,"num_write":989,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'141","reported_seq":767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.861787+0000","last_change":"2024-09-22T08:42:15.431071+0000","last_active":"2024-09-22T09:50:12.861787+0000","last_peered":"2024-09-22T09:50:12.861787+0000","last_clean":"2024-09-22T09:50:12.861787+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:50:12.861787+0000","last_undegraded":"2024-09-22T09:50:12.861787+0000","last_fullsized":"2024-09-22T09:50:12.861787+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:37.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'136","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.433476+0000","last_change":"2024-09-22T08:42:46.096812+0000","last_active":"2024-09-22T09:50:57.433476+0000","last_peered":"2024-09-22T09:50:57.433476+0000","last_clean":"2024-09-22T09:50:57.433476+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:50:57.433476+0000","last_undegraded":"2024-09-22T09:50:57.433476+0000","last_fullsized":"2024-09-22T09:50:57.433476+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:57.098166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21059257,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":103374,"num_write":676,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.458574+0000","last_change":"2024-09-22T08:42:15.435522+0000","last_active":"2024-09-22T09:51:48.458574+0000","last_peered":"2024-09-22T09:51:48.458574+0000","last_clean":"2024-09-22T09:51:48.458574+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:51:48.458574+0000","last_undegraded":"2024-09-22T09:51:48.458574+0000","last_fullsized":"2024-09-22T09:51:48.458574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:45.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'206","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662676+0000","last_change":"2024-09-22T08:42:13.406564+0000","last_active":"2024-09-22T09:51:02.662676+0000","last_peered":"2024-09-22T09:51:02.662676+0000","last_clean":"2024-09-22T09:51:02.662676+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:51:02.662676+0000","last_undegraded":"2024-09-22T09:51:02.662676+0000","last_fullsized":"2024-09-22T09:51:02.662676+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:01.206591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":374630,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":499,"num_read_kb":4356,"num_write":981,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545888+0000","last_change":"2024-09-22T08:42:15.422331+0000","last_active":"2024-09-22T09:49:47.545888+0000","last_peered":"2024-09-22T09:49:47.545888+0000","last_clean":"2024-09-22T09:49:47.545888+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:49:47.545888+0000","last_undegraded":"2024-09-22T09:49:47.545888+0000","last_fullsized":"2024-09-22T09:49:47.545888+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:17.082268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'206","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.508468+0000","last_change":"2024-09-22T08:42:13.412575+0000","last_active":"2024-09-22T09:51:13.508468+0000","last_peered":"2024-09-22T09:51:13.508468+0000","last_clean":"2024-09-22T09:51:13.508468+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:51:13.508468+0000","last_undegraded":"2024-09-22T09:51:13.508468+0000","last_fullsized":"2024-09-22T09:51:13.508468+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:29.683561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6331018,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":1081,"num_write":998,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.171752+0000","last_change":"2024-09-22T08:42:15.432415+0000","last_active":"2024-09-22T09:50:21.171752+0000","last_peered":"2024-09-22T09:50:21.171752+0000","last_clean":"2024-09-22T09:50:21.171752+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:50:21.171752+0000","last_undegraded":"2024-09-22T09:50:21.171752+0000","last_fullsized":"2024-09-22T09:50:21.171752+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.375014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'203","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:58.564083+0000","last_change":"2024-09-22T08:42:13.415020+0000","last_active":"2024-09-22T09:53:58.564083+0000","last_peered":"2024-09-22T09:53:58.564083+0000","last_clean":"2024-09-22T09:53:58.564083+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:53:58.564083+0000","last_undegraded":"2024-09-22T09:53:58.564083+0000","last_fullsized":"2024-09-22T09:53:58.564083+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:27.087793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242932,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":6282,"num_write":913,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":681,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.669900+0000","last_change":"2024-09-22T08:42:15.432007+0000","last_active":"2024-09-22T09:50:22.669900+0000","last_peered":"2024-09-22T09:50:22.669900+0000","last_clean":"2024-09-22T09:50:22.669900+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:50:22.669900+0000","last_undegraded":"2024-09-22T09:50:22.669900+0000","last_fullsized":"2024-09-22T09:50:22.669900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:22.641506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'215","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671676+0000","last_change":"2024-09-22T08:42:13.406807+0000","last_active":"2024-09-22T09:49:47.671676+0000","last_peered":"2024-09-22T09:49:47.671676+0000","last_clean":"2024-09-22T09:49:47.671676+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:49:47.671676+0000","last_undegraded":"2024-09-22T09:49:47.671676+0000","last_fullsized":"2024-09-22T09:49:47.671676+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:01.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":688,"num_read_kb":1734,"num_write":930,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4552","reported_seq":5321,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556891+0000","last_change":"2024-09-22T08:42:15.421948+0000","last_active":"2024-09-22T09:51:02.556891+0000","last_peered":"2024-09-22T09:51:02.556891+0000","last_clean":"2024-09-22T09:51:02.556891+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:51:02.556891+0000","last_undegraded":"2024-09-22T09:51:02.556891+0000","last_fullsized":"2024-09-22T09:51:02.556891+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":3000,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:54.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'321","reported_seq":1024,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.765211+0000","last_change":"2024-09-22T08:42:13.413783+0000","last_active":"2024-09-22T09:52:19.765211+0000","last_peered":"2024-09-22T09:52:19.765211+0000","last_clean":"2024-09-22T09:52:19.765211+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:52:19.765211+0000","last_undegraded":"2024-09-22T09:52:19.765211+0000","last_fullsized":"2024-09-22T09:52:19.765211+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:22.263546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11561569,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":962,"num_read_kb":40392,"num_write":1275,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'116","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682868+0000","last_change":"2024-09-22T08:42:15.435779+0000","last_active":"2024-09-22T09:51:02.682868+0000","last_peered":"2024-09-22T09:51:02.682868+0000","last_clean":"2024-09-22T09:51:02.682868+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:51:02.682868+0000","last_undegraded":"2024-09-22T09:51:02.682868+0000","last_fullsized":"2024-09-22T09:51:02.682868+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:34.540861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'203","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.312026+0000","last_change":"2024-09-22T08:42:13.409600+0000","last_active":"2024-09-22T09:51:35.312026+0000","last_peered":"2024-09-22T09:51:35.312026+0000","last_clean":"2024-09-22T09:51:35.312026+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:51:35.312026+0000","last_undegraded":"2024-09-22T09:51:35.312026+0000","last_fullsized":"2024-09-22T09:51:35.312026+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:13:38.537153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459866,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":705,"num_read_kb":60138,"num_write":925,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.872378+0000","last_change":"2024-09-22T08:42:15.430810+0000","last_active":"2024-09-22T09:51:09.872378+0000","last_peered":"2024-09-22T09:51:09.872378+0000","last_clean":"2024-09-22T09:51:09.872378+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:51:09.872378+0000","last_undegraded":"2024-09-22T09:51:09.872378+0000","last_fullsized":"2024-09-22T09:51:09.872378+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:24.046046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547462+0000","last_change":"2024-09-22T08:42:15.423020+0000","last_active":"2024-09-22T09:49:57.547462+0000","last_peered":"2024-09-22T09:49:57.547462+0000","last_clean":"2024-09-22T09:49:57.547462+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:49:57.547462+0000","last_undegraded":"2024-09-22T09:49:57.547462+0000","last_fullsized":"2024-09-22T09:49:57.547462+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:37.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'215","reported_seq":848,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.795599+0000","last_change":"2024-09-22T08:42:13.423588+0000","last_active":"2024-09-22T09:51:09.795599+0000","last_peered":"2024-09-22T09:51:09.795599+0000","last_clean":"2024-09-22T09:51:09.795599+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:51:09.795599+0000","last_undegraded":"2024-09-22T09:51:09.795599+0000","last_fullsized":"2024-09-22T09:51:09.795599+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:30.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485787,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":599,"num_read_kb":44934,"num_write":914,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514762+0000","last_change":"2024-09-22T08:42:15.436779+0000","last_active":"2024-09-22T09:49:57.514762+0000","last_peered":"2024-09-22T09:49:57.514762+0000","last_clean":"2024-09-22T09:49:57.514762+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:49:57.514762+0000","last_undegraded":"2024-09-22T09:49:57.514762+0000","last_fullsized":"2024-09-22T09:49:57.514762+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:13.788611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'136","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.577926+0000","last_change":"2024-09-22T08:42:13.397442+0000","last_active":"2024-09-22T09:51:42.577926+0000","last_peered":"2024-09-22T09:51:42.577926+0000","last_clean":"2024-09-22T09:51:42.577926+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:51:42.577926+0000","last_undegraded":"2024-09-22T09:51:42.577926+0000","last_fullsized":"2024-09-22T09:51:42.577926+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242938,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":4340,"num_write":702,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:46.831407+0000","last_change":"2024-09-22T08:42:15.430118+0000","last_active":"2024-09-22T09:51:46.831407+0000","last_peered":"2024-09-22T09:51:46.831407+0000","last_clean":"2024-09-22T09:51:46.831407+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:51:46.831407+0000","last_undegraded":"2024-09-22T09:51:46.831407+0000","last_fullsized":"2024-09-22T09:51:46.831407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:28.368027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'197","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666687+0000","last_change":"2024-09-22T08:42:46.094591+0000","last_active":"2024-09-22T09:49:57.666687+0000","last_peered":"2024-09-22T09:49:57.666687+0000","last_clean":"2024-09-22T09:49:57.666687+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:49:57.666687+0000","last_undegraded":"2024-09-22T09:49:57.666687+0000","last_fullsized":"2024-09-22T09:49:57.666687+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:10.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569641,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":44793,"num_write":914,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'262","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:09.851927+0000","last_change":"2024-09-22T08:42:15.433496+0000","last_active":"2024-09-22T09:50:09.851927+0000","last_peered":"2024-09-22T09:50:09.851927+0000","last_clean":"2024-09-22T09:50:09.851927+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:50:09.851927+0000","last_undegraded":"2024-09-22T09:50:09.851927+0000","last_fullsized":"2024-09-22T09:50:09.851927+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:34.253039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'203","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547558+0000","last_change":"2024-09-22T08:42:13.419441+0000","last_active":"2024-09-22T09:49:57.547558+0000","last_peered":"2024-09-22T09:49:57.547558+0000","last_clean":"2024-09-22T09:49:57.547558+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:49:57.547558+0000","last_undegraded":"2024-09-22T09:49:57.547558+0000","last_fullsized":"2024-09-22T09:49:57.547558+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:02.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563032,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":761,"num_read_kb":637,"num_write":1011,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'334","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:56.563649+0000","last_change":"2024-09-22T08:42:15.431963+0000","last_active":"2024-09-22T09:51:56.563649+0000","last_peered":"2024-09-22T09:51:56.563649+0000","last_clean":"2024-09-22T09:51:56.563649+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:51:56.563649+0000","last_undegraded":"2024-09-22T09:51:56.563649+0000","last_fullsized":"2024-09-22T09:51:56.563649+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:19.216549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'227","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.016903+0000","last_change":"2024-09-22T08:42:13.415311+0000","last_active":"2024-09-22T09:52:32.016903+0000","last_peered":"2024-09-22T09:52:32.016903+0000","last_clean":"2024-09-22T09:52:32.016903+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:52:32.016903+0000","last_undegraded":"2024-09-22T09:52:32.016903+0000","last_fullsized":"2024-09-22T09:52:32.016903+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:24.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5258177,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":35016,"num_write":915,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'67","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547581+0000","last_change":"2024-09-22T08:42:15.436918+0000","last_active":"2024-09-22T09:49:57.547581+0000","last_peered":"2024-09-22T09:49:57.547581+0000","last_clean":"2024-09-22T09:49:57.547581+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:49:57.547581+0000","last_undegraded":"2024-09-22T09:49:57.547581+0000","last_fullsized":"2024-09-22T09:49:57.547581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:11.373207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'200","reported_seq":1063,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.503387+0000","last_change":"2024-09-22T08:42:13.420123+0000","last_active":"2024-09-22T09:50:50.503387+0000","last_peered":"2024-09-22T09:50:50.503387+0000","last_clean":"2024-09-22T09:50:50.503387+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:50:50.503387+0000","last_undegraded":"2024-09-22T09:50:50.503387+0000","last_fullsized":"2024-09-22T09:50:50.503387+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:04.931071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15751322,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":71433,"num_write":1016,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'127","reported_seq":637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.786070+0000","last_change":"2024-09-22T08:42:23.524985+0000","last_active":"2024-09-22T09:52:36.786070+0000","last_peered":"2024-09-22T09:52:36.786070+0000","last_clean":"2024-09-22T09:52:36.786070+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:52:36.786070+0000","last_undegraded":"2024-09-22T09:52:36.786070+0000","last_fullsized":"2024-09-22T09:52:36.786070+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:48.897187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655253+0000","last_change":"2024-09-22T08:42:15.440938+0000","last_active":"2024-09-22T09:50:07.655253+0000","last_peered":"2024-09-22T09:50:07.655253+0000","last_clean":"2024-09-22T09:50:07.655253+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:50:07.655253+0000","last_undegraded":"2024-09-22T09:50:07.655253+0000","last_fullsized":"2024-09-22T09:50:07.655253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:37.823594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'243","reported_seq":944,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514032+0000","last_change":"2024-09-22T08:42:13.421758+0000","last_active":"2024-09-22T09:49:52.514032+0000","last_peered":"2024-09-22T09:49:52.514032+0000","last_clean":"2024-09-22T09:49:52.514032+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:49:52.514032+0000","last_undegraded":"2024-09-22T09:49:52.514032+0000","last_fullsized":"2024-09-22T09:49:52.514032+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:55.196735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81664,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":75224,"num_write":1092,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673256+0000","last_change":"2024-09-22T08:42:17.436026+0000","last_active":"2024-09-22T09:49:57.673256+0000","last_peered":"2024-09-22T09:49:57.673256+0000","last_clean":"2024-09-22T09:49:57.673256+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:49:57.673256+0000","last_undegraded":"2024-09-22T09:49:57.673256+0000","last_fullsized":"2024-09-22T09:49:57.673256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:39.444676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'212","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.573790+0000","last_change":"2024-09-22T08:42:19.458164+0000","last_active":"2024-09-22T09:52:52.573790+0000","last_peered":"2024-09-22T09:52:52.573790+0000","last_clean":"2024-09-22T09:52:52.573790+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:52:52.573790+0000","last_undegraded":"2024-09-22T09:52:52.573790+0000","last_fullsized":"2024-09-22T09:52:52.573790+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:13.853175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15363,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":282,"num_read_kb":359,"num_write":168,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515692+0000","last_change":"2024-09-22T08:42:21.476835+0000","last_active":"2024-09-22T09:50:02.515692+0000","last_peered":"2024-09-22T09:50:02.515692+0000","last_clean":"2024-09-22T09:50:02.515692+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:50:02.515692+0000","last_undegraded":"2024-09-22T09:50:02.515692+0000","last_fullsized":"2024-09-22T09:50:02.515692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:23.164486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'141","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.326568+0000","last_change":"2024-09-22T08:42:23.525612+0000","last_active":"2024-09-22T09:51:11.326568+0000","last_peered":"2024-09-22T09:51:11.326568+0000","last_clean":"2024-09-22T09:51:11.326568+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:51:11.326568+0000","last_undegraded":"2024-09-22T09:51:11.326568+0000","last_fullsized":"2024-09-22T09:51:11.326568+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:43.028034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673203+0000","last_change":"2024-09-22T08:42:15.433777+0000","last_active":"2024-09-22T09:49:57.673203+0000","last_peered":"2024-09-22T09:49:57.673203+0000","last_clean":"2024-09-22T09:49:57.673203+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:49:57.673203+0000","last_undegraded":"2024-09-22T09:49:57.673203+0000","last_fullsized":"2024-09-22T09:49:57.673203+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:47.845777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'198","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.654080+0000","last_change":"2024-09-22T08:42:13.409995+0000","last_active":"2024-09-22T09:49:57.654080+0000","last_peered":"2024-09-22T09:49:57.654080+0000","last_clean":"2024-09-22T09:49:57.654080+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:49:57.654080+0000","last_undegraded":"2024-09-22T09:49:57.654080+0000","last_fullsized":"2024-09-22T09:49:57.654080+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:32.859795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110244,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":43802,"num_write":906,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655271+0000","last_change":"2024-09-22T08:42:17.438392+0000","last_active":"2024-09-22T09:50:07.655271+0000","last_peered":"2024-09-22T09:50:07.655271+0000","last_clean":"2024-09-22T09:50:07.655271+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:50:07.655271+0000","last_undegraded":"2024-09-22T09:50:07.655271+0000","last_fullsized":"2024-09-22T09:50:07.655271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:33.187002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'99","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.845043+0000","last_change":"2024-09-22T08:42:19.453384+0000","last_active":"2024-09-22T09:52:52.845043+0000","last_peered":"2024-09-22T09:52:52.845043+0000","last_clean":"2024-09-22T09:52:52.845043+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:52:52.845043+0000","last_undegraded":"2024-09-22T09:52:52.845043+0000","last_fullsized":"2024-09-22T09:52:52.845043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:58.602109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.548236+0000","last_change":"2024-09-22T08:42:21.479500+0000","last_active":"2024-09-22T09:50:02.548236+0000","last_peered":"2024-09-22T09:50:02.548236+0000","last_clean":"2024-09-22T09:50:02.548236+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:50:02.548236+0000","last_undegraded":"2024-09-22T09:50:02.548236+0000","last_fullsized":"2024-09-22T09:50:02.548236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:12.904978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'108","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.888189+0000","last_change":"2024-09-22T08:42:23.524672+0000","last_active":"2024-09-22T09:51:39.888189+0000","last_peered":"2024-09-22T09:51:39.888189+0000","last_clean":"2024-09-22T09:51:39.888189+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:51:39.888189+0000","last_undegraded":"2024-09-22T09:51:39.888189+0000","last_fullsized":"2024-09-22T09:51:39.888189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:49.539509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":746,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.900800+0000","last_change":"2024-09-22T08:42:15.431967+0000","last_active":"2024-09-22T09:51:39.900800+0000","last_peered":"2024-09-22T09:51:39.900800+0000","last_clean":"2024-09-22T09:51:39.900800+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:51:39.900800+0000","last_undegraded":"2024-09-22T09:51:39.900800+0000","last_fullsized":"2024-09-22T09:51:39.900800+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:21.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'242","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.690577+0000","last_change":"2024-09-22T08:42:46.096752+0000","last_active":"2024-09-22T09:50:27.690577+0000","last_peered":"2024-09-22T09:50:27.690577+0000","last_clean":"2024-09-22T09:50:27.690577+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:50:27.690577+0000","last_undegraded":"2024-09-22T09:50:27.690577+0000","last_fullsized":"2024-09-22T09:50:27.690577+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:52.050611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26247569,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":41488,"num_write":1118,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"36'4","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.244745+0000","last_change":"2024-09-22T08:42:17.436896+0000","last_active":"2024-09-22T09:54:00.244745+0000","last_peered":"2024-09-22T09:54:00.244745+0000","last_clean":"2024-09-22T09:54:00.244745+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:00.244745+0000","last_undegraded":"2024-09-22T09:54:00.244745+0000","last_fullsized":"2024-09-22T09:54:00.244745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:50.909668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'142","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.882035+0000","last_change":"2024-09-22T08:42:19.453227+0000","last_active":"2024-09-22T09:52:52.882035+0000","last_peered":"2024-09-22T09:52:52.882035+0000","last_clean":"2024-09-22T09:52:52.882035+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:52:52.882035+0000","last_undegraded":"2024-09-22T09:52:52.882035+0000","last_fullsized":"2024-09-22T09:52:52.882035+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.144959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'743","reported_seq":2932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790557+0000","last_change":"2024-09-22T08:42:21.477386+0000","last_active":"2024-09-22T09:54:03.790557+0000","last_peered":"2024-09-22T09:54:03.790557+0000","last_clean":"2024-09-22T09:54:03.790557+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:03.790557+0000","last_undegraded":"2024-09-22T09:54:03.790557+0000","last_fullsized":"2024-09-22T09:54:03.790557+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:26.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'218","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.675764+0000","last_change":"2024-09-22T08:42:23.578386+0000","last_active":"2024-09-22T09:52:36.675764+0000","last_peered":"2024-09-22T09:52:36.675764+0000","last_clean":"2024-09-22T09:52:36.675764+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:52:36.675764+0000","last_undegraded":"2024-09-22T09:52:36.675764+0000","last_fullsized":"2024-09-22T09:52:36.675764+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:30.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.329583+0000","last_change":"2024-09-22T08:42:15.435930+0000","last_active":"2024-09-22T09:50:15.329583+0000","last_peered":"2024-09-22T09:50:15.329583+0000","last_clean":"2024-09-22T09:50:15.329583+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:50:15.329583+0000","last_undegraded":"2024-09-22T09:50:15.329583+0000","last_fullsized":"2024-09-22T09:50:15.329583+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:06.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'173","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666614+0000","last_change":"2024-09-22T08:42:13.400466+0000","last_active":"2024-09-22T09:49:57.666614+0000","last_peered":"2024-09-22T09:49:57.666614+0000","last_clean":"2024-09-22T09:49:57.666614+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:49:57.666614+0000","last_undegraded":"2024-09-22T09:49:57.666614+0000","last_fullsized":"2024-09-22T09:49:57.666614+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:24.218589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11590790,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":536,"num_read_kb":49818,"num_write":841,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673308+0000","last_change":"2024-09-22T08:42:17.435623+0000","last_active":"2024-09-22T09:49:57.673308+0000","last_peered":"2024-09-22T09:49:57.673308+0000","last_clean":"2024-09-22T09:49:57.673308+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:49:57.673308+0000","last_undegraded":"2024-09-22T09:49:57.673308+0000","last_fullsized":"2024-09-22T09:49:57.673308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:28.519736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'146","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.887895+0000","last_change":"2024-09-22T08:42:19.456582+0000","last_active":"2024-09-22T09:52:52.887895+0000","last_peered":"2024-09-22T09:52:52.887895+0000","last_clean":"2024-09-22T09:52:52.887895+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:52:52.887895+0000","last_undegraded":"2024-09-22T09:52:52.887895+0000","last_fullsized":"2024-09-22T09:52:52.887895+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:38.574953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":189,"num_read_kb":255,"num_write":106,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'752","reported_seq":2397,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782892+0000","last_change":"2024-09-22T08:42:21.478967+0000","last_active":"2024-09-22T09:54:03.782892+0000","last_peered":"2024-09-22T09:54:03.782892+0000","last_clean":"2024-09-22T09:54:03.782892+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:03.782892+0000","last_undegraded":"2024-09-22T09:54:03.782892+0000","last_fullsized":"2024-09-22T09:54:03.782892+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:49.086596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687895+0000","last_change":"2024-09-22T08:42:15.434568+0000","last_active":"2024-09-22T09:51:37.687895+0000","last_peered":"2024-09-22T09:51:37.687895+0000","last_clean":"2024-09-22T09:51:37.687895+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:51:37.687895+0000","last_undegraded":"2024-09-22T09:51:37.687895+0000","last_fullsized":"2024-09-22T09:51:37.687895+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:47.411833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'186","reported_seq":806,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:06.030411+0000","last_change":"2024-09-22T08:42:46.096820+0000","last_active":"2024-09-22T09:51:06.030411+0000","last_peered":"2024-09-22T09:51:06.030411+0000","last_clean":"2024-09-22T09:51:06.030411+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:51:06.030411+0000","last_undegraded":"2024-09-22T09:51:06.030411+0000","last_fullsized":"2024-09-22T09:51:06.030411+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:26.829701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5318948,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":37265,"num_write":896,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.530209+0000","last_change":"2024-09-22T08:42:17.428741+0000","last_active":"2024-09-22T09:51:37.530209+0000","last_peered":"2024-09-22T09:51:37.530209+0000","last_clean":"2024-09-22T09:51:37.530209+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:51:37.530209+0000","last_undegraded":"2024-09-22T09:51:37.530209+0000","last_fullsized":"2024-09-22T09:51:37.530209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.400097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'248","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.707978+0000","last_change":"2024-09-22T08:42:19.453085+0000","last_active":"2024-09-22T09:53:57.707978+0000","last_peered":"2024-09-22T09:53:57.707978+0000","last_clean":"2024-09-22T09:53:57.707978+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:53:57.707978+0000","last_undegraded":"2024-09-22T09:53:57.707978+0000","last_fullsized":"2024-09-22T09:53:57.707978+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:18.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12768,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":346,"num_read_kb":397,"num_write":206,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426203+0000","last_change":"2024-09-22T08:42:21.473910+0000","last_active":"2024-09-22T09:49:52.426203+0000","last_peered":"2024-09-22T09:49:52.426203+0000","last_clean":"2024-09-22T09:49:52.426203+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:49:52.426203+0000","last_undegraded":"2024-09-22T09:49:52.426203+0000","last_fullsized":"2024-09-22T09:49:52.426203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:39.543682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'582","reported_seq":1405,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.730090+0000","last_change":"2024-09-22T08:42:23.524686+0000","last_active":"2024-09-22T09:54:00.730090+0000","last_peered":"2024-09-22T09:54:00.730090+0000","last_clean":"2024-09-22T09:54:00.730090+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:00.730090+0000","last_undegraded":"2024-09-22T09:54:00.730090+0000","last_fullsized":"2024-09-22T09:54:00.730090+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:20.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.561618+0000","last_change":"2024-09-22T08:42:15.437596+0000","last_active":"2024-09-22T09:51:37.561618+0000","last_peered":"2024-09-22T09:51:37.561618+0000","last_clean":"2024-09-22T09:51:37.561618+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:51:37.561618+0000","last_undegraded":"2024-09-22T09:51:37.561618+0000","last_fullsized":"2024-09-22T09:51:37.561618+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:39.538847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'225","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533591+0000","last_change":"2024-09-22T08:42:13.415541+0000","last_active":"2024-09-22T09:51:57.533591+0000","last_peered":"2024-09-22T09:51:57.533591+0000","last_clean":"2024-09-22T09:51:57.533591+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:51:57.533591+0000","last_undegraded":"2024-09-22T09:51:57.533591+0000","last_fullsized":"2024-09-22T09:51:57.533591+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:48:38.008511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11135054,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":642,"num_read_kb":43078,"num_write":992,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697218+0000","last_change":"2024-09-22T08:42:17.437870+0000","last_active":"2024-09-22T09:51:37.697218+0000","last_peered":"2024-09-22T09:51:37.697218+0000","last_clean":"2024-09-22T09:51:37.697218+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:51:37.697218+0000","last_undegraded":"2024-09-22T09:51:37.697218+0000","last_fullsized":"2024-09-22T09:51:37.697218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:56.092607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'148","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.869599+0000","last_change":"2024-09-22T08:42:19.453046+0000","last_active":"2024-09-22T09:52:52.869599+0000","last_peered":"2024-09-22T09:52:52.869599+0000","last_clean":"2024-09-22T09:52:52.869599+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:52:52.869599+0000","last_undegraded":"2024-09-22T09:52:52.869599+0000","last_fullsized":"2024-09-22T09:52:52.869599+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:19.048949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":209,"num_write":100,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2542","reported_seq":4378,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.695093+0000","last_change":"2024-09-22T08:42:23.525193+0000","last_active":"2024-09-22T09:53:22.695093+0000","last_peered":"2024-09-22T09:53:22.695093+0000","last_clean":"2024-09-22T09:53:22.695093+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:53:22.695093+0000","last_undegraded":"2024-09-22T09:53:22.695093+0000","last_fullsized":"2024-09-22T09:53:22.695093+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:05.078232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1200,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681284+0000","last_change":"2024-09-22T08:42:15.439516+0000","last_active":"2024-09-22T09:51:42.681284+0000","last_peered":"2024-09-22T09:51:42.681284+0000","last_clean":"2024-09-22T09:51:42.681284+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:51:42.681284+0000","last_undegraded":"2024-09-22T09:51:42.681284+0000","last_fullsized":"2024-09-22T09:51:42.681284+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:06.792912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'237","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.533551+0000","last_change":"2024-09-22T08:42:13.422752+0000","last_active":"2024-09-22T09:51:57.533551+0000","last_peered":"2024-09-22T09:51:57.533551+0000","last_clean":"2024-09-22T09:51:57.533551+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:51:57.533551+0000","last_undegraded":"2024-09-22T09:51:57.533551+0000","last_fullsized":"2024-09-22T09:51:57.533551+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.596026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16090748,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":591,"num_read_kb":17575,"num_write":1014,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686455+0000","last_change":"2024-09-22T08:42:17.437867+0000","last_active":"2024-09-22T09:49:47.686455+0000","last_peered":"2024-09-22T09:49:47.686455+0000","last_clean":"2024-09-22T09:49:47.686455+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:49:47.686455+0000","last_undegraded":"2024-09-22T09:49:47.686455+0000","last_fullsized":"2024-09-22T09:49:47.686455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:57.450851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'194","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.550842+0000","last_change":"2024-09-22T08:42:19.455781+0000","last_active":"2024-09-22T09:53:52.550842+0000","last_peered":"2024-09-22T09:53:52.550842+0000","last_clean":"2024-09-22T09:53:52.550842+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:53:52.550842+0000","last_undegraded":"2024-09-22T09:53:52.550842+0000","last_fullsized":"2024-09-22T09:53:52.550842+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:37:46.879916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10697,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":313,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'755","reported_seq":2721,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782626+0000","last_change":"2024-09-22T08:42:21.480118+0000","last_active":"2024-09-22T09:54:03.782626+0000","last_peered":"2024-09-22T09:54:03.782626+0000","last_clean":"2024-09-22T09:54:03.782626+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:03.782626+0000","last_undegraded":"2024-09-22T09:54:03.782626+0000","last_fullsized":"2024-09-22T09:54:03.782626+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:26.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'119","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.314868+0000","last_change":"2024-09-22T08:42:23.527331+0000","last_active":"2024-09-22T09:53:59.314868+0000","last_peered":"2024-09-22T09:53:59.314868+0000","last_clean":"2024-09-22T09:53:59.314868+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:53:59.314868+0000","last_undegraded":"2024-09-22T09:53:59.314868+0000","last_fullsized":"2024-09-22T09:53:59.314868+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:06.830634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":883,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:13.581065+0000","last_change":"2024-09-22T08:42:15.435714+0000","last_active":"2024-09-22T09:51:13.581065+0000","last_peered":"2024-09-22T09:51:13.581065+0000","last_clean":"2024-09-22T09:51:13.581065+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:51:13.581065+0000","last_undegraded":"2024-09-22T09:51:13.581065+0000","last_fullsized":"2024-09-22T09:51:13.581065+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:25.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'206","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671732+0000","last_change":"2024-09-22T08:42:13.403452+0000","last_active":"2024-09-22T09:49:47.671732+0000","last_peered":"2024-09-22T09:49:47.671732+0000","last_clean":"2024-09-22T09:49:47.671732+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:49:47.671732+0000","last_undegraded":"2024-09-22T09:49:47.671732+0000","last_fullsized":"2024-09-22T09:49:47.671732+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:14.603364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299561,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":60855,"num_write":911,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697795+0000","last_change":"2024-09-22T08:42:17.435826+0000","last_active":"2024-09-22T09:51:42.697795+0000","last_peered":"2024-09-22T09:51:42.697795+0000","last_clean":"2024-09-22T09:51:42.697795+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:51:42.697795+0000","last_undegraded":"2024-09-22T09:51:42.697795+0000","last_fullsized":"2024-09-22T09:51:42.697795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:56.041489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'196","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.695871+0000","last_change":"2024-09-22T08:42:19.452009+0000","last_active":"2024-09-22T09:54:00.695871+0000","last_peered":"2024-09-22T09:54:00.695871+0000","last_clean":"2024-09-22T09:54:00.695871+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:00.695871+0000","last_undegraded":"2024-09-22T09:54:00.695871+0000","last_fullsized":"2024-09-22T09:54:00.695871+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:46.201887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":279,"num_read_kb":351,"num_write":136,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697752+0000","last_change":"2024-09-22T08:42:21.479365+0000","last_active":"2024-09-22T09:51:42.697752+0000","last_peered":"2024-09-22T09:51:42.697752+0000","last_clean":"2024-09-22T09:51:42.697752+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:51:42.697752+0000","last_undegraded":"2024-09-22T09:51:42.697752+0000","last_fullsized":"2024-09-22T09:51:42.697752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.054664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'142","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.315438+0000","last_change":"2024-09-22T08:42:23.525367+0000","last_active":"2024-09-22T09:53:59.315438+0000","last_peered":"2024-09-22T09:53:59.315438+0000","last_clean":"2024-09-22T09:53:59.315438+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:53:59.315438+0000","last_undegraded":"2024-09-22T09:53:59.315438+0000","last_fullsized":"2024-09-22T09:53:59.315438+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:24.183213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":700,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545943+0000","last_change":"2024-09-22T08:42:15.430534+0000","last_active":"2024-09-22T09:49:47.545943+0000","last_peered":"2024-09-22T09:49:47.545943+0000","last_clean":"2024-09-22T09:49:47.545943+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:49:47.545943+0000","last_undegraded":"2024-09-22T09:49:47.545943+0000","last_fullsized":"2024-09-22T09:49:47.545943+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:45.930207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'363","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:51.846880+0000","last_change":"2024-09-22T08:42:13.401775+0000","last_active":"2024-09-22T09:53:51.846880+0000","last_peered":"2024-09-22T09:53:51.846880+0000","last_clean":"2024-09-22T09:53:51.846880+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:53:51.846880+0000","last_undegraded":"2024-09-22T09:53:51.846880+0000","last_fullsized":"2024-09-22T09:53:51.846880+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:19.013414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31394,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1016,"num_read_kb":7434,"num_write":1384,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686491+0000","last_change":"2024-09-22T08:42:17.438355+0000","last_active":"2024-09-22T09:49:47.686491+0000","last_peered":"2024-09-22T09:49:47.686491+0000","last_clean":"2024-09-22T09:49:47.686491+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:49:47.686491+0000","last_undegraded":"2024-09-22T09:49:47.686491+0000","last_fullsized":"2024-09-22T09:49:47.686491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.597938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'162","reported_seq":748,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.912530+0000","last_change":"2024-09-22T08:42:19.454917+0000","last_active":"2024-09-22T09:52:52.912530+0000","last_peered":"2024-09-22T09:52:52.912530+0000","last_clean":"2024-09-22T09:52:52.912530+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:52:52.912530+0000","last_undegraded":"2024-09-22T09:52:52.912530+0000","last_fullsized":"2024-09-22T09:52:52.912530+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:48.566070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7797,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":251,"num_write":178,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654973+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:50:02.654973+0000","last_peered":"2024-09-22T09:50:02.654973+0000","last_clean":"2024-09-22T09:50:02.654973+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:50:02.654973+0000","last_undegraded":"2024-09-22T09:50:02.654973+0000","last_fullsized":"2024-09-22T09:50:02.654973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:44.790859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674614+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:52:37.674614+0000","last_peered":"2024-09-22T09:52:37.674614+0000","last_clean":"2024-09-22T09:52:37.674614+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:52:37.674614+0000","last_undegraded":"2024-09-22T09:52:37.674614+0000","last_fullsized":"2024-09-22T09:52:37.674614+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:23.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.083868+0000","last_change":"2024-09-22T08:42:15.429567+0000","last_active":"2024-09-22T09:52:32.083868+0000","last_peered":"2024-09-22T09:52:32.083868+0000","last_clean":"2024-09-22T09:52:32.083868+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:52:32.083868+0000","last_undegraded":"2024-09-22T09:52:32.083868+0000","last_fullsized":"2024-09-22T09:52:32.083868+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:58.301320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'231","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:19.767112+0000","last_change":"2024-09-22T08:42:13.403639+0000","last_active":"2024-09-22T09:52:19.767112+0000","last_peered":"2024-09-22T09:52:19.767112+0000","last_clean":"2024-09-22T09:52:19.767112+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:52:19.767112+0000","last_undegraded":"2024-09-22T09:52:19.767112+0000","last_fullsized":"2024-09-22T09:52:19.767112+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:45.735642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22046937,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":761,"num_read_kb":42930,"num_write":1120,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425560+0000","last_change":"2024-09-22T08:42:17.436642+0000","last_active":"2024-09-22T09:49:47.425560+0000","last_peered":"2024-09-22T09:49:47.425560+0000","last_clean":"2024-09-22T09:49:47.425560+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:49:47.425560+0000","last_undegraded":"2024-09-22T09:49:47.425560+0000","last_fullsized":"2024-09-22T09:49:47.425560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:56.592253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'190","reported_seq":790,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.960456+0000","last_change":"2024-09-22T08:42:19.451872+0000","last_active":"2024-09-22T09:52:52.960456+0000","last_peered":"2024-09-22T09:52:52.960456+0000","last_clean":"2024-09-22T09:52:52.960456+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:52:52.960456+0000","last_undegraded":"2024-09-22T09:52:52.960456+0000","last_fullsized":"2024-09-22T09:52:52.960456+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:10.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":249,"num_read_kb":310,"num_write":142,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'718","reported_seq":2491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.783109+0000","last_change":"2024-09-22T08:42:21.477749+0000","last_active":"2024-09-22T09:54:03.783109+0000","last_peered":"2024-09-22T09:54:03.783109+0000","last_clean":"2024-09-22T09:54:03.783109+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:03.783109+0000","last_undegraded":"2024-09-22T09:54:03.783109+0000","last_fullsized":"2024-09-22T09:54:03.783109+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:54:39.808571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'139","reported_seq":639,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:34.236678+0000","last_change":"2024-09-22T08:42:23.527200+0000","last_active":"2024-09-22T09:52:34.236678+0000","last_peered":"2024-09-22T09:52:34.236678+0000","last_clean":"2024-09-22T09:52:34.236678+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:52:34.236678+0000","last_undegraded":"2024-09-22T09:52:34.236678+0000","last_fullsized":"2024-09-22T09:52:34.236678+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:36.368516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":722,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:50.583270+0000","last_change":"2024-09-22T08:42:15.434596+0000","last_active":"2024-09-22T09:50:50.583270+0000","last_peered":"2024-09-22T09:50:50.583270+0000","last_clean":"2024-09-22T09:50:50.583270+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:50:50.583270+0000","last_undegraded":"2024-09-22T09:50:50.583270+0000","last_fullsized":"2024-09-22T09:50:50.583270+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:08.897077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'256","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653785+0000","last_change":"2024-09-22T08:42:46.165164+0000","last_active":"2024-09-22T09:49:57.653785+0000","last_peered":"2024-09-22T09:49:57.653785+0000","last_clean":"2024-09-22T09:49:57.653785+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:49:57.653785+0000","last_undegraded":"2024-09-22T09:49:57.653785+0000","last_fullsized":"2024-09-22T09:49:57.653785+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:28.663766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485776,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1201,"num_read_kb":6055,"num_write":1101,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1448,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.257154+0000","last_change":"2024-09-22T08:42:17.433014+0000","last_active":"2024-09-22T09:54:00.257154+0000","last_peered":"2024-09-22T09:54:00.257154+0000","last_clean":"2024-09-22T09:54:00.257154+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:00.257154+0000","last_undegraded":"2024-09-22T09:54:00.257154+0000","last_fullsized":"2024-09-22T09:54:00.257154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:41.112528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'132","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.816417+0000","last_change":"2024-09-22T08:42:19.457240+0000","last_active":"2024-09-22T09:52:52.816417+0000","last_peered":"2024-09-22T09:52:52.816417+0000","last_clean":"2024-09-22T09:52:52.816417+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:52:52.816417+0000","last_undegraded":"2024-09-22T09:52:52.816417+0000","last_fullsized":"2024-09-22T09:52:52.816417+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:43.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'754","reported_seq":2727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790782+0000","last_change":"2024-09-22T08:42:21.479394+0000","last_active":"2024-09-22T09:54:03.790782+0000","last_peered":"2024-09-22T09:54:03.790782+0000","last_clean":"2024-09-22T09:54:03.790782+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:03.790782+0000","last_undegraded":"2024-09-22T09:54:03.790782+0000","last_fullsized":"2024-09-22T09:54:03.790782+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:36.701700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'118","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558129+0000","last_change":"2024-09-22T08:42:23.526928+0000","last_active":"2024-09-22T09:51:12.558129+0000","last_peered":"2024-09-22T09:51:12.558129+0000","last_clean":"2024-09-22T09:51:12.558129+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:51:12.558129+0000","last_undegraded":"2024-09-22T09:51:12.558129+0000","last_fullsized":"2024-09-22T09:51:12.558129+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:16.995273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.427871+0000","last_change":"2024-09-22T08:42:15.434196+0000","last_active":"2024-09-22T09:50:07.427871+0000","last_peered":"2024-09-22T09:50:07.427871+0000","last_clean":"2024-09-22T09:50:07.427871+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:50:07.427871+0000","last_undegraded":"2024-09-22T09:50:07.427871+0000","last_fullsized":"2024-09-22T09:50:07.427871+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:29.967093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'182","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.665992+0000","last_change":"2024-09-22T08:42:13.403505+0000","last_active":"2024-09-22T09:51:32.665992+0000","last_peered":"2024-09-22T09:51:32.665992+0000","last_clean":"2024-09-22T09:51:32.665992+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:51:32.665992+0000","last_undegraded":"2024-09-22T09:51:32.665992+0000","last_fullsized":"2024-09-22T09:51:32.665992+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:50:46.095633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14980326,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":701,"num_read_kb":142631,"num_write":841,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545984+0000","last_change":"2024-09-22T08:42:17.428207+0000","last_active":"2024-09-22T09:49:47.545984+0000","last_peered":"2024-09-22T09:49:47.545984+0000","last_clean":"2024-09-22T09:49:47.545984+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:49:47.545984+0000","last_undegraded":"2024-09-22T09:49:47.545984+0000","last_fullsized":"2024-09-22T09:49:47.545984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:36.330654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'219","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.907443+0000","last_change":"2024-09-22T08:42:19.459817+0000","last_active":"2024-09-22T09:52:52.907443+0000","last_peered":"2024-09-22T09:52:52.907443+0000","last_clean":"2024-09-22T09:52:52.907443+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:52:52.907443+0000","last_undegraded":"2024-09-22T09:52:52.907443+0000","last_fullsized":"2024-09-22T09:52:52.907443+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:06.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":313,"num_read_kb":355,"num_write":182,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.666030+0000","last_change":"2024-09-22T08:42:21.481035+0000","last_active":"2024-09-22T09:49:52.666030+0000","last_peered":"2024-09-22T09:49:52.666030+0000","last_clean":"2024-09-22T09:49:52.666030+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:49:52.666030+0000","last_undegraded":"2024-09-22T09:49:52.666030+0000","last_fullsized":"2024-09-22T09:49:52.666030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:13.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'130","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.452137+0000","last_change":"2024-09-22T08:42:23.529103+0000","last_active":"2024-09-22T09:51:48.452137+0000","last_peered":"2024-09-22T09:51:48.452137+0000","last_clean":"2024-09-22T09:51:48.452137+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:51:48.452137+0000","last_undegraded":"2024-09-22T09:51:48.452137+0000","last_fullsized":"2024-09-22T09:51:48.452137+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:43.270586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676034+0000","last_change":"2024-09-22T08:42:15.435903+0000","last_active":"2024-09-22T09:51:07.676034+0000","last_peered":"2024-09-22T09:51:07.676034+0000","last_clean":"2024-09-22T09:51:07.676034+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:51:07.676034+0000","last_undegraded":"2024-09-22T09:51:07.676034+0000","last_fullsized":"2024-09-22T09:51:07.676034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:50.676641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.535997+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T09:52:12.535997+0000","last_peered":"2024-09-22T09:52:12.535997+0000","last_clean":"2024-09-22T09:52:12.535997+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:52:12.535997+0000","last_undegraded":"2024-09-22T09:52:12.535997+0000","last_fullsized":"2024-09-22T09:52:12.535997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680619+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T09:50:47.680619+0000","last_peered":"2024-09-22T09:50:47.680619+0000","last_clean":"2024-09-22T09:50:47.680619+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:50:47.680619+0000","last_undegraded":"2024-09-22T09:50:47.680619+0000","last_fullsized":"2024-09-22T09:50:47.680619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'251","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661666+0000","last_change":"2024-09-22T08:42:46.093573+0000","last_active":"2024-09-22T09:50:57.661666+0000","last_peered":"2024-09-22T09:50:57.661666+0000","last_clean":"2024-09-22T09:50:57.661666+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:50:57.661666+0000","last_undegraded":"2024-09-22T09:50:57.661666+0000","last_fullsized":"2024-09-22T09:50:57.661666+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:55.591787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6682307,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":661,"num_read_kb":19728,"num_write":1077,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524909+0000","last_change":"2024-09-22T08:42:17.430962+0000","last_active":"2024-09-22T09:51:02.524909+0000","last_peered":"2024-09-22T09:51:02.524909+0000","last_clean":"2024-09-22T09:51:02.524909+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:51:02.524909+0000","last_undegraded":"2024-09-22T09:51:02.524909+0000","last_fullsized":"2024-09-22T09:51:02.524909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:38.741426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'310","reported_seq":1011,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.713968+0000","last_change":"2024-09-22T08:42:19.458458+0000","last_active":"2024-09-22T09:54:00.713968+0000","last_peered":"2024-09-22T09:54:00.713968+0000","last_clean":"2024-09-22T09:54:00.713968+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:00.713968+0000","last_undegraded":"2024-09-22T09:54:00.713968+0000","last_fullsized":"2024-09-22T09:54:00.713968+0000","mapping_epoch":30,"log_start":"259'200","ondisk_log_start":"259'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:21.464285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":547,"num_read_kb":700,"num_write":484,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.668007+0000","last_change":"2024-09-22T08:42:21.476608+0000","last_active":"2024-09-22T09:51:42.668007+0000","last_peered":"2024-09-22T09:51:42.668007+0000","last_clean":"2024-09-22T09:51:42.668007+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:51:42.668007+0000","last_undegraded":"2024-09-22T09:51:42.668007+0000","last_fullsized":"2024-09-22T09:51:42.668007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:00.388229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'205","reported_seq":913,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.706774+0000","last_change":"2024-09-22T08:42:23.527973+0000","last_active":"2024-09-22T09:52:36.706774+0000","last_peered":"2024-09-22T09:52:36.706774+0000","last_clean":"2024-09-22T09:52:36.706774+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:52:36.706774+0000","last_undegraded":"2024-09-22T09:52:36.706774+0000","last_fullsized":"2024-09-22T09:52:36.706774+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:38.241959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'136","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667317+0000","last_change":"2024-09-22T08:42:46.096326+0000","last_active":"2024-09-22T09:51:37.667317+0000","last_peered":"2024-09-22T09:51:37.667317+0000","last_clean":"2024-09-22T09:51:37.667317+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:51:37.667317+0000","last_undegraded":"2024-09-22T09:51:37.667317+0000","last_fullsized":"2024-09-22T09:51:37.667317+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:21.464651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.517955+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T09:50:17.517955+0000","last_peered":"2024-09-22T09:50:17.517955+0000","last_clean":"2024-09-22T09:50:17.517955+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:50:17.517955+0000","last_undegraded":"2024-09-22T09:50:17.517955+0000","last_fullsized":"2024-09-22T09:50:17.517955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'208","reported_seq":909,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662541+0000","last_change":"2024-09-22T08:42:13.420863+0000","last_active":"2024-09-22T09:51:02.662541+0000","last_peered":"2024-09-22T09:51:02.662541+0000","last_clean":"2024-09-22T09:51:02.662541+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:51:02.662541+0000","last_undegraded":"2024-09-22T09:51:02.662541+0000","last_fullsized":"2024-09-22T09:51:02.662541+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:47.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294213,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":798,"num_read_kb":134895,"num_write":906,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.688003+0000","last_change":"2024-09-22T08:42:17.440799+0000","last_active":"2024-09-22T09:51:37.688003+0000","last_peered":"2024-09-22T09:51:37.688003+0000","last_clean":"2024-09-22T09:51:37.688003+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:51:37.688003+0000","last_undegraded":"2024-09-22T09:51:37.688003+0000","last_fullsized":"2024-09-22T09:51:37.688003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:27.078620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'886","reported_seq":2685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.768544+0000","last_change":"2024-09-22T08:42:19.455687+0000","last_active":"2024-09-22T09:54:03.768544+0000","last_peered":"2024-09-22T09:54:03.768544+0000","last_clean":"2024-09-22T09:54:03.768544+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:03.768544+0000","last_undegraded":"2024-09-22T09:54:03.768544+0000","last_fullsized":"2024-09-22T09:54:03.768544+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":801,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.282664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1245,"num_read_kb":1438,"num_write":372,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.527988+0000","last_change":"2024-09-22T08:42:21.476397+0000","last_active":"2024-09-22T09:51:22.527988+0000","last_peered":"2024-09-22T09:51:22.527988+0000","last_clean":"2024-09-22T09:51:22.527988+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:51:22.527988+0000","last_undegraded":"2024-09-22T09:51:22.527988+0000","last_fullsized":"2024-09-22T09:51:22.527988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:11.328442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'234","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.082338+0000","last_change":"2024-09-22T08:42:23.576879+0000","last_active":"2024-09-22T09:50:32.082338+0000","last_peered":"2024-09-22T09:50:32.082338+0000","last_clean":"2024-09-22T09:50:32.082338+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:50:32.082338+0000","last_undegraded":"2024-09-22T09:50:32.082338+0000","last_fullsized":"2024-09-22T09:50:32.082338+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:21.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438071+0000","last_change":"2024-09-22T08:42:15.437627+0000","last_active":"2024-09-22T09:51:37.438071+0000","last_peered":"2024-09-22T09:51:37.438071+0000","last_clean":"2024-09-22T09:51:37.438071+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:51:37.438071+0000","last_undegraded":"2024-09-22T09:51:37.438071+0000","last_fullsized":"2024-09-22T09:51:37.438071+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:22.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.692480+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T09:50:47.692480+0000","last_peered":"2024-09-22T09:50:47.692480+0000","last_clean":"2024-09-22T09:50:47.692480+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:50:47.692480+0000","last_undegraded":"2024-09-22T09:50:47.692480+0000","last_fullsized":"2024-09-22T09:50:47.692480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'194","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430645+0000","last_change":"2024-09-22T08:42:13.407521+0000","last_active":"2024-09-22T09:50:32.430645+0000","last_peered":"2024-09-22T09:50:32.430645+0000","last_clean":"2024-09-22T09:50:32.430645+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:50:32.430645+0000","last_undegraded":"2024-09-22T09:50:32.430645+0000","last_fullsized":"2024-09-22T09:50:32.430645+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:16.981459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10546972,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":559,"num_read_kb":19334,"num_write":880,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697276+0000","last_change":"2024-09-22T08:42:17.436489+0000","last_active":"2024-09-22T09:51:37.697276+0000","last_peered":"2024-09-22T09:51:37.697276+0000","last_clean":"2024-09-22T09:51:37.697276+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:51:37.697276+0000","last_undegraded":"2024-09-22T09:51:37.697276+0000","last_fullsized":"2024-09-22T09:51:37.697276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:43.716495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'282","reported_seq":1698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.992925+0000","last_change":"2024-09-22T08:42:19.458357+0000","last_active":"2024-09-22T09:53:57.992925+0000","last_peered":"2024-09-22T09:53:57.992925+0000","last_clean":"2024-09-22T09:53:57.992925+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:53:57.992925+0000","last_undegraded":"2024-09-22T09:53:57.992925+0000","last_fullsized":"2024-09-22T09:53:57.992925+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:59.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663363+0000","last_change":"2024-09-22T08:42:21.479092+0000","last_active":"2024-09-22T09:51:07.663363+0000","last_peered":"2024-09-22T09:51:07.663363+0000","last_clean":"2024-09-22T09:51:07.663363+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:51:07.663363+0000","last_undegraded":"2024-09-22T09:51:07.663363+0000","last_fullsized":"2024-09-22T09:51:07.663363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:10.715693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.853797+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:35.853797+0000","last_peered":"2024-09-22T09:52:35.853797+0000","last_clean":"2024-09-22T09:52:35.853797+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:35.853797+0000","last_undegraded":"2024-09-22T09:52:35.853797+0000","last_fullsized":"2024-09-22T09:52:35.853797+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:52.995365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.434014+0000","last_change":"2024-09-22T08:42:15.430662+0000","last_active":"2024-09-22T09:51:02.434014+0000","last_peered":"2024-09-22T09:51:02.434014+0000","last_clean":"2024-09-22T09:51:02.434014+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:51:02.434014+0000","last_undegraded":"2024-09-22T09:51:02.434014+0000","last_fullsized":"2024-09-22T09:51:02.434014+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:01.989354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680585+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T09:50:47.680585+0000","last_peered":"2024-09-22T09:50:47.680585+0000","last_clean":"2024-09-22T09:50:47.680585+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:50:47.680585+0000","last_undegraded":"2024-09-22T09:50:47.680585+0000","last_fullsized":"2024-09-22T09:50:47.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'220","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556862+0000","last_change":"2024-09-22T08:42:13.416911+0000","last_active":"2024-09-22T09:51:02.556862+0000","last_peered":"2024-09-22T09:51:02.556862+0000","last_clean":"2024-09-22T09:51:02.556862+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:51:02.556862+0000","last_undegraded":"2024-09-22T09:51:02.556862+0000","last_fullsized":"2024-09-22T09:51:02.556862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:31.168513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392059,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":567,"num_read_kb":44921,"num_write":1096,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663982+0000","last_change":"2024-09-22T08:42:17.437159+0000","last_active":"2024-09-22T09:51:12.663982+0000","last_peered":"2024-09-22T09:51:12.663982+0000","last_clean":"2024-09-22T09:51:12.663982+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:51:12.663982+0000","last_undegraded":"2024-09-22T09:51:12.663982+0000","last_fullsized":"2024-09-22T09:51:12.663982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.902285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'158","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.565701+0000","last_change":"2024-09-22T08:42:19.456365+0000","last_active":"2024-09-22T09:53:52.565701+0000","last_peered":"2024-09-22T09:53:52.565701+0000","last_clean":"2024-09-22T09:53:52.565701+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:53:52.565701+0000","last_undegraded":"2024-09-22T09:53:52.565701+0000","last_fullsized":"2024-09-22T09:53:52.565701+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:24.107895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681332+0000","last_change":"2024-09-22T08:42:21.479775+0000","last_active":"2024-09-22T09:51:42.681332+0000","last_peered":"2024-09-22T09:51:42.681332+0000","last_clean":"2024-09-22T09:51:42.681332+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:51:42.681332+0000","last_undegraded":"2024-09-22T09:51:42.681332+0000","last_fullsized":"2024-09-22T09:51:42.681332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:27.626455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'121","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.689264+0000","last_change":"2024-09-22T08:42:23.527151+0000","last_active":"2024-09-22T09:51:47.689264+0000","last_peered":"2024-09-22T09:51:47.689264+0000","last_clean":"2024-09-22T09:51:47.689264+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:51:47.689264+0000","last_undegraded":"2024-09-22T09:51:47.689264+0000","last_fullsized":"2024-09-22T09:51:47.689264+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:36.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.433983+0000","last_change":"2024-09-22T08:42:15.437662+0000","last_active":"2024-09-22T09:51:02.433983+0000","last_peered":"2024-09-22T09:51:02.433983+0000","last_clean":"2024-09-22T09:51:02.433983+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:51:02.433983+0000","last_undegraded":"2024-09-22T09:51:02.433983+0000","last_fullsized":"2024-09-22T09:51:02.433983+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:44.376313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'188","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:49.774854+0000","last_change":"2024-09-22T08:42:13.406072+0000","last_active":"2024-09-22T09:53:49.774854+0000","last_peered":"2024-09-22T09:53:49.774854+0000","last_clean":"2024-09-22T09:53:49.774854+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:53:49.774854+0000","last_undegraded":"2024-09-22T09:53:49.774854+0000","last_fullsized":"2024-09-22T09:53:49.774854+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:34:54.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":36411,"num_write":934,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.432285+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T09:50:47.432285+0000","last_peered":"2024-09-22T09:50:47.432285+0000","last_clean":"2024-09-22T09:50:47.432285+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:50:47.432285+0000","last_undegraded":"2024-09-22T09:50:47.432285+0000","last_fullsized":"2024-09-22T09:50:47.432285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662643+0000","last_change":"2024-09-22T08:42:17.436067+0000","last_active":"2024-09-22T09:51:02.662643+0000","last_peered":"2024-09-22T09:51:02.662643+0000","last_clean":"2024-09-22T09:51:02.662643+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:51:02.662643+0000","last_undegraded":"2024-09-22T09:51:02.662643+0000","last_fullsized":"2024-09-22T09:51:02.662643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:08.963170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'350","reported_seq":1029,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.705822+0000","last_change":"2024-09-22T08:42:19.456910+0000","last_active":"2024-09-22T09:54:00.705822+0000","last_peered":"2024-09-22T09:54:00.705822+0000","last_clean":"2024-09-22T09:54:00.705822+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:00.705822+0000","last_undegraded":"2024-09-22T09:54:00.705822+0000","last_fullsized":"2024-09-22T09:54:00.705822+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:35.309371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24760,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1176,"num_read_kb":1299,"num_write":1762,"num_write_kb":1579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557458+0000","last_change":"2024-09-22T08:42:21.481570+0000","last_active":"2024-09-22T09:51:07.557458+0000","last_peered":"2024-09-22T09:51:07.557458+0000","last_clean":"2024-09-22T09:51:07.557458+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:51:07.557458+0000","last_undegraded":"2024-09-22T09:51:07.557458+0000","last_fullsized":"2024-09-22T09:51:07.557458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:52.544367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.135926+0000","last_change":"2024-09-22T08:42:23.578322+0000","last_active":"2024-09-22T09:52:33.135926+0000","last_peered":"2024-09-22T09:52:33.135926+0000","last_clean":"2024-09-22T09:52:33.135926+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:52:33.135926+0000","last_undegraded":"2024-09-22T09:52:33.135926+0000","last_fullsized":"2024-09-22T09:52:33.135926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:06.092146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662627+0000","last_change":"2024-09-22T08:42:15.425980+0000","last_active":"2024-09-22T09:51:02.662627+0000","last_peered":"2024-09-22T09:51:02.662627+0000","last_clean":"2024-09-22T09:51:02.662627+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:51:02.662627+0000","last_undegraded":"2024-09-22T09:51:02.662627+0000","last_fullsized":"2024-09-22T09:51:02.662627+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:08.622112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'219","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:02.447621+0000","last_change":"2024-09-22T08:42:13.422109+0000","last_active":"2024-09-22T09:53:02.447621+0000","last_peered":"2024-09-22T09:53:02.447621+0000","last_clean":"2024-09-22T09:53:02.447621+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:53:02.447621+0000","last_undegraded":"2024-09-22T09:53:02.447621+0000","last_fullsized":"2024-09-22T09:53:02.447621+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:30.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236610,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":545,"num_read_kb":1845,"num_write":1045,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524935+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T09:51:02.524935+0000","last_peered":"2024-09-22T09:51:02.524935+0000","last_clean":"2024-09-22T09:51:02.524935+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:51:02.524935+0000","last_undegraded":"2024-09-22T09:51:02.524935+0000","last_fullsized":"2024-09-22T09:51:02.524935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675254+0000","last_change":"2024-09-22T08:42:17.436017+0000","last_active":"2024-09-22T09:51:02.675254+0000","last_peered":"2024-09-22T09:51:02.675254+0000","last_clean":"2024-09-22T09:51:02.675254+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:51:02.675254+0000","last_undegraded":"2024-09-22T09:51:02.675254+0000","last_fullsized":"2024-09-22T09:51:02.675254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:52.183670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'215","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.922563+0000","last_change":"2024-09-22T08:42:19.456840+0000","last_active":"2024-09-22T09:52:52.922563+0000","last_peered":"2024-09-22T09:52:52.922563+0000","last_clean":"2024-09-22T09:52:52.922563+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:52:52.922563+0000","last_undegraded":"2024-09-22T09:52:52.922563+0000","last_fullsized":"2024-09-22T09:52:52.922563+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:19.484900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'761","reported_seq":4641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.789752+0000","last_change":"2024-09-22T08:42:21.481370+0000","last_active":"2024-09-22T09:54:03.789752+0000","last_peered":"2024-09-22T09:54:03.789752+0000","last_clean":"2024-09-22T09:54:03.789752+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:03.789752+0000","last_undegraded":"2024-09-22T09:54:03.789752+0000","last_fullsized":"2024-09-22T09:54:03.789752+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":701,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:26.631766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.133370+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:52:33.133370+0000","last_peered":"2024-09-22T09:52:33.133370+0000","last_clean":"2024-09-22T09:52:33.133370+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:52:33.133370+0000","last_undegraded":"2024-09-22T09:52:33.133370+0000","last_fullsized":"2024-09-22T09:52:33.133370+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.457091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658056+0000","last_change":"2024-09-22T08:42:15.435920+0000","last_active":"2024-09-22T09:50:27.658056+0000","last_peered":"2024-09-22T09:50:27.658056+0000","last_clean":"2024-09-22T09:50:27.658056+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:50:27.658056+0000","last_undegraded":"2024-09-22T09:50:27.658056+0000","last_fullsized":"2024-09-22T09:50:27.658056+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:21.159641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666115+0000","last_change":"2024-09-22T08:42:13.414597+0000","last_active":"2024-09-22T09:51:32.666115+0000","last_peered":"2024-09-22T09:51:32.666115+0000","last_clean":"2024-09-22T09:51:32.666115+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:51:32.666115+0000","last_undegraded":"2024-09-22T09:51:32.666115+0000","last_fullsized":"2024-09-22T09:51:32.666115+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:34.931040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.436368+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T09:51:22.436368+0000","last_peered":"2024-09-22T09:51:22.436368+0000","last_clean":"2024-09-22T09:51:22.436368+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:51:22.436368+0000","last_undegraded":"2024-09-22T09:51:22.436368+0000","last_fullsized":"2024-09-22T09:51:22.436368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556800+0000","last_change":"2024-09-22T08:42:17.440772+0000","last_active":"2024-09-22T09:51:02.556800+0000","last_peered":"2024-09-22T09:51:02.556800+0000","last_clean":"2024-09-22T09:51:02.556800+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:51:02.556800+0000","last_undegraded":"2024-09-22T09:51:02.556800+0000","last_fullsized":"2024-09-22T09:51:02.556800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:54.715553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'134","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.892504+0000","last_change":"2024-09-22T08:42:19.457603+0000","last_active":"2024-09-22T09:52:52.892504+0000","last_peered":"2024-09-22T09:52:52.892504+0000","last_clean":"2024-09-22T09:52:52.892504+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:52:52.892504+0000","last_undegraded":"2024-09-22T09:52:52.892504+0000","last_fullsized":"2024-09-22T09:52:52.892504+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:47.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'752","reported_seq":2853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.782873+0000","last_change":"2024-09-22T08:42:21.478082+0000","last_active":"2024-09-22T09:54:03.782873+0000","last_peered":"2024-09-22T09:54:03.782873+0000","last_clean":"2024-09-22T09:54:03.782873+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:03.782873+0000","last_undegraded":"2024-09-22T09:54:03.782873+0000","last_fullsized":"2024-09-22T09:54:03.782873+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:57.519253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'148","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.332706+0000","last_change":"2024-09-22T08:42:23.525171+0000","last_active":"2024-09-22T09:51:11.332706+0000","last_peered":"2024-09-22T09:51:11.332706+0000","last_clean":"2024-09-22T09:51:11.332706+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:51:11.332706+0000","last_undegraded":"2024-09-22T09:51:11.332706+0000","last_fullsized":"2024-09-22T09:51:11.332706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:04.949992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556810+0000","last_change":"2024-09-22T08:42:15.426476+0000","last_active":"2024-09-22T09:51:02.556810+0000","last_peered":"2024-09-22T09:51:02.556810+0000","last_clean":"2024-09-22T09:51:02.556810+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:51:02.556810+0000","last_undegraded":"2024-09-22T09:51:02.556810+0000","last_fullsized":"2024-09-22T09:51:02.556810+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:40.091111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'187","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667284+0000","last_change":"2024-09-22T08:42:13.412711+0000","last_active":"2024-09-22T09:51:37.667284+0000","last_peered":"2024-09-22T09:51:37.667284+0000","last_clean":"2024-09-22T09:51:37.667284+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:51:37.667284+0000","last_undegraded":"2024-09-22T09:51:37.667284+0000","last_fullsized":"2024-09-22T09:51:37.667284+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266062,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":406,"num_write":847,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.678442+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T09:51:22.678442+0000","last_peered":"2024-09-22T09:51:22.678442+0000","last_clean":"2024-09-22T09:51:22.678442+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:51:22.678442+0000","last_undegraded":"2024-09-22T09:51:22.678442+0000","last_fullsized":"2024-09-22T09:51:22.678442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658036+0000","last_change":"2024-09-22T08:42:17.440887+0000","last_active":"2024-09-22T09:50:27.658036+0000","last_peered":"2024-09-22T09:50:27.658036+0000","last_clean":"2024-09-22T09:50:27.658036+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:50:27.658036+0000","last_undegraded":"2024-09-22T09:50:27.658036+0000","last_fullsized":"2024-09-22T09:50:27.658036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:14.170224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'345","reported_seq":1068,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.702399+0000","last_change":"2024-09-22T08:42:19.455440+0000","last_active":"2024-09-22T09:54:00.702399+0000","last_peered":"2024-09-22T09:54:00.702399+0000","last_clean":"2024-09-22T09:54:00.702399+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:00.702399+0000","last_undegraded":"2024-09-22T09:54:00.702399+0000","last_fullsized":"2024-09-22T09:54:00.702399+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:31.127669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34966,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":508,"num_read_kb":712,"num_write":272,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662903+0000","last_change":"2024-09-22T08:42:21.481354+0000","last_active":"2024-09-22T09:51:07.662903+0000","last_peered":"2024-09-22T09:51:07.662903+0000","last_clean":"2024-09-22T09:51:07.662903+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:51:07.662903+0000","last_undegraded":"2024-09-22T09:51:07.662903+0000","last_fullsized":"2024-09-22T09:51:07.662903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:55.654023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'92","reported_seq":590,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.904200+0000","last_change":"2024-09-22T08:42:23.528079+0000","last_active":"2024-09-22T09:50:17.904200+0000","last_peered":"2024-09-22T09:50:17.904200+0000","last_clean":"2024-09-22T09:50:17.904200+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:50:17.904200+0000","last_undegraded":"2024-09-22T09:50:17.904200+0000","last_fullsized":"2024-09-22T09:50:17.904200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:28.365018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547536+0000","last_change":"2024-09-22T08:42:15.426467+0000","last_active":"2024-09-22T09:49:57.547536+0000","last_peered":"2024-09-22T09:49:57.547536+0000","last_clean":"2024-09-22T09:49:57.547536+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:49:57.547536+0000","last_undegraded":"2024-09-22T09:49:57.547536+0000","last_fullsized":"2024-09-22T09:49:57.547536+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:10.885001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'191","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.549844+0000","last_change":"2024-09-22T08:42:13.418044+0000","last_active":"2024-09-22T09:50:12.549844+0000","last_peered":"2024-09-22T09:50:12.549844+0000","last_clean":"2024-09-22T09:50:12.549844+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:50:12.549844+0000","last_undegraded":"2024-09-22T09:50:12.549844+0000","last_fullsized":"2024-09-22T09:50:12.549844+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:06.417643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21018941,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":56883,"num_write":849,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426786+0000","last_change":"2024-09-22T08:42:17.434551+0000","last_active":"2024-09-22T09:49:57.426786+0000","last_peered":"2024-09-22T09:49:57.426786+0000","last_clean":"2024-09-22T09:49:57.426786+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:49:57.426786+0000","last_undegraded":"2024-09-22T09:49:57.426786+0000","last_fullsized":"2024-09-22T09:49:57.426786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:49.306717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'167","reported_seq":749,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.927346+0000","last_change":"2024-09-22T08:42:19.459166+0000","last_active":"2024-09-22T09:52:52.927346+0000","last_peered":"2024-09-22T09:52:52.927346+0000","last_clean":"2024-09-22T09:52:52.927346+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:52:52.927346+0000","last_undegraded":"2024-09-22T09:52:52.927346+0000","last_fullsized":"2024-09-22T09:52:52.927346+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:04.933821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":222,"num_read_kb":300,"num_write":130,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654407+0000","last_change":"2024-09-22T08:42:21.480559+0000","last_active":"2024-09-22T09:50:02.654407+0000","last_peered":"2024-09-22T09:50:02.654407+0000","last_clean":"2024-09-22T09:50:02.654407+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:50:02.654407+0000","last_undegraded":"2024-09-22T09:50:02.654407+0000","last_fullsized":"2024-09-22T09:50:02.654407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:57.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:00.060711+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:51:00.060711+0000","last_peered":"2024-09-22T09:51:00.060711+0000","last_clean":"2024-09-22T09:51:00.060711+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:51:00.060711+0000","last_undegraded":"2024-09-22T09:51:00.060711+0000","last_fullsized":"2024-09-22T09:51:00.060711+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:00.026997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426814+0000","last_change":"2024-09-22T08:42:15.435296+0000","last_active":"2024-09-22T09:49:57.426814+0000","last_peered":"2024-09-22T09:49:57.426814+0000","last_clean":"2024-09-22T09:49:57.426814+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:49:57.426814+0000","last_undegraded":"2024-09-22T09:49:57.426814+0000","last_fullsized":"2024-09-22T09:49:57.426814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:37.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'220","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.514089+0000","last_change":"2024-09-22T08:42:13.414954+0000","last_active":"2024-09-22T09:49:52.514089+0000","last_peered":"2024-09-22T09:49:52.514089+0000","last_clean":"2024-09-22T09:49:52.514089+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:49:52.514089+0000","last_undegraded":"2024-09-22T09:49:52.514089+0000","last_fullsized":"2024-09-22T09:49:52.514089+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:55.273095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16394947,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":586,"num_read_kb":50629,"num_write":1049,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653853+0000","last_change":"2024-09-22T08:42:17.440629+0000","last_active":"2024-09-22T09:49:57.653853+0000","last_peered":"2024-09-22T09:49:57.653853+0000","last_clean":"2024-09-22T09:49:57.653853+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:49:57.653853+0000","last_undegraded":"2024-09-22T09:49:57.653853+0000","last_fullsized":"2024-09-22T09:49:57.653853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:13.561126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'53","reported_seq":565,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.547272+0000","last_change":"2024-09-22T08:42:19.456534+0000","last_active":"2024-09-22T09:52:52.547272+0000","last_peered":"2024-09-22T09:52:52.547272+0000","last_clean":"2024-09-22T09:52:52.547272+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:52:52.547272+0000","last_undegraded":"2024-09-22T09:52:52.547272+0000","last_fullsized":"2024-09-22T09:52:52.547272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:45.983322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515570+0000","last_change":"2024-09-22T08:42:21.476849+0000","last_active":"2024-09-22T09:50:02.515570+0000","last_peered":"2024-09-22T09:50:02.515570+0000","last_clean":"2024-09-22T09:50:02.515570+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:50:02.515570+0000","last_undegraded":"2024-09-22T09:50:02.515570+0000","last_fullsized":"2024-09-22T09:50:02.515570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:43.656268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.634796+0000","last_change":"2024-09-22T08:42:23.526388+0000","last_active":"2024-09-22T09:52:35.634796+0000","last_peered":"2024-09-22T09:52:35.634796+0000","last_clean":"2024-09-22T09:52:35.634796+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:52:35.634796+0000","last_undegraded":"2024-09-22T09:52:35.634796+0000","last_fullsized":"2024-09-22T09:52:35.634796+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:29.029640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.665914+0000","last_change":"2024-09-22T08:42:15.438483+0000","last_active":"2024-09-22T09:52:36.665914+0000","last_peered":"2024-09-22T09:52:36.665914+0000","last_clean":"2024-09-22T09:52:36.665914+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:52:36.665914+0000","last_undegraded":"2024-09-22T09:52:36.665914+0000","last_fullsized":"2024-09-22T09:52:36.665914+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.521372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'203","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673275+0000","last_change":"2024-09-22T08:42:13.413578+0000","last_active":"2024-09-22T09:49:57.673275+0000","last_peered":"2024-09-22T09:49:57.673275+0000","last_clean":"2024-09-22T09:49:57.673275+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:49:57.673275+0000","last_undegraded":"2024-09-22T09:49:57.673275+0000","last_fullsized":"2024-09-22T09:49:57.673275+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:00.034449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267605,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":27137,"num_write":991,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514721+0000","last_change":"2024-09-22T08:42:17.430472+0000","last_active":"2024-09-22T09:49:57.514721+0000","last_peered":"2024-09-22T09:49:57.514721+0000","last_clean":"2024-09-22T09:49:57.514721+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:49:57.514721+0000","last_undegraded":"2024-09-22T09:49:57.514721+0000","last_fullsized":"2024-09-22T09:49:57.514721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:35.687053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'193","reported_seq":791,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.415565+0000","last_change":"2024-09-22T08:42:19.459846+0000","last_active":"2024-09-22T09:53:59.415565+0000","last_peered":"2024-09-22T09:53:59.415565+0000","last_clean":"2024-09-22T09:53:59.415565+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:53:59.415565+0000","last_undegraded":"2024-09-22T09:53:59.415565+0000","last_fullsized":"2024-09-22T09:53:59.415565+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:37.691592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":310,"num_write":142,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.667537+0000","last_change":"2024-09-22T08:42:21.479495+0000","last_active":"2024-09-22T09:50:02.667537+0000","last_peered":"2024-09-22T09:50:02.667537+0000","last_clean":"2024-09-22T09:50:02.667537+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:50:02.667537+0000","last_undegraded":"2024-09-22T09:50:02.667537+0000","last_fullsized":"2024-09-22T09:50:02.667537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:56.016803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'184","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.144194+0000","last_change":"2024-09-22T08:42:23.527658+0000","last_active":"2024-09-22T09:50:22.144194+0000","last_peered":"2024-09-22T09:50:22.144194+0000","last_clean":"2024-09-22T09:50:22.144194+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:50:22.144194+0000","last_undegraded":"2024-09-22T09:50:22.144194+0000","last_fullsized":"2024-09-22T09:50:22.144194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:34.867859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'173","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653721+0000","last_change":"2024-09-22T08:42:15.440994+0000","last_active":"2024-09-22T09:49:57.653721+0000","last_peered":"2024-09-22T09:49:57.653721+0000","last_clean":"2024-09-22T09:49:57.653721+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:49:57.653721+0000","last_undegraded":"2024-09-22T09:49:57.653721+0000","last_fullsized":"2024-09-22T09:49:57.653721+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:06.924407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'200","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:56.590917+0000","last_change":"2024-09-22T08:42:13.421739+0000","last_active":"2024-09-22T09:50:56.590917+0000","last_peered":"2024-09-22T09:50:56.590917+0000","last_clean":"2024-09-22T09:50:56.590917+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:50:56.590917+0000","last_undegraded":"2024-09-22T09:50:56.590917+0000","last_fullsized":"2024-09-22T09:50:56.590917+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:25:10.061779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10786420,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":41854,"num_write":1016,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666642+0000","last_change":"2024-09-22T08:42:17.428665+0000","last_active":"2024-09-22T09:49:57.666642+0000","last_peered":"2024-09-22T09:49:57.666642+0000","last_clean":"2024-09-22T09:49:57.666642+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:49:57.666642+0000","last_undegraded":"2024-09-22T09:49:57.666642+0000","last_fullsized":"2024-09-22T09:49:57.666642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:34.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'144","reported_seq":717,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.714713+0000","last_change":"2024-09-22T08:42:19.453111+0000","last_active":"2024-09-22T09:52:52.714713+0000","last_peered":"2024-09-22T09:52:52.714713+0000","last_clean":"2024-09-22T09:52:52.714713+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:52:52.714713+0000","last_undegraded":"2024-09-22T09:52:52.714713+0000","last_fullsized":"2024-09-22T09:52:52.714713+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:24.508041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":182,"num_read_kb":204,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654861+0000","last_change":"2024-09-22T08:42:21.475223+0000","last_active":"2024-09-22T09:50:02.654861+0000","last_peered":"2024-09-22T09:50:02.654861+0000","last_clean":"2024-09-22T09:50:02.654861+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:50:02.654861+0000","last_undegraded":"2024-09-22T09:50:02.654861+0000","last_fullsized":"2024-09-22T09:50:02.654861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:09.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675311+0000","last_change":"2024-09-22T08:42:15.431489+0000","last_active":"2024-09-22T09:51:02.675311+0000","last_peered":"2024-09-22T09:51:02.675311+0000","last_clean":"2024-09-22T09:51:02.675311+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:51:02.675311+0000","last_undegraded":"2024-09-22T09:51:02.675311+0000","last_fullsized":"2024-09-22T09:51:02.675311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:58.608179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'198","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:26.664923+0000","last_change":"2024-09-22T08:42:13.403630+0000","last_active":"2024-09-22T09:50:26.664923+0000","last_peered":"2024-09-22T09:50:26.664923+0000","last_clean":"2024-09-22T09:50:26.664923+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:50:26.664923+0000","last_undegraded":"2024-09-22T09:50:26.664923+0000","last_fullsized":"2024-09-22T09:50:26.664923+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:49.925047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16345112,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":68522,"num_write":909,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658194+0000","last_change":"2024-09-22T08:42:17.438090+0000","last_active":"2024-09-22T09:50:27.658194+0000","last_peered":"2024-09-22T09:50:27.658194+0000","last_clean":"2024-09-22T09:50:27.658194+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:50:27.658194+0000","last_undegraded":"2024-09-22T09:50:27.658194+0000","last_fullsized":"2024-09-22T09:50:27.658194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:49.781681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.698391+0000","last_change":"2024-09-22T08:42:19.455805+0000","last_active":"2024-09-22T09:54:00.698391+0000","last_peered":"2024-09-22T09:54:00.698391+0000","last_clean":"2024-09-22T09:54:00.698391+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:00.698391+0000","last_undegraded":"2024-09-22T09:54:00.698391+0000","last_fullsized":"2024-09-22T09:54:00.698391+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:46.845015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30397,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":335,"num_read_kb":501,"num_write":220,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.672389+0000","last_change":"2024-09-22T08:42:21.482536+0000","last_active":"2024-09-22T09:49:52.672389+0000","last_peered":"2024-09-22T09:49:52.672389+0000","last_clean":"2024-09-22T09:49:52.672389+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:49:52.672389+0000","last_undegraded":"2024-09-22T09:49:52.672389+0000","last_fullsized":"2024-09-22T09:49:52.672389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:16.490768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.317977+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:50:15.317977+0000","last_peered":"2024-09-22T09:50:15.317977+0000","last_clean":"2024-09-22T09:50:15.317977+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:50:15.317977+0000","last_undegraded":"2024-09-22T09:50:15.317977+0000","last_fullsized":"2024-09-22T09:50:15.317977+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:49.491628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658171+0000","last_change":"2024-09-22T08:42:15.427151+0000","last_active":"2024-09-22T09:50:27.658171+0000","last_peered":"2024-09-22T09:50:27.658171+0000","last_clean":"2024-09-22T09:50:27.658171+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:50:27.658171+0000","last_undegraded":"2024-09-22T09:50:27.658171+0000","last_fullsized":"2024-09-22T09:50:27.658171+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:08.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'216","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428487+0000","last_change":"2024-09-22T08:42:13.408621+0000","last_active":"2024-09-22T09:50:12.428487+0000","last_peered":"2024-09-22T09:50:12.428487+0000","last_clean":"2024-09-22T09:50:12.428487+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:50:12.428487+0000","last_undegraded":"2024-09-22T09:50:12.428487+0000","last_fullsized":"2024-09-22T09:50:12.428487+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:38.944084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2123947,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":678,"num_read_kb":5102,"num_write":1152,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675298+0000","last_change":"2024-09-22T08:42:17.432901+0000","last_active":"2024-09-22T09:51:02.675298+0000","last_peered":"2024-09-22T09:51:02.675298+0000","last_clean":"2024-09-22T09:51:02.675298+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:51:02.675298+0000","last_undegraded":"2024-09-22T09:51:02.675298+0000","last_fullsized":"2024-09-22T09:51:02.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:54.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'202","reported_seq":797,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.798953+0000","last_change":"2024-09-22T08:42:19.454425+0000","last_active":"2024-09-22T09:52:52.798953+0000","last_peered":"2024-09-22T09:52:52.798953+0000","last_clean":"2024-09-22T09:52:52.798953+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:52:52.798953+0000","last_undegraded":"2024-09-22T09:52:52.798953+0000","last_fullsized":"2024-09-22T09:52:52.798953+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:32.598763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7943,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":326,"num_write":180,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426248+0000","last_change":"2024-09-22T08:42:21.476913+0000","last_active":"2024-09-22T09:49:52.426248+0000","last_peered":"2024-09-22T09:49:52.426248+0000","last_clean":"2024-09-22T09:49:52.426248+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:49:52.426248+0000","last_undegraded":"2024-09-22T09:49:52.426248+0000","last_fullsized":"2024-09-22T09:49:52.426248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:43.637608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'167","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.287498+0000","last_change":"2024-09-22T08:42:23.524343+0000","last_active":"2024-09-22T09:52:35.287498+0000","last_peered":"2024-09-22T09:52:35.287498+0000","last_clean":"2024-09-22T09:52:35.287498+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:52:35.287498+0000","last_undegraded":"2024-09-22T09:52:35.287498+0000","last_fullsized":"2024-09-22T09:52:35.287498+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:59.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652648+0000","last_change":"2024-09-22T08:42:15.441307+0000","last_active":"2024-09-22T09:49:47.652648+0000","last_peered":"2024-09-22T09:49:47.652648+0000","last_clean":"2024-09-22T09:49:47.652648+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:49:47.652648+0000","last_undegraded":"2024-09-22T09:49:47.652648+0000","last_fullsized":"2024-09-22T09:49:47.652648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:01.398679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'189","reported_seq":914,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545846+0000","last_change":"2024-09-22T08:42:13.403394+0000","last_active":"2024-09-22T09:49:47.545846+0000","last_peered":"2024-09-22T09:49:47.545846+0000","last_clean":"2024-09-22T09:49:47.545846+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:49:47.545846+0000","last_undegraded":"2024-09-22T09:49:47.545846+0000","last_fullsized":"2024-09-22T09:49:47.545846+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:07.863561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29587,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1207,"num_read_kb":5814,"num_write":978,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545954+0000","last_change":"2024-09-22T08:42:17.435464+0000","last_active":"2024-09-22T09:49:47.545954+0000","last_peered":"2024-09-22T09:49:47.545954+0000","last_clean":"2024-09-22T09:49:47.545954+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:49:47.545954+0000","last_undegraded":"2024-09-22T09:49:47.545954+0000","last_fullsized":"2024-09-22T09:49:47.545954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:38.411752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'156","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.560516+0000","last_change":"2024-09-22T08:42:19.458421+0000","last_active":"2024-09-22T09:53:12.560516+0000","last_peered":"2024-09-22T09:53:12.560516+0000","last_clean":"2024-09-22T09:53:12.560516+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:53:12.560516+0000","last_undegraded":"2024-09-22T09:53:12.560516+0000","last_fullsized":"2024-09-22T09:53:12.560516+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:17.997133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12957,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":277,"num_write":116,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431784+0000","last_change":"2024-09-22T08:42:21.482356+0000","last_active":"2024-09-22T09:50:42.431784+0000","last_peered":"2024-09-22T09:50:42.431784+0000","last_clean":"2024-09-22T09:50:42.431784+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:50:42.431784+0000","last_undegraded":"2024-09-22T09:50:42.431784+0000","last_fullsized":"2024-09-22T09:50:42.431784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:32.679904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'112","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.729613+0000","last_change":"2024-09-22T08:42:23.524273+0000","last_active":"2024-09-22T09:54:00.729613+0000","last_peered":"2024-09-22T09:54:00.729613+0000","last_clean":"2024-09-22T09:54:00.729613+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:00.729613+0000","last_undegraded":"2024-09-22T09:54:00.729613+0000","last_fullsized":"2024-09-22T09:54:00.729613+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:17.604133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686473+0000","last_change":"2024-09-22T08:42:15.435809+0000","last_active":"2024-09-22T09:49:47.686473+0000","last_peered":"2024-09-22T09:49:47.686473+0000","last_clean":"2024-09-22T09:49:47.686473+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:49:47.686473+0000","last_undegraded":"2024-09-22T09:49:47.686473+0000","last_fullsized":"2024-09-22T09:49:47.686473+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:40.478687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'235","reported_seq":922,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:19.479556+0000","last_change":"2024-09-22T08:42:13.413803+0000","last_active":"2024-09-22T09:51:19.479556+0000","last_peered":"2024-09-22T09:51:19.479556+0000","last_clean":"2024-09-22T09:51:19.479556+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:51:19.479556+0000","last_undegraded":"2024-09-22T09:51:19.479556+0000","last_fullsized":"2024-09-22T09:51:19.479556+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:20.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290233,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":752,"num_read_kb":123234,"num_write":1013,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425590+0000","last_change":"2024-09-22T08:42:17.435752+0000","last_active":"2024-09-22T09:49:47.425590+0000","last_peered":"2024-09-22T09:49:47.425590+0000","last_clean":"2024-09-22T09:49:47.425590+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:49:47.425590+0000","last_undegraded":"2024-09-22T09:49:47.425590+0000","last_fullsized":"2024-09-22T09:49:47.425590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:10.922721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'121","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.915476+0000","last_change":"2024-09-22T08:42:19.453093+0000","last_active":"2024-09-22T09:52:52.915476+0000","last_peered":"2024-09-22T09:52:52.915476+0000","last_clean":"2024-09-22T09:52:52.915476+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:52:52.915476+0000","last_undegraded":"2024-09-22T09:52:52.915476+0000","last_fullsized":"2024-09-22T09:52:52.915476+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:18.283880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'756","reported_seq":4728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:03.790790+0000","last_change":"2024-09-22T08:42:21.480171+0000","last_active":"2024-09-22T09:54:03.790790+0000","last_peered":"2024-09-22T09:54:03.790790+0000","last_clean":"2024-09-22T09:54:03.790790+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:03.790790+0000","last_undegraded":"2024-09-22T09:54:03.790790+0000","last_fullsized":"2024-09-22T09:54:03.790790+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:05.223141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.660200+0000","last_change":"2024-09-22T08:42:23.528243+0000","last_active":"2024-09-22T09:52:36.660200+0000","last_peered":"2024-09-22T09:52:36.660200+0000","last_clean":"2024-09-22T09:52:36.660200+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:52:36.660200+0000","last_undegraded":"2024-09-22T09:52:36.660200+0000","last_fullsized":"2024-09-22T09:52:36.660200+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:46.020648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545909+0000","last_change":"2024-09-22T08:42:46.084787+0000","last_active":"2024-09-22T09:49:47.545909+0000","last_peered":"2024-09-22T09:49:47.545909+0000","last_clean":"2024-09-22T09:49:47.545909+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:49:47.545909+0000","last_undegraded":"2024-09-22T09:49:47.545909+0000","last_fullsized":"2024-09-22T09:49:47.545909+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:31.609602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'288","reported_seq":1020,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.260177+0000","last_change":"2024-09-22T08:42:46.086633+0000","last_active":"2024-09-22T09:51:11.260177+0000","last_peered":"2024-09-22T09:51:11.260177+0000","last_clean":"2024-09-22T09:51:11.260177+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:51:11.260177+0000","last_undegraded":"2024-09-22T09:51:11.260177+0000","last_fullsized":"2024-09-22T09:51:11.260177+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:16.757938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324323,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1299,"num_read_kb":50200,"num_write":1262,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"36'3","reported_seq":971,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.246095+0000","last_change":"2024-09-22T08:42:17.430502+0000","last_active":"2024-09-22T09:54:00.246095+0000","last_peered":"2024-09-22T09:54:00.246095+0000","last_clean":"2024-09-22T09:54:00.246095+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:00.246095+0000","last_undegraded":"2024-09-22T09:54:00.246095+0000","last_fullsized":"2024-09-22T09:54:00.246095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:02.208302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'210","reported_seq":809,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.941440+0000","last_change":"2024-09-22T08:42:19.455535+0000","last_active":"2024-09-22T09:52:52.941440+0000","last_peered":"2024-09-22T09:52:52.941440+0000","last_clean":"2024-09-22T09:52:52.941440+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:52:52.941440+0000","last_undegraded":"2024-09-22T09:52:52.941440+0000","last_fullsized":"2024-09-22T09:52:52.941440+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:46.902494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7279,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":309,"num_write":158,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654816+0000","last_change":"2024-09-22T08:42:21.476713+0000","last_active":"2024-09-22T09:50:02.654816+0000","last_peered":"2024-09-22T09:50:02.654816+0000","last_clean":"2024-09-22T09:50:02.654816+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:50:02.654816+0000","last_undegraded":"2024-09-22T09:50:02.654816+0000","last_fullsized":"2024-09-22T09:50:02.654816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:07.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'140","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539387+0000","last_change":"2024-09-22T08:42:23.517176+0000","last_active":"2024-09-22T09:52:32.539387+0000","last_peered":"2024-09-22T09:52:32.539387+0000","last_clean":"2024-09-22T09:52:32.539387+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:52:32.539387+0000","last_undegraded":"2024-09-22T09:52:32.539387+0000","last_fullsized":"2024-09-22T09:52:32.539387+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":763,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.383248+0000","last_change":"2024-09-22T08:42:15.431566+0000","last_active":"2024-09-22T09:51:28.383248+0000","last_peered":"2024-09-22T09:51:28.383248+0000","last_clean":"2024-09-22T09:51:28.383248+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:51:28.383248+0000","last_undegraded":"2024-09-22T09:51:28.383248+0000","last_fullsized":"2024-09-22T09:51:28.383248+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:38.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'210","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:59.997385+0000","last_change":"2024-09-22T08:42:46.088505+0000","last_active":"2024-09-22T09:50:59.997385+0000","last_peered":"2024-09-22T09:50:59.997385+0000","last_clean":"2024-09-22T09:50:59.997385+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:50:59.997385+0000","last_undegraded":"2024-09-22T09:50:59.997385+0000","last_fullsized":"2024-09-22T09:50:59.997385+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:58.102532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10731717,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":523,"num_read_kb":26654,"num_write":907,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671704+0000","last_change":"2024-09-22T08:42:17.434837+0000","last_active":"2024-09-22T09:49:47.671704+0000","last_peered":"2024-09-22T09:49:47.671704+0000","last_clean":"2024-09-22T09:49:47.671704+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:49:47.671704+0000","last_undegraded":"2024-09-22T09:49:47.671704+0000","last_fullsized":"2024-09-22T09:49:47.671704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:44.721168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'140","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.500608+0000","last_change":"2024-09-22T08:42:19.455628+0000","last_active":"2024-09-22T09:52:52.500608+0000","last_peered":"2024-09-22T09:52:52.500608+0000","last_clean":"2024-09-22T09:52:52.500608+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:52:52.500608+0000","last_undegraded":"2024-09-22T09:52:52.500608+0000","last_fullsized":"2024-09-22T09:52:52.500608+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:09.361619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12014,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":188,"num_read_kb":248,"num_write":106,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668079+0000","last_change":"2024-09-22T08:42:21.476902+0000","last_active":"2024-09-22T09:50:07.668079+0000","last_peered":"2024-09-22T09:50:07.668079+0000","last_clean":"2024-09-22T09:50:07.668079+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:50:07.668079+0000","last_undegraded":"2024-09-22T09:50:07.668079+0000","last_fullsized":"2024-09-22T09:50:07.668079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:29.159677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.376679+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:51:35.376679+0000","last_peered":"2024-09-22T09:51:35.376679+0000","last_clean":"2024-09-22T09:51:35.376679+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:51:35.376679+0000","last_undegraded":"2024-09-22T09:51:35.376679+0000","last_fullsized":"2024-09-22T09:51:35.376679+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.855073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655142+0000","last_change":"2024-09-22T08:42:15.439064+0000","last_active":"2024-09-22T09:50:07.655142+0000","last_peered":"2024-09-22T09:50:07.655142+0000","last_clean":"2024-09-22T09:50:07.655142+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:50:07.655142+0000","last_undegraded":"2024-09-22T09:50:07.655142+0000","last_fullsized":"2024-09-22T09:50:07.655142+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:36.078212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'272","reported_seq":945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657511+0000","last_change":"2024-09-22T08:42:13.405170+0000","last_active":"2024-09-22T09:50:22.657511+0000","last_peered":"2024-09-22T09:50:22.657511+0000","last_clean":"2024-09-22T09:50:22.657511+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:50:22.657511+0000","last_undegraded":"2024-09-22T09:50:22.657511+0000","last_fullsized":"2024-09-22T09:50:22.657511+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:38.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5302814,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":35485,"num_write":1183,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547433+0000","last_change":"2024-09-22T08:42:17.428752+0000","last_active":"2024-09-22T09:49:57.547433+0000","last_peered":"2024-09-22T09:49:57.547433+0000","last_clean":"2024-09-22T09:49:57.547433+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:49:57.547433+0000","last_undegraded":"2024-09-22T09:49:57.547433+0000","last_fullsized":"2024-09-22T09:49:57.547433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:24.944481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'111","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.679823+0000","last_change":"2024-09-22T08:42:19.453726+0000","last_active":"2024-09-22T09:52:52.679823+0000","last_peered":"2024-09-22T09:52:52.679823+0000","last_clean":"2024-09-22T09:52:52.679823+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:52:52.679823+0000","last_undegraded":"2024-09-22T09:52:52.679823+0000","last_fullsized":"2024-09-22T09:52:52.679823+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:05.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16619,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":237,"num_write":76,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.546807+0000","last_change":"2024-09-22T08:42:21.478595+0000","last_active":"2024-09-22T09:49:52.546807+0000","last_peered":"2024-09-22T09:49:52.546807+0000","last_clean":"2024-09-22T09:49:52.546807+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:49:52.546807+0000","last_undegraded":"2024-09-22T09:49:52.546807+0000","last_fullsized":"2024-09-22T09:49:52.546807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:19.682078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'159","reported_seq":1627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.954159+0000","last_change":"2024-09-22T08:42:23.526111+0000","last_active":"2024-09-22T09:52:32.954159+0000","last_peered":"2024-09-22T09:52:32.954159+0000","last_clean":"2024-09-22T09:52:32.954159+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:52:32.954159+0000","last_undegraded":"2024-09-22T09:52:32.954159+0000","last_fullsized":"2024-09-22T09:52:32.954159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:23.624323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5257,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547451+0000","last_change":"2024-09-22T08:42:15.428024+0000","last_active":"2024-09-22T09:49:57.547451+0000","last_peered":"2024-09-22T09:49:57.547451+0000","last_clean":"2024-09-22T09:49:57.547451+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:49:57.547451+0000","last_undegraded":"2024-09-22T09:49:57.547451+0000","last_fullsized":"2024-09-22T09:49:57.547451+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:35.144593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'232","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662743+0000","last_change":"2024-09-22T08:42:13.422788+0000","last_active":"2024-09-22T09:51:02.662743+0000","last_peered":"2024-09-22T09:51:02.662743+0000","last_clean":"2024-09-22T09:51:02.662743+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:51:02.662743+0000","last_undegraded":"2024-09-22T09:51:02.662743+0000","last_fullsized":"2024-09-22T09:51:02.662743+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:52.150990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15884519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":597,"num_read_kb":45002,"num_write":1092,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429129+0000","last_change":"2024-09-22T08:42:17.443746+0000","last_active":"2024-09-22T09:50:17.429129+0000","last_peered":"2024-09-22T09:50:17.429129+0000","last_clean":"2024-09-22T09:50:17.429129+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:50:17.429129+0000","last_undegraded":"2024-09-22T09:50:17.429129+0000","last_fullsized":"2024-09-22T09:50:17.429129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:19.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'214","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.729377+0000","last_change":"2024-09-22T08:42:19.454027+0000","last_active":"2024-09-22T09:52:52.729377+0000","last_peered":"2024-09-22T09:52:52.729377+0000","last_clean":"2024-09-22T09:52:52.729377+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:52:52.729377+0000","last_undegraded":"2024-09-22T09:52:52.729377+0000","last_fullsized":"2024-09-22T09:52:52.729377+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:10.523969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146257,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":312,"num_read_kb":767,"num_write":212,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.653425+0000","last_change":"2024-09-22T08:42:21.477428+0000","last_active":"2024-09-22T09:49:52.653425+0000","last_peered":"2024-09-22T09:49:52.653425+0000","last_clean":"2024-09-22T09:49:52.653425+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:49:52.653425+0000","last_undegraded":"2024-09-22T09:49:52.653425+0000","last_fullsized":"2024-09-22T09:49:52.653425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:24.672129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'126","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.396183+0000","last_change":"2024-09-22T08:42:23.527124+0000","last_active":"2024-09-22T09:53:59.396183+0000","last_peered":"2024-09-22T09:53:59.396183+0000","last_clean":"2024-09-22T09:53:59.396183+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:53:59.396183+0000","last_undegraded":"2024-09-22T09:53:59.396183+0000","last_fullsized":"2024-09-22T09:53:59.396183+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:53.459446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438059+0000","last_change":"2024-09-22T08:42:15.436664+0000","last_active":"2024-09-22T09:51:37.438059+0000","last_peered":"2024-09-22T09:51:37.438059+0000","last_clean":"2024-09-22T09:51:37.438059+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:51:37.438059+0000","last_undegraded":"2024-09-22T09:51:37.438059+0000","last_fullsized":"2024-09-22T09:51:37.438059+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:03.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'193","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675198+0000","last_change":"2024-09-22T08:42:13.411262+0000","last_active":"2024-09-22T09:51:02.675198+0000","last_peered":"2024-09-22T09:51:02.675198+0000","last_clean":"2024-09-22T09:51:02.675198+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:51:02.675198+0000","last_undegraded":"2024-09-22T09:51:02.675198+0000","last_fullsized":"2024-09-22T09:51:02.675198+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:13.868253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10537104,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":68297,"num_write":935,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438046+0000","last_change":"2024-09-22T08:42:15.434625+0000","last_active":"2024-09-22T09:51:37.438046+0000","last_peered":"2024-09-22T09:51:37.438046+0000","last_clean":"2024-09-22T09:51:37.438046+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:51:37.438046+0000","last_undegraded":"2024-09-22T09:51:37.438046+0000","last_fullsized":"2024-09-22T09:51:37.438046+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:41.767444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.693374+0000","last_change":"2024-09-22T08:42:13.390383+0000","last_active":"2024-09-22T09:50:57.693374+0000","last_peered":"2024-09-22T09:50:57.693374+0000","last_clean":"2024-09-22T09:50:57.693374+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:50:57.693374+0000","last_undegraded":"2024-09-22T09:50:57.693374+0000","last_fullsized":"2024-09-22T09:50:57.693374+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:49.173702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268101,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":8670,"num_write":930,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687969+0000","last_change":"2024-09-22T08:42:15.434734+0000","last_active":"2024-09-22T09:51:37.687969+0000","last_peered":"2024-09-22T09:51:37.687969+0000","last_clean":"2024-09-22T09:51:37.687969+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:51:37.687969+0000","last_undegraded":"2024-09-22T09:51:37.687969+0000","last_fullsized":"2024-09-22T09:51:37.687969+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:30.081403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'195","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682799+0000","last_change":"2024-09-22T08:42:13.405053+0000","last_active":"2024-09-22T09:51:02.682799+0000","last_peered":"2024-09-22T09:51:02.682799+0000","last_clean":"2024-09-22T09:51:02.682799+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:51:02.682799+0000","last_undegraded":"2024-09-22T09:51:02.682799+0000","last_fullsized":"2024-09-22T09:51:02.682799+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:50.824870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4127,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":609,"num_read_kb":540,"num_write":1013,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438008+0000","last_change":"2024-09-22T08:42:15.431647+0000","last_active":"2024-09-22T09:51:37.438008+0000","last_peered":"2024-09-22T09:51:37.438008+0000","last_clean":"2024-09-22T09:51:37.438008+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:51:37.438008+0000","last_undegraded":"2024-09-22T09:51:37.438008+0000","last_fullsized":"2024-09-22T09:51:37.438008+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:55.015297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'203","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663931+0000","last_change":"2024-09-22T08:42:13.415007+0000","last_active":"2024-09-22T09:51:12.663931+0000","last_peered":"2024-09-22T09:51:12.663931+0000","last_clean":"2024-09-22T09:51:12.663931+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:51:12.663931+0000","last_undegraded":"2024-09-22T09:51:12.663931+0000","last_fullsized":"2024-09-22T09:51:12.663931+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:14.358684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54426,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":18552,"num_write":936,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663562+0000","last_change":"2024-09-22T08:42:15.436338+0000","last_active":"2024-09-22T09:51:12.663562+0000","last_peered":"2024-09-22T09:51:12.663562+0000","last_clean":"2024-09-22T09:51:12.663562+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:51:12.663562+0000","last_undegraded":"2024-09-22T09:51:12.663562+0000","last_fullsized":"2024-09-22T09:51:12.663562+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:58.108852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'220","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666067+0000","last_change":"2024-09-22T08:42:13.406108+0000","last_active":"2024-09-22T09:51:32.666067+0000","last_peered":"2024-09-22T09:51:32.666067+0000","last_clean":"2024-09-22T09:51:32.666067+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:51:32.666067+0000","last_undegraded":"2024-09-22T09:51:32.666067+0000","last_fullsized":"2024-09-22T09:51:32.666067+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:52.215127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243409,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":30794,"num_write":964,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'219","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.656045+0000","last_change":"2024-09-22T08:42:15.433745+0000","last_active":"2024-09-22T09:51:42.656045+0000","last_peered":"2024-09-22T09:51:42.656045+0000","last_clean":"2024-09-22T09:51:42.656045+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:51:42.656045+0000","last_undegraded":"2024-09-22T09:51:42.656045+0000","last_fullsized":"2024-09-22T09:51:42.656045+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:09.992145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'275","reported_seq":965,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.437474+0000","last_change":"2024-09-22T08:42:13.422466+0000","last_active":"2024-09-22T09:51:32.437474+0000","last_peered":"2024-09-22T09:51:32.437474+0000","last_clean":"2024-09-22T09:51:32.437474+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:51:32.437474+0000","last_undegraded":"2024-09-22T09:51:32.437474+0000","last_fullsized":"2024-09-22T09:51:32.437474+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:03.795312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487837,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":750,"num_read_kb":37020,"num_write":1214,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662275+0000","last_change":"2024-09-22T08:42:15.440845+0000","last_active":"2024-09-22T09:51:02.662275+0000","last_peered":"2024-09-22T09:51:02.662275+0000","last_clean":"2024-09-22T09:51:02.662275+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:51:02.662275+0000","last_undegraded":"2024-09-22T09:51:02.662275+0000","last_fullsized":"2024-09-22T09:51:02.662275+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:42.146384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'206","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680426+0000","last_change":"2024-09-22T08:42:13.407850+0000","last_active":"2024-09-22T09:51:37.680426+0000","last_peered":"2024-09-22T09:51:37.680426+0000","last_clean":"2024-09-22T09:51:37.680426+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:51:37.680426+0000","last_undegraded":"2024-09-22T09:51:37.680426+0000","last_fullsized":"2024-09-22T09:51:37.680426+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.638315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11563136,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":7650,"num_write":1034,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675220+0000","last_change":"2024-09-22T08:42:15.429000+0000","last_active":"2024-09-22T09:51:02.675220+0000","last_peered":"2024-09-22T09:51:02.675220+0000","last_clean":"2024-09-22T09:51:02.675220+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:51:02.675220+0000","last_undegraded":"2024-09-22T09:51:02.675220+0000","last_fullsized":"2024-09-22T09:51:02.675220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.839044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'227","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666130+0000","last_change":"2024-09-22T08:42:13.415853+0000","last_active":"2024-09-22T09:51:32.666130+0000","last_peered":"2024-09-22T09:51:32.666130+0000","last_clean":"2024-09-22T09:51:32.666130+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:51:32.666130+0000","last_undegraded":"2024-09-22T09:51:32.666130+0000","last_fullsized":"2024-09-22T09:51:32.666130+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:53.049074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244238,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":20476,"num_write":1021,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.397601+0000","last_change":"2024-09-22T08:42:15.440719+0000","last_active":"2024-09-22T09:53:59.397601+0000","last_peered":"2024-09-22T09:53:59.397601+0000","last_clean":"2024-09-22T09:53:59.397601+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:53:59.397601+0000","last_undegraded":"2024-09-22T09:53:59.397601+0000","last_fullsized":"2024-09-22T09:53:59.397601+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:13.105481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'183","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:54.968519+0000","last_change":"2024-09-22T08:42:13.411004+0000","last_active":"2024-09-22T09:53:54.968519+0000","last_peered":"2024-09-22T09:53:54.968519+0000","last_clean":"2024-09-22T09:53:54.968519+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:53:54.968519+0000","last_undegraded":"2024-09-22T09:53:54.968519+0000","last_fullsized":"2024-09-22T09:53:54.968519+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:46.465435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513032,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":7230,"num_write":904,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.157183+0000","last_change":"2024-09-22T08:42:15.428553+0000","last_active":"2024-09-22T09:50:22.157183+0000","last_peered":"2024-09-22T09:50:22.157183+0000","last_clean":"2024-09-22T09:50:22.157183+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:50:22.157183+0000","last_undegraded":"2024-09-22T09:50:22.157183+0000","last_fullsized":"2024-09-22T09:50:22.157183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:18.827032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'224","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669346+0000","last_change":"2024-09-22T08:42:13.407996+0000","last_active":"2024-09-22T09:51:57.669346+0000","last_peered":"2024-09-22T09:51:57.669346+0000","last_clean":"2024-09-22T09:51:57.669346+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:51:57.669346+0000","last_undegraded":"2024-09-22T09:51:57.669346+0000","last_fullsized":"2024-09-22T09:51:57.669346+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:37.268934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509892,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1621,"num_read_kb":135465,"num_write":992,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'142","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.686967+0000","last_change":"2024-09-22T08:42:15.433622+0000","last_active":"2024-09-22T09:49:52.686967+0000","last_peered":"2024-09-22T09:49:52.686967+0000","last_clean":"2024-09-22T09:49:52.686967+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:49:52.686967+0000","last_undegraded":"2024-09-22T09:49:52.686967+0000","last_fullsized":"2024-09-22T09:49:52.686967+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:44.943406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'177","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.020929+0000","last_change":"2024-09-22T08:42:13.402320+0000","last_active":"2024-09-22T09:50:12.020929+0000","last_peered":"2024-09-22T09:50:12.020929+0000","last_clean":"2024-09-22T09:50:12.020929+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:50:12.020929+0000","last_undegraded":"2024-09-22T09:50:12.020929+0000","last_fullsized":"2024-09-22T09:50:12.020929+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:31.569406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5659775,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":433,"num_read_kb":30385,"num_write":835,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545931+0000","last_change":"2024-09-22T08:42:15.428668+0000","last_active":"2024-09-22T09:49:47.545931+0000","last_peered":"2024-09-22T09:49:47.545931+0000","last_clean":"2024-09-22T09:49:47.545931+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:49:47.545931+0000","last_undegraded":"2024-09-22T09:49:47.545931+0000","last_fullsized":"2024-09-22T09:49:47.545931+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:57.959775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'190","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652896+0000","last_change":"2024-09-22T08:42:13.405602+0000","last_active":"2024-09-22T09:49:47.652896+0000","last_peered":"2024-09-22T09:49:47.652896+0000","last_clean":"2024-09-22T09:49:47.652896+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:49:47.652896+0000","last_undegraded":"2024-09-22T09:49:47.652896+0000","last_fullsized":"2024-09-22T09:49:47.652896+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:20.603994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5324486,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":23430,"num_write":909,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":885,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.513374+0000","last_change":"2024-09-22T08:42:15.438409+0000","last_active":"2024-09-22T09:49:47.513374+0000","last_peered":"2024-09-22T09:49:47.513374+0000","last_clean":"2024-09-22T09:49:47.513374+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:49:47.513374+0000","last_undegraded":"2024-09-22T09:49:47.513374+0000","last_fullsized":"2024-09-22T09:49:47.513374+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.728188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'211","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.665417+0000","last_change":"2024-09-22T08:42:13.406750+0000","last_active":"2024-09-22T09:49:47.665417+0000","last_peered":"2024-09-22T09:49:47.665417+0000","last_clean":"2024-09-22T09:49:47.665417+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:49:47.665417+0000","last_undegraded":"2024-09-22T09:49:47.665417+0000","last_fullsized":"2024-09-22T09:49:47.665417+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:31.322960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":533,"num_read_kb":16539,"num_write":977,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":840,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.382202+0000","last_change":"2024-09-22T08:42:15.435371+0000","last_active":"2024-09-22T09:51:35.382202+0000","last_peered":"2024-09-22T09:51:35.382202+0000","last_clean":"2024-09-22T09:51:35.382202+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:51:35.382202+0000","last_undegraded":"2024-09-22T09:51:35.382202+0000","last_fullsized":"2024-09-22T09:51:35.382202+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:25.479186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'190","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.303905+0000","last_change":"2024-09-22T08:42:13.416475+0000","last_active":"2024-09-22T09:51:28.303905+0000","last_peered":"2024-09-22T09:51:28.303905+0000","last_clean":"2024-09-22T09:51:28.303905+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:51:28.303905+0000","last_undegraded":"2024-09-22T09:51:28.303905+0000","last_fullsized":"2024-09-22T09:51:28.303905+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:13.725268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511517,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":32139,"num_write":904,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652546+0000","last_change":"2024-09-22T08:42:15.436821+0000","last_active":"2024-09-22T09:49:47.652546+0000","last_peered":"2024-09-22T09:49:47.652546+0000","last_clean":"2024-09-22T09:49:47.652546+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:49:47.652546+0000","last_undegraded":"2024-09-22T09:49:47.652546+0000","last_fullsized":"2024-09-22T09:49:47.652546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:30.622726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'201","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:23.345932+0000","last_change":"2024-09-22T08:42:13.400175+0000","last_active":"2024-09-22T09:51:23.345932+0000","last_peered":"2024-09-22T09:51:23.345932+0000","last_clean":"2024-09-22T09:51:23.345932+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:51:23.345932+0000","last_undegraded":"2024-09-22T09:51:23.345932+0000","last_fullsized":"2024-09-22T09:51:23.345932+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:35.492802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6061192,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":31835,"num_write":1009,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.532605+0000","last_change":"2024-09-22T08:42:15.433332+0000","last_active":"2024-09-22T09:51:52.532605+0000","last_peered":"2024-09-22T09:51:52.532605+0000","last_clean":"2024-09-22T09:51:52.532605+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:51:52.532605+0000","last_undegraded":"2024-09-22T09:51:52.532605+0000","last_fullsized":"2024-09-22T09:51:52.532605+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:33.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'224","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.823125+0000","last_change":"2024-09-22T08:42:13.417006+0000","last_active":"2024-09-22T09:51:39.823125+0000","last_peered":"2024-09-22T09:51:39.823125+0000","last_clean":"2024-09-22T09:51:39.823125+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:51:39.823125+0000","last_undegraded":"2024-09-22T09:51:39.823125+0000","last_fullsized":"2024-09-22T09:51:39.823125+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:01.120483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15749336,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":662,"num_read_kb":33540,"num_write":1135,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'199","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.099498+0000","last_change":"2024-09-22T08:42:13.414146+0000","last_active":"2024-09-22T09:50:21.099498+0000","last_peered":"2024-09-22T09:50:21.099498+0000","last_clean":"2024-09-22T09:50:21.099498+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:50:21.099498+0000","last_undegraded":"2024-09-22T09:50:21.099498+0000","last_fullsized":"2024-09-22T09:50:21.099498+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:45.228462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10508441,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":16611,"num_write":905,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655515+0000","last_change":"2024-09-22T08:42:15.431931+0000","last_active":"2024-09-22T09:50:07.655515+0000","last_peered":"2024-09-22T09:50:07.655515+0000","last_clean":"2024-09-22T09:50:07.655515+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:50:07.655515+0000","last_undegraded":"2024-09-22T09:50:07.655515+0000","last_fullsized":"2024-09-22T09:50:07.655515+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:55.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'224","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426140+0000","last_change":"2024-09-22T08:42:13.421991+0000","last_active":"2024-09-22T09:49:52.426140+0000","last_peered":"2024-09-22T09:49:52.426140+0000","last_clean":"2024-09-22T09:49:52.426140+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:49:52.426140+0000","last_undegraded":"2024-09-22T09:49:52.426140+0000","last_fullsized":"2024-09-22T09:49:52.426140+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926338,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":653,"num_read_kb":76384,"num_write":1021,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673291+0000","last_change":"2024-09-22T08:42:15.433648+0000","last_active":"2024-09-22T09:49:57.673291+0000","last_peered":"2024-09-22T09:49:57.673291+0000","last_clean":"2024-09-22T09:49:57.673291+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:49:57.673291+0000","last_undegraded":"2024-09-22T09:49:57.673291+0000","last_fullsized":"2024-09-22T09:49:57.673291+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:57.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1596,"ondisk_log_size":1596,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":390,"ondisk_log_size":390,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":464513,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":9727,"num_read_kb":11902,"num_write":6883,"num_write_kb":3179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":192276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1805,"ondisk_log_size":1805,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3773,"ondisk_log_size":3773,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":533460138,"num_objects":410,"num_object_clones":0,"num_object_copies":1640,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":0,"num_read":42187,"num_read_kb":2399793,"num_write":63093,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":715456512,"data_stored":715456512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4338,"ondisk_log_size":4338,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":120,"num_read_kb":189640,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72989493,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":117,"num_read_kb":189064,"num_write":139,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145989632,"data_stored":145978986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543016,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346644,"kb_used_data":103044,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94025196,"statfs":{"total":96636764160,"available":96281800704,"internally_reserved":0,"allocated":105517056,"data_stored":103464448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543016,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414580,"kb_used_data":148772,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93957260,"statfs":{"total":96636764160,"available":96212234240,"internally_reserved":0,"allocated":152342528,"data_stored":150381183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543018,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213764,"kb_used_data":120180,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94158076,"statfs":{"total":96636764160,"available":96417869824,"internally_reserved":0,"allocated":123064320,"data_stored":121014480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543017,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254368,"kb_used_data":146832,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94117472,"statfs":{"total":96636764160,"available":96376291328,"internally_reserved":0,"allocated":150355968,"data_stored":148445373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543016,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356132,"kb_used_data":130580,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94015708,"statfs":{"total":96636764160,"available":96272084992,"internally_reserved":0,"allocated":133713920,"data_stored":131707867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543020,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179808,"kb_used_data":108368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94192032,"statfs":{"total":96636764160,"available":96452640768,"internally_reserved":0,"allocated":110968832,"data_stored":109048955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543016,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264916,"kb_used_data":135236,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94106924,"statfs":{"total":96636764160,"available":96365490176,"internally_reserved":0,"allocated":138481664,"data_stored":136503112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543018,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359156,"kb_used_data":125284,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94012684,"statfs":{"total":96636764160,"available":96268988416,"internally_reserved":0,"allocated":128290816,"data_stored":126284216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":92995584,"data_stored":92995584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84254720,"data_stored":84254720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70447104,"data_stored":70447104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":80138240,"data_stored":80138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":112041984,"data_stored":112041984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":87261184,"data_stored":87261184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":97763328,"data_stored":97763328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90554368,"data_stored":90554368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":26679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":25842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":7470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":26841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":33446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":39804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17412096,"data_stored":17410001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18458577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26222592,"data_stored":26219364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20979712,"data_stored":20976484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3153920,"data_stored":3150692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32555008,"data_stored":32554278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17883136,"data_stored":17879178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24702976,"data_stored":24701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3731456,"data_stored":3730091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:54:16.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T09:54:17.098 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:17.099 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":262,"fsid":"83a27d2c-39d0-4c1b-857e-35a2ddf6d58a","created":"2024-09-22T08:41:40.292875+0000","modified":"2024-09-22T09:20:13.848996+0000","last_up_change":"2024-09-22T08:41:52.173648+0000","last_in_change":"2024-09-22T08:41:42.722676+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T08:41:52.915090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T08:41:58.877419+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-22T08:42:11.336724+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-22T08:42:13.743925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-22T08:42:15.590513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-22T08:42:17.696085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-22T08:42:19.469269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-22T08:42:21.538920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-22T08:57:03.331492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"251","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-22T09:01:06.064445+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-22T09:01:10.463813+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-22T09:20:11.456281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c251b8fa-97aa-48dc-a49b-7f742aad0e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6809","nonce":3239671675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6811","nonce":3239671675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6815","nonce":3239671675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3239671675},{"type":"v1","addr":"172.21.15.39:6813","nonce":3239671675}]},"public_addr":"172.21.15.39:6809/3239671675","cluster_addr":"172.21.15.39:6811/3239671675","heartbeat_back_addr":"172.21.15.39:6815/3239671675","heartbeat_front_addr":"172.21.15.39:6813/3239671675","state":["exists","up"]},{"osd":1,"uuid":"157fcacc-9625-4803-8084-1b80c082b4bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6801","nonce":1561628689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6803","nonce":1561628689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6807","nonce":1561628689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1561628689},{"type":"v1","addr":"172.21.15.39:6805","nonce":1561628689}]},"public_addr":"172.21.15.39:6801/1561628689","cluster_addr":"172.21.15.39:6803/1561628689","heartbeat_back_addr":"172.21.15.39:6807/1561628689","heartbeat_front_addr":"172.21.15.39:6805/1561628689","state":["exists","up"]},{"osd":2,"uuid":"e0413f5d-e2da-4de2-89f7-6d9454e32f4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6825","nonce":1117132609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6827","nonce":1117132609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6831","nonce":1117132609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1117132609},{"type":"v1","addr":"172.21.15.39:6829","nonce":1117132609}]},"public_addr":"172.21.15.39:6825/1117132609","cluster_addr":"172.21.15.39:6827/1117132609","heartbeat_back_addr":"172.21.15.39:6831/1117132609","heartbeat_front_addr":"172.21.15.39:6829/1117132609","state":["exists","up"]},{"osd":3,"uuid":"5b750bea-dbeb-49e1-a7c2-e2e176e1154d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6817","nonce":2957971359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6819","nonce":2957971359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6823","nonce":2957971359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2957971359},{"type":"v1","addr":"172.21.15.39:6821","nonce":2957971359}]},"public_addr":"172.21.15.39:6817/2957971359","cluster_addr":"172.21.15.39:6819/2957971359","heartbeat_back_addr":"172.21.15.39:6823/2957971359","heartbeat_front_addr":"172.21.15.39:6821/2957971359","state":["exists","up"]},{"osd":4,"uuid":"362296d1-a0aa-4fdb-8e29-a5d226635219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6801","nonce":575457324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6803","nonce":575457324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6807","nonce":575457324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":575457324},{"type":"v1","addr":"172.21.15.117:6805","nonce":575457324}]},"public_addr":"172.21.15.117:6801/575457324","cluster_addr":"172.21.15.117:6803/575457324","heartbeat_back_addr":"172.21.15.117:6807/575457324","heartbeat_front_addr":"172.21.15.117:6805/575457324","state":["exists","up"]},{"osd":5,"uuid":"f88b1aa5-636a-4ee0-b9f9-d285898adb31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6809","nonce":1279363323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6811","nonce":1279363323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6815","nonce":1279363323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1279363323},{"type":"v1","addr":"172.21.15.117:6813","nonce":1279363323}]},"public_addr":"172.21.15.117:6809/1279363323","cluster_addr":"172.21.15.117:6811/1279363323","heartbeat_back_addr":"172.21.15.117:6815/1279363323","heartbeat_front_addr":"172.21.15.117:6813/1279363323","state":["exists","up"]},{"osd":6,"uuid":"6582865b-e919-4569-b8bd-e71f770b850d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6817","nonce":277639924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6819","nonce":277639924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6823","nonce":277639924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":277639924},{"type":"v1","addr":"172.21.15.117:6821","nonce":277639924}]},"public_addr":"172.21.15.117:6817/277639924","cluster_addr":"172.21.15.117:6819/277639924","heartbeat_back_addr":"172.21.15.117:6823/277639924","heartbeat_front_addr":"172.21.15.117:6821/277639924","state":["exists","up"]},{"osd":7,"uuid":"38bd038f-6f53-4506-9523-43f0bcf34dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6825","nonce":3276057253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6827","nonce":3276057253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6831","nonce":3276057253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3276057253},{"type":"v1","addr":"172.21.15.117:6829","nonce":3276057253}]},"public_addr":"172.21.15.117:6825/3276057253","cluster_addr":"172.21.15.117:6827/3276057253","heartbeat_back_addr":"172.21.15.117:6831/3276057253","heartbeat_front_addr":"172.21.15.117:6829/3276057253","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.833700+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.259217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.566490+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.067523+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.555351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:48.587557+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.235117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T08:41:49.750747+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":3}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":1}]},{"pgid":"3.3e","mappings":[{"from":6,"to":3}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"67.19","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T09:54:17.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-22T09:54:18.112 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T09:54:18.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:18.268 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:18.268 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:18.268 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:18.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T09:54:18.597 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T09:54:18.611 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T09:54:18.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:18.751 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:18.752 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:18.752 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:18.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T09:54:19.078 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T09:54:19.091 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T09:54:19.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:19.232 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:19.233 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:19.233 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:19.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T09:54:19.564 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T09:54:19.578 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T09:54:19.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:19.720 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:19.720 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:19.720 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:19.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T09:54:20.048 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T09:54:20.061 INFO:tasks.ceph:Scrubbing osd.4 2024-09-22T09:54:20.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:20.204 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:20.204 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:20.204 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:20.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-22T09:54:20.530 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 4 to deep-scrub 2024-09-22T09:54:20.543 INFO:tasks.ceph:Scrubbing osd.5 2024-09-22T09:54:20.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:20.686 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:20.686 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:20.686 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:20.697 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-22T09:54:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 5 to deep-scrub 2024-09-22T09:54:21.030 INFO:tasks.ceph:Scrubbing osd.6 2024-09-22T09:54:21.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:21.172 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:21.173 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:21.173 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:21.183 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-22T09:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 6 to deep-scrub 2024-09-22T09:54:21.516 INFO:tasks.ceph:Scrubbing osd.7 2024-09-22T09:54:21.516 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-22T09:54:21.660 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-22T09:54:21.660 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T09:54:21.660 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-22T09:54:21.671 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-22T09:54:21.990 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 7 to deep-scrub 2024-09-22T09:54:22.004 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:54:22.343 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:22.354 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:54:22.356 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2429,"stamp":"2024-09-22T09:54:20.421703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106502740,"num_objects":492,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":190601,"num_read_kb":2910687,"num_write":128942,"num_write_kb":2504267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13074,"ondisk_log_size":13074,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1557304,"kb_used_data":173336,"kb_used_omap":12,"kb_used_meta":1383411,"kb_avail":753417416,"statfs":{"total":773094113280,"available":771499433984,"internally_reserved":0,"allocated":177496064,"data_stored":161872998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1416613425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-574008158,"num_objects":-282,"num_object_clones":0,"num_object_copies":-1052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-282,"num_whiteouts":0,"num_read":610,"num_read_kb":671,"num_write":439,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005051"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'8","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.705974+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:42.705974+0000","last_peered":"2024-09-22T09:53:42.705974+0000","last_clean":"2024-09-22T09:53:42.705974+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:53:42.705974+0000","last_undegraded":"2024-09-22T09:53:42.705974+0000","last_fullsized":"2024-09-22T09:53:42.705974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.689100+0000","last_change":"2024-09-22T09:20:12.873395+0000","last_active":"2024-09-22T09:50:12.689100+0000","last_peered":"2024-09-22T09:50:12.689100+0000","last_clean":"2024-09-22T09:50:12.689100+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:50:12.689100+0000","last_undegraded":"2024-09-22T09:50:12.689100+0000","last_fullsized":"2024-09-22T09:50:12.689100+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:11.074090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'9","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.579860+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:53:42.579860+0000","last_peered":"2024-09-22T09:53:42.579860+0000","last_clean":"2024-09-22T09:53:42.579860+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:53:42.579860+0000","last_undegraded":"2024-09-22T09:53:42.579860+0000","last_fullsized":"2024-09-22T09:53:42.579860+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":18432,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.948724+0000","last_change":"2024-09-22T09:01:07.465099+0000","last_active":"2024-09-22T09:54:13.948724+0000","last_peered":"2024-09-22T09:54:13.948724+0000","last_clean":"2024-09-22T09:54:13.948724+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:54:13.948724+0000","last_undegraded":"2024-09-22T09:54:13.948724+0000","last_fullsized":"2024-09-22T09:54:13.948724+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:59.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694907+0000","last_change":"2024-09-22T08:57:04.397022+0000","last_active":"2024-09-22T09:51:12.694907+0000","last_peered":"2024-09-22T09:51:12.694907+0000","last_clean":"2024-09-22T09:51:12.694907+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:51:12.694907+0000","last_undegraded":"2024-09-22T09:51:12.694907+0000","last_fullsized":"2024-09-22T09:51:12.694907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:59.048334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.934694+0000","last_change":"2024-09-22T09:01:07.467647+0000","last_active":"2024-09-22T09:54:13.934694+0000","last_peered":"2024-09-22T09:54:13.934694+0000","last_clean":"2024-09-22T09:54:13.934694+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:54:13.934694+0000","last_undegraded":"2024-09-22T09:54:13.934694+0000","last_fullsized":"2024-09-22T09:54:13.934694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:12.140780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":619,"num_write":4,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651709+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:49:37.651709+0000","last_peered":"2024-09-22T09:49:37.651709+0000","last_clean":"2024-09-22T09:49:37.651709+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:49:37.651709+0000","last_undegraded":"2024-09-22T09:49:37.651709+0000","last_fullsized":"2024-09-22T09:49:37.651709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:58:53.738400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":115,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651360+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:49:37.651360+0000","last_peered":"2024-09-22T09:49:37.651360+0000","last_clean":"2024-09-22T09:49:37.651360+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:49:37.651360+0000","last_undegraded":"2024-09-22T09:49:37.651360+0000","last_fullsized":"2024-09-22T09:49:37.651360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:52.455370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.671292+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:52:12.671292+0000","last_peered":"2024-09-22T09:52:12.671292+0000","last_clean":"2024-09-22T09:52:12.671292+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:52:12.671292+0000","last_undegraded":"2024-09-22T09:52:12.671292+0000","last_fullsized":"2024-09-22T09:52:12.671292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.670273+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:49:37.670273+0000","last_peered":"2024-09-22T09:49:37.670273+0000","last_clean":"2024-09-22T09:49:37.670273+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:49:37.670273+0000","last_undegraded":"2024-09-22T09:49:37.670273+0000","last_fullsized":"2024-09-22T09:49:37.670273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:21:49.468579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.669135+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:51:52.669135+0000","last_peered":"2024-09-22T09:51:52.669135+0000","last_clean":"2024-09-22T09:51:52.669135+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:51:52.669135+0000","last_undegraded":"2024-09-22T09:51:52.669135+0000","last_fullsized":"2024-09-22T09:51:52.669135+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.651319+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:49:37.651319+0000","last_peered":"2024-09-22T09:49:37.651319+0000","last_clean":"2024-09-22T09:49:37.651319+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:49:37.651319+0000","last_undegraded":"2024-09-22T09:49:37.651319+0000","last_fullsized":"2024-09-22T09:49:37.651319+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:53.670732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.032206+0000","last_change":"2024-09-22T09:01:11.514663+0000","last_active":"2024-09-22T09:54:14.032206+0000","last_peered":"2024-09-22T09:54:14.032206+0000","last_clean":"2024-09-22T09:54:14.032206+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:54:14.032206+0000","last_undegraded":"2024-09-22T09:54:14.032206+0000","last_fullsized":"2024-09-22T09:54:14.032206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:31.564030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:42.545151+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:49:42.545151+0000","last_peered":"2024-09-22T09:49:42.545151+0000","last_clean":"2024-09-22T09:49:42.545151+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:49:42.545151+0000","last_undegraded":"2024-09-22T09:49:42.545151+0000","last_fullsized":"2024-09-22T09:49:42.545151+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:07:19.067022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":260,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:37.663945+0000","last_change":"2024-09-22T08:57:04.396164+0000","last_active":"2024-09-22T09:49:37.663945+0000","last_peered":"2024-09-22T09:49:37.663945+0000","last_clean":"2024-09-22T09:49:37.663945+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:49:37.663945+0000","last_undegraded":"2024-09-22T09:49:37.663945+0000","last_fullsized":"2024-09-22T09:49:37.663945+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:24.400394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.033215+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:54:14.033215+0000","last_peered":"2024-09-22T09:54:14.033215+0000","last_clean":"2024-09-22T09:54:14.033215+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:54:14.033215+0000","last_undegraded":"2024-09-22T09:54:14.033215+0000","last_fullsized":"2024-09-22T09:54:14.033215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:37.683649+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:53:37.683649+0000","last_peered":"2024-09-22T09:53:37.683649+0000","last_clean":"2024-09-22T09:53:37.683649+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:53:37.683649+0000","last_undegraded":"2024-09-22T09:53:37.683649+0000","last_fullsized":"2024-09-22T09:53:37.683649+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429096+0000","last_change":"2024-09-22T08:57:04.400224+0000","last_active":"2024-09-22T09:50:17.429096+0000","last_peered":"2024-09-22T09:50:17.429096+0000","last_clean":"2024-09-22T09:50:17.429096+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:50:17.429096+0000","last_undegraded":"2024-09-22T09:50:17.429096+0000","last_fullsized":"2024-09-22T09:50:17.429096+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:47.678550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650766+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:49:32.650766+0000","last_peered":"2024-09-22T09:49:32.650766+0000","last_clean":"2024-09-22T09:49:32.650766+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:49:32.650766+0000","last_undegraded":"2024-09-22T09:49:32.650766+0000","last_fullsized":"2024-09-22T09:49:32.650766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:02.822384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'3","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.695974+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:52:32.695974+0000","last_peered":"2024-09-22T09:52:32.695974+0000","last_clean":"2024-09-22T09:52:32.695974+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:52:32.695974+0000","last_undegraded":"2024-09-22T09:52:32.695974+0000","last_fullsized":"2024-09-22T09:52:32.695974+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:26:14.614902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691085+0000","last_change":"2024-09-22T09:20:12.861108+0000","last_active":"2024-09-22T09:50:32.691085+0000","last_peered":"2024-09-22T09:50:32.691085+0000","last_clean":"2024-09-22T09:50:32.691085+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:50:32.691085+0000","last_undegraded":"2024-09-22T09:50:32.691085+0000","last_fullsized":"2024-09-22T09:50:32.691085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:55.356489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'3","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674681+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:52:37.674681+0000","last_peered":"2024-09-22T09:52:37.674681+0000","last_clean":"2024-09-22T09:52:37.674681+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:52:37.674681+0000","last_undegraded":"2024-09-22T09:52:37.674681+0000","last_fullsized":"2024-09-22T09:52:37.674681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.049531+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:54:14.049531+0000","last_peered":"2024-09-22T09:54:14.049531+0000","last_clean":"2024-09-22T09:54:14.049531+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:54:14.049531+0000","last_undegraded":"2024-09-22T09:54:14.049531+0000","last_fullsized":"2024-09-22T09:54:14.049531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.650821+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:49:32.650821+0000","last_peered":"2024-09-22T09:49:32.650821+0000","last_clean":"2024-09-22T09:49:32.650821+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:49:32.650821+0000","last_undegraded":"2024-09-22T09:49:32.650821+0000","last_fullsized":"2024-09-22T09:49:32.650821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:42.484414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'6","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.949157+0000","last_change":"2024-09-22T09:01:07.465474+0000","last_active":"2024-09-22T09:54:13.949157+0000","last_peered":"2024-09-22T09:54:13.949157+0000","last_clean":"2024-09-22T09:54:13.949157+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:54:13.949157+0000","last_undegraded":"2024-09-22T09:54:13.949157+0000","last_fullsized":"2024-09-22T09:54:13.949157+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:54.197542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.689645+0000","last_change":"2024-09-22T08:57:04.398115+0000","last_active":"2024-09-22T09:50:17.689645+0000","last_peered":"2024-09-22T09:50:17.689645+0000","last_clean":"2024-09-22T09:50:17.689645+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:50:17.689645+0000","last_undegraded":"2024-09-22T09:50:17.689645+0000","last_fullsized":"2024-09-22T09:50:17.689645+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:33.062709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":44,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:32.543852+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:49:32.543852+0000","last_peered":"2024-09-22T09:49:32.543852+0000","last_clean":"2024-09-22T09:49:32.543852+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:49:32.543852+0000","last_undegraded":"2024-09-22T09:49:32.543852+0000","last_fullsized":"2024-09-22T09:49:32.543852+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:55:11.506562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.884299+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:54:13.884299+0000","last_peered":"2024-09-22T09:54:13.884299+0000","last_clean":"2024-09-22T09:54:13.884299+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:54:13.884299+0000","last_undegraded":"2024-09-22T09:54:13.884299+0000","last_fullsized":"2024-09-22T09:54:13.884299+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428515+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:50:12.428515+0000","last_peered":"2024-09-22T09:50:12.428515+0000","last_clean":"2024-09-22T09:50:12.428515+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:50:12.428515+0000","last_undegraded":"2024-09-22T09:50:12.428515+0000","last_fullsized":"2024-09-22T09:50:12.428515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:47.707645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.569045+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:52:27.569045+0000","last_peered":"2024-09-22T09:52:27.569045+0000","last_clean":"2024-09-22T09:52:27.569045+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:52:27.569045+0000","last_undegraded":"2024-09-22T09:52:27.569045+0000","last_fullsized":"2024-09-22T09:52:27.569045+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:52.131442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.443836+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:52:32.443836+0000","last_peered":"2024-09-22T09:52:32.443836+0000","last_clean":"2024-09-22T09:52:32.443836+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:52:32.443836+0000","last_undegraded":"2024-09-22T09:52:32.443836+0000","last_fullsized":"2024-09-22T09:52:32.443836+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:49.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655114+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:50:07.655114+0000","last_peered":"2024-09-22T09:50:07.655114+0000","last_clean":"2024-09-22T09:50:07.655114+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:50:07.655114+0000","last_undegraded":"2024-09-22T09:50:07.655114+0000","last_fullsized":"2024-09-22T09:50:07.655114+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:28.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.655936+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:50:12.655936+0000","last_peered":"2024-09-22T09:50:12.655936+0000","last_clean":"2024-09-22T09:50:12.655936+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:50:12.655936+0000","last_undegraded":"2024-09-22T09:50:12.655936+0000","last_fullsized":"2024-09-22T09:50:12.655936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:02.097970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668153+0000","last_change":"2024-09-22T09:01:07.463162+0000","last_active":"2024-09-22T09:50:07.668153+0000","last_peered":"2024-09-22T09:50:07.668153+0000","last_clean":"2024-09-22T09:50:07.668153+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:50:07.668153+0000","last_undegraded":"2024-09-22T09:50:07.668153+0000","last_fullsized":"2024-09-22T09:50:07.668153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:40.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'5","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.017935+0000","last_change":"2024-09-22T09:01:11.517359+0000","last_active":"2024-09-22T09:54:14.017935+0000","last_peered":"2024-09-22T09:54:14.017935+0000","last_clean":"2024-09-22T09:54:14.017935+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:54:14.017935+0000","last_undegraded":"2024-09-22T09:54:14.017935+0000","last_fullsized":"2024-09-22T09:54:14.017935+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:49.248745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'10","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.695112+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:52:27.695112+0000","last_peered":"2024-09-22T09:52:27.695112+0000","last_clean":"2024-09-22T09:52:27.695112+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:52:27.695112+0000","last_undegraded":"2024-09-22T09:52:27.695112+0000","last_fullsized":"2024-09-22T09:52:27.695112+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:43.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691557+0000","last_change":"2024-09-22T09:20:12.858546+0000","last_active":"2024-09-22T09:50:37.691557+0000","last_peered":"2024-09-22T09:50:37.691557+0000","last_clean":"2024-09-22T09:50:37.691557+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:50:37.691557+0000","last_undegraded":"2024-09-22T09:50:37.691557+0000","last_fullsized":"2024-09-22T09:50:37.691557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:50.810813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:57.677847+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:52:57.677847+0000","last_peered":"2024-09-22T09:52:57.677847+0000","last_clean":"2024-09-22T09:52:57.677847+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:52:57.677847+0000","last_undegraded":"2024-09-22T09:52:57.677847+0000","last_fullsized":"2024-09-22T09:52:57.677847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691594+0000","last_change":"2024-09-22T09:01:07.465057+0000","last_active":"2024-09-22T09:50:37.691594+0000","last_peered":"2024-09-22T09:50:37.691594+0000","last_clean":"2024-09-22T09:50:37.691594+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:50:37.691594+0000","last_undegraded":"2024-09-22T09:50:37.691594+0000","last_fullsized":"2024-09-22T09:50:37.691594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:51.656500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.683656+0000","last_change":"2024-09-22T08:57:04.397214+0000","last_active":"2024-09-22T09:51:07.683656+0000","last_peered":"2024-09-22T09:51:07.683656+0000","last_clean":"2024-09-22T09:51:07.683656+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:51:07.683656+0000","last_undegraded":"2024-09-22T09:51:07.683656+0000","last_fullsized":"2024-09-22T09:51:07.683656+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:24.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.671153+0000","last_change":"2024-09-22T09:20:12.869138+0000","last_active":"2024-09-22T09:50:32.671153+0000","last_peered":"2024-09-22T09:50:32.671153+0000","last_clean":"2024-09-22T09:50:32.671153+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:50:32.671153+0000","last_undegraded":"2024-09-22T09:50:32.671153+0000","last_fullsized":"2024-09-22T09:50:32.671153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:20.523450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'8","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.032498+0000","last_change":"2024-09-22T09:01:11.518715+0000","last_active":"2024-09-22T09:54:14.032498+0000","last_peered":"2024-09-22T09:54:14.032498+0000","last_clean":"2024-09-22T09:54:14.032498+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:54:14.032498+0000","last_undegraded":"2024-09-22T09:54:14.032498+0000","last_fullsized":"2024-09-22T09:54:14.032498+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:25.716417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6192,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.677278+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:52:52.677278+0000","last_peered":"2024-09-22T09:52:52.677278+0000","last_clean":"2024-09-22T09:52:52.677278+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:52:52.677278+0000","last_undegraded":"2024-09-22T09:52:52.677278+0000","last_fullsized":"2024-09-22T09:52:52.677278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676022+0000","last_change":"2024-09-22T08:57:04.395860+0000","last_active":"2024-09-22T09:51:07.676022+0000","last_peered":"2024-09-22T09:51:07.676022+0000","last_clean":"2024-09-22T09:51:07.676022+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:51:07.676022+0000","last_undegraded":"2024-09-22T09:51:07.676022+0000","last_fullsized":"2024-09-22T09:51:07.676022+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:13.903713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520070+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:50:32.520070+0000","last_peered":"2024-09-22T09:50:32.520070+0000","last_clean":"2024-09-22T09:50:32.520070+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:50:32.520070+0000","last_undegraded":"2024-09-22T09:50:32.520070+0000","last_fullsized":"2024-09-22T09:50:32.520070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:36.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:07.448284+0000","last_change":"2024-09-22T09:01:07.463902+0000","last_active":"2024-09-22T09:53:07.448284+0000","last_peered":"2024-09-22T09:53:07.448284+0000","last_clean":"2024-09-22T09:53:07.448284+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:53:07.448284+0000","last_undegraded":"2024-09-22T09:53:07.448284+0000","last_fullsized":"2024-09-22T09:53:07.448284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:06.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.694357+0000","last_change":"2024-09-22T08:57:04.397359+0000","last_active":"2024-09-22T09:51:07.694357+0000","last_peered":"2024-09-22T09:51:07.694357+0000","last_clean":"2024-09-22T09:51:07.694357+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:51:07.694357+0000","last_undegraded":"2024-09-22T09:51:07.694357+0000","last_fullsized":"2024-09-22T09:51:07.694357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:55.654439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'9","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.575471+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:53:12.575471+0000","last_peered":"2024-09-22T09:53:12.575471+0000","last_clean":"2024-09-22T09:53:12.575471+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:53:12.575471+0000","last_undegraded":"2024-09-22T09:53:12.575471+0000","last_fullsized":"2024-09-22T09:53:12.575471+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":122,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663336+0000","last_change":"2024-09-22T08:57:04.405441+0000","last_active":"2024-09-22T09:51:07.663336+0000","last_peered":"2024-09-22T09:51:07.663336+0000","last_clean":"2024-09-22T09:51:07.663336+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:51:07.663336+0000","last_undegraded":"2024-09-22T09:51:07.663336+0000","last_fullsized":"2024-09-22T09:51:07.663336+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:56.122641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:07.448190+0000","last_change":"2024-09-22T09:01:07.462593+0000","last_active":"2024-09-22T09:53:07.448190+0000","last_peered":"2024-09-22T09:53:07.448190+0000","last_clean":"2024-09-22T09:53:07.448190+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:53:07.448190+0000","last_undegraded":"2024-09-22T09:53:07.448190+0000","last_fullsized":"2024-09-22T09:53:07.448190+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:03.677122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528666+0000","last_change":"2024-09-22T08:57:04.395828+0000","last_active":"2024-09-22T09:51:27.528666+0000","last_peered":"2024-09-22T09:51:27.528666+0000","last_clean":"2024-09-22T09:51:27.528666+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:51:27.528666+0000","last_undegraded":"2024-09-22T09:51:27.528666+0000","last_fullsized":"2024-09-22T09:51:27.528666+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:01.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431738+0000","last_change":"2024-09-22T09:01:11.516330+0000","last_active":"2024-09-22T09:50:42.431738+0000","last_peered":"2024-09-22T09:50:42.431738+0000","last_clean":"2024-09-22T09:50:42.431738+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:50:42.431738+0000","last_undegraded":"2024-09-22T09:50:42.431738+0000","last_fullsized":"2024-09-22T09:50:42.431738+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:46.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'14","reported_seq":85,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.680090+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:53:12.680090+0000","last_peered":"2024-09-22T09:53:12.680090+0000","last_clean":"2024-09-22T09:53:12.680090+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:53:12.680090+0000","last_undegraded":"2024-09-22T09:53:12.680090+0000","last_fullsized":"2024-09-22T09:53:12.680090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32770,"num_write":29,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.546212+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:22.546212+0000","last_peered":"2024-09-22T09:53:22.546212+0000","last_clean":"2024-09-22T09:53:22.546212+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:53:22.546212+0000","last_undegraded":"2024-09-22T09:53:22.546212+0000","last_fullsized":"2024-09-22T09:53:22.546212+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":74,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677517+0000","last_change":"2024-09-22T08:57:04.395126+0000","last_active":"2024-09-22T09:51:17.677517+0000","last_peered":"2024-09-22T09:51:17.677517+0000","last_clean":"2024-09-22T09:51:17.677517+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:51:17.677517+0000","last_undegraded":"2024-09-22T09:51:17.677517+0000","last_fullsized":"2024-09-22T09:51:17.677517+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:33.605027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.680915+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:53:17.680915+0000","last_peered":"2024-09-22T09:53:17.680915+0000","last_clean":"2024-09-22T09:53:17.680915+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:53:17.680915+0000","last_undegraded":"2024-09-22T09:53:17.680915+0000","last_fullsized":"2024-09-22T09:53:17.680915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.708014+0000","last_change":"2024-09-22T09:01:07.464584+0000","last_active":"2024-09-22T09:53:17.708014+0000","last_peered":"2024-09-22T09:53:17.708014+0000","last_clean":"2024-09-22T09:53:17.708014+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:53:17.708014+0000","last_undegraded":"2024-09-22T09:53:17.708014+0000","last_fullsized":"2024-09-22T09:53:17.708014+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:12.421058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677612+0000","last_change":"2024-09-22T08:57:04.400659+0000","last_active":"2024-09-22T09:51:17.677612+0000","last_peered":"2024-09-22T09:51:17.677612+0000","last_clean":"2024-09-22T09:51:17.677612+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:51:17.677612+0000","last_undegraded":"2024-09-22T09:51:17.677612+0000","last_fullsized":"2024-09-22T09:51:17.677612+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.429612+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:50:22.429612+0000","last_peered":"2024-09-22T09:50:22.429612+0000","last_clean":"2024-09-22T09:50:22.429612+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:50:22.429612+0000","last_undegraded":"2024-09-22T09:50:22.429612+0000","last_fullsized":"2024-09-22T09:50:22.429612+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:16.516456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528740+0000","last_change":"2024-09-22T08:57:04.401962+0000","last_active":"2024-09-22T09:51:27.528740+0000","last_peered":"2024-09-22T09:51:27.528740+0000","last_clean":"2024-09-22T09:51:27.528740+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:51:27.528740+0000","last_undegraded":"2024-09-22T09:51:27.528740+0000","last_fullsized":"2024-09-22T09:51:27.528740+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:43.579055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.435663+0000","last_change":"2024-09-22T08:57:04.397895+0000","last_active":"2024-09-22T09:51:17.435663+0000","last_peered":"2024-09-22T09:51:17.435663+0000","last_clean":"2024-09-22T09:51:17.435663+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:51:17.435663+0000","last_undegraded":"2024-09-22T09:51:17.435663+0000","last_fullsized":"2024-09-22T09:51:17.435663+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:57.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691139+0000","last_change":"2024-09-22T09:20:12.868011+0000","last_active":"2024-09-22T09:50:32.691139+0000","last_peered":"2024-09-22T09:50:32.691139+0000","last_clean":"2024-09-22T09:50:32.691139+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:50:32.691139+0000","last_undegraded":"2024-09-22T09:50:32.691139+0000","last_fullsized":"2024-09-22T09:50:32.691139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:51.261678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.435132+0000","last_change":"2024-09-22T09:01:11.515368+0000","last_active":"2024-09-22T09:51:12.435132+0000","last_peered":"2024-09-22T09:51:12.435132+0000","last_clean":"2024-09-22T09:51:12.435132+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:51:12.435132+0000","last_undegraded":"2024-09-22T09:51:12.435132+0000","last_fullsized":"2024-09-22T09:51:12.435132+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:01.643271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658823+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:50:32.658823+0000","last_peered":"2024-09-22T09:50:32.658823+0000","last_clean":"2024-09-22T09:50:32.658823+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:50:32.658823+0000","last_undegraded":"2024-09-22T09:50:32.658823+0000","last_fullsized":"2024-09-22T09:50:32.658823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:55.492793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.558791+0000","last_change":"2024-09-22T08:57:04.398627+0000","last_active":"2024-09-22T09:51:17.558791+0000","last_peered":"2024-09-22T09:51:17.558791+0000","last_clean":"2024-09-22T09:51:17.558791+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:51:17.558791+0000","last_undegraded":"2024-09-22T09:51:17.558791+0000","last_fullsized":"2024-09-22T09:51:17.558791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:23.008984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676744+0000","last_change":"2024-09-22T09:01:11.522462+0000","last_active":"2024-09-22T09:51:12.676744+0000","last_peered":"2024-09-22T09:51:12.676744+0000","last_clean":"2024-09-22T09:51:12.676744+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:51:12.676744+0000","last_undegraded":"2024-09-22T09:51:12.676744+0000","last_fullsized":"2024-09-22T09:51:12.676744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:13.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434560+0000","last_change":"2024-09-22T09:01:07.463509+0000","last_active":"2024-09-22T09:51:07.434560+0000","last_peered":"2024-09-22T09:51:07.434560+0000","last_clean":"2024-09-22T09:51:07.434560+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:51:07.434560+0000","last_undegraded":"2024-09-22T09:51:07.434560+0000","last_fullsized":"2024-09-22T09:51:07.434560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:59.139960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677548+0000","last_change":"2024-09-22T08:57:04.386372+0000","last_active":"2024-09-22T09:51:17.677548+0000","last_peered":"2024-09-22T09:51:17.677548+0000","last_clean":"2024-09-22T09:51:17.677548+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:51:17.677548+0000","last_undegraded":"2024-09-22T09:51:17.677548+0000","last_fullsized":"2024-09-22T09:51:17.677548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:50.648447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.576360+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:53:17.576360+0000","last_peered":"2024-09-22T09:53:17.576360+0000","last_clean":"2024-09-22T09:53:17.576360+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:53:17.576360+0000","last_undegraded":"2024-09-22T09:53:17.576360+0000","last_fullsized":"2024-09-22T09:53:17.576360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.967003+0000","last_change":"2024-09-22T09:01:07.457691+0000","last_active":"2024-09-22T09:54:13.967003+0000","last_peered":"2024-09-22T09:54:13.967003+0000","last_clean":"2024-09-22T09:54:13.967003+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:54:13.967003+0000","last_undegraded":"2024-09-22T09:54:13.967003+0000","last_fullsized":"2024-09-22T09:54:13.967003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:44.440513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25607,"num_write":10,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'215","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.091587+0000","last_change":"2024-09-22T08:42:13.423188+0000","last_active":"2024-09-22T09:54:14.091587+0000","last_peered":"2024-09-22T09:54:14.091587+0000","last_clean":"2024-09-22T09:54:14.091587+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:54:14.091587+0000","last_undegraded":"2024-09-22T09:54:14.091587+0000","last_fullsized":"2024-09-22T09:54:14.091587+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:47.101356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":13876,"num_write":999,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'141","reported_seq":767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.861787+0000","last_change":"2024-09-22T08:42:15.431071+0000","last_active":"2024-09-22T09:50:12.861787+0000","last_peered":"2024-09-22T09:50:12.861787+0000","last_clean":"2024-09-22T09:50:12.861787+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:50:12.861787+0000","last_undegraded":"2024-09-22T09:50:12.861787+0000","last_fullsized":"2024-09-22T09:50:12.861787+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:37.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'143","reported_seq":799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.061078+0000","last_change":"2024-09-22T08:42:46.096812+0000","last_active":"2024-09-22T09:54:14.061078+0000","last_peered":"2024-09-22T09:54:14.061078+0000","last_clean":"2024-09-22T09:54:14.061078+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:54:14.061078+0000","last_undegraded":"2024-09-22T09:54:14.061078+0000","last_fullsized":"2024-09-22T09:54:14.061078+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:57.098166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":432,"num_read_kb":103374,"num_write":683,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.458574+0000","last_change":"2024-09-22T08:42:15.435522+0000","last_active":"2024-09-22T09:51:48.458574+0000","last_peered":"2024-09-22T09:51:48.458574+0000","last_clean":"2024-09-22T09:51:48.458574+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:51:48.458574+0000","last_undegraded":"2024-09-22T09:51:48.458574+0000","last_fullsized":"2024-09-22T09:51:48.458574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:45.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'209","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.153902+0000","last_change":"2024-09-22T08:42:13.406564+0000","last_active":"2024-09-22T09:54:14.153902+0000","last_peered":"2024-09-22T09:54:14.153902+0000","last_clean":"2024-09-22T09:54:14.153902+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:54:14.153902+0000","last_undegraded":"2024-09-22T09:54:14.153902+0000","last_fullsized":"2024-09-22T09:54:14.153902+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:53:01.206591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":4356,"num_write":984,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545888+0000","last_change":"2024-09-22T08:42:15.422331+0000","last_active":"2024-09-22T09:49:47.545888+0000","last_peered":"2024-09-22T09:49:47.545888+0000","last_clean":"2024-09-22T09:49:47.545888+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:49:47.545888+0000","last_undegraded":"2024-09-22T09:49:47.545888+0000","last_fullsized":"2024-09-22T09:49:47.545888+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:17.082268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'211","reported_seq":856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.061437+0000","last_change":"2024-09-22T08:42:13.412575+0000","last_active":"2024-09-22T09:54:14.061437+0000","last_peered":"2024-09-22T09:54:14.061437+0000","last_clean":"2024-09-22T09:54:14.061437+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:54:14.061437+0000","last_undegraded":"2024-09-22T09:54:14.061437+0000","last_fullsized":"2024-09-22T09:54:14.061437+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:02:29.683561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":600,"num_read_kb":1083,"num_write":1003,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1017,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:21.171752+0000","last_change":"2024-09-22T08:42:15.432415+0000","last_active":"2024-09-22T09:50:21.171752+0000","last_peered":"2024-09-22T09:50:21.171752+0000","last_clean":"2024-09-22T09:50:21.171752+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:50:21.171752+0000","last_undegraded":"2024-09-22T09:50:21.171752+0000","last_fullsized":"2024-09-22T09:50:21.171752+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:34.375014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'204","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:58.565644+0000","last_change":"2024-09-22T08:42:13.415020+0000","last_active":"2024-09-22T09:53:58.565644+0000","last_peered":"2024-09-22T09:53:58.565644+0000","last_clean":"2024-09-22T09:53:58.565644+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:53:58.565644+0000","last_undegraded":"2024-09-22T09:53:58.565644+0000","last_fullsized":"2024-09-22T09:53:58.565644+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:27.087793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":570,"num_read_kb":6282,"num_write":914,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":681,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.669900+0000","last_change":"2024-09-22T08:42:15.432007+0000","last_active":"2024-09-22T09:50:22.669900+0000","last_peered":"2024-09-22T09:50:22.669900+0000","last_clean":"2024-09-22T09:50:22.669900+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:50:22.669900+0000","last_undegraded":"2024-09-22T09:50:22.669900+0000","last_fullsized":"2024-09-22T09:50:22.669900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:22.641506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'218","reported_seq":868,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.124862+0000","last_change":"2024-09-22T08:42:13.406807+0000","last_active":"2024-09-22T09:54:14.124862+0000","last_peered":"2024-09-22T09:54:14.124862+0000","last_clean":"2024-09-22T09:54:14.124862+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:54:14.124862+0000","last_undegraded":"2024-09-22T09:54:14.124862+0000","last_fullsized":"2024-09-22T09:54:14.124862+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:01.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":691,"num_read_kb":1734,"num_write":933,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4552","reported_seq":5321,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556891+0000","last_change":"2024-09-22T08:42:15.421948+0000","last_active":"2024-09-22T09:51:02.556891+0000","last_peered":"2024-09-22T09:51:02.556891+0000","last_clean":"2024-09-22T09:51:02.556891+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:51:02.556891+0000","last_undegraded":"2024-09-22T09:51:02.556891+0000","last_fullsized":"2024-09-22T09:51:02.556891+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":3000,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:54.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'324","reported_seq":1027,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.982125+0000","last_change":"2024-09-22T08:42:13.413783+0000","last_active":"2024-09-22T09:54:13.982125+0000","last_peered":"2024-09-22T09:54:13.982125+0000","last_clean":"2024-09-22T09:54:13.982125+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:54:13.982125+0000","last_undegraded":"2024-09-22T09:54:13.982125+0000","last_fullsized":"2024-09-22T09:54:13.982125+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:22.263546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":40392,"num_write":1278,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'116","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682868+0000","last_change":"2024-09-22T08:42:15.435779+0000","last_active":"2024-09-22T09:51:02.682868+0000","last_peered":"2024-09-22T09:51:02.682868+0000","last_clean":"2024-09-22T09:51:02.682868+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:51:02.682868+0000","last_undegraded":"2024-09-22T09:51:02.682868+0000","last_fullsized":"2024-09-22T09:51:02.682868+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:34.540861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'206","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.019078+0000","last_change":"2024-09-22T08:42:13.409600+0000","last_active":"2024-09-22T09:54:14.019078+0000","last_peered":"2024-09-22T09:54:14.019078+0000","last_clean":"2024-09-22T09:54:14.019078+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:54:14.019078+0000","last_undegraded":"2024-09-22T09:54:14.019078+0000","last_fullsized":"2024-09-22T09:54:14.019078+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:13:38.537153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":708,"num_read_kb":60138,"num_write":928,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:09.872378+0000","last_change":"2024-09-22T08:42:15.430810+0000","last_active":"2024-09-22T09:51:09.872378+0000","last_peered":"2024-09-22T09:51:09.872378+0000","last_clean":"2024-09-22T09:51:09.872378+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:51:09.872378+0000","last_undegraded":"2024-09-22T09:51:09.872378+0000","last_fullsized":"2024-09-22T09:51:09.872378+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:30:24.046046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547462+0000","last_change":"2024-09-22T08:42:15.423020+0000","last_active":"2024-09-22T09:49:57.547462+0000","last_peered":"2024-09-22T09:49:57.547462+0000","last_clean":"2024-09-22T09:49:57.547462+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:49:57.547462+0000","last_undegraded":"2024-09-22T09:49:57.547462+0000","last_fullsized":"2024-09-22T09:49:57.547462+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:50:37.612020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'216","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539397+0000","last_change":"2024-09-22T08:42:13.423588+0000","last_active":"2024-09-22T09:52:32.539397+0000","last_peered":"2024-09-22T09:52:32.539397+0000","last_clean":"2024-09-22T09:52:32.539397+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:52:32.539397+0000","last_undegraded":"2024-09-22T09:52:32.539397+0000","last_fullsized":"2024-09-22T09:52:32.539397+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:30.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":44934,"num_write":915,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514762+0000","last_change":"2024-09-22T08:42:15.436779+0000","last_active":"2024-09-22T09:49:57.514762+0000","last_peered":"2024-09-22T09:49:57.514762+0000","last_clean":"2024-09-22T09:49:57.514762+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:49:57.514762+0000","last_undegraded":"2024-09-22T09:49:57.514762+0000","last_fullsized":"2024-09-22T09:49:57.514762+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:59:13.788611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'137","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:22.686763+0000","last_change":"2024-09-22T08:42:13.397442+0000","last_active":"2024-09-22T09:52:22.686763+0000","last_peered":"2024-09-22T09:52:22.686763+0000","last_clean":"2024-09-22T09:52:22.686763+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:52:22.686763+0000","last_undegraded":"2024-09-22T09:52:22.686763+0000","last_fullsized":"2024-09-22T09:52:22.686763+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":4340,"num_write":703,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:46.831407+0000","last_change":"2024-09-22T08:42:15.430118+0000","last_active":"2024-09-22T09:51:46.831407+0000","last_peered":"2024-09-22T09:51:46.831407+0000","last_clean":"2024-09-22T09:51:46.831407+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:51:46.831407+0000","last_undegraded":"2024-09-22T09:51:46.831407+0000","last_fullsized":"2024-09-22T09:51:46.831407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:28:28.368027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'200","reported_seq":836,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.957462+0000","last_change":"2024-09-22T08:42:46.094591+0000","last_active":"2024-09-22T09:54:13.957462+0000","last_peered":"2024-09-22T09:54:13.957462+0000","last_clean":"2024-09-22T09:54:13.957462+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:54:13.957462+0000","last_undegraded":"2024-09-22T09:54:13.957462+0000","last_fullsized":"2024-09-22T09:54:13.957462+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:10.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":44793,"num_write":917,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'262","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:09.851927+0000","last_change":"2024-09-22T08:42:15.433496+0000","last_active":"2024-09-22T09:50:09.851927+0000","last_peered":"2024-09-22T09:50:09.851927+0000","last_clean":"2024-09-22T09:50:09.851927+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:50:09.851927+0000","last_undegraded":"2024-09-22T09:50:09.851927+0000","last_fullsized":"2024-09-22T09:50:09.851927+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:35:34.253039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'208","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.095182+0000","last_change":"2024-09-22T08:42:13.419441+0000","last_active":"2024-09-22T09:54:14.095182+0000","last_peered":"2024-09-22T09:54:14.095182+0000","last_clean":"2024-09-22T09:54:14.095182+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:54:14.095182+0000","last_undegraded":"2024-09-22T09:54:14.095182+0000","last_fullsized":"2024-09-22T09:54:14.095182+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:50:02.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":639,"num_write":1016,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'334","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:56.563649+0000","last_change":"2024-09-22T08:42:15.431963+0000","last_active":"2024-09-22T09:51:56.563649+0000","last_peered":"2024-09-22T09:51:56.563649+0000","last_clean":"2024-09-22T09:51:56.563649+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:51:56.563649+0000","last_undegraded":"2024-09-22T09:51:56.563649+0000","last_fullsized":"2024-09-22T09:51:56.563649+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:19.216549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'231","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.091376+0000","last_change":"2024-09-22T08:42:13.415311+0000","last_active":"2024-09-22T09:54:14.091376+0000","last_peered":"2024-09-22T09:54:14.091376+0000","last_clean":"2024-09-22T09:54:14.091376+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:54:14.091376+0000","last_undegraded":"2024-09-22T09:54:14.091376+0000","last_fullsized":"2024-09-22T09:54:14.091376+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:24.924985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":35016,"num_write":919,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'67","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547581+0000","last_change":"2024-09-22T08:42:15.436918+0000","last_active":"2024-09-22T09:49:57.547581+0000","last_peered":"2024-09-22T09:49:57.547581+0000","last_clean":"2024-09-22T09:49:57.547581+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:49:57.547581+0000","last_undegraded":"2024-09-22T09:49:57.547581+0000","last_fullsized":"2024-09-22T09:49:57.547581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:11.373207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'204","reported_seq":1067,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.153973+0000","last_change":"2024-09-22T08:42:13.420123+0000","last_active":"2024-09-22T09:54:14.153973+0000","last_peered":"2024-09-22T09:54:14.153973+0000","last_clean":"2024-09-22T09:54:14.153973+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:54:14.153973+0000","last_undegraded":"2024-09-22T09:54:14.153973+0000","last_fullsized":"2024-09-22T09:54:14.153973+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:04.931071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1343,"num_read_kb":71433,"num_write":1020,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'127","reported_seq":637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.786070+0000","last_change":"2024-09-22T08:42:23.524985+0000","last_active":"2024-09-22T09:52:36.786070+0000","last_peered":"2024-09-22T09:52:36.786070+0000","last_clean":"2024-09-22T09:52:36.786070+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:52:36.786070+0000","last_undegraded":"2024-09-22T09:52:36.786070+0000","last_fullsized":"2024-09-22T09:52:36.786070+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:48.897187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":702,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655253+0000","last_change":"2024-09-22T08:42:15.440938+0000","last_active":"2024-09-22T09:50:07.655253+0000","last_peered":"2024-09-22T09:50:07.655253+0000","last_clean":"2024-09-22T09:50:07.655253+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:50:07.655253+0000","last_undegraded":"2024-09-22T09:50:07.655253+0000","last_fullsized":"2024-09-22T09:50:07.655253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:37.823594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'246","reported_seq":947,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.038206+0000","last_change":"2024-09-22T08:42:13.421758+0000","last_active":"2024-09-22T09:54:14.038206+0000","last_peered":"2024-09-22T09:54:14.038206+0000","last_clean":"2024-09-22T09:54:14.038206+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:54:14.038206+0000","last_undegraded":"2024-09-22T09:54:14.038206+0000","last_fullsized":"2024-09-22T09:54:14.038206+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:55.196735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":724,"num_read_kb":75224,"num_write":1095,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673256+0000","last_change":"2024-09-22T08:42:17.436026+0000","last_active":"2024-09-22T09:49:57.673256+0000","last_peered":"2024-09-22T09:49:57.673256+0000","last_clean":"2024-09-22T09:49:57.673256+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:49:57.673256+0000","last_undegraded":"2024-09-22T09:49:57.673256+0000","last_fullsized":"2024-09-22T09:49:57.673256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:39.444676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'216","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.003127+0000","last_change":"2024-09-22T08:42:19.458164+0000","last_active":"2024-09-22T09:54:14.003127+0000","last_peered":"2024-09-22T09:54:14.003127+0000","last_clean":"2024-09-22T09:54:14.003127+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:54:14.003127+0000","last_undegraded":"2024-09-22T09:54:14.003127+0000","last_fullsized":"2024-09-22T09:54:14.003127+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:13.853175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":291,"num_read_kb":380,"num_write":172,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515692+0000","last_change":"2024-09-22T08:42:21.476835+0000","last_active":"2024-09-22T09:50:02.515692+0000","last_peered":"2024-09-22T09:50:02.515692+0000","last_clean":"2024-09-22T09:50:02.515692+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:50:02.515692+0000","last_undegraded":"2024-09-22T09:50:02.515692+0000","last_fullsized":"2024-09-22T09:50:02.515692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:23.164486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'141","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.326568+0000","last_change":"2024-09-22T08:42:23.525612+0000","last_active":"2024-09-22T09:51:11.326568+0000","last_peered":"2024-09-22T09:51:11.326568+0000","last_clean":"2024-09-22T09:51:11.326568+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:51:11.326568+0000","last_undegraded":"2024-09-22T09:51:11.326568+0000","last_fullsized":"2024-09-22T09:51:11.326568+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:43.028034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673203+0000","last_change":"2024-09-22T08:42:15.433777+0000","last_active":"2024-09-22T09:49:57.673203+0000","last_peered":"2024-09-22T09:49:57.673203+0000","last_clean":"2024-09-22T09:49:57.673203+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:49:57.673203+0000","last_undegraded":"2024-09-22T09:49:57.673203+0000","last_fullsized":"2024-09-22T09:49:57.673203+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:10:47.845777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'203","reported_seq":823,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.062864+0000","last_change":"2024-09-22T08:42:13.409995+0000","last_active":"2024-09-22T09:54:14.062864+0000","last_peered":"2024-09-22T09:54:14.062864+0000","last_clean":"2024-09-22T09:54:14.062864+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:54:14.062864+0000","last_undegraded":"2024-09-22T09:54:14.062864+0000","last_fullsized":"2024-09-22T09:54:14.062864+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:32.859795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":43802,"num_write":911,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655271+0000","last_change":"2024-09-22T08:42:17.438392+0000","last_active":"2024-09-22T09:50:07.655271+0000","last_peered":"2024-09-22T09:50:07.655271+0000","last_clean":"2024-09-22T09:50:07.655271+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:50:07.655271+0000","last_undegraded":"2024-09-22T09:50:07.655271+0000","last_fullsized":"2024-09-22T09:50:07.655271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:33.187002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'99","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.845043+0000","last_change":"2024-09-22T08:42:19.453384+0000","last_active":"2024-09-22T09:52:52.845043+0000","last_peered":"2024-09-22T09:52:52.845043+0000","last_clean":"2024-09-22T09:52:52.845043+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:52:52.845043+0000","last_undegraded":"2024-09-22T09:52:52.845043+0000","last_fullsized":"2024-09-22T09:52:52.845043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:58.602109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.548236+0000","last_change":"2024-09-22T08:42:21.479500+0000","last_active":"2024-09-22T09:50:02.548236+0000","last_peered":"2024-09-22T09:50:02.548236+0000","last_clean":"2024-09-22T09:50:02.548236+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:50:02.548236+0000","last_undegraded":"2024-09-22T09:50:02.548236+0000","last_fullsized":"2024-09-22T09:50:02.548236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:12.904978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'108","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.888189+0000","last_change":"2024-09-22T08:42:23.524672+0000","last_active":"2024-09-22T09:51:39.888189+0000","last_peered":"2024-09-22T09:51:39.888189+0000","last_clean":"2024-09-22T09:51:39.888189+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:51:39.888189+0000","last_undegraded":"2024-09-22T09:51:39.888189+0000","last_fullsized":"2024-09-22T09:51:39.888189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:49.539509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":746,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.900800+0000","last_change":"2024-09-22T08:42:15.431967+0000","last_active":"2024-09-22T09:51:39.900800+0000","last_peered":"2024-09-22T09:51:39.900800+0000","last_clean":"2024-09-22T09:51:39.900800+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:51:39.900800+0000","last_undegraded":"2024-09-22T09:51:39.900800+0000","last_fullsized":"2024-09-22T09:51:39.900800+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:21.421688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'246","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.103215+0000","last_change":"2024-09-22T08:42:46.096752+0000","last_active":"2024-09-22T09:54:14.103215+0000","last_peered":"2024-09-22T09:54:14.103215+0000","last_clean":"2024-09-22T09:54:14.103215+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:54:14.103215+0000","last_undegraded":"2024-09-22T09:54:14.103215+0000","last_fullsized":"2024-09-22T09:54:14.103215+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:52.050611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":41488,"num_write":1122,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"36'4","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.391097+0000","last_change":"2024-09-22T08:42:17.436896+0000","last_active":"2024-09-22T09:54:13.391097+0000","last_peered":"2024-09-22T09:54:13.391097+0000","last_clean":"2024-09-22T09:54:13.391097+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:13.391097+0000","last_undegraded":"2024-09-22T09:54:13.391097+0000","last_fullsized":"2024-09-22T09:54:13.391097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:50.909668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'142","reported_seq":692,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.882035+0000","last_change":"2024-09-22T08:42:19.453227+0000","last_active":"2024-09-22T09:52:52.882035+0000","last_peered":"2024-09-22T09:52:52.882035+0000","last_clean":"2024-09-22T09:52:52.882035+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:52:52.882035+0000","last_undegraded":"2024-09-22T09:52:52.882035+0000","last_fullsized":"2024-09-22T09:52:52.882035+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:49.144959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'746","reported_seq":2935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.827250+0000","last_change":"2024-09-22T08:42:21.477386+0000","last_active":"2024-09-22T09:54:13.827250+0000","last_peered":"2024-09-22T09:54:13.827250+0000","last_clean":"2024-09-22T09:54:13.827250+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:13.827250+0000","last_undegraded":"2024-09-22T09:54:13.827250+0000","last_fullsized":"2024-09-22T09:54:13.827250+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:26.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'218","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.675764+0000","last_change":"2024-09-22T08:42:23.578386+0000","last_active":"2024-09-22T09:52:36.675764+0000","last_peered":"2024-09-22T09:52:36.675764+0000","last_clean":"2024-09-22T09:52:36.675764+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:52:36.675764+0000","last_undegraded":"2024-09-22T09:52:36.675764+0000","last_fullsized":"2024-09-22T09:52:36.675764+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:30.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.329583+0000","last_change":"2024-09-22T08:42:15.435930+0000","last_active":"2024-09-22T09:50:15.329583+0000","last_peered":"2024-09-22T09:50:15.329583+0000","last_clean":"2024-09-22T09:50:15.329583+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:50:15.329583+0000","last_undegraded":"2024-09-22T09:50:15.329583+0000","last_fullsized":"2024-09-22T09:50:15.329583+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:06.574368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'178","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.062007+0000","last_change":"2024-09-22T08:42:13.400466+0000","last_active":"2024-09-22T09:54:14.062007+0000","last_peered":"2024-09-22T09:54:14.062007+0000","last_clean":"2024-09-22T09:54:14.062007+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:54:14.062007+0000","last_undegraded":"2024-09-22T09:54:14.062007+0000","last_fullsized":"2024-09-22T09:54:14.062007+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:39:24.218589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":49818,"num_write":846,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673308+0000","last_change":"2024-09-22T08:42:17.435623+0000","last_active":"2024-09-22T09:49:57.673308+0000","last_peered":"2024-09-22T09:49:57.673308+0000","last_clean":"2024-09-22T09:49:57.673308+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:49:57.673308+0000","last_undegraded":"2024-09-22T09:49:57.673308+0000","last_fullsized":"2024-09-22T09:49:57.673308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:28.519736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'150","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.951698+0000","last_change":"2024-09-22T08:42:19.456582+0000","last_active":"2024-09-22T09:54:13.951698+0000","last_peered":"2024-09-22T09:54:13.951698+0000","last_clean":"2024-09-22T09:54:13.951698+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:54:13.951698+0000","last_undegraded":"2024-09-22T09:54:13.951698+0000","last_fullsized":"2024-09-22T09:54:13.951698+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:38.574953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":274,"num_write":110,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'755","reported_seq":2400,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.832370+0000","last_change":"2024-09-22T08:42:21.478967+0000","last_active":"2024-09-22T09:54:13.832370+0000","last_peered":"2024-09-22T09:54:13.832370+0000","last_clean":"2024-09-22T09:54:13.832370+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:13.832370+0000","last_undegraded":"2024-09-22T09:54:13.832370+0000","last_fullsized":"2024-09-22T09:54:13.832370+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:49.086596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687895+0000","last_change":"2024-09-22T08:42:15.434568+0000","last_active":"2024-09-22T09:51:37.687895+0000","last_peered":"2024-09-22T09:51:37.687895+0000","last_clean":"2024-09-22T09:51:37.687895+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:51:37.687895+0000","last_undegraded":"2024-09-22T09:51:37.687895+0000","last_fullsized":"2024-09-22T09:51:37.687895+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:22:47.411833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'193","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.171509+0000","last_change":"2024-09-22T08:42:46.096820+0000","last_active":"2024-09-22T09:54:14.171509+0000","last_peered":"2024-09-22T09:54:14.171509+0000","last_clean":"2024-09-22T09:54:14.171509+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:54:14.171509+0000","last_undegraded":"2024-09-22T09:54:14.171509+0000","last_fullsized":"2024-09-22T09:54:14.171509+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:26.829701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":37265,"num_write":903,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.530209+0000","last_change":"2024-09-22T08:42:17.428741+0000","last_active":"2024-09-22T09:51:37.530209+0000","last_peered":"2024-09-22T09:51:37.530209+0000","last_clean":"2024-09-22T09:51:37.530209+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:51:37.530209+0000","last_undegraded":"2024-09-22T09:51:37.530209+0000","last_fullsized":"2024-09-22T09:51:37.530209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.400097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'252","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.041327+0000","last_change":"2024-09-22T08:42:19.453085+0000","last_active":"2024-09-22T09:54:14.041327+0000","last_peered":"2024-09-22T09:54:14.041327+0000","last_clean":"2024-09-22T09:54:14.041327+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:54:14.041327+0000","last_undegraded":"2024-09-22T09:54:14.041327+0000","last_fullsized":"2024-09-22T09:54:14.041327+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:18.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6788,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":355,"num_read_kb":422,"num_write":210,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426203+0000","last_change":"2024-09-22T08:42:21.473910+0000","last_active":"2024-09-22T09:49:52.426203+0000","last_peered":"2024-09-22T09:49:52.426203+0000","last_clean":"2024-09-22T09:49:52.426203+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:49:52.426203+0000","last_undegraded":"2024-09-22T09:49:52.426203+0000","last_fullsized":"2024-09-22T09:49:52.426203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:36:39.543682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'582","reported_seq":1405,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.730090+0000","last_change":"2024-09-22T08:42:23.524686+0000","last_active":"2024-09-22T09:54:00.730090+0000","last_peered":"2024-09-22T09:54:00.730090+0000","last_clean":"2024-09-22T09:54:00.730090+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:00.730090+0000","last_undegraded":"2024-09-22T09:54:00.730090+0000","last_fullsized":"2024-09-22T09:54:00.730090+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:20.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":996,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.561618+0000","last_change":"2024-09-22T08:42:15.437596+0000","last_active":"2024-09-22T09:51:37.561618+0000","last_peered":"2024-09-22T09:51:37.561618+0000","last_clean":"2024-09-22T09:51:37.561618+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:51:37.561618+0000","last_undegraded":"2024-09-22T09:51:37.561618+0000","last_fullsized":"2024-09-22T09:51:37.561618+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:39.538847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'229","reported_seq":881,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.103874+0000","last_change":"2024-09-22T08:42:13.415541+0000","last_active":"2024-09-22T09:54:14.103874+0000","last_peered":"2024-09-22T09:54:14.103874+0000","last_clean":"2024-09-22T09:54:14.103874+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:54:14.103874+0000","last_undegraded":"2024-09-22T09:54:14.103874+0000","last_fullsized":"2024-09-22T09:54:14.103874+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:48:38.008511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":43078,"num_write":996,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697218+0000","last_change":"2024-09-22T08:42:17.437870+0000","last_active":"2024-09-22T09:51:37.697218+0000","last_peered":"2024-09-22T09:51:37.697218+0000","last_clean":"2024-09-22T09:51:37.697218+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:51:37.697218+0000","last_undegraded":"2024-09-22T09:51:37.697218+0000","last_fullsized":"2024-09-22T09:51:37.697218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:56.092607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'152","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.174757+0000","last_change":"2024-09-22T08:42:19.453046+0000","last_active":"2024-09-22T09:54:14.174757+0000","last_peered":"2024-09-22T09:54:14.174757+0000","last_clean":"2024-09-22T09:54:14.174757+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:54:14.174757+0000","last_undegraded":"2024-09-22T09:54:14.174757+0000","last_fullsized":"2024-09-22T09:54:14.174757+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:19.048949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":232,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2542","reported_seq":4378,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.695093+0000","last_change":"2024-09-22T08:42:23.525193+0000","last_active":"2024-09-22T09:53:22.695093+0000","last_peered":"2024-09-22T09:53:22.695093+0000","last_clean":"2024-09-22T09:53:22.695093+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:53:22.695093+0000","last_undegraded":"2024-09-22T09:53:22.695093+0000","last_fullsized":"2024-09-22T09:53:22.695093+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:05.078232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1200,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681284+0000","last_change":"2024-09-22T08:42:15.439516+0000","last_active":"2024-09-22T09:51:42.681284+0000","last_peered":"2024-09-22T09:51:42.681284+0000","last_clean":"2024-09-22T09:51:42.681284+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:51:42.681284+0000","last_undegraded":"2024-09-22T09:51:42.681284+0000","last_fullsized":"2024-09-22T09:51:42.681284+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:06.792912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'249","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.107734+0000","last_change":"2024-09-22T08:42:13.422752+0000","last_active":"2024-09-22T09:54:14.107734+0000","last_peered":"2024-09-22T09:54:14.107734+0000","last_clean":"2024-09-22T09:54:14.107734+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:54:14.107734+0000","last_undegraded":"2024-09-22T09:54:14.107734+0000","last_fullsized":"2024-09-22T09:54:14.107734+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:29.596026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":17581,"num_write":1026,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.699788+0000","last_change":"2024-09-22T08:42:17.437867+0000","last_active":"2024-09-22T09:52:02.699788+0000","last_peered":"2024-09-22T09:52:02.699788+0000","last_clean":"2024-09-22T09:52:02.699788+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:52:02.699788+0000","last_undegraded":"2024-09-22T09:52:02.699788+0000","last_fullsized":"2024-09-22T09:52:02.699788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:57.450851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'198","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.068294+0000","last_change":"2024-09-22T08:42:19.455781+0000","last_active":"2024-09-22T09:54:14.068294+0000","last_peered":"2024-09-22T09:54:14.068294+0000","last_clean":"2024-09-22T09:54:14.068294+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:54:14.068294+0000","last_undegraded":"2024-09-22T09:54:14.068294+0000","last_fullsized":"2024-09-22T09:54:14.068294+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:37:46.879916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6515,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":336,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'758","reported_seq":2724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.833355+0000","last_change":"2024-09-22T08:42:21.480118+0000","last_active":"2024-09-22T09:54:13.833355+0000","last_peered":"2024-09-22T09:54:13.833355+0000","last_clean":"2024-09-22T09:54:13.833355+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:13.833355+0000","last_undegraded":"2024-09-22T09:54:13.833355+0000","last_fullsized":"2024-09-22T09:54:13.833355+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:26.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'119","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.314868+0000","last_change":"2024-09-22T08:42:23.527331+0000","last_active":"2024-09-22T09:53:59.314868+0000","last_peered":"2024-09-22T09:53:59.314868+0000","last_clean":"2024-09-22T09:53:59.314868+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:53:59.314868+0000","last_undegraded":"2024-09-22T09:53:59.314868+0000","last_fullsized":"2024-09-22T09:53:59.314868+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:06.830634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":884,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.670369+0000","last_change":"2024-09-22T08:42:15.435714+0000","last_active":"2024-09-22T09:52:02.670369+0000","last_peered":"2024-09-22T09:52:02.670369+0000","last_clean":"2024-09-22T09:52:02.670369+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:52:02.670369+0000","last_undegraded":"2024-09-22T09:52:02.670369+0000","last_fullsized":"2024-09-22T09:52:02.670369+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:25.048498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'210","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.179623+0000","last_change":"2024-09-22T08:42:13.403452+0000","last_active":"2024-09-22T09:54:14.179623+0000","last_peered":"2024-09-22T09:54:14.179623+0000","last_clean":"2024-09-22T09:54:14.179623+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:54:14.179623+0000","last_undegraded":"2024-09-22T09:54:14.179623+0000","last_fullsized":"2024-09-22T09:54:14.179623+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:25:14.603364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":60855,"num_write":915,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697795+0000","last_change":"2024-09-22T08:42:17.435826+0000","last_active":"2024-09-22T09:51:42.697795+0000","last_peered":"2024-09-22T09:51:42.697795+0000","last_clean":"2024-09-22T09:51:42.697795+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:51:42.697795+0000","last_undegraded":"2024-09-22T09:51:42.697795+0000","last_fullsized":"2024-09-22T09:51:42.697795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:56.041489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'204","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.084983+0000","last_change":"2024-09-22T08:42:19.452009+0000","last_active":"2024-09-22T09:54:14.084983+0000","last_peered":"2024-09-22T09:54:14.084983+0000","last_clean":"2024-09-22T09:54:14.084983+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:14.084983+0000","last_undegraded":"2024-09-22T09:54:14.084983+0000","last_fullsized":"2024-09-22T09:54:14.084983+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:46.201887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":297,"num_read_kb":387,"num_write":144,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697752+0000","last_change":"2024-09-22T08:42:21.479365+0000","last_active":"2024-09-22T09:51:42.697752+0000","last_peered":"2024-09-22T09:51:42.697752+0000","last_clean":"2024-09-22T09:51:42.697752+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:51:42.697752+0000","last_undegraded":"2024-09-22T09:51:42.697752+0000","last_fullsized":"2024-09-22T09:51:42.697752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.054664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'142","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.315438+0000","last_change":"2024-09-22T08:42:23.525367+0000","last_active":"2024-09-22T09:53:59.315438+0000","last_peered":"2024-09-22T09:53:59.315438+0000","last_clean":"2024-09-22T09:53:59.315438+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:53:59.315438+0000","last_undegraded":"2024-09-22T09:53:59.315438+0000","last_fullsized":"2024-09-22T09:53:59.315438+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:24.183213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":701,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.565115+0000","last_change":"2024-09-22T08:42:15.430534+0000","last_active":"2024-09-22T09:52:02.565115+0000","last_peered":"2024-09-22T09:52:02.565115+0000","last_clean":"2024-09-22T09:52:02.565115+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:52:02.565115+0000","last_undegraded":"2024-09-22T09:52:02.565115+0000","last_fullsized":"2024-09-22T09:52:02.565115+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:45.930207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'366","reported_seq":1051,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.134113+0000","last_change":"2024-09-22T08:42:13.401775+0000","last_active":"2024-09-22T09:54:14.134113+0000","last_peered":"2024-09-22T09:54:14.134113+0000","last_clean":"2024-09-22T09:54:14.134113+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:54:14.134113+0000","last_undegraded":"2024-09-22T09:54:14.134113+0000","last_fullsized":"2024-09-22T09:54:14.134113+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:55:19.013414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1019,"num_read_kb":7434,"num_write":1387,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.699819+0000","last_change":"2024-09-22T08:42:17.438355+0000","last_active":"2024-09-22T09:52:02.699819+0000","last_peered":"2024-09-22T09:52:02.699819+0000","last_clean":"2024-09-22T09:52:02.699819+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:52:02.699819+0000","last_undegraded":"2024-09-22T09:52:02.699819+0000","last_fullsized":"2024-09-22T09:52:02.699819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:23:46.597938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'166","reported_seq":756,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.898712+0000","last_change":"2024-09-22T08:42:19.454917+0000","last_active":"2024-09-22T09:54:13.898712+0000","last_peered":"2024-09-22T09:54:13.898712+0000","last_clean":"2024-09-22T09:54:13.898712+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:54:13.898712+0000","last_undegraded":"2024-09-22T09:54:13.898712+0000","last_fullsized":"2024-09-22T09:54:13.898712+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:48.566070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":182,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654973+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:50:02.654973+0000","last_peered":"2024-09-22T09:50:02.654973+0000","last_clean":"2024-09-22T09:50:02.654973+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:50:02.654973+0000","last_undegraded":"2024-09-22T09:50:02.654973+0000","last_fullsized":"2024-09-22T09:50:02.654973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:44.790859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674614+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:52:37.674614+0000","last_peered":"2024-09-22T09:52:37.674614+0000","last_clean":"2024-09-22T09:52:37.674614+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:52:37.674614+0000","last_undegraded":"2024-09-22T09:52:37.674614+0000","last_fullsized":"2024-09-22T09:52:37.674614+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:23.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":864,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.099788+0000","last_change":"2024-09-22T08:42:15.429567+0000","last_active":"2024-09-22T09:52:32.099788+0000","last_peered":"2024-09-22T09:52:32.099788+0000","last_clean":"2024-09-22T09:52:32.099788+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:52:32.099788+0000","last_undegraded":"2024-09-22T09:52:32.099788+0000","last_fullsized":"2024-09-22T09:52:32.099788+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:58.301320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'237","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.076042+0000","last_change":"2024-09-22T08:42:13.403639+0000","last_active":"2024-09-22T09:54:14.076042+0000","last_peered":"2024-09-22T09:54:14.076042+0000","last_clean":"2024-09-22T09:54:14.076042+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:54:14.076042+0000","last_undegraded":"2024-09-22T09:54:14.076042+0000","last_fullsized":"2024-09-22T09:54:14.076042+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:45.735642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242950,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":767,"num_read_kb":42930,"num_write":1126,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.440558+0000","last_change":"2024-09-22T08:42:17.436642+0000","last_active":"2024-09-22T09:52:02.440558+0000","last_peered":"2024-09-22T09:52:02.440558+0000","last_clean":"2024-09-22T09:52:02.440558+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:52:02.440558+0000","last_undegraded":"2024-09-22T09:52:02.440558+0000","last_fullsized":"2024-09-22T09:52:02.440558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:56.592253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'193","reported_seq":797,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.139151+0000","last_change":"2024-09-22T08:42:19.451872+0000","last_active":"2024-09-22T09:54:14.139151+0000","last_peered":"2024-09-22T09:54:14.139151+0000","last_clean":"2024-09-22T09:54:14.139151+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:54:14.139151+0000","last_undegraded":"2024-09-22T09:54:14.139151+0000","last_fullsized":"2024-09-22T09:54:14.139151+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:59:10.727757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'722","reported_seq":2495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.909731+0000","last_change":"2024-09-22T08:42:21.477749+0000","last_active":"2024-09-22T09:54:13.909731+0000","last_peered":"2024-09-22T09:54:13.909731+0000","last_clean":"2024-09-22T09:54:13.909731+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:13.909731+0000","last_undegraded":"2024-09-22T09:54:13.909731+0000","last_fullsized":"2024-09-22T09:54:13.909731+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:54:39.808571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'139","reported_seq":639,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:34.236678+0000","last_change":"2024-09-22T08:42:23.527200+0000","last_active":"2024-09-22T09:52:34.236678+0000","last_peered":"2024-09-22T09:52:34.236678+0000","last_clean":"2024-09-22T09:52:34.236678+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:52:34.236678+0000","last_undegraded":"2024-09-22T09:52:34.236678+0000","last_fullsized":"2024-09-22T09:52:34.236678+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:36.368516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":723,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.565161+0000","last_change":"2024-09-22T08:42:15.434596+0000","last_active":"2024-09-22T09:52:02.565161+0000","last_peered":"2024-09-22T09:52:02.565161+0000","last_clean":"2024-09-22T09:52:02.565161+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:52:02.565161+0000","last_undegraded":"2024-09-22T09:52:02.565161+0000","last_fullsized":"2024-09-22T09:52:02.565161+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:08.897077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'258","reported_seq":975,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.048064+0000","last_change":"2024-09-22T08:42:46.165164+0000","last_active":"2024-09-22T09:54:14.048064+0000","last_peered":"2024-09-22T09:54:14.048064+0000","last_clean":"2024-09-22T09:54:14.048064+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:54:14.048064+0000","last_undegraded":"2024-09-22T09:54:14.048064+0000","last_fullsized":"2024-09-22T09:54:14.048064+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:28.663766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1203,"num_read_kb":6055,"num_write":1103,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1452,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.403388+0000","last_change":"2024-09-22T08:42:17.433014+0000","last_active":"2024-09-22T09:54:13.403388+0000","last_peered":"2024-09-22T09:54:13.403388+0000","last_clean":"2024-09-22T09:54:13.403388+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:13.403388+0000","last_undegraded":"2024-09-22T09:54:13.403388+0000","last_fullsized":"2024-09-22T09:54:13.403388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:41.112528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'132","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.816417+0000","last_change":"2024-09-22T08:42:19.457240+0000","last_active":"2024-09-22T09:52:52.816417+0000","last_peered":"2024-09-22T09:52:52.816417+0000","last_clean":"2024-09-22T09:52:52.816417+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:52:52.816417+0000","last_undegraded":"2024-09-22T09:52:52.816417+0000","last_fullsized":"2024-09-22T09:52:52.816417+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:43.701333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'757","reported_seq":2730,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.829772+0000","last_change":"2024-09-22T08:42:21.479394+0000","last_active":"2024-09-22T09:54:13.829772+0000","last_peered":"2024-09-22T09:54:13.829772+0000","last_clean":"2024-09-22T09:54:13.829772+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:13.829772+0000","last_undegraded":"2024-09-22T09:54:13.829772+0000","last_fullsized":"2024-09-22T09:54:13.829772+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:36.701700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'118","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558129+0000","last_change":"2024-09-22T08:42:23.526928+0000","last_active":"2024-09-22T09:51:12.558129+0000","last_peered":"2024-09-22T09:51:12.558129+0000","last_clean":"2024-09-22T09:51:12.558129+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:51:12.558129+0000","last_undegraded":"2024-09-22T09:51:12.558129+0000","last_fullsized":"2024-09-22T09:51:12.558129+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:16.995273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.427871+0000","last_change":"2024-09-22T08:42:15.434196+0000","last_active":"2024-09-22T09:50:07.427871+0000","last_peered":"2024-09-22T09:50:07.427871+0000","last_clean":"2024-09-22T09:50:07.427871+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:50:07.427871+0000","last_undegraded":"2024-09-22T09:50:07.427871+0000","last_fullsized":"2024-09-22T09:50:07.427871+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:06:29.967093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'188","reported_seq":863,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.155951+0000","last_change":"2024-09-22T08:42:13.403505+0000","last_active":"2024-09-22T09:54:14.155951+0000","last_peered":"2024-09-22T09:54:14.155951+0000","last_clean":"2024-09-22T09:54:14.155951+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:54:14.155951+0000","last_undegraded":"2024-09-22T09:54:14.155951+0000","last_fullsized":"2024-09-22T09:54:14.155951+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:50:46.095633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":707,"num_read_kb":142631,"num_write":847,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.565147+0000","last_change":"2024-09-22T08:42:17.428207+0000","last_active":"2024-09-22T09:52:02.565147+0000","last_peered":"2024-09-22T09:52:02.565147+0000","last_clean":"2024-09-22T09:52:02.565147+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:52:02.565147+0000","last_undegraded":"2024-09-22T09:52:02.565147+0000","last_fullsized":"2024-09-22T09:52:02.565147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:36.330654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'223","reported_seq":852,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.010392+0000","last_change":"2024-09-22T08:42:19.459817+0000","last_active":"2024-09-22T09:54:14.010392+0000","last_peered":"2024-09-22T09:54:14.010392+0000","last_clean":"2024-09-22T09:54:14.010392+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:54:14.010392+0000","last_undegraded":"2024-09-22T09:54:14.010392+0000","last_fullsized":"2024-09-22T09:54:14.010392+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:06.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":186,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.666030+0000","last_change":"2024-09-22T08:42:21.481035+0000","last_active":"2024-09-22T09:49:52.666030+0000","last_peered":"2024-09-22T09:49:52.666030+0000","last_clean":"2024-09-22T09:49:52.666030+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:49:52.666030+0000","last_undegraded":"2024-09-22T09:49:52.666030+0000","last_fullsized":"2024-09-22T09:49:52.666030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:13.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'130","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.452137+0000","last_change":"2024-09-22T08:42:23.529103+0000","last_active":"2024-09-22T09:51:48.452137+0000","last_peered":"2024-09-22T09:51:48.452137+0000","last_clean":"2024-09-22T09:51:48.452137+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:51:48.452137+0000","last_undegraded":"2024-09-22T09:51:48.452137+0000","last_fullsized":"2024-09-22T09:51:48.452137+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:43.270586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676034+0000","last_change":"2024-09-22T08:42:15.435903+0000","last_active":"2024-09-22T09:51:07.676034+0000","last_peered":"2024-09-22T09:51:07.676034+0000","last_clean":"2024-09-22T09:51:07.676034+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:51:07.676034+0000","last_undegraded":"2024-09-22T09:51:07.676034+0000","last_fullsized":"2024-09-22T09:51:07.676034+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:23:50.676641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.535997+0000","last_change":"2024-09-22T08:41:54.774798+0000","last_active":"2024-09-22T09:52:12.535997+0000","last_peered":"2024-09-22T09:52:12.535997+0000","last_clean":"2024-09-22T09:52:12.535997+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:52:12.535997+0000","last_undegraded":"2024-09-22T09:52:12.535997+0000","last_fullsized":"2024-09-22T09:52:12.535997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:53.176588+0000","last_clean_scrub_stamp":"2024-09-22T08:41:53.176588+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:43.736359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":529,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680619+0000","last_change":"2024-09-22T08:42:02.252322+0000","last_active":"2024-09-22T09:50:47.680619+0000","last_peered":"2024-09-22T09:50:47.680619+0000","last_clean":"2024-09-22T09:50:47.680619+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:50:47.680619+0000","last_undegraded":"2024-09-22T09:50:47.680619+0000","last_fullsized":"2024-09-22T09:50:47.680619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:11:50.316250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'265","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.170579+0000","last_change":"2024-09-22T08:42:46.093573+0000","last_active":"2024-09-22T09:54:14.170579+0000","last_peered":"2024-09-22T09:54:14.170579+0000","last_clean":"2024-09-22T09:54:14.170579+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:54:14.170579+0000","last_undegraded":"2024-09-22T09:54:14.170579+0000","last_fullsized":"2024-09-22T09:54:14.170579+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:55.591787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":19734,"num_write":1091,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524909+0000","last_change":"2024-09-22T08:42:17.430962+0000","last_active":"2024-09-22T09:51:02.524909+0000","last_peered":"2024-09-22T09:51:02.524909+0000","last_clean":"2024-09-22T09:51:02.524909+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:51:02.524909+0000","last_undegraded":"2024-09-22T09:51:02.524909+0000","last_fullsized":"2024-09-22T09:51:02.524909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:38.741426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'321","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.126335+0000","last_change":"2024-09-22T08:42:19.458458+0000","last_active":"2024-09-22T09:54:14.126335+0000","last_peered":"2024-09-22T09:54:14.126335+0000","last_clean":"2024-09-22T09:54:14.126335+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:14.126335+0000","last_undegraded":"2024-09-22T09:54:14.126335+0000","last_fullsized":"2024-09-22T09:54:14.126335+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:21.464285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":739,"num_write":494,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.668007+0000","last_change":"2024-09-22T08:42:21.476608+0000","last_active":"2024-09-22T09:51:42.668007+0000","last_peered":"2024-09-22T09:51:42.668007+0000","last_clean":"2024-09-22T09:51:42.668007+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:51:42.668007+0000","last_undegraded":"2024-09-22T09:51:42.668007+0000","last_fullsized":"2024-09-22T09:51:42.668007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:00.388229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'205","reported_seq":913,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.706774+0000","last_change":"2024-09-22T08:42:23.527973+0000","last_active":"2024-09-22T09:52:36.706774+0000","last_peered":"2024-09-22T09:52:36.706774+0000","last_clean":"2024-09-22T09:52:36.706774+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:52:36.706774+0000","last_undegraded":"2024-09-22T09:52:36.706774+0000","last_fullsized":"2024-09-22T09:52:36.706774+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:38.241959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'136","reported_seq":761,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667317+0000","last_change":"2024-09-22T08:42:46.096326+0000","last_active":"2024-09-22T09:51:37.667317+0000","last_peered":"2024-09-22T09:51:37.667317+0000","last_clean":"2024-09-22T09:51:37.667317+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:51:37.667317+0000","last_undegraded":"2024-09-22T09:51:37.667317+0000","last_fullsized":"2024-09-22T09:51:37.667317+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:21.464651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:17.536704+0000","last_change":"2024-09-22T08:42:03.332243+0000","last_active":"2024-09-22T09:52:17.536704+0000","last_peered":"2024-09-22T09:52:17.536704+0000","last_clean":"2024-09-22T09:52:17.536704+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:52:17.536704+0000","last_undegraded":"2024-09-22T09:52:17.536704+0000","last_fullsized":"2024-09-22T09:52:17.536704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:15:03.304689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'211","reported_seq":912,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.021077+0000","last_change":"2024-09-22T08:42:13.420863+0000","last_active":"2024-09-22T09:54:14.021077+0000","last_peered":"2024-09-22T09:54:14.021077+0000","last_clean":"2024-09-22T09:54:14.021077+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:54:14.021077+0000","last_undegraded":"2024-09-22T09:54:14.021077+0000","last_fullsized":"2024-09-22T09:54:14.021077+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:47.662518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":801,"num_read_kb":134895,"num_write":909,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.688003+0000","last_change":"2024-09-22T08:42:17.440799+0000","last_active":"2024-09-22T09:51:37.688003+0000","last_peered":"2024-09-22T09:51:37.688003+0000","last_clean":"2024-09-22T09:51:37.688003+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:51:37.688003+0000","last_undegraded":"2024-09-22T09:51:37.688003+0000","last_fullsized":"2024-09-22T09:51:37.688003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:27.078620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'900","reported_seq":2712,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.181834+0000","last_change":"2024-09-22T08:42:19.455687+0000","last_active":"2024-09-22T09:54:14.181834+0000","last_peered":"2024-09-22T09:54:14.181834+0000","last_clean":"2024-09-22T09:54:14.181834+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:14.181834+0000","last_undegraded":"2024-09-22T09:54:14.181834+0000","last_fullsized":"2024-09-22T09:54:14.181834+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":801,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.282664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22457,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1275,"num_read_kb":1494,"num_write":384,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.527988+0000","last_change":"2024-09-22T08:42:21.476397+0000","last_active":"2024-09-22T09:51:22.527988+0000","last_peered":"2024-09-22T09:51:22.527988+0000","last_clean":"2024-09-22T09:51:22.527988+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:51:22.527988+0000","last_undegraded":"2024-09-22T09:51:22.527988+0000","last_fullsized":"2024-09-22T09:51:22.527988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:11.328442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'234","reported_seq":762,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.441069+0000","last_change":"2024-09-22T08:42:23.576879+0000","last_active":"2024-09-22T09:52:07.441069+0000","last_peered":"2024-09-22T09:52:07.441069+0000","last_clean":"2024-09-22T09:52:07.441069+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:52:07.441069+0000","last_undegraded":"2024-09-22T09:52:07.441069+0000","last_fullsized":"2024-09-22T09:52:07.441069+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:21.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438071+0000","last_change":"2024-09-22T08:42:15.437627+0000","last_active":"2024-09-22T09:51:37.438071+0000","last_peered":"2024-09-22T09:51:37.438071+0000","last_clean":"2024-09-22T09:51:37.438071+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:51:37.438071+0000","last_undegraded":"2024-09-22T09:51:37.438071+0000","last_fullsized":"2024-09-22T09:51:37.438071+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:50:22.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.692480+0000","last_change":"2024-09-22T08:42:02.511877+0000","last_active":"2024-09-22T09:50:47.692480+0000","last_peered":"2024-09-22T09:50:47.692480+0000","last_clean":"2024-09-22T09:50:47.692480+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:50:47.692480+0000","last_undegraded":"2024-09-22T09:50:47.692480+0000","last_fullsized":"2024-09-22T09:50:47.692480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:29:28.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'200","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.095151+0000","last_change":"2024-09-22T08:42:13.407521+0000","last_active":"2024-09-22T09:54:14.095151+0000","last_peered":"2024-09-22T09:54:14.095151+0000","last_clean":"2024-09-22T09:54:14.095151+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:54:14.095151+0000","last_undegraded":"2024-09-22T09:54:14.095151+0000","last_fullsized":"2024-09-22T09:54:14.095151+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:16.981459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485786,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":19334,"num_write":886,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.697276+0000","last_change":"2024-09-22T08:42:17.436489+0000","last_active":"2024-09-22T09:51:37.697276+0000","last_peered":"2024-09-22T09:51:37.697276+0000","last_clean":"2024-09-22T09:51:37.697276+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:51:37.697276+0000","last_undegraded":"2024-09-22T09:51:37.697276+0000","last_fullsized":"2024-09-22T09:51:37.697276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:43.716495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'282","reported_seq":1698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.992925+0000","last_change":"2024-09-22T08:42:19.458357+0000","last_active":"2024-09-22T09:53:57.992925+0000","last_peered":"2024-09-22T09:53:57.992925+0000","last_clean":"2024-09-22T09:53:57.992925+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:53:57.992925+0000","last_undegraded":"2024-09-22T09:53:57.992925+0000","last_fullsized":"2024-09-22T09:53:57.992925+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:59.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663363+0000","last_change":"2024-09-22T08:42:21.479092+0000","last_active":"2024-09-22T09:51:07.663363+0000","last_peered":"2024-09-22T09:51:07.663363+0000","last_clean":"2024-09-22T09:51:07.663363+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:51:07.663363+0000","last_undegraded":"2024-09-22T09:51:07.663363+0000","last_fullsized":"2024-09-22T09:51:07.663363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:10.715693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.853797+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:35.853797+0000","last_peered":"2024-09-22T09:52:35.853797+0000","last_clean":"2024-09-22T09:52:35.853797+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:35.853797+0000","last_undegraded":"2024-09-22T09:52:35.853797+0000","last_fullsized":"2024-09-22T09:52:35.853797+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:33:52.995365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.434014+0000","last_change":"2024-09-22T08:42:15.430662+0000","last_active":"2024-09-22T09:51:02.434014+0000","last_peered":"2024-09-22T09:51:02.434014+0000","last_clean":"2024-09-22T09:51:02.434014+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:51:02.434014+0000","last_undegraded":"2024-09-22T09:51:02.434014+0000","last_fullsized":"2024-09-22T09:51:02.434014+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:01.989354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":530,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.680585+0000","last_change":"2024-09-22T08:42:02.252760+0000","last_active":"2024-09-22T09:50:47.680585+0000","last_peered":"2024-09-22T09:50:47.680585+0000","last_clean":"2024-09-22T09:50:47.680585+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:50:47.680585+0000","last_undegraded":"2024-09-22T09:50:47.680585+0000","last_fullsized":"2024-09-22T09:50:47.680585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:10:45.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'227","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.103790+0000","last_change":"2024-09-22T08:42:13.416911+0000","last_active":"2024-09-22T09:54:14.103790+0000","last_peered":"2024-09-22T09:54:14.103790+0000","last_clean":"2024-09-22T09:54:14.103790+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:54:14.103790+0000","last_undegraded":"2024-09-22T09:54:14.103790+0000","last_fullsized":"2024-09-22T09:54:14.103790+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:31.168513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":44921,"num_write":1103,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663982+0000","last_change":"2024-09-22T08:42:17.437159+0000","last_active":"2024-09-22T09:51:12.663982+0000","last_peered":"2024-09-22T09:51:12.663982+0000","last_clean":"2024-09-22T09:51:12.663982+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:51:12.663982+0000","last_undegraded":"2024-09-22T09:51:12.663982+0000","last_fullsized":"2024-09-22T09:51:12.663982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.902285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'158","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.565701+0000","last_change":"2024-09-22T08:42:19.456365+0000","last_active":"2024-09-22T09:53:52.565701+0000","last_peered":"2024-09-22T09:53:52.565701+0000","last_clean":"2024-09-22T09:53:52.565701+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:53:52.565701+0000","last_undegraded":"2024-09-22T09:53:52.565701+0000","last_fullsized":"2024-09-22T09:53:52.565701+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:24.107895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681332+0000","last_change":"2024-09-22T08:42:21.479775+0000","last_active":"2024-09-22T09:51:42.681332+0000","last_peered":"2024-09-22T09:51:42.681332+0000","last_clean":"2024-09-22T09:51:42.681332+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:51:42.681332+0000","last_undegraded":"2024-09-22T09:51:42.681332+0000","last_fullsized":"2024-09-22T09:51:42.681332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:27.626455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'121","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.689264+0000","last_change":"2024-09-22T08:42:23.527151+0000","last_active":"2024-09-22T09:51:47.689264+0000","last_peered":"2024-09-22T09:51:47.689264+0000","last_clean":"2024-09-22T09:51:47.689264+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:51:47.689264+0000","last_undegraded":"2024-09-22T09:51:47.689264+0000","last_fullsized":"2024-09-22T09:51:47.689264+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:36.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":931,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.433983+0000","last_change":"2024-09-22T08:42:15.437662+0000","last_active":"2024-09-22T09:51:02.433983+0000","last_peered":"2024-09-22T09:51:02.433983+0000","last_clean":"2024-09-22T09:51:02.433983+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:51:02.433983+0000","last_undegraded":"2024-09-22T09:51:02.433983+0000","last_fullsized":"2024-09-22T09:51:02.433983+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:44.376313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'191","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.052518+0000","last_change":"2024-09-22T08:42:13.406072+0000","last_active":"2024-09-22T09:54:14.052518+0000","last_peered":"2024-09-22T09:54:14.052518+0000","last_clean":"2024-09-22T09:54:14.052518+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:54:14.052518+0000","last_undegraded":"2024-09-22T09:54:14.052518+0000","last_fullsized":"2024-09-22T09:54:14.052518+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:34:54.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":36411,"num_write":937,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.432285+0000","last_change":"2024-09-22T08:42:02.254750+0000","last_active":"2024-09-22T09:50:47.432285+0000","last_peered":"2024-09-22T09:50:47.432285+0000","last_clean":"2024-09-22T09:50:47.432285+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:50:47.432285+0000","last_undegraded":"2024-09-22T09:50:47.432285+0000","last_fullsized":"2024-09-22T09:50:47.432285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:33.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662643+0000","last_change":"2024-09-22T08:42:17.436067+0000","last_active":"2024-09-22T09:51:02.662643+0000","last_peered":"2024-09-22T09:51:02.662643+0000","last_clean":"2024-09-22T09:51:02.662643+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:51:02.662643+0000","last_undegraded":"2024-09-22T09:51:02.662643+0000","last_fullsized":"2024-09-22T09:51:02.662643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:08.963170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'358","reported_seq":1045,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.136117+0000","last_change":"2024-09-22T08:42:19.456910+0000","last_active":"2024-09-22T09:54:14.136117+0000","last_peered":"2024-09-22T09:54:14.136117+0000","last_clean":"2024-09-22T09:54:14.136117+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:14.136117+0000","last_undegraded":"2024-09-22T09:54:14.136117+0000","last_fullsized":"2024-09-22T09:54:14.136117+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:35.309371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18381,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1194,"num_read_kb":1339,"num_write":1770,"num_write_kb":1581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557458+0000","last_change":"2024-09-22T08:42:21.481570+0000","last_active":"2024-09-22T09:51:07.557458+0000","last_peered":"2024-09-22T09:51:07.557458+0000","last_clean":"2024-09-22T09:51:07.557458+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:51:07.557458+0000","last_undegraded":"2024-09-22T09:51:07.557458+0000","last_fullsized":"2024-09-22T09:51:07.557458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:52.544367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.135926+0000","last_change":"2024-09-22T08:42:23.578322+0000","last_active":"2024-09-22T09:52:33.135926+0000","last_peered":"2024-09-22T09:52:33.135926+0000","last_clean":"2024-09-22T09:52:33.135926+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:52:33.135926+0000","last_undegraded":"2024-09-22T09:52:33.135926+0000","last_fullsized":"2024-09-22T09:52:33.135926+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:06.092146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662627+0000","last_change":"2024-09-22T08:42:15.425980+0000","last_active":"2024-09-22T09:51:02.662627+0000","last_peered":"2024-09-22T09:51:02.662627+0000","last_clean":"2024-09-22T09:51:02.662627+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:51:02.662627+0000","last_undegraded":"2024-09-22T09:51:02.662627+0000","last_fullsized":"2024-09-22T09:51:02.662627+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:16:08.622112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'220","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:54.237654+0000","last_change":"2024-09-22T08:42:13.422109+0000","last_active":"2024-09-22T09:53:54.237654+0000","last_peered":"2024-09-22T09:53:54.237654+0000","last_clean":"2024-09-22T09:53:54.237654+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:53:54.237654+0000","last_undegraded":"2024-09-22T09:53:54.237654+0000","last_fullsized":"2024-09-22T09:53:54.237654+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:30.891651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":1845,"num_write":1046,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524935+0000","last_change":"2024-09-22T08:42:03.332293+0000","last_active":"2024-09-22T09:51:02.524935+0000","last_peered":"2024-09-22T09:51:02.524935+0000","last_clean":"2024-09-22T09:51:02.524935+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:51:02.524935+0000","last_undegraded":"2024-09-22T09:51:02.524935+0000","last_fullsized":"2024-09-22T09:51:02.524935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:39.820477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675254+0000","last_change":"2024-09-22T08:42:17.436017+0000","last_active":"2024-09-22T09:51:02.675254+0000","last_peered":"2024-09-22T09:51:02.675254+0000","last_clean":"2024-09-22T09:51:02.675254+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:51:02.675254+0000","last_undegraded":"2024-09-22T09:51:02.675254+0000","last_fullsized":"2024-09-22T09:51:02.675254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:46:52.183670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'215","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.922563+0000","last_change":"2024-09-22T08:42:19.456840+0000","last_active":"2024-09-22T09:52:52.922563+0000","last_peered":"2024-09-22T09:52:52.922563+0000","last_clean":"2024-09-22T09:52:52.922563+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:52:52.922563+0000","last_undegraded":"2024-09-22T09:52:52.922563+0000","last_fullsized":"2024-09-22T09:52:52.922563+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:19.484900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'764","reported_seq":4644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.825778+0000","last_change":"2024-09-22T08:42:21.481370+0000","last_active":"2024-09-22T09:54:13.825778+0000","last_peered":"2024-09-22T09:54:13.825778+0000","last_clean":"2024-09-22T09:54:13.825778+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:13.825778+0000","last_undegraded":"2024-09-22T09:54:13.825778+0000","last_fullsized":"2024-09-22T09:54:13.825778+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":701,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:26.631766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.133370+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:52:33.133370+0000","last_peered":"2024-09-22T09:52:33.133370+0000","last_clean":"2024-09-22T09:52:33.133370+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:52:33.133370+0000","last_undegraded":"2024-09-22T09:52:33.133370+0000","last_fullsized":"2024-09-22T09:52:33.133370+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.457091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":795,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658056+0000","last_change":"2024-09-22T08:42:15.435920+0000","last_active":"2024-09-22T09:50:27.658056+0000","last_peered":"2024-09-22T09:50:27.658056+0000","last_clean":"2024-09-22T09:50:27.658056+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:50:27.658056+0000","last_undegraded":"2024-09-22T09:50:27.658056+0000","last_fullsized":"2024-09-22T09:50:27.658056+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:21.159641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.666115+0000","last_change":"2024-09-22T08:42:13.414597+0000","last_active":"2024-09-22T09:51:32.666115+0000","last_peered":"2024-09-22T09:51:32.666115+0000","last_clean":"2024-09-22T09:51:32.666115+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:51:32.666115+0000","last_undegraded":"2024-09-22T09:51:32.666115+0000","last_fullsized":"2024-09-22T09:51:32.666115+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:34.931040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.436368+0000","last_change":"2024-09-22T08:42:02.254801+0000","last_active":"2024-09-22T09:51:22.436368+0000","last_peered":"2024-09-22T09:51:22.436368+0000","last_clean":"2024-09-22T09:51:22.436368+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:51:22.436368+0000","last_undegraded":"2024-09-22T09:51:22.436368+0000","last_fullsized":"2024-09-22T09:51:22.436368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:11.769116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556800+0000","last_change":"2024-09-22T08:42:17.440772+0000","last_active":"2024-09-22T09:51:02.556800+0000","last_peered":"2024-09-22T09:51:02.556800+0000","last_clean":"2024-09-22T09:51:02.556800+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:51:02.556800+0000","last_undegraded":"2024-09-22T09:51:02.556800+0000","last_fullsized":"2024-09-22T09:51:02.556800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:54.715553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'134","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.892504+0000","last_change":"2024-09-22T08:42:19.457603+0000","last_active":"2024-09-22T09:52:52.892504+0000","last_peered":"2024-09-22T09:52:52.892504+0000","last_clean":"2024-09-22T09:52:52.892504+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:52:52.892504+0000","last_undegraded":"2024-09-22T09:52:52.892504+0000","last_fullsized":"2024-09-22T09:52:52.892504+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:47.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'755","reported_seq":2856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.830968+0000","last_change":"2024-09-22T08:42:21.478082+0000","last_active":"2024-09-22T09:54:13.830968+0000","last_peered":"2024-09-22T09:54:13.830968+0000","last_clean":"2024-09-22T09:54:13.830968+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:13.830968+0000","last_undegraded":"2024-09-22T09:54:13.830968+0000","last_fullsized":"2024-09-22T09:54:13.830968+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:57.519253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'148","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.332706+0000","last_change":"2024-09-22T08:42:23.525171+0000","last_active":"2024-09-22T09:51:11.332706+0000","last_peered":"2024-09-22T09:51:11.332706+0000","last_clean":"2024-09-22T09:51:11.332706+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:51:11.332706+0000","last_undegraded":"2024-09-22T09:51:11.332706+0000","last_fullsized":"2024-09-22T09:51:11.332706+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:04.949992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":842,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556810+0000","last_change":"2024-09-22T08:42:15.426476+0000","last_active":"2024-09-22T09:51:02.556810+0000","last_peered":"2024-09-22T09:51:02.556810+0000","last_clean":"2024-09-22T09:51:02.556810+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:51:02.556810+0000","last_undegraded":"2024-09-22T09:51:02.556810+0000","last_fullsized":"2024-09-22T09:51:02.556810+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:12:40.091111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'190","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.016911+0000","last_change":"2024-09-22T08:42:13.412711+0000","last_active":"2024-09-22T09:54:14.016911+0000","last_peered":"2024-09-22T09:54:14.016911+0000","last_clean":"2024-09-22T09:54:14.016911+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:54:14.016911+0000","last_undegraded":"2024-09-22T09:54:14.016911+0000","last_fullsized":"2024-09-22T09:54:14.016911+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":406,"num_write":850,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.678442+0000","last_change":"2024-09-22T08:42:03.205842+0000","last_active":"2024-09-22T09:51:22.678442+0000","last_peered":"2024-09-22T09:51:22.678442+0000","last_clean":"2024-09-22T09:51:22.678442+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:51:22.678442+0000","last_undegraded":"2024-09-22T09:51:22.678442+0000","last_fullsized":"2024-09-22T09:51:22.678442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:41:59.205701+0000","last_clean_scrub_stamp":"2024-09-22T08:41:59.205701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:50.112553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658036+0000","last_change":"2024-09-22T08:42:17.440887+0000","last_active":"2024-09-22T09:50:27.658036+0000","last_peered":"2024-09-22T09:50:27.658036+0000","last_clean":"2024-09-22T09:50:27.658036+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:50:27.658036+0000","last_undegraded":"2024-09-22T09:50:27.658036+0000","last_fullsized":"2024-09-22T09:50:27.658036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:57:14.170224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'357","reported_seq":1092,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.190538+0000","last_change":"2024-09-22T08:42:19.455440+0000","last_active":"2024-09-22T09:54:14.190538+0000","last_peered":"2024-09-22T09:54:14.190538+0000","last_clean":"2024-09-22T09:54:14.190538+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:14.190538+0000","last_undegraded":"2024-09-22T09:54:14.190538+0000","last_fullsized":"2024-09-22T09:54:14.190538+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:31.127669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23842,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":535,"num_read_kb":775,"num_write":284,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662903+0000","last_change":"2024-09-22T08:42:21.481354+0000","last_active":"2024-09-22T09:51:07.662903+0000","last_peered":"2024-09-22T09:51:07.662903+0000","last_clean":"2024-09-22T09:51:07.662903+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:51:07.662903+0000","last_undegraded":"2024-09-22T09:51:07.662903+0000","last_fullsized":"2024-09-22T09:51:07.662903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:55.654023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'92","reported_seq":590,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.904200+0000","last_change":"2024-09-22T08:42:23.528079+0000","last_active":"2024-09-22T09:50:17.904200+0000","last_peered":"2024-09-22T09:50:17.904200+0000","last_clean":"2024-09-22T09:50:17.904200+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:50:17.904200+0000","last_undegraded":"2024-09-22T09:50:17.904200+0000","last_fullsized":"2024-09-22T09:50:17.904200+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:28.365018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547536+0000","last_change":"2024-09-22T08:42:15.426467+0000","last_active":"2024-09-22T09:49:57.547536+0000","last_peered":"2024-09-22T09:49:57.547536+0000","last_clean":"2024-09-22T09:49:57.547536+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:49:57.547536+0000","last_undegraded":"2024-09-22T09:49:57.547536+0000","last_fullsized":"2024-09-22T09:49:57.547536+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:10.885001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'197","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.158798+0000","last_change":"2024-09-22T08:42:13.418044+0000","last_active":"2024-09-22T09:54:14.158798+0000","last_peered":"2024-09-22T09:54:14.158798+0000","last_clean":"2024-09-22T09:54:14.158798+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:54:14.158798+0000","last_undegraded":"2024-09-22T09:54:14.158798+0000","last_fullsized":"2024-09-22T09:54:14.158798+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:06.417643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":56883,"num_write":855,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426786+0000","last_change":"2024-09-22T08:42:17.434551+0000","last_active":"2024-09-22T09:49:57.426786+0000","last_peered":"2024-09-22T09:49:57.426786+0000","last_clean":"2024-09-22T09:49:57.426786+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:49:57.426786+0000","last_undegraded":"2024-09-22T09:49:57.426786+0000","last_fullsized":"2024-09-22T09:49:57.426786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:49.306717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'171","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.054853+0000","last_change":"2024-09-22T08:42:19.459166+0000","last_active":"2024-09-22T09:54:14.054853+0000","last_peered":"2024-09-22T09:54:14.054853+0000","last_clean":"2024-09-22T09:54:14.054853+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:54:14.054853+0000","last_undegraded":"2024-09-22T09:54:14.054853+0000","last_fullsized":"2024-09-22T09:54:14.054853+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:04.933821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":323,"num_write":134,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654407+0000","last_change":"2024-09-22T08:42:21.480559+0000","last_active":"2024-09-22T09:50:02.654407+0000","last_peered":"2024-09-22T09:50:02.654407+0000","last_clean":"2024-09-22T09:50:02.654407+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:50:02.654407+0000","last_undegraded":"2024-09-22T09:50:02.654407+0000","last_fullsized":"2024-09-22T09:50:02.654407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:57.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:00.060711+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:51:00.060711+0000","last_peered":"2024-09-22T09:51:00.060711+0000","last_clean":"2024-09-22T09:51:00.060711+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:51:00.060711+0000","last_undegraded":"2024-09-22T09:51:00.060711+0000","last_fullsized":"2024-09-22T09:51:00.060711+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:00.026997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.426814+0000","last_change":"2024-09-22T08:42:15.435296+0000","last_active":"2024-09-22T09:49:57.426814+0000","last_peered":"2024-09-22T09:49:57.426814+0000","last_clean":"2024-09-22T09:49:57.426814+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:49:57.426814+0000","last_undegraded":"2024-09-22T09:49:57.426814+0000","last_fullsized":"2024-09-22T09:49:57.426814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:37.637400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'226","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.145738+0000","last_change":"2024-09-22T08:42:13.414954+0000","last_active":"2024-09-22T09:54:14.145738+0000","last_peered":"2024-09-22T09:54:14.145738+0000","last_clean":"2024-09-22T09:54:14.145738+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:54:14.145738+0000","last_undegraded":"2024-09-22T09:54:14.145738+0000","last_fullsized":"2024-09-22T09:54:14.145738+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:55.273095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":50629,"num_write":1055,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653853+0000","last_change":"2024-09-22T08:42:17.440629+0000","last_active":"2024-09-22T09:49:57.653853+0000","last_peered":"2024-09-22T09:49:57.653853+0000","last_clean":"2024-09-22T09:49:57.653853+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:49:57.653853+0000","last_undegraded":"2024-09-22T09:49:57.653853+0000","last_fullsized":"2024-09-22T09:49:57.653853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:13.561126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'53","reported_seq":565,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.547272+0000","last_change":"2024-09-22T08:42:19.456534+0000","last_active":"2024-09-22T09:52:52.547272+0000","last_peered":"2024-09-22T09:52:52.547272+0000","last_clean":"2024-09-22T09:52:52.547272+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:52:52.547272+0000","last_undegraded":"2024-09-22T09:52:52.547272+0000","last_fullsized":"2024-09-22T09:52:52.547272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:45.983322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515570+0000","last_change":"2024-09-22T08:42:21.476849+0000","last_active":"2024-09-22T09:50:02.515570+0000","last_peered":"2024-09-22T09:50:02.515570+0000","last_clean":"2024-09-22T09:50:02.515570+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:50:02.515570+0000","last_undegraded":"2024-09-22T09:50:02.515570+0000","last_fullsized":"2024-09-22T09:50:02.515570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:43.656268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.634796+0000","last_change":"2024-09-22T08:42:23.526388+0000","last_active":"2024-09-22T09:52:35.634796+0000","last_peered":"2024-09-22T09:52:35.634796+0000","last_clean":"2024-09-22T09:52:35.634796+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:52:35.634796+0000","last_undegraded":"2024-09-22T09:52:35.634796+0000","last_fullsized":"2024-09-22T09:52:35.634796+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:29.029640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.665914+0000","last_change":"2024-09-22T08:42:15.438483+0000","last_active":"2024-09-22T09:52:36.665914+0000","last_peered":"2024-09-22T09:52:36.665914+0000","last_clean":"2024-09-22T09:52:36.665914+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:52:36.665914+0000","last_undegraded":"2024-09-22T09:52:36.665914+0000","last_fullsized":"2024-09-22T09:52:36.665914+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.521372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'206","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.016667+0000","last_change":"2024-09-22T08:42:13.413578+0000","last_active":"2024-09-22T09:54:14.016667+0000","last_peered":"2024-09-22T09:54:14.016667+0000","last_clean":"2024-09-22T09:54:14.016667+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:54:14.016667+0000","last_undegraded":"2024-09-22T09:54:14.016667+0000","last_fullsized":"2024-09-22T09:54:14.016667+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:00.034449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":559,"num_read_kb":27137,"num_write":994,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.514721+0000","last_change":"2024-09-22T08:42:17.430472+0000","last_active":"2024-09-22T09:49:57.514721+0000","last_peered":"2024-09-22T09:49:57.514721+0000","last_clean":"2024-09-22T09:49:57.514721+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:49:57.514721+0000","last_undegraded":"2024-09-22T09:49:57.514721+0000","last_fullsized":"2024-09-22T09:49:57.514721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:00:35.687053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'197","reported_seq":799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.942912+0000","last_change":"2024-09-22T08:42:19.459846+0000","last_active":"2024-09-22T09:54:13.942912+0000","last_peered":"2024-09-22T09:54:13.942912+0000","last_clean":"2024-09-22T09:54:13.942912+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:54:13.942912+0000","last_undegraded":"2024-09-22T09:54:13.942912+0000","last_fullsized":"2024-09-22T09:54:13.942912+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:37.691592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":325,"num_write":146,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.667537+0000","last_change":"2024-09-22T08:42:21.479495+0000","last_active":"2024-09-22T09:50:02.667537+0000","last_peered":"2024-09-22T09:50:02.667537+0000","last_clean":"2024-09-22T09:50:02.667537+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:50:02.667537+0000","last_undegraded":"2024-09-22T09:50:02.667537+0000","last_fullsized":"2024-09-22T09:50:02.667537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:56.016803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'184","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.144194+0000","last_change":"2024-09-22T08:42:23.527658+0000","last_active":"2024-09-22T09:50:22.144194+0000","last_peered":"2024-09-22T09:50:22.144194+0000","last_clean":"2024-09-22T09:50:22.144194+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:50:22.144194+0000","last_undegraded":"2024-09-22T09:50:22.144194+0000","last_fullsized":"2024-09-22T09:50:22.144194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:34.867859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'173","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.653721+0000","last_change":"2024-09-22T08:42:15.440994+0000","last_active":"2024-09-22T09:49:57.653721+0000","last_peered":"2024-09-22T09:49:57.653721+0000","last_clean":"2024-09-22T09:49:57.653721+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:49:57.653721+0000","last_undegraded":"2024-09-22T09:49:57.653721+0000","last_fullsized":"2024-09-22T09:49:57.653721+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:06.924407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'205","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.061787+0000","last_change":"2024-09-22T08:42:13.421739+0000","last_active":"2024-09-22T09:54:14.061787+0000","last_peered":"2024-09-22T09:54:14.061787+0000","last_clean":"2024-09-22T09:54:14.061787+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:54:14.061787+0000","last_undegraded":"2024-09-22T09:54:14.061787+0000","last_fullsized":"2024-09-22T09:54:14.061787+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:25:10.061779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":41854,"num_write":1021,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.666642+0000","last_change":"2024-09-22T08:42:17.428665+0000","last_active":"2024-09-22T09:49:57.666642+0000","last_peered":"2024-09-22T09:49:57.666642+0000","last_clean":"2024-09-22T09:49:57.666642+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:49:57.666642+0000","last_undegraded":"2024-09-22T09:49:57.666642+0000","last_fullsized":"2024-09-22T09:49:57.666642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:47:34.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'148","reported_seq":725,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.922802+0000","last_change":"2024-09-22T08:42:19.453111+0000","last_active":"2024-09-22T09:54:13.922802+0000","last_peered":"2024-09-22T09:54:13.922802+0000","last_clean":"2024-09-22T09:54:13.922802+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:54:13.922802+0000","last_undegraded":"2024-09-22T09:54:13.922802+0000","last_fullsized":"2024-09-22T09:54:13.922802+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:24.508041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":223,"num_write":104,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654861+0000","last_change":"2024-09-22T08:42:21.475223+0000","last_active":"2024-09-22T09:50:02.654861+0000","last_peered":"2024-09-22T09:50:02.654861+0000","last_clean":"2024-09-22T09:50:02.654861+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:50:02.654861+0000","last_undegraded":"2024-09-22T09:50:02.654861+0000","last_fullsized":"2024-09-22T09:50:02.654861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:09.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":658,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675311+0000","last_change":"2024-09-22T08:42:15.431489+0000","last_active":"2024-09-22T09:51:02.675311+0000","last_peered":"2024-09-22T09:51:02.675311+0000","last_clean":"2024-09-22T09:51:02.675311+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:51:02.675311+0000","last_undegraded":"2024-09-22T09:51:02.675311+0000","last_fullsized":"2024-09-22T09:51:02.675311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:58.608179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'205","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.159474+0000","last_change":"2024-09-22T08:42:13.403630+0000","last_active":"2024-09-22T09:54:14.159474+0000","last_peered":"2024-09-22T09:54:14.159474+0000","last_clean":"2024-09-22T09:54:14.159474+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:54:14.159474+0000","last_undegraded":"2024-09-22T09:54:14.159474+0000","last_fullsized":"2024-09-22T09:54:14.159474+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:49.925047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":584,"num_read_kb":68522,"num_write":916,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658194+0000","last_change":"2024-09-22T08:42:17.438090+0000","last_active":"2024-09-22T09:50:27.658194+0000","last_peered":"2024-09-22T09:50:27.658194+0000","last_clean":"2024-09-22T09:50:27.658194+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:50:27.658194+0000","last_undegraded":"2024-09-22T09:50:27.658194+0000","last_fullsized":"2024-09-22T09:50:27.658194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:49.781681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'235","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.120201+0000","last_change":"2024-09-22T08:42:19.455805+0000","last_active":"2024-09-22T09:54:14.120201+0000","last_peered":"2024-09-22T09:54:14.120201+0000","last_clean":"2024-09-22T09:54:14.120201+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:14.120201+0000","last_undegraded":"2024-09-22T09:54:14.120201+0000","last_fullsized":"2024-09-22T09:54:14.120201+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:46.845015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22939,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":353,"num_read_kb":545,"num_write":228,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.672389+0000","last_change":"2024-09-22T08:42:21.482536+0000","last_active":"2024-09-22T09:49:52.672389+0000","last_peered":"2024-09-22T09:49:52.672389+0000","last_clean":"2024-09-22T09:49:52.672389+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:49:52.672389+0000","last_undegraded":"2024-09-22T09:49:52.672389+0000","last_fullsized":"2024-09-22T09:49:52.672389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:16.490768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.317977+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:50:15.317977+0000","last_peered":"2024-09-22T09:50:15.317977+0000","last_clean":"2024-09-22T09:50:15.317977+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:50:15.317977+0000","last_undegraded":"2024-09-22T09:50:15.317977+0000","last_fullsized":"2024-09-22T09:50:15.317977+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:49.491628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:27.658171+0000","last_change":"2024-09-22T08:42:15.427151+0000","last_active":"2024-09-22T09:50:27.658171+0000","last_peered":"2024-09-22T09:50:27.658171+0000","last_clean":"2024-09-22T09:50:27.658171+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:50:27.658171+0000","last_undegraded":"2024-09-22T09:50:27.658171+0000","last_fullsized":"2024-09-22T09:50:27.658171+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:08.119841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'225","reported_seq":879,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.107922+0000","last_change":"2024-09-22T08:42:13.408621+0000","last_active":"2024-09-22T09:54:14.107922+0000","last_peered":"2024-09-22T09:54:14.107922+0000","last_clean":"2024-09-22T09:54:14.107922+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:54:14.107922+0000","last_undegraded":"2024-09-22T09:54:14.107922+0000","last_fullsized":"2024-09-22T09:54:14.107922+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:38.944084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5108,"num_write":1161,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675298+0000","last_change":"2024-09-22T08:42:17.432901+0000","last_active":"2024-09-22T09:51:02.675298+0000","last_peered":"2024-09-22T09:51:02.675298+0000","last_clean":"2024-09-22T09:51:02.675298+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:51:02.675298+0000","last_undegraded":"2024-09-22T09:51:02.675298+0000","last_fullsized":"2024-09-22T09:51:02.675298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:54.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'206","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.930200+0000","last_change":"2024-09-22T08:42:19.454425+0000","last_active":"2024-09-22T09:54:13.930200+0000","last_peered":"2024-09-22T09:54:13.930200+0000","last_clean":"2024-09-22T09:54:13.930200+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:54:13.930200+0000","last_undegraded":"2024-09-22T09:54:13.930200+0000","last_fullsized":"2024-09-22T09:54:13.930200+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:32.598763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":279,"num_read_kb":343,"num_write":184,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426248+0000","last_change":"2024-09-22T08:42:21.476913+0000","last_active":"2024-09-22T09:49:52.426248+0000","last_peered":"2024-09-22T09:49:52.426248+0000","last_clean":"2024-09-22T09:49:52.426248+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:49:52.426248+0000","last_undegraded":"2024-09-22T09:49:52.426248+0000","last_fullsized":"2024-09-22T09:49:52.426248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:43.637608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'167","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.287498+0000","last_change":"2024-09-22T08:42:23.524343+0000","last_active":"2024-09-22T09:52:35.287498+0000","last_peered":"2024-09-22T09:52:35.287498+0000","last_clean":"2024-09-22T09:52:35.287498+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:52:35.287498+0000","last_undegraded":"2024-09-22T09:52:35.287498+0000","last_fullsized":"2024-09-22T09:52:35.287498+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:59.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652648+0000","last_change":"2024-09-22T08:42:15.441307+0000","last_active":"2024-09-22T09:49:47.652648+0000","last_peered":"2024-09-22T09:49:47.652648+0000","last_clean":"2024-09-22T09:49:47.652648+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:49:47.652648+0000","last_undegraded":"2024-09-22T09:49:47.652648+0000","last_fullsized":"2024-09-22T09:49:47.652648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:01.398679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'192","reported_seq":917,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.102634+0000","last_change":"2024-09-22T08:42:13.403394+0000","last_active":"2024-09-22T09:54:14.102634+0000","last_peered":"2024-09-22T09:54:14.102634+0000","last_clean":"2024-09-22T09:54:14.102634+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:54:14.102634+0000","last_undegraded":"2024-09-22T09:54:14.102634+0000","last_fullsized":"2024-09-22T09:54:14.102634+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:26:07.863561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1210,"num_read_kb":5814,"num_write":981,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545954+0000","last_change":"2024-09-22T08:42:17.435464+0000","last_active":"2024-09-22T09:49:47.545954+0000","last_peered":"2024-09-22T09:49:47.545954+0000","last_clean":"2024-09-22T09:49:47.545954+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:49:47.545954+0000","last_undegraded":"2024-09-22T09:49:47.545954+0000","last_fullsized":"2024-09-22T09:49:47.545954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:38.411752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'160","reported_seq":750,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.097288+0000","last_change":"2024-09-22T08:42:19.458421+0000","last_active":"2024-09-22T09:54:14.097288+0000","last_peered":"2024-09-22T09:54:14.097288+0000","last_clean":"2024-09-22T09:54:14.097288+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:54:14.097288+0000","last_undegraded":"2024-09-22T09:54:14.097288+0000","last_fullsized":"2024-09-22T09:54:14.097288+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:17.997133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":298,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431784+0000","last_change":"2024-09-22T08:42:21.482356+0000","last_active":"2024-09-22T09:50:42.431784+0000","last_peered":"2024-09-22T09:50:42.431784+0000","last_clean":"2024-09-22T09:50:42.431784+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:50:42.431784+0000","last_undegraded":"2024-09-22T09:50:42.431784+0000","last_fullsized":"2024-09-22T09:50:42.431784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:32.679904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'112","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.729613+0000","last_change":"2024-09-22T08:42:23.524273+0000","last_active":"2024-09-22T09:54:00.729613+0000","last_peered":"2024-09-22T09:54:00.729613+0000","last_clean":"2024-09-22T09:54:00.729613+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:00.729613+0000","last_undegraded":"2024-09-22T09:54:00.729613+0000","last_fullsized":"2024-09-22T09:54:00.729613+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:17.604133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.686473+0000","last_change":"2024-09-22T08:42:15.435809+0000","last_active":"2024-09-22T09:49:47.686473+0000","last_peered":"2024-09-22T09:49:47.686473+0000","last_clean":"2024-09-22T09:49:47.686473+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:49:47.686473+0000","last_undegraded":"2024-09-22T09:49:47.686473+0000","last_fullsized":"2024-09-22T09:49:47.686473+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:40.478687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'240","reported_seq":927,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.124744+0000","last_change":"2024-09-22T08:42:13.413803+0000","last_active":"2024-09-22T09:54:14.124744+0000","last_peered":"2024-09-22T09:54:14.124744+0000","last_clean":"2024-09-22T09:54:14.124744+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:54:14.124744+0000","last_undegraded":"2024-09-22T09:54:14.124744+0000","last_fullsized":"2024-09-22T09:54:14.124744+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:20.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":123234,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425590+0000","last_change":"2024-09-22T08:42:17.435752+0000","last_active":"2024-09-22T09:49:47.425590+0000","last_peered":"2024-09-22T09:49:47.425590+0000","last_clean":"2024-09-22T09:49:47.425590+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:49:47.425590+0000","last_undegraded":"2024-09-22T09:49:47.425590+0000","last_fullsized":"2024-09-22T09:49:47.425590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:10.922721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'121","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.915476+0000","last_change":"2024-09-22T08:42:19.453093+0000","last_active":"2024-09-22T09:52:52.915476+0000","last_peered":"2024-09-22T09:52:52.915476+0000","last_clean":"2024-09-22T09:52:52.915476+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:52:52.915476+0000","last_undegraded":"2024-09-22T09:52:52.915476+0000","last_fullsized":"2024-09-22T09:52:52.915476+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:28:18.283880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'759","reported_seq":4731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.823952+0000","last_change":"2024-09-22T08:42:21.480171+0000","last_active":"2024-09-22T09:54:13.823952+0000","last_peered":"2024-09-22T09:54:13.823952+0000","last_clean":"2024-09-22T09:54:13.823952+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:13.823952+0000","last_undegraded":"2024-09-22T09:54:13.823952+0000","last_fullsized":"2024-09-22T09:54:13.823952+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:05.223141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.660200+0000","last_change":"2024-09-22T08:42:23.528243+0000","last_active":"2024-09-22T09:52:36.660200+0000","last_peered":"2024-09-22T09:52:36.660200+0000","last_clean":"2024-09-22T09:52:36.660200+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:52:36.660200+0000","last_undegraded":"2024-09-22T09:52:36.660200+0000","last_fullsized":"2024-09-22T09:52:36.660200+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:46.020648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545909+0000","last_change":"2024-09-22T08:42:46.084787+0000","last_active":"2024-09-22T09:49:47.545909+0000","last_peered":"2024-09-22T09:49:47.545909+0000","last_clean":"2024-09-22T09:49:47.545909+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:49:47.545909+0000","last_undegraded":"2024-09-22T09:49:47.545909+0000","last_fullsized":"2024-09-22T09:49:47.545909+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:31.609602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'293","reported_seq":1025,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.168644+0000","last_change":"2024-09-22T08:42:46.086633+0000","last_active":"2024-09-22T09:54:14.168644+0000","last_peered":"2024-09-22T09:54:14.168644+0000","last_clean":"2024-09-22T09:54:14.168644+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:54:14.168644+0000","last_undegraded":"2024-09-22T09:54:14.168644+0000","last_fullsized":"2024-09-22T09:54:14.168644+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:16.757938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1304,"num_read_kb":50200,"num_write":1267,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"36'3","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.392394+0000","last_change":"2024-09-22T08:42:17.430502+0000","last_active":"2024-09-22T09:54:13.392394+0000","last_peered":"2024-09-22T09:54:13.392394+0000","last_clean":"2024-09-22T09:54:13.392394+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:13.392394+0000","last_undegraded":"2024-09-22T09:54:13.392394+0000","last_fullsized":"2024-09-22T09:54:13.392394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:02.208302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'214","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.147141+0000","last_change":"2024-09-22T08:42:19.455535+0000","last_active":"2024-09-22T09:54:14.147141+0000","last_peered":"2024-09-22T09:54:14.147141+0000","last_clean":"2024-09-22T09:54:14.147141+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:54:14.147141+0000","last_undegraded":"2024-09-22T09:54:14.147141+0000","last_fullsized":"2024-09-22T09:54:14.147141+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:46.902494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6055,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":273,"num_read_kb":326,"num_write":162,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654816+0000","last_change":"2024-09-22T08:42:21.476713+0000","last_active":"2024-09-22T09:50:02.654816+0000","last_peered":"2024-09-22T09:50:02.654816+0000","last_clean":"2024-09-22T09:50:02.654816+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:50:02.654816+0000","last_undegraded":"2024-09-22T09:50:02.654816+0000","last_fullsized":"2024-09-22T09:50:02.654816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:07.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'140","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539387+0000","last_change":"2024-09-22T08:42:23.517176+0000","last_active":"2024-09-22T09:52:32.539387+0000","last_peered":"2024-09-22T09:52:32.539387+0000","last_clean":"2024-09-22T09:52:32.539387+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:52:32.539387+0000","last_undegraded":"2024-09-22T09:52:32.539387+0000","last_fullsized":"2024-09-22T09:52:32.539387+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":763,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:28.383248+0000","last_change":"2024-09-22T08:42:15.431566+0000","last_active":"2024-09-22T09:51:28.383248+0000","last_peered":"2024-09-22T09:51:28.383248+0000","last_clean":"2024-09-22T09:51:28.383248+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:51:28.383248+0000","last_undegraded":"2024-09-22T09:51:28.383248+0000","last_fullsized":"2024-09-22T09:51:28.383248+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:38.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'213","reported_seq":810,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.959055+0000","last_change":"2024-09-22T08:42:46.088505+0000","last_active":"2024-09-22T09:54:13.959055+0000","last_peered":"2024-09-22T09:54:13.959055+0000","last_clean":"2024-09-22T09:54:13.959055+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:54:13.959055+0000","last_undegraded":"2024-09-22T09:54:13.959055+0000","last_fullsized":"2024-09-22T09:54:13.959055+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:58.102532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26654,"num_write":910,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671704+0000","last_change":"2024-09-22T08:42:17.434837+0000","last_active":"2024-09-22T09:49:47.671704+0000","last_peered":"2024-09-22T09:49:47.671704+0000","last_clean":"2024-09-22T09:49:47.671704+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:49:47.671704+0000","last_undegraded":"2024-09-22T09:49:47.671704+0000","last_fullsized":"2024-09-22T09:49:47.671704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:44.721168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'144","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.162790+0000","last_change":"2024-09-22T08:42:19.455628+0000","last_active":"2024-09-22T09:54:14.162790+0000","last_peered":"2024-09-22T09:54:14.162790+0000","last_clean":"2024-09-22T09:54:14.162790+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:54:14.162790+0000","last_undegraded":"2024-09-22T09:54:14.162790+0000","last_fullsized":"2024-09-22T09:54:14.162790+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:09.361619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6811,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":273,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668079+0000","last_change":"2024-09-22T08:42:21.476902+0000","last_active":"2024-09-22T09:50:07.668079+0000","last_peered":"2024-09-22T09:50:07.668079+0000","last_clean":"2024-09-22T09:50:07.668079+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:50:07.668079+0000","last_undegraded":"2024-09-22T09:50:07.668079+0000","last_fullsized":"2024-09-22T09:50:07.668079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:29.159677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.376679+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:51:35.376679+0000","last_peered":"2024-09-22T09:51:35.376679+0000","last_clean":"2024-09-22T09:51:35.376679+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:51:35.376679+0000","last_undegraded":"2024-09-22T09:51:35.376679+0000","last_fullsized":"2024-09-22T09:51:35.376679+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.855073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":882,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655142+0000","last_change":"2024-09-22T08:42:15.439064+0000","last_active":"2024-09-22T09:50:07.655142+0000","last_peered":"2024-09-22T09:50:07.655142+0000","last_clean":"2024-09-22T09:50:07.655142+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:50:07.655142+0000","last_undegraded":"2024-09-22T09:50:07.655142+0000","last_fullsized":"2024-09-22T09:50:07.655142+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:36.078212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'277","reported_seq":950,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.117498+0000","last_change":"2024-09-22T08:42:13.405170+0000","last_active":"2024-09-22T09:54:14.117498+0000","last_peered":"2024-09-22T09:54:14.117498+0000","last_clean":"2024-09-22T09:54:14.117498+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:54:14.117498+0000","last_undegraded":"2024-09-22T09:54:14.117498+0000","last_fullsized":"2024-09-22T09:54:14.117498+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:40:38.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":745,"num_read_kb":35485,"num_write":1188,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547433+0000","last_change":"2024-09-22T08:42:17.428752+0000","last_active":"2024-09-22T09:49:57.547433+0000","last_peered":"2024-09-22T09:49:57.547433+0000","last_clean":"2024-09-22T09:49:57.547433+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:49:57.547433+0000","last_undegraded":"2024-09-22T09:49:57.547433+0000","last_fullsized":"2024-09-22T09:49:57.547433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:24.944481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'115","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.077934+0000","last_change":"2024-09-22T08:42:19.453726+0000","last_active":"2024-09-22T09:54:14.077934+0000","last_peered":"2024-09-22T09:54:14.077934+0000","last_clean":"2024-09-22T09:54:14.077934+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:54:14.077934+0000","last_undegraded":"2024-09-22T09:54:14.077934+0000","last_fullsized":"2024-09-22T09:54:14.077934+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:05.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":258,"num_write":80,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.546807+0000","last_change":"2024-09-22T08:42:21.478595+0000","last_active":"2024-09-22T09:49:52.546807+0000","last_peered":"2024-09-22T09:49:52.546807+0000","last_clean":"2024-09-22T09:49:52.546807+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:49:52.546807+0000","last_undegraded":"2024-09-22T09:49:52.546807+0000","last_fullsized":"2024-09-22T09:49:52.546807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:19.682078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'159","reported_seq":1627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.954159+0000","last_change":"2024-09-22T08:42:23.526111+0000","last_active":"2024-09-22T09:52:32.954159+0000","last_peered":"2024-09-22T09:52:32.954159+0000","last_clean":"2024-09-22T09:52:32.954159+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:52:32.954159+0000","last_undegraded":"2024-09-22T09:52:32.954159+0000","last_fullsized":"2024-09-22T09:52:32.954159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:23.624323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5257,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547451+0000","last_change":"2024-09-22T08:42:15.428024+0000","last_active":"2024-09-22T09:49:57.547451+0000","last_peered":"2024-09-22T09:49:57.547451+0000","last_clean":"2024-09-22T09:49:57.547451+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:49:57.547451+0000","last_undegraded":"2024-09-22T09:49:57.547451+0000","last_fullsized":"2024-09-22T09:49:57.547451+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:35.144593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'237","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.154020+0000","last_change":"2024-09-22T08:42:13.422788+0000","last_active":"2024-09-22T09:54:14.154020+0000","last_peered":"2024-09-22T09:54:14.154020+0000","last_clean":"2024-09-22T09:54:14.154020+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:54:14.154020+0000","last_undegraded":"2024-09-22T09:54:14.154020+0000","last_fullsized":"2024-09-22T09:54:14.154020+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:52.150990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":602,"num_read_kb":45002,"num_write":1097,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429129+0000","last_change":"2024-09-22T08:42:17.443746+0000","last_active":"2024-09-22T09:50:17.429129+0000","last_peered":"2024-09-22T09:50:17.429129+0000","last_clean":"2024-09-22T09:50:17.429129+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:50:17.429129+0000","last_undegraded":"2024-09-22T09:50:17.429129+0000","last_fullsized":"2024-09-22T09:50:17.429129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:38:19.136201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'218","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.110815+0000","last_change":"2024-09-22T08:42:19.454027+0000","last_active":"2024-09-22T09:54:14.110815+0000","last_peered":"2024-09-22T09:54:14.110815+0000","last_clean":"2024-09-22T09:54:14.110815+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:54:14.110815+0000","last_undegraded":"2024-09-22T09:54:14.110815+0000","last_fullsized":"2024-09-22T09:54:14.110815+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:10.523969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":792,"num_write":216,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.653425+0000","last_change":"2024-09-22T08:42:21.477428+0000","last_active":"2024-09-22T09:49:52.653425+0000","last_peered":"2024-09-22T09:49:52.653425+0000","last_clean":"2024-09-22T09:49:52.653425+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:49:52.653425+0000","last_undegraded":"2024-09-22T09:49:52.653425+0000","last_fullsized":"2024-09-22T09:49:52.653425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:24.672129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'126","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.396183+0000","last_change":"2024-09-22T08:42:23.527124+0000","last_active":"2024-09-22T09:53:59.396183+0000","last_peered":"2024-09-22T09:53:59.396183+0000","last_clean":"2024-09-22T09:53:59.396183+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:53:59.396183+0000","last_undegraded":"2024-09-22T09:53:59.396183+0000","last_fullsized":"2024-09-22T09:53:59.396183+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:53.459446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438059+0000","last_change":"2024-09-22T08:42:15.436664+0000","last_active":"2024-09-22T09:51:37.438059+0000","last_peered":"2024-09-22T09:51:37.438059+0000","last_clean":"2024-09-22T09:51:37.438059+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:51:37.438059+0000","last_undegraded":"2024-09-22T09:51:37.438059+0000","last_fullsized":"2024-09-22T09:51:37.438059+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:56:03.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'198","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.153823+0000","last_change":"2024-09-22T08:42:13.411262+0000","last_active":"2024-09-22T09:54:14.153823+0000","last_peered":"2024-09-22T09:54:14.153823+0000","last_clean":"2024-09-22T09:54:14.153823+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:54:14.153823+0000","last_undegraded":"2024-09-22T09:54:14.153823+0000","last_fullsized":"2024-09-22T09:54:14.153823+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:13.868253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":68297,"num_write":940,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":969,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438046+0000","last_change":"2024-09-22T08:42:15.434625+0000","last_active":"2024-09-22T09:51:37.438046+0000","last_peered":"2024-09-22T09:51:37.438046+0000","last_clean":"2024-09-22T09:51:37.438046+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:51:37.438046+0000","last_undegraded":"2024-09-22T09:51:37.438046+0000","last_fullsized":"2024-09-22T09:51:37.438046+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:24:41.767444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'194","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.132483+0000","last_change":"2024-09-22T08:42:13.390383+0000","last_active":"2024-09-22T09:54:14.132483+0000","last_peered":"2024-09-22T09:54:14.132483+0000","last_clean":"2024-09-22T09:54:14.132483+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:54:14.132483+0000","last_undegraded":"2024-09-22T09:54:14.132483+0000","last_fullsized":"2024-09-22T09:54:14.132483+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:49.173702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":8670,"num_write":934,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.687969+0000","last_change":"2024-09-22T08:42:15.434734+0000","last_active":"2024-09-22T09:51:37.687969+0000","last_peered":"2024-09-22T09:51:37.687969+0000","last_clean":"2024-09-22T09:51:37.687969+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:51:37.687969+0000","last_undegraded":"2024-09-22T09:51:37.687969+0000","last_fullsized":"2024-09-22T09:51:37.687969+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:17:30.081403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'197","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.008224+0000","last_change":"2024-09-22T08:42:13.405053+0000","last_active":"2024-09-22T09:54:14.008224+0000","last_peered":"2024-09-22T09:54:14.008224+0000","last_clean":"2024-09-22T09:54:14.008224+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:54:14.008224+0000","last_undegraded":"2024-09-22T09:54:14.008224+0000","last_fullsized":"2024-09-22T09:54:14.008224+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:50.824870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":611,"num_read_kb":542,"num_write":1015,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.438008+0000","last_change":"2024-09-22T08:42:15.431647+0000","last_active":"2024-09-22T09:51:37.438008+0000","last_peered":"2024-09-22T09:51:37.438008+0000","last_clean":"2024-09-22T09:51:37.438008+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:51:37.438008+0000","last_undegraded":"2024-09-22T09:51:37.438008+0000","last_fullsized":"2024-09-22T09:51:37.438008+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:55.015297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'205","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.919192+0000","last_change":"2024-09-22T08:42:13.415007+0000","last_active":"2024-09-22T09:54:13.919192+0000","last_peered":"2024-09-22T09:54:13.919192+0000","last_clean":"2024-09-22T09:54:13.919192+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:54:13.919192+0000","last_undegraded":"2024-09-22T09:54:13.919192+0000","last_fullsized":"2024-09-22T09:54:13.919192+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:14.358684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":724,"num_read_kb":18552,"num_write":938,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663562+0000","last_change":"2024-09-22T08:42:15.436338+0000","last_active":"2024-09-22T09:51:12.663562+0000","last_peered":"2024-09-22T09:51:12.663562+0000","last_clean":"2024-09-22T09:51:12.663562+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:51:12.663562+0000","last_undegraded":"2024-09-22T09:51:12.663562+0000","last_fullsized":"2024-09-22T09:51:12.663562+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:58.108852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'222","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.908943+0000","last_change":"2024-09-22T08:42:13.406108+0000","last_active":"2024-09-22T09:54:13.908943+0000","last_peered":"2024-09-22T09:54:13.908943+0000","last_clean":"2024-09-22T09:54:13.908943+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:54:13.908943+0000","last_undegraded":"2024-09-22T09:54:13.908943+0000","last_fullsized":"2024-09-22T09:54:13.908943+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:52.215127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":30794,"num_write":966,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'219","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.656045+0000","last_change":"2024-09-22T08:42:15.433745+0000","last_active":"2024-09-22T09:51:42.656045+0000","last_peered":"2024-09-22T09:51:42.656045+0000","last_clean":"2024-09-22T09:51:42.656045+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:51:42.656045+0000","last_undegraded":"2024-09-22T09:51:42.656045+0000","last_fullsized":"2024-09-22T09:51:42.656045+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:27:09.992145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'282","reported_seq":972,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.116685+0000","last_change":"2024-09-22T08:42:13.422466+0000","last_active":"2024-09-22T09:54:14.116685+0000","last_peered":"2024-09-22T09:54:14.116685+0000","last_clean":"2024-09-22T09:54:14.116685+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:54:14.116685+0000","last_undegraded":"2024-09-22T09:54:14.116685+0000","last_fullsized":"2024-09-22T09:54:14.116685+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:02:03.795312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242911,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":757,"num_read_kb":37026,"num_write":1221,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662275+0000","last_change":"2024-09-22T08:42:15.440845+0000","last_active":"2024-09-22T09:51:02.662275+0000","last_peered":"2024-09-22T09:51:02.662275+0000","last_clean":"2024-09-22T09:51:02.662275+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:51:02.662275+0000","last_undegraded":"2024-09-22T09:51:02.662275+0000","last_fullsized":"2024-09-22T09:51:02.662275+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:42.146384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'210","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.168957+0000","last_change":"2024-09-22T08:42:13.407850+0000","last_active":"2024-09-22T09:54:14.168957+0000","last_peered":"2024-09-22T09:54:14.168957+0000","last_clean":"2024-09-22T09:54:14.168957+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:54:14.168957+0000","last_undegraded":"2024-09-22T09:54:14.168957+0000","last_fullsized":"2024-09-22T09:54:14.168957+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.638315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":7650,"num_write":1038,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.675220+0000","last_change":"2024-09-22T08:42:15.429000+0000","last_active":"2024-09-22T09:51:02.675220+0000","last_peered":"2024-09-22T09:51:02.675220+0000","last_clean":"2024-09-22T09:51:02.675220+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:51:02.675220+0000","last_undegraded":"2024-09-22T09:51:02.675220+0000","last_fullsized":"2024-09-22T09:51:02.675220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:12:42.839044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'229","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.031364+0000","last_change":"2024-09-22T08:42:13.415853+0000","last_active":"2024-09-22T09:54:14.031364+0000","last_peered":"2024-09-22T09:54:14.031364+0000","last_clean":"2024-09-22T09:54:14.031364+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:54:14.031364+0000","last_undegraded":"2024-09-22T09:54:14.031364+0000","last_fullsized":"2024-09-22T09:54:14.031364+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:53.049074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":20476,"num_write":1023,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.397601+0000","last_change":"2024-09-22T08:42:15.440719+0000","last_active":"2024-09-22T09:53:59.397601+0000","last_peered":"2024-09-22T09:53:59.397601+0000","last_clean":"2024-09-22T09:53:59.397601+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:53:59.397601+0000","last_undegraded":"2024-09-22T09:53:59.397601+0000","last_fullsized":"2024-09-22T09:53:59.397601+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:17:13.105481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'186","reported_seq":792,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.032747+0000","last_change":"2024-09-22T08:42:13.411004+0000","last_active":"2024-09-22T09:54:14.032747+0000","last_peered":"2024-09-22T09:54:14.032747+0000","last_clean":"2024-09-22T09:54:14.032747+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:54:14.032747+0000","last_undegraded":"2024-09-22T09:54:14.032747+0000","last_fullsized":"2024-09-22T09:54:14.032747+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:12:46.465435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":7230,"num_write":907,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.157183+0000","last_change":"2024-09-22T08:42:15.428553+0000","last_active":"2024-09-22T09:50:22.157183+0000","last_peered":"2024-09-22T09:50:22.157183+0000","last_clean":"2024-09-22T09:50:22.157183+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:50:22.157183+0000","last_undegraded":"2024-09-22T09:50:22.157183+0000","last_fullsized":"2024-09-22T09:50:22.157183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:57:18.827032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'226","reported_seq":1048,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.020280+0000","last_change":"2024-09-22T08:42:13.407996+0000","last_active":"2024-09-22T09:54:14.020280+0000","last_peered":"2024-09-22T09:54:14.020280+0000","last_clean":"2024-09-22T09:54:14.020280+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:54:14.020280+0000","last_undegraded":"2024-09-22T09:54:14.020280+0000","last_fullsized":"2024-09-22T09:54:14.020280+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:37.268934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1623,"num_read_kb":135465,"num_write":994,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'142","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.686967+0000","last_change":"2024-09-22T08:42:15.433622+0000","last_active":"2024-09-22T09:49:52.686967+0000","last_peered":"2024-09-22T09:49:52.686967+0000","last_clean":"2024-09-22T09:49:52.686967+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:49:52.686967+0000","last_undegraded":"2024-09-22T09:49:52.686967+0000","last_fullsized":"2024-09-22T09:49:52.686967+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:44.943406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'180","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.144597+0000","last_change":"2024-09-22T08:42:13.402320+0000","last_active":"2024-09-22T09:54:14.144597+0000","last_peered":"2024-09-22T09:54:14.144597+0000","last_clean":"2024-09-22T09:54:14.144597+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:54:14.144597+0000","last_undegraded":"2024-09-22T09:54:14.144597+0000","last_fullsized":"2024-09-22T09:54:14.144597+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:40:31.569406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170178,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":30385,"num_write":838,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":696,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.565093+0000","last_change":"2024-09-22T08:42:15.428668+0000","last_active":"2024-09-22T09:52:02.565093+0000","last_peered":"2024-09-22T09:52:02.565093+0000","last_clean":"2024-09-22T09:52:02.565093+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:52:02.565093+0000","last_undegraded":"2024-09-22T09:52:02.565093+0000","last_fullsized":"2024-09-22T09:52:02.565093+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:37:57.959775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.038361+0000","last_change":"2024-09-22T08:42:13.405602+0000","last_active":"2024-09-22T09:54:14.038361+0000","last_peered":"2024-09-22T09:54:14.038361+0000","last_clean":"2024-09-22T09:54:14.038361+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:54:14.038361+0000","last_undegraded":"2024-09-22T09:54:14.038361+0000","last_fullsized":"2024-09-22T09:54:14.038361+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:20.603994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":23430,"num_write":912,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.534285+0000","last_change":"2024-09-22T08:42:15.438409+0000","last_active":"2024-09-22T09:52:02.534285+0000","last_peered":"2024-09-22T09:52:02.534285+0000","last_clean":"2024-09-22T09:52:02.534285+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:52:02.534285+0000","last_undegraded":"2024-09-22T09:52:02.534285+0000","last_fullsized":"2024-09-22T09:52:02.534285+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:44.728188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'212","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.973428+0000","last_change":"2024-09-22T08:42:13.406750+0000","last_active":"2024-09-22T09:54:13.973428+0000","last_peered":"2024-09-22T09:54:13.973428+0000","last_clean":"2024-09-22T09:54:13.973428+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:54:13.973428+0000","last_undegraded":"2024-09-22T09:54:13.973428+0000","last_fullsized":"2024-09-22T09:54:13.973428+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:31.322960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":16539,"num_write":978,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.670337+0000","last_change":"2024-09-22T08:42:15.435371+0000","last_active":"2024-09-22T09:52:02.670337+0000","last_peered":"2024-09-22T09:52:02.670337+0000","last_clean":"2024-09-22T09:52:02.670337+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:52:02.670337+0000","last_undegraded":"2024-09-22T09:52:02.670337+0000","last_fullsized":"2024-09-22T09:52:02.670337+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:25.479186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'199","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.053069+0000","last_change":"2024-09-22T08:42:13.416475+0000","last_active":"2024-09-22T09:54:14.053069+0000","last_peered":"2024-09-22T09:54:14.053069+0000","last_clean":"2024-09-22T09:54:14.053069+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:54:14.053069+0000","last_undegraded":"2024-09-22T09:54:14.053069+0000","last_fullsized":"2024-09-22T09:54:14.053069+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:13.725268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":32145,"num_write":913,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.669984+0000","last_change":"2024-09-22T08:42:15.436821+0000","last_active":"2024-09-22T09:52:02.669984+0000","last_peered":"2024-09-22T09:52:02.669984+0000","last_clean":"2024-09-22T09:52:02.669984+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:52:02.669984+0000","last_undegraded":"2024-09-22T09:52:02.669984+0000","last_fullsized":"2024-09-22T09:52:02.669984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:30.622726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'203","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.919144+0000","last_change":"2024-09-22T08:42:13.400175+0000","last_active":"2024-09-22T09:54:13.919144+0000","last_peered":"2024-09-22T09:54:13.919144+0000","last_clean":"2024-09-22T09:54:13.919144+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:54:13.919144+0000","last_undegraded":"2024-09-22T09:54:13.919144+0000","last_fullsized":"2024-09-22T09:54:13.919144+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:35.492802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493665,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":31835,"num_write":1011,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":769,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.532605+0000","last_change":"2024-09-22T08:42:15.433332+0000","last_active":"2024-09-22T09:51:52.532605+0000","last_peered":"2024-09-22T09:51:52.532605+0000","last_clean":"2024-09-22T09:51:52.532605+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:51:52.532605+0000","last_undegraded":"2024-09-22T09:51:52.532605+0000","last_fullsized":"2024-09-22T09:51:52.532605+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:18:33.437758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'227","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.990660+0000","last_change":"2024-09-22T08:42:13.417006+0000","last_active":"2024-09-22T09:54:13.990660+0000","last_peered":"2024-09-22T09:54:13.990660+0000","last_clean":"2024-09-22T09:54:13.990660+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:54:13.990660+0000","last_undegraded":"2024-09-22T09:54:13.990660+0000","last_fullsized":"2024-09-22T09:54:13.990660+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:58:01.120483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242963,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":33540,"num_write":1138,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'203","reported_seq":811,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.153769+0000","last_change":"2024-09-22T08:42:13.414146+0000","last_active":"2024-09-22T09:54:14.153769+0000","last_peered":"2024-09-22T09:54:14.153769+0000","last_clean":"2024-09-22T09:54:14.153769+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:54:14.153769+0000","last_undegraded":"2024-09-22T09:54:14.153769+0000","last_fullsized":"2024-09-22T09:54:14.153769+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:45.228462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":478,"num_read_kb":16611,"num_write":909,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655515+0000","last_change":"2024-09-22T08:42:15.431931+0000","last_active":"2024-09-22T09:50:07.655515+0000","last_peered":"2024-09-22T09:50:07.655515+0000","last_clean":"2024-09-22T09:50:07.655515+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:50:07.655515+0000","last_undegraded":"2024-09-22T09:50:07.655515+0000","last_fullsized":"2024-09-22T09:50:07.655515+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:55.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'230","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.060105+0000","last_change":"2024-09-22T08:42:13.421991+0000","last_active":"2024-09-22T09:54:14.060105+0000","last_peered":"2024-09-22T09:54:14.060105+0000","last_clean":"2024-09-22T09:54:14.060105+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:54:14.060105+0000","last_undegraded":"2024-09-22T09:54:14.060105+0000","last_fullsized":"2024-09-22T09:54:14.060105+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:12.334364+0000","last_clean_scrub_stamp":"2024-09-22T08:42:12.334364+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:20:48.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":659,"num_read_kb":76384,"num_write":1027,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673291+0000","last_change":"2024-09-22T08:42:15.433648+0000","last_active":"2024-09-22T09:49:57.673291+0000","last_peered":"2024-09-22T09:49:57.673291+0000","last_clean":"2024-09-22T09:49:57.673291+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:49:57.673291+0000","last_undegraded":"2024-09-22T09:49:57.673291+0000","last_fullsized":"2024-09-22T09:49:57.673291+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:57.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1596,"ondisk_log_size":1596,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":415,"ondisk_log_size":415,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":372077,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":10012,"num_read_kb":12519,"num_write":7007,"num_write_kb":3209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3773,"ondisk_log_size":3773,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":105523402,"num_objects":166,"num_object_clones":0,"num_object_copies":664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42464,"num_read_kb":2399835,"num_write":63370,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142622720,"data_stored":142622720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":189640,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189064,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543017,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265968,"kb_used_data":22280,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94105872,"statfs":{"total":96636764160,"available":96364412928,"internally_reserved":0,"allocated":22814720,"data_stored":20815259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543017,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291644,"kb_used_data":21624,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94080196,"statfs":{"total":96636764160,"available":96338120704,"internally_reserved":0,"allocated":22142976,"data_stored":20214796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543019,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117628,"kb_used_data":19808,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94254212,"statfs":{"total":96636764160,"available":96516313088,"internally_reserved":0,"allocated":20283392,"data_stored":18282616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543018,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":134044,"kb_used_data":26496,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94237796,"statfs":{"total":96636764160,"available":96499503104,"internally_reserved":0,"allocated":27131904,"data_stored":25227113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543017,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249532,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122308,"statfs":{"total":96636764160,"available":96381243392,"internally_reserved":0,"allocated":20230144,"data_stored":18263996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543021,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91248,"kb_used_data":19792,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280592,"statfs":{"total":96636764160,"available":96543326208,"internally_reserved":0,"allocated":20267008,"data_stored":18362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543017,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149600,"kb_used_data":19868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94222240,"statfs":{"total":96636764160,"available":96483573760,"internally_reserved":0,"allocated":20344832,"data_stored":18397529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543019,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257640,"kb_used_data":23712,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94114200,"statfs":{"total":96636764160,"available":96372940800,"internally_reserved":0,"allocated":24281088,"data_stored":22309261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16138240,"data_stored":16138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":16105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":16003072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22970368,"data_stored":22970368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16023552,"data_stored":16023552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17956864,"data_stored":17956864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17965056,"data_stored":17965056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.373 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.374 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.375 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.376 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.377 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.378 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.379 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.380 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.381 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.382 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.383 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.384 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.385 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.386 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.387 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.388 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.389 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.390 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.391 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.392 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.393 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.394 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.395 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T08:41:53.176588+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=53, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.396 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.397 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.398 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.399 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.400 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T08:41:59.205701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=59, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.401 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.402 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.403 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.404 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.405 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.406 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.407 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.408 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.409 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.410 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.411 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.412 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.413 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.413 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.413 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-22T08:42:12.334364+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=12, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.413 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:22.413 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:54:42.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:54:42.767 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:54:42.779 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:54:42.781 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2440,"stamp":"2024-09-22T09:54:42.430541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106502740,"num_objects":492,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":190601,"num_read_kb":2910687,"num_write":128942,"num_write_kb":2504267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8753,"num_omap_keys":38,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13098,"ondisk_log_size":13098,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1561048,"kb_used_data":173336,"kb_used_omap":12,"kb_used_meta":1387571,"kb_avail":753413672,"statfs":{"total":773094113280,"available":771495600128,"internally_reserved":0,"allocated":177496064,"data_stored":161872998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1420873265},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8287,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004598"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'8","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.705974+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:42.705974+0000","last_peered":"2024-09-22T09:53:42.705974+0000","last_clean":"2024-09-22T09:53:42.705974+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:53:42.705974+0000","last_undegraded":"2024-09-22T09:53:42.705974+0000","last_fullsized":"2024-09-22T09:53:42.705974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.689100+0000","last_change":"2024-09-22T09:20:12.873395+0000","last_active":"2024-09-22T09:50:12.689100+0000","last_peered":"2024-09-22T09:50:12.689100+0000","last_clean":"2024-09-22T09:50:12.689100+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:50:12.689100+0000","last_undegraded":"2024-09-22T09:50:12.689100+0000","last_fullsized":"2024-09-22T09:50:12.689100+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:11.074090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'9","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.579860+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:53:42.579860+0000","last_peered":"2024-09-22T09:53:42.579860+0000","last_clean":"2024-09-22T09:53:42.579860+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:53:42.579860+0000","last_undegraded":"2024-09-22T09:53:42.579860+0000","last_fullsized":"2024-09-22T09:53:42.579860+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":18432,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'5","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.948724+0000","last_change":"2024-09-22T09:01:07.465099+0000","last_active":"2024-09-22T09:54:13.948724+0000","last_peered":"2024-09-22T09:54:13.948724+0000","last_clean":"2024-09-22T09:54:13.948724+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:54:13.948724+0000","last_undegraded":"2024-09-22T09:54:13.948724+0000","last_fullsized":"2024-09-22T09:54:13.948724+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:23:59.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":96,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.694907+0000","last_change":"2024-09-22T08:57:04.397022+0000","last_active":"2024-09-22T09:51:12.694907+0000","last_peered":"2024-09-22T09:51:12.694907+0000","last_clean":"2024-09-22T09:51:12.694907+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:51:12.694907+0000","last_undegraded":"2024-09-22T09:51:12.694907+0000","last_fullsized":"2024-09-22T09:51:12.694907+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:59.048334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'4","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.934694+0000","last_change":"2024-09-22T09:01:07.467647+0000","last_active":"2024-09-22T09:54:13.934694+0000","last_peered":"2024-09-22T09:54:13.934694+0000","last_clean":"2024-09-22T09:54:13.934694+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:54:13.934694+0000","last_undegraded":"2024-09-22T09:54:13.934694+0000","last_fullsized":"2024-09-22T09:54:13.934694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:53:12.140780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":619,"num_write":4,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":155,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670956+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:52:07.670956+0000","last_peered":"2024-09-22T09:52:07.670956+0000","last_clean":"2024-09-22T09:52:07.670956+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:52:07.670956+0000","last_undegraded":"2024-09-22T09:52:07.670956+0000","last_fullsized":"2024-09-22T09:52:07.670956+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670673+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:52:07.670673+0000","last_peered":"2024-09-22T09:52:07.670673+0000","last_clean":"2024-09-22T09:52:07.670673+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:52:07.670673+0000","last_undegraded":"2024-09-22T09:52:07.670673+0000","last_fullsized":"2024-09-22T09:52:07.670673+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.671292+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:52:12.671292+0000","last_peered":"2024-09-22T09:52:12.671292+0000","last_clean":"2024-09-22T09:52:12.671292+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:52:12.671292+0000","last_undegraded":"2024-09-22T09:52:12.671292+0000","last_fullsized":"2024-09-22T09:52:12.671292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.691217+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:52:02.691217+0000","last_peered":"2024-09-22T09:52:02.691217+0000","last_clean":"2024-09-22T09:52:02.691217+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:52:02.691217+0000","last_undegraded":"2024-09-22T09:52:02.691217+0000","last_fullsized":"2024-09-22T09:52:02.691217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.669135+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:51:52.669135+0000","last_peered":"2024-09-22T09:51:52.669135+0000","last_clean":"2024-09-22T09:51:52.669135+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:51:52.669135+0000","last_undegraded":"2024-09-22T09:51:52.669135+0000","last_fullsized":"2024-09-22T09:51:52.669135+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670615+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:52:07.670615+0000","last_peered":"2024-09-22T09:52:07.670615+0000","last_clean":"2024-09-22T09:52:07.670615+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:52:07.670615+0000","last_undegraded":"2024-09-22T09:52:07.670615+0000","last_fullsized":"2024-09-22T09:52:07.670615+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.075915+0000","last_change":"2024-09-22T09:01:11.514663+0000","last_active":"2024-09-22T09:54:14.075915+0000","last_peered":"2024-09-22T09:54:14.075915+0000","last_clean":"2024-09-22T09:54:14.075915+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:54:14.075915+0000","last_undegraded":"2024-09-22T09:54:14.075915+0000","last_fullsized":"2024-09-22T09:54:14.075915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.565901+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:52:07.565901+0000","last_peered":"2024-09-22T09:52:07.565901+0000","last_clean":"2024-09-22T09:52:07.565901+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:52:07.565901+0000","last_undegraded":"2024-09-22T09:52:07.565901+0000","last_fullsized":"2024-09-22T09:52:07.565901+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":261,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.684761+0000","last_change":"2024-09-22T08:57:04.396164+0000","last_active":"2024-09-22T09:52:07.684761+0000","last_peered":"2024-09-22T09:52:07.684761+0000","last_clean":"2024-09-22T09:52:07.684761+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:52:07.684761+0000","last_undegraded":"2024-09-22T09:52:07.684761+0000","last_fullsized":"2024-09-22T09:52:07.684761+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.033215+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:54:14.033215+0000","last_peered":"2024-09-22T09:54:14.033215+0000","last_clean":"2024-09-22T09:54:14.033215+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:54:14.033215+0000","last_undegraded":"2024-09-22T09:54:14.033215+0000","last_fullsized":"2024-09-22T09:54:14.033215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:37.683649+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:53:37.683649+0000","last_peered":"2024-09-22T09:53:37.683649+0000","last_clean":"2024-09-22T09:53:37.683649+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:53:37.683649+0000","last_undegraded":"2024-09-22T09:53:37.683649+0000","last_fullsized":"2024-09-22T09:53:37.683649+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.429096+0000","last_change":"2024-09-22T08:57:04.400224+0000","last_active":"2024-09-22T09:50:17.429096+0000","last_peered":"2024-09-22T09:50:17.429096+0000","last_clean":"2024-09-22T09:50:17.429096+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:50:17.429096+0000","last_undegraded":"2024-09-22T09:50:17.429096+0000","last_fullsized":"2024-09-22T09:50:17.429096+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:24:47.678550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669452+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:51:57.669452+0000","last_peered":"2024-09-22T09:51:57.669452+0000","last_clean":"2024-09-22T09:51:57.669452+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:51:57.669452+0000","last_undegraded":"2024-09-22T09:51:57.669452+0000","last_fullsized":"2024-09-22T09:51:57.669452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'3","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.695974+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:52:32.695974+0000","last_peered":"2024-09-22T09:52:32.695974+0000","last_clean":"2024-09-22T09:52:32.695974+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:52:32.695974+0000","last_undegraded":"2024-09-22T09:52:32.695974+0000","last_fullsized":"2024-09-22T09:52:32.695974+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:26:14.614902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691085+0000","last_change":"2024-09-22T09:20:12.861108+0000","last_active":"2024-09-22T09:50:32.691085+0000","last_peered":"2024-09-22T09:50:32.691085+0000","last_clean":"2024-09-22T09:50:32.691085+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:50:32.691085+0000","last_undegraded":"2024-09-22T09:50:32.691085+0000","last_fullsized":"2024-09-22T09:50:32.691085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:55.356489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'3","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674681+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:52:37.674681+0000","last_peered":"2024-09-22T09:52:37.674681+0000","last_clean":"2024-09-22T09:52:37.674681+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:52:37.674681+0000","last_undegraded":"2024-09-22T09:52:37.674681+0000","last_fullsized":"2024-09-22T09:52:37.674681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.049531+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:54:14.049531+0000","last_peered":"2024-09-22T09:54:14.049531+0000","last_clean":"2024-09-22T09:54:14.049531+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:54:14.049531+0000","last_undegraded":"2024-09-22T09:54:14.049531+0000","last_fullsized":"2024-09-22T09:54:14.049531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669489+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:51:57.669489+0000","last_peered":"2024-09-22T09:51:57.669489+0000","last_clean":"2024-09-22T09:51:57.669489+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:51:57.669489+0000","last_undegraded":"2024-09-22T09:51:57.669489+0000","last_fullsized":"2024-09-22T09:51:57.669489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'6","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.949157+0000","last_change":"2024-09-22T09:01:07.465474+0000","last_active":"2024-09-22T09:54:13.949157+0000","last_peered":"2024-09-22T09:54:13.949157+0000","last_clean":"2024-09-22T09:54:13.949157+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:54:13.949157+0000","last_undegraded":"2024-09-22T09:54:13.949157+0000","last_fullsized":"2024-09-22T09:54:13.949157+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:54.197542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":156,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.689645+0000","last_change":"2024-09-22T08:57:04.398115+0000","last_active":"2024-09-22T09:50:17.689645+0000","last_peered":"2024-09-22T09:50:17.689645+0000","last_clean":"2024-09-22T09:50:17.689645+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:50:17.689645+0000","last_undegraded":"2024-09-22T09:50:17.689645+0000","last_fullsized":"2024-09-22T09:50:17.689645+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:33.062709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.564378+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:51:57.564378+0000","last_peered":"2024-09-22T09:51:57.564378+0000","last_clean":"2024-09-22T09:51:57.564378+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:51:57.564378+0000","last_undegraded":"2024-09-22T09:51:57.564378+0000","last_fullsized":"2024-09-22T09:51:57.564378+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.884299+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:54:13.884299+0000","last_peered":"2024-09-22T09:54:13.884299+0000","last_clean":"2024-09-22T09:54:13.884299+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:54:13.884299+0000","last_undegraded":"2024-09-22T09:54:13.884299+0000","last_fullsized":"2024-09-22T09:54:13.884299+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.428515+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:50:12.428515+0000","last_peered":"2024-09-22T09:50:12.428515+0000","last_clean":"2024-09-22T09:50:12.428515+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:50:12.428515+0000","last_undegraded":"2024-09-22T09:50:12.428515+0000","last_fullsized":"2024-09-22T09:50:12.428515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:47.707645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.569045+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:52:27.569045+0000","last_peered":"2024-09-22T09:52:27.569045+0000","last_clean":"2024-09-22T09:52:27.569045+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:52:27.569045+0000","last_undegraded":"2024-09-22T09:52:27.569045+0000","last_fullsized":"2024-09-22T09:52:27.569045+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:03:52.131442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.443836+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:52:32.443836+0000","last_peered":"2024-09-22T09:52:32.443836+0000","last_clean":"2024-09-22T09:52:32.443836+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:52:32.443836+0000","last_undegraded":"2024-09-22T09:52:32.443836+0000","last_fullsized":"2024-09-22T09:52:32.443836+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:49.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655114+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:50:07.655114+0000","last_peered":"2024-09-22T09:50:07.655114+0000","last_clean":"2024-09-22T09:50:07.655114+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:50:07.655114+0000","last_undegraded":"2024-09-22T09:50:07.655114+0000","last_fullsized":"2024-09-22T09:50:07.655114+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:07:28.914821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.655936+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:50:12.655936+0000","last_peered":"2024-09-22T09:50:12.655936+0000","last_clean":"2024-09-22T09:50:12.655936+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:50:12.655936+0000","last_undegraded":"2024-09-22T09:50:12.655936+0000","last_fullsized":"2024-09-22T09:50:12.655936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:36:02.097970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668153+0000","last_change":"2024-09-22T09:01:07.463162+0000","last_active":"2024-09-22T09:50:07.668153+0000","last_peered":"2024-09-22T09:50:07.668153+0000","last_clean":"2024-09-22T09:50:07.668153+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:50:07.668153+0000","last_undegraded":"2024-09-22T09:50:07.668153+0000","last_fullsized":"2024-09-22T09:50:07.668153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:40.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'5","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.017935+0000","last_change":"2024-09-22T09:01:11.517359+0000","last_active":"2024-09-22T09:54:14.017935+0000","last_peered":"2024-09-22T09:54:14.017935+0000","last_clean":"2024-09-22T09:54:14.017935+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:54:14.017935+0000","last_undegraded":"2024-09-22T09:54:14.017935+0000","last_fullsized":"2024-09-22T09:54:14.017935+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:49.248745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'10","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.695112+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:52:27.695112+0000","last_peered":"2024-09-22T09:52:27.695112+0000","last_clean":"2024-09-22T09:52:27.695112+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:52:27.695112+0000","last_undegraded":"2024-09-22T09:52:27.695112+0000","last_fullsized":"2024-09-22T09:52:27.695112+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:43.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691557+0000","last_change":"2024-09-22T09:20:12.858546+0000","last_active":"2024-09-22T09:50:37.691557+0000","last_peered":"2024-09-22T09:50:37.691557+0000","last_clean":"2024-09-22T09:50:37.691557+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:50:37.691557+0000","last_undegraded":"2024-09-22T09:50:37.691557+0000","last_fullsized":"2024-09-22T09:50:37.691557+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:50.810813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:57.677847+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:52:57.677847+0000","last_peered":"2024-09-22T09:52:57.677847+0000","last_clean":"2024-09-22T09:52:57.677847+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:52:57.677847+0000","last_undegraded":"2024-09-22T09:52:57.677847+0000","last_fullsized":"2024-09-22T09:52:57.677847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.691594+0000","last_change":"2024-09-22T09:01:07.465057+0000","last_active":"2024-09-22T09:50:37.691594+0000","last_peered":"2024-09-22T09:50:37.691594+0000","last_clean":"2024-09-22T09:50:37.691594+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:50:37.691594+0000","last_undegraded":"2024-09-22T09:50:37.691594+0000","last_fullsized":"2024-09-22T09:50:37.691594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:51.656500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.683656+0000","last_change":"2024-09-22T08:57:04.397214+0000","last_active":"2024-09-22T09:51:07.683656+0000","last_peered":"2024-09-22T09:51:07.683656+0000","last_clean":"2024-09-22T09:51:07.683656+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:51:07.683656+0000","last_undegraded":"2024-09-22T09:51:07.683656+0000","last_fullsized":"2024-09-22T09:51:07.683656+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:54:24.811854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.671153+0000","last_change":"2024-09-22T09:20:12.869138+0000","last_active":"2024-09-22T09:50:32.671153+0000","last_peered":"2024-09-22T09:50:32.671153+0000","last_clean":"2024-09-22T09:50:32.671153+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:50:32.671153+0000","last_undegraded":"2024-09-22T09:50:32.671153+0000","last_fullsized":"2024-09-22T09:50:32.671153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:20.523450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'8","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.032498+0000","last_change":"2024-09-22T09:01:11.518715+0000","last_active":"2024-09-22T09:54:14.032498+0000","last_peered":"2024-09-22T09:54:14.032498+0000","last_clean":"2024-09-22T09:54:14.032498+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:54:14.032498+0000","last_undegraded":"2024-09-22T09:54:14.032498+0000","last_fullsized":"2024-09-22T09:54:14.032498+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:25.716417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6192,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.677278+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:52:52.677278+0000","last_peered":"2024-09-22T09:52:52.677278+0000","last_clean":"2024-09-22T09:52:52.677278+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:52:52.677278+0000","last_undegraded":"2024-09-22T09:52:52.677278+0000","last_fullsized":"2024-09-22T09:52:52.677278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.676022+0000","last_change":"2024-09-22T08:57:04.395860+0000","last_active":"2024-09-22T09:51:07.676022+0000","last_peered":"2024-09-22T09:51:07.676022+0000","last_clean":"2024-09-22T09:51:07.676022+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:51:07.676022+0000","last_undegraded":"2024-09-22T09:51:07.676022+0000","last_fullsized":"2024-09-22T09:51:07.676022+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:13.903713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520070+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:50:32.520070+0000","last_peered":"2024-09-22T09:50:32.520070+0000","last_clean":"2024-09-22T09:50:32.520070+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:50:32.520070+0000","last_undegraded":"2024-09-22T09:50:32.520070+0000","last_fullsized":"2024-09-22T09:50:32.520070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:36.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:07.448284+0000","last_change":"2024-09-22T09:01:07.463902+0000","last_active":"2024-09-22T09:53:07.448284+0000","last_peered":"2024-09-22T09:53:07.448284+0000","last_clean":"2024-09-22T09:53:07.448284+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:53:07.448284+0000","last_undegraded":"2024-09-22T09:53:07.448284+0000","last_fullsized":"2024-09-22T09:53:07.448284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:52:06.653470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.694357+0000","last_change":"2024-09-22T08:57:04.397359+0000","last_active":"2024-09-22T09:51:07.694357+0000","last_peered":"2024-09-22T09:51:07.694357+0000","last_clean":"2024-09-22T09:51:07.694357+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:51:07.694357+0000","last_undegraded":"2024-09-22T09:51:07.694357+0000","last_fullsized":"2024-09-22T09:51:07.694357+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:55.654439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'9","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.575471+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:53:12.575471+0000","last_peered":"2024-09-22T09:53:12.575471+0000","last_clean":"2024-09-22T09:53:12.575471+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:53:12.575471+0000","last_undegraded":"2024-09-22T09:53:12.575471+0000","last_fullsized":"2024-09-22T09:53:12.575471+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":122,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663336+0000","last_change":"2024-09-22T08:57:04.405441+0000","last_active":"2024-09-22T09:51:07.663336+0000","last_peered":"2024-09-22T09:51:07.663336+0000","last_clean":"2024-09-22T09:51:07.663336+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:51:07.663336+0000","last_undegraded":"2024-09-22T09:51:07.663336+0000","last_fullsized":"2024-09-22T09:51:07.663336+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:28:56.122641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'5","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:07.448190+0000","last_change":"2024-09-22T09:01:07.462593+0000","last_active":"2024-09-22T09:53:07.448190+0000","last_peered":"2024-09-22T09:53:07.448190+0000","last_clean":"2024-09-22T09:53:07.448190+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:53:07.448190+0000","last_undegraded":"2024-09-22T09:53:07.448190+0000","last_fullsized":"2024-09-22T09:53:07.448190+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:23:03.677122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528666+0000","last_change":"2024-09-22T08:57:04.395828+0000","last_active":"2024-09-22T09:51:27.528666+0000","last_peered":"2024-09-22T09:51:27.528666+0000","last_clean":"2024-09-22T09:51:27.528666+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:51:27.528666+0000","last_undegraded":"2024-09-22T09:51:27.528666+0000","last_fullsized":"2024-09-22T09:51:27.528666+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:01.801022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431738+0000","last_change":"2024-09-22T09:01:11.516330+0000","last_active":"2024-09-22T09:50:42.431738+0000","last_peered":"2024-09-22T09:50:42.431738+0000","last_clean":"2024-09-22T09:50:42.431738+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:50:42.431738+0000","last_undegraded":"2024-09-22T09:50:42.431738+0000","last_fullsized":"2024-09-22T09:50:42.431738+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:35:46.512497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'14","reported_seq":85,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.680090+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:53:12.680090+0000","last_peered":"2024-09-22T09:53:12.680090+0000","last_clean":"2024-09-22T09:53:12.680090+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:53:12.680090+0000","last_undegraded":"2024-09-22T09:53:12.680090+0000","last_fullsized":"2024-09-22T09:53:12.680090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32770,"num_write":29,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.546212+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:22.546212+0000","last_peered":"2024-09-22T09:53:22.546212+0000","last_clean":"2024-09-22T09:53:22.546212+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:53:22.546212+0000","last_undegraded":"2024-09-22T09:53:22.546212+0000","last_fullsized":"2024-09-22T09:53:22.546212+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":74,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677517+0000","last_change":"2024-09-22T08:57:04.395126+0000","last_active":"2024-09-22T09:51:17.677517+0000","last_peered":"2024-09-22T09:51:17.677517+0000","last_clean":"2024-09-22T09:51:17.677517+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:51:17.677517+0000","last_undegraded":"2024-09-22T09:51:17.677517+0000","last_fullsized":"2024-09-22T09:51:17.677517+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:53:33.605027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.680915+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:53:17.680915+0000","last_peered":"2024-09-22T09:53:17.680915+0000","last_clean":"2024-09-22T09:53:17.680915+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:53:17.680915+0000","last_undegraded":"2024-09-22T09:53:17.680915+0000","last_fullsized":"2024-09-22T09:53:17.680915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.708014+0000","last_change":"2024-09-22T09:01:07.464584+0000","last_active":"2024-09-22T09:53:17.708014+0000","last_peered":"2024-09-22T09:53:17.708014+0000","last_clean":"2024-09-22T09:53:17.708014+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:53:17.708014+0000","last_undegraded":"2024-09-22T09:53:17.708014+0000","last_fullsized":"2024-09-22T09:53:17.708014+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:12.421058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":932,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677612+0000","last_change":"2024-09-22T08:57:04.400659+0000","last_active":"2024-09-22T09:51:17.677612+0000","last_peered":"2024-09-22T09:51:17.677612+0000","last_clean":"2024-09-22T09:51:17.677612+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:51:17.677612+0000","last_undegraded":"2024-09-22T09:51:17.677612+0000","last_fullsized":"2024-09-22T09:51:17.677612+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:49:56.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:22.442726+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:52:22.442726+0000","last_peered":"2024-09-22T09:52:22.442726+0000","last_clean":"2024-09-22T09:52:22.442726+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:52:22.442726+0000","last_undegraded":"2024-09-22T09:52:22.442726+0000","last_fullsized":"2024-09-22T09:52:22.442726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528740+0000","last_change":"2024-09-22T08:57:04.401962+0000","last_active":"2024-09-22T09:51:27.528740+0000","last_peered":"2024-09-22T09:51:27.528740+0000","last_clean":"2024-09-22T09:51:27.528740+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:51:27.528740+0000","last_undegraded":"2024-09-22T09:51:27.528740+0000","last_fullsized":"2024-09-22T09:51:27.528740+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:43.579055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.435663+0000","last_change":"2024-09-22T08:57:04.397895+0000","last_active":"2024-09-22T09:51:17.435663+0000","last_peered":"2024-09-22T09:51:17.435663+0000","last_clean":"2024-09-22T09:51:17.435663+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:51:17.435663+0000","last_undegraded":"2024-09-22T09:51:17.435663+0000","last_fullsized":"2024-09-22T09:51:17.435663+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:57.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.691139+0000","last_change":"2024-09-22T09:20:12.868011+0000","last_active":"2024-09-22T09:50:32.691139+0000","last_peered":"2024-09-22T09:50:32.691139+0000","last_clean":"2024-09-22T09:50:32.691139+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:50:32.691139+0000","last_undegraded":"2024-09-22T09:50:32.691139+0000","last_fullsized":"2024-09-22T09:50:32.691139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:51.261678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.435132+0000","last_change":"2024-09-22T09:01:11.515368+0000","last_active":"2024-09-22T09:51:12.435132+0000","last_peered":"2024-09-22T09:51:12.435132+0000","last_clean":"2024-09-22T09:51:12.435132+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:51:12.435132+0000","last_undegraded":"2024-09-22T09:51:12.435132+0000","last_fullsized":"2024-09-22T09:51:12.435132+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:01.643271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658823+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:50:32.658823+0000","last_peered":"2024-09-22T09:50:32.658823+0000","last_clean":"2024-09-22T09:50:32.658823+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:50:32.658823+0000","last_undegraded":"2024-09-22T09:50:32.658823+0000","last_fullsized":"2024-09-22T09:50:32.658823+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:05:55.492793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.558791+0000","last_change":"2024-09-22T08:57:04.398627+0000","last_active":"2024-09-22T09:51:17.558791+0000","last_peered":"2024-09-22T09:51:17.558791+0000","last_clean":"2024-09-22T09:51:17.558791+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:51:17.558791+0000","last_undegraded":"2024-09-22T09:51:17.558791+0000","last_fullsized":"2024-09-22T09:51:17.558791+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:23.008984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.676744+0000","last_change":"2024-09-22T09:01:11.522462+0000","last_active":"2024-09-22T09:51:12.676744+0000","last_peered":"2024-09-22T09:51:12.676744+0000","last_clean":"2024-09-22T09:51:12.676744+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:51:12.676744+0000","last_undegraded":"2024-09-22T09:51:12.676744+0000","last_fullsized":"2024-09-22T09:51:12.676744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:07:13.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.434560+0000","last_change":"2024-09-22T09:01:07.463509+0000","last_active":"2024-09-22T09:51:07.434560+0000","last_peered":"2024-09-22T09:51:07.434560+0000","last_clean":"2024-09-22T09:51:07.434560+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:51:07.434560+0000","last_undegraded":"2024-09-22T09:51:07.434560+0000","last_fullsized":"2024-09-22T09:51:07.434560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:59.139960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":119,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.677548+0000","last_change":"2024-09-22T08:57:04.386372+0000","last_active":"2024-09-22T09:51:17.677548+0000","last_peered":"2024-09-22T09:51:17.677548+0000","last_clean":"2024-09-22T09:51:17.677548+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:51:17.677548+0000","last_undegraded":"2024-09-22T09:51:17.677548+0000","last_fullsized":"2024-09-22T09:51:17.677548+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:05:50.648447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.576360+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:53:17.576360+0000","last_peered":"2024-09-22T09:53:17.576360+0000","last_clean":"2024-09-22T09:53:17.576360+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:53:17.576360+0000","last_undegraded":"2024-09-22T09:53:17.576360+0000","last_fullsized":"2024-09-22T09:53:17.576360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'10","reported_seq":77,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.967003+0000","last_change":"2024-09-22T09:01:07.457691+0000","last_active":"2024-09-22T09:54:13.967003+0000","last_peered":"2024-09-22T09:54:13.967003+0000","last_clean":"2024-09-22T09:54:13.967003+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:54:13.967003+0000","last_undegraded":"2024-09-22T09:54:13.967003+0000","last_fullsized":"2024-09-22T09:54:13.967003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:44.440513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25607,"num_write":10,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'215","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.577099+0000","last_change":"2024-09-22T09:54:31.577099+0000","last_active":"2024-09-22T09:54:31.577099+0000","last_peered":"2024-09-22T09:54:31.577099+0000","last_clean":"2024-09-22T09:54:31.577099+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:54:31.577099+0000","last_undegraded":"2024-09-22T09:54:31.577099+0000","last_fullsized":"2024-09-22T09:54:31.577099+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'215","last_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_deep_scrub":"262'215","last_deep_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.576998+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:44.998984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":13876,"num_write":999,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'141","reported_seq":767,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.861787+0000","last_change":"2024-09-22T08:42:15.431071+0000","last_active":"2024-09-22T09:50:12.861787+0000","last_peered":"2024-09-22T09:50:12.861787+0000","last_clean":"2024-09-22T09:50:12.861787+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:50:12.861787+0000","last_undegraded":"2024-09-22T09:50:12.861787+0000","last_fullsized":"2024-09-22T09:50:12.861787+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:14:37.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'143","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.231015+0000","last_change":"2024-09-22T09:54:24.231015+0000","last_active":"2024-09-22T09:54:24.231015+0000","last_peered":"2024-09-22T09:54:24.231015+0000","last_clean":"2024-09-22T09:54:24.231015+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:54:24.231015+0000","last_undegraded":"2024-09-22T09:54:24.231015+0000","last_fullsized":"2024-09-22T09:54:24.231015+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.230885+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:36.854502+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":432,"num_read_kb":103374,"num_write":683,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.458574+0000","last_change":"2024-09-22T08:42:15.435522+0000","last_active":"2024-09-22T09:51:48.458574+0000","last_peered":"2024-09-22T09:51:48.458574+0000","last_clean":"2024-09-22T09:51:48.458574+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:51:48.458574+0000","last_undegraded":"2024-09-22T09:51:48.458574+0000","last_fullsized":"2024-09-22T09:51:48.458574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:45.229380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'209","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.013430+0000","last_change":"2024-09-22T09:54:28.013430+0000","last_active":"2024-09-22T09:54:28.013430+0000","last_peered":"2024-09-22T09:54:28.013430+0000","last_clean":"2024-09-22T09:54:28.013430+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:54:28.013430+0000","last_undegraded":"2024-09-22T09:54:28.013430+0000","last_fullsized":"2024-09-22T09:54:28.013430+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.013255+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:24.596859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":4356,"num_write":984,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545888+0000","last_change":"2024-09-22T08:42:15.422331+0000","last_active":"2024-09-22T09:49:47.545888+0000","last_peered":"2024-09-22T09:49:47.545888+0000","last_clean":"2024-09-22T09:49:47.545888+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:49:47.545888+0000","last_undegraded":"2024-09-22T09:49:47.545888+0000","last_fullsized":"2024-09-22T09:49:47.545888+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:43:17.082268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'211","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.380352+0000","last_change":"2024-09-22T09:54:33.380352+0000","last_active":"2024-09-22T09:54:33.380352+0000","last_peered":"2024-09-22T09:54:33.380352+0000","last_clean":"2024-09-22T09:54:33.380352+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:54:33.380352+0000","last_undegraded":"2024-09-22T09:54:33.380352+0000","last_fullsized":"2024-09-22T09:54:33.380352+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.380242+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:52.978925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":600,"num_read_kb":1083,"num_write":1003,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1025,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.063002+0000","last_change":"2024-09-22T09:54:37.063002+0000","last_active":"2024-09-22T09:54:37.063002+0000","last_peered":"2024-09-22T09:54:37.063002+0000","last_clean":"2024-09-22T09:54:37.063002+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:54:37.063002+0000","last_undegraded":"2024-09-22T09:54:37.063002+0000","last_fullsized":"2024-09-22T09:54:37.063002+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'351","last_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_deep_scrub":"262'351","last_deep_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.062905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:49.568320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'204","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.546046+0000","last_change":"2024-09-22T09:54:28.546046+0000","last_active":"2024-09-22T09:54:28.546046+0000","last_peered":"2024-09-22T09:54:28.546046+0000","last_clean":"2024-09-22T09:54:28.546046+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:54:28.546046+0000","last_undegraded":"2024-09-22T09:54:28.546046+0000","last_fullsized":"2024-09-22T09:54:28.546046+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.545908+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:30.243289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":570,"num_read_kb":6282,"num_write":914,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.949036+0000","last_change":"2024-09-22T09:54:34.949036+0000","last_active":"2024-09-22T09:54:34.949036+0000","last_peered":"2024-09-22T09:54:34.949036+0000","last_clean":"2024-09-22T09:54:34.949036+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:54:34.949036+0000","last_undegraded":"2024-09-22T09:54:34.949036+0000","last_fullsized":"2024-09-22T09:54:34.949036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'106","last_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_deep_scrub":"262'106","last_deep_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.948920+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:26.051361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'218","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.423574+0000","last_change":"2024-09-22T09:54:30.423574+0000","last_active":"2024-09-22T09:54:30.423574+0000","last_peered":"2024-09-22T09:54:30.423574+0000","last_clean":"2024-09-22T09:54:30.423574+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:54:30.423574+0000","last_undegraded":"2024-09-22T09:54:30.423574+0000","last_fullsized":"2024-09-22T09:54:30.423574+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.423472+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:42.929221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":691,"num_read_kb":1734,"num_write":933,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4552","reported_seq":5321,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556891+0000","last_change":"2024-09-22T08:42:15.421948+0000","last_active":"2024-09-22T09:51:02.556891+0000","last_peered":"2024-09-22T09:51:02.556891+0000","last_clean":"2024-09-22T09:51:02.556891+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:51:02.556891+0000","last_undegraded":"2024-09-22T09:51:02.556891+0000","last_fullsized":"2024-09-22T09:51:02.556891+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":3000,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:10:54.736409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'324","reported_seq":1035,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.569112+0000","last_change":"2024-09-22T09:54:30.569112+0000","last_active":"2024-09-22T09:54:30.569112+0000","last_peered":"2024-09-22T09:54:30.569112+0000","last_clean":"2024-09-22T09:54:30.569112+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:54:30.569112+0000","last_undegraded":"2024-09-22T09:54:30.569112+0000","last_fullsized":"2024-09-22T09:54:30.569112+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.568978+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:49:58.439696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":40392,"num_write":1278,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'116","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.682868+0000","last_change":"2024-09-22T08:42:15.435779+0000","last_active":"2024-09-22T09:51:02.682868+0000","last_peered":"2024-09-22T09:51:02.682868+0000","last_clean":"2024-09-22T09:51:02.682868+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:51:02.682868+0000","last_undegraded":"2024-09-22T09:51:02.682868+0000","last_fullsized":"2024-09-22T09:51:02.682868+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:04:34.540861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'206","reported_seq":900,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.814919+0000","last_change":"2024-09-22T09:54:34.814919+0000","last_active":"2024-09-22T09:54:34.814919+0000","last_peered":"2024-09-22T09:54:34.814919+0000","last_clean":"2024-09-22T09:54:34.814919+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:54:34.814919+0000","last_undegraded":"2024-09-22T09:54:34.814919+0000","last_fullsized":"2024-09-22T09:54:34.814919+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.814749+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:27.535584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":708,"num_read_kb":60138,"num_write":928,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.622414+0000","last_change":"2024-09-22T09:54:30.622414+0000","last_active":"2024-09-22T09:54:30.622414+0000","last_peered":"2024-09-22T09:54:30.622414+0000","last_clean":"2024-09-22T09:54:30.622414+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:54:30.622414+0000","last_undegraded":"2024-09-22T09:54:30.622414+0000","last_fullsized":"2024-09-22T09:54:30.622414+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.622328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:28.359393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.679959+0000","last_change":"2024-09-22T09:54:35.679903+0000","last_active":"2024-09-22T09:54:35.679959+0000","last_peered":"2024-09-22T09:54:35.679959+0000","last_clean":"2024-09-22T09:54:35.679959+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:54:35.679959+0000","last_undegraded":"2024-09-22T09:54:35.679959+0000","last_fullsized":"2024-09-22T09:54:35.679959+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.679816+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:58:37.331041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'216","reported_seq":857,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.502790+0000","last_change":"2024-09-22T09:54:27.502790+0000","last_active":"2024-09-22T09:54:27.502790+0000","last_peered":"2024-09-22T09:54:27.502790+0000","last_clean":"2024-09-22T09:54:27.502790+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:54:27.502790+0000","last_undegraded":"2024-09-22T09:54:27.502790+0000","last_fullsized":"2024-09-22T09:54:27.502790+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'216","last_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_deep_scrub":"262'216","last_deep_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.502656+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:28.950343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":44934,"num_write":915,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.573561+0000","last_change":"2024-09-22T09:54:36.573483+0000","last_active":"2024-09-22T09:54:36.573561+0000","last_peered":"2024-09-22T09:54:36.573561+0000","last_clean":"2024-09-22T09:54:36.573561+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:54:36.573561+0000","last_undegraded":"2024-09-22T09:54:36.573561+0000","last_fullsized":"2024-09-22T09:54:36.573561+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.573367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:13.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'137","reported_seq":741,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.908195+0000","last_change":"2024-09-22T09:54:27.908195+0000","last_active":"2024-09-22T09:54:27.908195+0000","last_peered":"2024-09-22T09:54:27.908195+0000","last_clean":"2024-09-22T09:54:27.908195+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:54:27.908195+0000","last_undegraded":"2024-09-22T09:54:27.908195+0000","last_fullsized":"2024-09-22T09:54:27.908195+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.908076+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:25:43.835693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":4340,"num_write":703,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.342751+0000","last_change":"2024-09-22T09:54:36.342751+0000","last_active":"2024-09-22T09:54:36.342751+0000","last_peered":"2024-09-22T09:54:36.342751+0000","last_clean":"2024-09-22T09:54:36.342751+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:54:36.342751+0000","last_undegraded":"2024-09-22T09:54:36.342751+0000","last_fullsized":"2024-09-22T09:54:36.342751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.342669+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:11.894761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'200","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.931797+0000","last_change":"2024-09-22T09:54:28.931797+0000","last_active":"2024-09-22T09:54:28.931797+0000","last_peered":"2024-09-22T09:54:28.931797+0000","last_clean":"2024-09-22T09:54:28.931797+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:54:28.931797+0000","last_undegraded":"2024-09-22T09:54:28.931797+0000","last_fullsized":"2024-09-22T09:54:28.931797+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.931664+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:23.475431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":44793,"num_write":917,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'263","reported_seq":905,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.645828+0000","last_change":"2024-09-22T09:54:28.645828+0000","last_active":"2024-09-22T09:54:28.645828+0000","last_peered":"2024-09-22T09:54:28.645828+0000","last_clean":"2024-09-22T09:54:28.645828+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:54:28.645828+0000","last_undegraded":"2024-09-22T09:54:28.645828+0000","last_fullsized":"2024-09-22T09:54:28.645828+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.645693+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:27.752376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'208","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.766105+0000","last_change":"2024-09-22T09:54:23.766105+0000","last_active":"2024-09-22T09:54:23.766105+0000","last_peered":"2024-09-22T09:54:23.766105+0000","last_clean":"2024-09-22T09:54:23.766105+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:54:23.766105+0000","last_undegraded":"2024-09-22T09:54:23.766105+0000","last_fullsized":"2024-09-22T09:54:23.766105+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.765983+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:24.208701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":639,"num_write":1016,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'336","reported_seq":984,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.625420+0000","last_change":"2024-09-22T09:54:29.625420+0000","last_active":"2024-09-22T09:54:29.625420+0000","last_peered":"2024-09-22T09:54:29.625420+0000","last_clean":"2024-09-22T09:54:29.625420+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:54:29.625420+0000","last_undegraded":"2024-09-22T09:54:29.625420+0000","last_fullsized":"2024-09-22T09:54:29.625420+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.625322+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:56.414721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'231","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.834762+0000","last_change":"2024-09-22T09:54:28.834762+0000","last_active":"2024-09-22T09:54:28.834762+0000","last_peered":"2024-09-22T09:54:28.834762+0000","last_clean":"2024-09-22T09:54:28.834762+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:54:28.834762+0000","last_undegraded":"2024-09-22T09:54:28.834762+0000","last_fullsized":"2024-09-22T09:54:28.834762+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.834665+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:27.131540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":35016,"num_write":919,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'67","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547581+0000","last_change":"2024-09-22T08:42:15.436918+0000","last_active":"2024-09-22T09:49:57.547581+0000","last_peered":"2024-09-22T09:49:57.547581+0000","last_clean":"2024-09-22T09:49:57.547581+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:49:57.547581+0000","last_undegraded":"2024-09-22T09:49:57.547581+0000","last_fullsized":"2024-09-22T09:49:57.547581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:11.373207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'204","reported_seq":1075,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.044159+0000","last_change":"2024-09-22T09:54:27.044159+0000","last_active":"2024-09-22T09:54:27.044159+0000","last_peered":"2024-09-22T09:54:27.044159+0000","last_clean":"2024-09-22T09:54:27.044159+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:54:27.044159+0000","last_undegraded":"2024-09-22T09:54:27.044159+0000","last_fullsized":"2024-09-22T09:54:27.044159+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.044042+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:26.911985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1343,"num_read_kb":71433,"num_write":1020,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'127","reported_seq":637,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.786070+0000","last_change":"2024-09-22T08:42:23.524985+0000","last_active":"2024-09-22T09:52:36.786070+0000","last_peered":"2024-09-22T09:52:36.786070+0000","last_clean":"2024-09-22T09:52:36.786070+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:52:36.786070+0000","last_undegraded":"2024-09-22T09:52:36.786070+0000","last_fullsized":"2024-09-22T09:52:36.786070+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:48.897187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":710,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886256+0000","last_change":"2024-09-22T09:54:32.886256+0000","last_active":"2024-09-22T09:54:32.886256+0000","last_peered":"2024-09-22T09:54:32.886256+0000","last_clean":"2024-09-22T09:54:32.886256+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:54:32.886256+0000","last_undegraded":"2024-09-22T09:54:32.886256+0000","last_fullsized":"2024-09-22T09:54:32.886256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886167+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:30.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'246","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.453792+0000","last_change":"2024-09-22T09:54:26.453733+0000","last_active":"2024-09-22T09:54:26.453792+0000","last_peered":"2024-09-22T09:54:26.453792+0000","last_clean":"2024-09-22T09:54:26.453792+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:54:26.453792+0000","last_undegraded":"2024-09-22T09:54:26.453792+0000","last_fullsized":"2024-09-22T09:54:26.453792+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.453584+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:12.566992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":724,"num_read_kb":75224,"num_write":1095,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673256+0000","last_change":"2024-09-22T08:42:17.436026+0000","last_active":"2024-09-22T09:49:57.673256+0000","last_peered":"2024-09-22T09:49:57.673256+0000","last_clean":"2024-09-22T09:49:57.673256+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:49:57.673256+0000","last_undegraded":"2024-09-22T09:49:57.673256+0000","last_fullsized":"2024-09-22T09:49:57.673256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:14:39.444676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'216","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.003127+0000","last_change":"2024-09-22T08:42:19.458164+0000","last_active":"2024-09-22T09:54:14.003127+0000","last_peered":"2024-09-22T09:54:14.003127+0000","last_clean":"2024-09-22T09:54:14.003127+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:54:14.003127+0000","last_undegraded":"2024-09-22T09:54:14.003127+0000","last_fullsized":"2024-09-22T09:54:14.003127+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:39:13.853175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":291,"num_read_kb":380,"num_write":172,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515692+0000","last_change":"2024-09-22T08:42:21.476835+0000","last_active":"2024-09-22T09:50:02.515692+0000","last_peered":"2024-09-22T09:50:02.515692+0000","last_clean":"2024-09-22T09:50:02.515692+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:50:02.515692+0000","last_undegraded":"2024-09-22T09:50:02.515692+0000","last_fullsized":"2024-09-22T09:50:02.515692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:23.164486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'141","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:11.326568+0000","last_change":"2024-09-22T08:42:23.525612+0000","last_active":"2024-09-22T09:51:11.326568+0000","last_peered":"2024-09-22T09:51:11.326568+0000","last_clean":"2024-09-22T09:51:11.326568+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:51:11.326568+0000","last_undegraded":"2024-09-22T09:51:11.326568+0000","last_fullsized":"2024-09-22T09:51:11.326568+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:43.028034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.356652+0000","last_change":"2024-09-22T09:54:34.356652+0000","last_active":"2024-09-22T09:54:34.356652+0000","last_peered":"2024-09-22T09:54:34.356652+0000","last_clean":"2024-09-22T09:54:34.356652+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:54:34.356652+0000","last_undegraded":"2024-09-22T09:54:34.356652+0000","last_fullsized":"2024-09-22T09:54:34.356652+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'241","last_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_deep_scrub":"262'241","last_deep_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.356567+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:12.922893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.085670+0000","last_change":"2024-09-22T09:54:21.085625+0000","last_active":"2024-09-22T09:54:21.085670+0000","last_peered":"2024-09-22T09:54:21.085670+0000","last_clean":"2024-09-22T09:54:21.085670+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:54:21.085670+0000","last_undegraded":"2024-09-22T09:54:21.085670+0000","last_fullsized":"2024-09-22T09:54:21.085670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.085544+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:19.372506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":43802,"num_write":911,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.655271+0000","last_change":"2024-09-22T08:42:17.438392+0000","last_active":"2024-09-22T09:50:07.655271+0000","last_peered":"2024-09-22T09:50:07.655271+0000","last_clean":"2024-09-22T09:50:07.655271+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:50:07.655271+0000","last_undegraded":"2024-09-22T09:50:07.655271+0000","last_fullsized":"2024-09-22T09:50:07.655271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:19:33.187002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'99","reported_seq":634,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.845043+0000","last_change":"2024-09-22T08:42:19.453384+0000","last_active":"2024-09-22T09:52:52.845043+0000","last_peered":"2024-09-22T09:52:52.845043+0000","last_clean":"2024-09-22T09:52:52.845043+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:52:52.845043+0000","last_undegraded":"2024-09-22T09:52:52.845043+0000","last_fullsized":"2024-09-22T09:52:52.845043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:58.602109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.548236+0000","last_change":"2024-09-22T08:42:21.479500+0000","last_active":"2024-09-22T09:50:02.548236+0000","last_peered":"2024-09-22T09:50:02.548236+0000","last_clean":"2024-09-22T09:50:02.548236+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:50:02.548236+0000","last_undegraded":"2024-09-22T09:50:02.548236+0000","last_fullsized":"2024-09-22T09:50:02.548236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:00:12.904978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'108","reported_seq":610,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:39.888189+0000","last_change":"2024-09-22T08:42:23.524672+0000","last_active":"2024-09-22T09:51:39.888189+0000","last_peered":"2024-09-22T09:51:39.888189+0000","last_clean":"2024-09-22T09:51:39.888189+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:51:39.888189+0000","last_undegraded":"2024-09-22T09:51:39.888189+0000","last_fullsized":"2024-09-22T09:51:39.888189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:19:49.539509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":754,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.045733+0000","last_change":"2024-09-22T09:54:31.045733+0000","last_active":"2024-09-22T09:54:31.045733+0000","last_peered":"2024-09-22T09:54:31.045733+0000","last_clean":"2024-09-22T09:54:31.045733+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:54:31.045733+0000","last_undegraded":"2024-09-22T09:54:31.045733+0000","last_fullsized":"2024-09-22T09:54:31.045733+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.045630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:36:20.196950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'246","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.640226+0000","last_change":"2024-09-22T09:54:21.640226+0000","last_active":"2024-09-22T09:54:21.640226+0000","last_peered":"2024-09-22T09:54:21.640226+0000","last_clean":"2024-09-22T09:54:21.640226+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:54:21.640226+0000","last_undegraded":"2024-09-22T09:54:21.640226+0000","last_fullsized":"2024-09-22T09:54:21.640226+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.640096+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.038690+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":41488,"num_write":1122,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"36'4","reported_seq":974,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.391097+0000","last_change":"2024-09-22T08:42:17.436896+0000","last_active":"2024-09-22T09:54:13.391097+0000","last_peered":"2024-09-22T09:54:13.391097+0000","last_clean":"2024-09-22T09:54:13.391097+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:13.391097+0000","last_undegraded":"2024-09-22T09:54:13.391097+0000","last_fullsized":"2024-09-22T09:54:13.391097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:50.909668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'147","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.635267+0000","last_change":"2024-09-22T09:54:37.635267+0000","last_active":"2024-09-22T09:54:37.635267+0000","last_peered":"2024-09-22T09:54:37.635267+0000","last_clean":"2024-09-22T09:54:37.635267+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:54:37.635267+0000","last_undegraded":"2024-09-22T09:54:37.635267+0000","last_fullsized":"2024-09-22T09:54:37.635267+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.635149+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:19.442915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'746","reported_seq":2935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.827250+0000","last_change":"2024-09-22T08:42:21.477386+0000","last_active":"2024-09-22T09:54:13.827250+0000","last_peered":"2024-09-22T09:54:13.827250+0000","last_clean":"2024-09-22T09:54:13.827250+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:13.827250+0000","last_undegraded":"2024-09-22T09:54:13.827250+0000","last_fullsized":"2024-09-22T09:54:13.827250+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:55:26.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'218","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.675764+0000","last_change":"2024-09-22T08:42:23.578386+0000","last_active":"2024-09-22T09:52:36.675764+0000","last_peered":"2024-09-22T09:52:36.675764+0000","last_clean":"2024-09-22T09:52:36.675764+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:52:36.675764+0000","last_undegraded":"2024-09-22T09:52:36.675764+0000","last_fullsized":"2024-09-22T09:52:36.675764+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:23:30.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.841700+0000","last_change":"2024-09-22T09:54:33.841700+0000","last_active":"2024-09-22T09:54:33.841700+0000","last_peered":"2024-09-22T09:54:33.841700+0000","last_clean":"2024-09-22T09:54:33.841700+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:54:33.841700+0000","last_undegraded":"2024-09-22T09:54:33.841700+0000","last_fullsized":"2024-09-22T09:54:33.841700+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'126","last_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_deep_scrub":"262'126","last_deep_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.841584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:42.546104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'178","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.765183+0000","last_change":"2024-09-22T09:54:22.765090+0000","last_active":"2024-09-22T09:54:22.765183+0000","last_peered":"2024-09-22T09:54:22.765183+0000","last_clean":"2024-09-22T09:54:22.765183+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:54:22.765183+0000","last_undegraded":"2024-09-22T09:54:22.765183+0000","last_fullsized":"2024-09-22T09:54:22.765183+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'178","last_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_deep_scrub":"262'178","last_deep_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.764975+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:45.588343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":49818,"num_write":846,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.673308+0000","last_change":"2024-09-22T08:42:17.435623+0000","last_active":"2024-09-22T09:49:57.673308+0000","last_peered":"2024-09-22T09:49:57.673308+0000","last_clean":"2024-09-22T09:49:57.673308+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:49:57.673308+0000","last_undegraded":"2024-09-22T09:49:57.673308+0000","last_fullsized":"2024-09-22T09:49:57.673308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:28.519736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'150","reported_seq":726,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.951698+0000","last_change":"2024-09-22T08:42:19.456582+0000","last_active":"2024-09-22T09:54:13.951698+0000","last_peered":"2024-09-22T09:54:13.951698+0000","last_clean":"2024-09-22T09:54:13.951698+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:54:13.951698+0000","last_undegraded":"2024-09-22T09:54:13.951698+0000","last_fullsized":"2024-09-22T09:54:13.951698+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:23:38.574953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":274,"num_write":110,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'755","reported_seq":2400,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.832370+0000","last_change":"2024-09-22T08:42:21.478967+0000","last_active":"2024-09-22T09:54:13.832370+0000","last_peered":"2024-09-22T09:54:13.832370+0000","last_clean":"2024-09-22T09:54:13.832370+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:13.832370+0000","last_undegraded":"2024-09-22T09:54:13.832370+0000","last_fullsized":"2024-09-22T09:54:13.832370+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:49.086596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.420090+0000","last_change":"2024-09-22T09:54:32.420090+0000","last_active":"2024-09-22T09:54:32.420090+0000","last_peered":"2024-09-22T09:54:32.420090+0000","last_clean":"2024-09-22T09:54:32.420090+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:54:32.420090+0000","last_undegraded":"2024-09-22T09:54:32.420090+0000","last_fullsized":"2024-09-22T09:54:32.420090+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.419968+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:58.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'193","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.589426+0000","last_change":"2024-09-22T09:54:20.589426+0000","last_active":"2024-09-22T09:54:20.589426+0000","last_peered":"2024-09-22T09:54:20.589426+0000","last_clean":"2024-09-22T09:54:20.589426+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:54:20.589426+0000","last_undegraded":"2024-09-22T09:54:20.589426+0000","last_fullsized":"2024-09-22T09:54:20.589426+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.589319+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.187304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":37265,"num_write":903,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.530209+0000","last_change":"2024-09-22T08:42:17.428741+0000","last_active":"2024-09-22T09:51:37.530209+0000","last_peered":"2024-09-22T09:51:37.530209+0000","last_clean":"2024-09-22T09:51:37.530209+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:51:37.530209+0000","last_undegraded":"2024-09-22T09:51:37.530209+0000","last_fullsized":"2024-09-22T09:51:37.530209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.400097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'252","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.041327+0000","last_change":"2024-09-22T08:42:19.453085+0000","last_active":"2024-09-22T09:54:14.041327+0000","last_peered":"2024-09-22T09:54:14.041327+0000","last_clean":"2024-09-22T09:54:14.041327+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:54:14.041327+0000","last_undegraded":"2024-09-22T09:54:14.041327+0000","last_fullsized":"2024-09-22T09:54:14.041327+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:18.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6788,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":355,"num_read_kb":422,"num_write":210,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.441095+0000","last_change":"2024-09-22T08:42:21.473910+0000","last_active":"2024-09-22T09:52:07.441095+0000","last_peered":"2024-09-22T09:52:07.441095+0000","last_clean":"2024-09-22T09:52:07.441095+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:52:07.441095+0000","last_undegraded":"2024-09-22T09:52:07.441095+0000","last_fullsized":"2024-09-22T09:52:07.441095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'582","reported_seq":1405,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.730090+0000","last_change":"2024-09-22T08:42:23.524686+0000","last_active":"2024-09-22T09:54:00.730090+0000","last_peered":"2024-09-22T09:54:00.730090+0000","last_clean":"2024-09-22T09:54:00.730090+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:00.730090+0000","last_undegraded":"2024-09-22T09:54:00.730090+0000","last_fullsized":"2024-09-22T09:54:00.730090+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:20.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":1004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.714675+0000","last_change":"2024-09-22T09:54:25.714675+0000","last_active":"2024-09-22T09:54:25.714675+0000","last_peered":"2024-09-22T09:54:25.714675+0000","last_clean":"2024-09-22T09:54:25.714675+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:54:25.714675+0000","last_undegraded":"2024-09-22T09:54:25.714675+0000","last_fullsized":"2024-09-22T09:54:25.714675+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.714587+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:22:34.018478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'229","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.529569+0000","last_change":"2024-09-22T09:54:24.529569+0000","last_active":"2024-09-22T09:54:24.529569+0000","last_peered":"2024-09-22T09:54:24.529569+0000","last_clean":"2024-09-22T09:54:24.529569+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:54:24.529569+0000","last_undegraded":"2024-09-22T09:54:24.529569+0000","last_fullsized":"2024-09-22T09:54:24.529569+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.529439+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:38.886184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":43078,"num_write":996,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.616335+0000","last_change":"2024-09-22T09:54:32.616335+0000","last_active":"2024-09-22T09:54:32.616335+0000","last_peered":"2024-09-22T09:54:32.616335+0000","last_clean":"2024-09-22T09:54:32.616335+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:54:32.616335+0000","last_undegraded":"2024-09-22T09:54:32.616335+0000","last_fullsized":"2024-09-22T09:54:32.616335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.616231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:46.763351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'152","reported_seq":732,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.175590+0000","last_change":"2024-09-22T08:42:19.453046+0000","last_active":"2024-09-22T09:54:14.175590+0000","last_peered":"2024-09-22T09:54:14.175590+0000","last_clean":"2024-09-22T09:54:14.175590+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:54:14.175590+0000","last_undegraded":"2024-09-22T09:54:14.175590+0000","last_fullsized":"2024-09-22T09:54:14.175590+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":232,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2542","reported_seq":4378,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.695093+0000","last_change":"2024-09-22T08:42:23.525193+0000","last_active":"2024-09-22T09:53:22.695093+0000","last_peered":"2024-09-22T09:53:22.695093+0000","last_clean":"2024-09-22T09:53:22.695093+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:53:22.695093+0000","last_undegraded":"2024-09-22T09:53:22.695093+0000","last_fullsized":"2024-09-22T09:53:22.695093+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":2500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:05.078232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1208,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.925826+0000","last_change":"2024-09-22T09:54:30.925826+0000","last_active":"2024-09-22T09:54:30.925826+0000","last_peered":"2024-09-22T09:54:30.925826+0000","last_clean":"2024-09-22T09:54:30.925826+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:54:30.925826+0000","last_undegraded":"2024-09-22T09:54:30.925826+0000","last_fullsized":"2024-09-22T09:54:30.925826+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'595","last_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_deep_scrub":"262'595","last_deep_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.925742+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:22.030833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'249","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.496340+0000","last_change":"2024-09-22T09:54:25.496340+0000","last_active":"2024-09-22T09:54:25.496340+0000","last_peered":"2024-09-22T09:54:25.496340+0000","last_clean":"2024-09-22T09:54:25.496340+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:54:25.496340+0000","last_undegraded":"2024-09-22T09:54:25.496340+0000","last_fullsized":"2024-09-22T09:54:25.496340+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'249","last_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_deep_scrub":"262'249","last_deep_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.496221+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:36.135437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":17581,"num_write":1026,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.594837+0000","last_change":"2024-09-22T09:54:34.594837+0000","last_active":"2024-09-22T09:54:34.594837+0000","last_peered":"2024-09-22T09:54:34.594837+0000","last_clean":"2024-09-22T09:54:34.594837+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:54:34.594837+0000","last_undegraded":"2024-09-22T09:54:34.594837+0000","last_fullsized":"2024-09-22T09:54:34.594837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.594730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:44.826276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'198","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.068294+0000","last_change":"2024-09-22T08:42:19.455781+0000","last_active":"2024-09-22T09:54:14.068294+0000","last_peered":"2024-09-22T09:54:14.068294+0000","last_clean":"2024-09-22T09:54:14.068294+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:54:14.068294+0000","last_undegraded":"2024-09-22T09:54:14.068294+0000","last_fullsized":"2024-09-22T09:54:14.068294+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:37:46.879916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6515,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":336,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'758","reported_seq":2724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.833355+0000","last_change":"2024-09-22T08:42:21.480118+0000","last_active":"2024-09-22T09:54:13.833355+0000","last_peered":"2024-09-22T09:54:13.833355+0000","last_clean":"2024-09-22T09:54:13.833355+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:13.833355+0000","last_undegraded":"2024-09-22T09:54:13.833355+0000","last_fullsized":"2024-09-22T09:54:13.833355+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:11:26.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'119","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.314868+0000","last_change":"2024-09-22T08:42:23.527331+0000","last_active":"2024-09-22T09:53:59.314868+0000","last_peered":"2024-09-22T09:53:59.314868+0000","last_clean":"2024-09-22T09:53:59.314868+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:53:59.314868+0000","last_undegraded":"2024-09-22T09:53:59.314868+0000","last_fullsized":"2024-09-22T09:53:59.314868+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:06.830634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.039780+0000","last_change":"2024-09-22T09:54:32.039780+0000","last_active":"2024-09-22T09:54:32.039780+0000","last_peered":"2024-09-22T09:54:32.039780+0000","last_clean":"2024-09-22T09:54:32.039780+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:54:32.039780+0000","last_undegraded":"2024-09-22T09:54:32.039780+0000","last_fullsized":"2024-09-22T09:54:32.039780+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.039644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:49.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'210","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.582258+0000","last_change":"2024-09-22T09:54:25.582258+0000","last_active":"2024-09-22T09:54:25.582258+0000","last_peered":"2024-09-22T09:54:25.582258+0000","last_clean":"2024-09-22T09:54:25.582258+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:54:25.582258+0000","last_undegraded":"2024-09-22T09:54:25.582258+0000","last_fullsized":"2024-09-22T09:54:25.582258+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.582157+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:50.691745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":60855,"num_write":915,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.585259+0000","last_change":"2024-09-22T09:54:33.585259+0000","last_active":"2024-09-22T09:54:33.585259+0000","last_peered":"2024-09-22T09:54:33.585259+0000","last_clean":"2024-09-22T09:54:33.585259+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:54:33.585259+0000","last_undegraded":"2024-09-22T09:54:33.585259+0000","last_fullsized":"2024-09-22T09:54:33.585259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.585167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:48.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'204","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.084983+0000","last_change":"2024-09-22T08:42:19.452009+0000","last_active":"2024-09-22T09:54:14.084983+0000","last_peered":"2024-09-22T09:54:14.084983+0000","last_clean":"2024-09-22T09:54:14.084983+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:14.084983+0000","last_undegraded":"2024-09-22T09:54:14.084983+0000","last_fullsized":"2024-09-22T09:54:14.084983+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:46.201887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":297,"num_read_kb":387,"num_write":144,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.697752+0000","last_change":"2024-09-22T08:42:21.479365+0000","last_active":"2024-09-22T09:51:42.697752+0000","last_peered":"2024-09-22T09:51:42.697752+0000","last_clean":"2024-09-22T09:51:42.697752+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:51:42.697752+0000","last_undegraded":"2024-09-22T09:51:42.697752+0000","last_fullsized":"2024-09-22T09:51:42.697752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:36:44.054664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'142","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.315438+0000","last_change":"2024-09-22T08:42:23.525367+0000","last_active":"2024-09-22T09:53:59.315438+0000","last_peered":"2024-09-22T09:53:59.315438+0000","last_clean":"2024-09-22T09:53:59.315438+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:53:59.315438+0000","last_undegraded":"2024-09-22T09:53:59.315438+0000","last_fullsized":"2024-09-22T09:53:59.315438+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:24.183213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.695111+0000","last_change":"2024-09-22T09:54:26.695111+0000","last_active":"2024-09-22T09:54:26.695111+0000","last_peered":"2024-09-22T09:54:26.695111+0000","last_clean":"2024-09-22T09:54:26.695111+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:54:26.695111+0000","last_undegraded":"2024-09-22T09:54:26.695111+0000","last_fullsized":"2024-09-22T09:54:26.695111+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.695015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:37.239794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'366","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.883932+0000","last_change":"2024-09-22T09:54:21.883932+0000","last_active":"2024-09-22T09:54:21.883932+0000","last_peered":"2024-09-22T09:54:21.883932+0000","last_clean":"2024-09-22T09:54:21.883932+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:54:21.883932+0000","last_undegraded":"2024-09-22T09:54:21.883932+0000","last_fullsized":"2024-09-22T09:54:21.883932+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.883821+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:21.748018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1019,"num_read_kb":7434,"num_write":1387,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.591498+0000","last_change":"2024-09-22T09:54:35.591498+0000","last_active":"2024-09-22T09:54:35.591498+0000","last_peered":"2024-09-22T09:54:35.591498+0000","last_clean":"2024-09-22T09:54:35.591498+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:54:35.591498+0000","last_undegraded":"2024-09-22T09:54:35.591498+0000","last_fullsized":"2024-09-22T09:54:35.591498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.591372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:34.926025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'166","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.899806+0000","last_change":"2024-09-22T08:42:19.454917+0000","last_active":"2024-09-22T09:54:13.899806+0000","last_peered":"2024-09-22T09:54:13.899806+0000","last_clean":"2024-09-22T09:54:13.899806+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:54:13.899806+0000","last_undegraded":"2024-09-22T09:54:13.899806+0000","last_fullsized":"2024-09-22T09:54:13.899806+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":182,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:17.672374+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:52:17.672374+0000","last_peered":"2024-09-22T09:52:17.672374+0000","last_clean":"2024-09-22T09:52:17.672374+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:52:17.672374+0000","last_undegraded":"2024-09-22T09:52:17.672374+0000","last_fullsized":"2024-09-22T09:52:17.672374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674614+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:52:37.674614+0000","last_peered":"2024-09-22T09:52:37.674614+0000","last_clean":"2024-09-22T09:52:37.674614+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:52:37.674614+0000","last_undegraded":"2024-09-22T09:52:37.674614+0000","last_fullsized":"2024-09-22T09:52:37.674614+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:23.393060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.718751+0000","last_change":"2024-09-22T09:54:27.718751+0000","last_active":"2024-09-22T09:54:27.718751+0000","last_peered":"2024-09-22T09:54:27.718751+0000","last_clean":"2024-09-22T09:54:27.718751+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:54:27.718751+0000","last_undegraded":"2024-09-22T09:54:27.718751+0000","last_fullsized":"2024-09-22T09:54:27.718751+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.718664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:52.332290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'237","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.813127+0000","last_change":"2024-09-22T09:54:21.813127+0000","last_active":"2024-09-22T09:54:21.813127+0000","last_peered":"2024-09-22T09:54:21.813127+0000","last_clean":"2024-09-22T09:54:21.813127+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:54:21.813127+0000","last_undegraded":"2024-09-22T09:54:21.813127+0000","last_fullsized":"2024-09-22T09:54:21.813127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.812963+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:20.379997+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242950,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":767,"num_read_kb":42930,"num_write":1126,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.200568+0000","last_change":"2024-09-22T09:54:36.200568+0000","last_active":"2024-09-22T09:54:36.200568+0000","last_peered":"2024-09-22T09:54:36.200568+0000","last_clean":"2024-09-22T09:54:36.200568+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:54:36.200568+0000","last_undegraded":"2024-09-22T09:54:36.200568+0000","last_fullsized":"2024-09-22T09:54:36.200568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.200478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:14.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'199","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.623404+0000","last_change":"2024-09-22T09:54:36.623404+0000","last_active":"2024-09-22T09:54:36.623404+0000","last_peered":"2024-09-22T09:54:36.623404+0000","last_clean":"2024-09-22T09:54:36.623404+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:54:36.623404+0000","last_undegraded":"2024-09-22T09:54:36.623404+0000","last_fullsized":"2024-09-22T09:54:36.623404+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.623296+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:27.880579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'722","reported_seq":2496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.197661+0000","last_change":"2024-09-22T08:42:21.477749+0000","last_active":"2024-09-22T09:54:14.197661+0000","last_peered":"2024-09-22T09:54:14.197661+0000","last_clean":"2024-09-22T09:54:14.197661+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:14.197661+0000","last_undegraded":"2024-09-22T09:54:14.197661+0000","last_fullsized":"2024-09-22T09:54:14.197661+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'139","reported_seq":639,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:34.236678+0000","last_change":"2024-09-22T08:42:23.527200+0000","last_active":"2024-09-22T09:52:34.236678+0000","last_peered":"2024-09-22T09:52:34.236678+0000","last_clean":"2024-09-22T09:52:34.236678+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:52:34.236678+0000","last_undegraded":"2024-09-22T09:52:34.236678+0000","last_fullsized":"2024-09-22T09:52:34.236678+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:36.368516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.702387+0000","last_change":"2024-09-22T09:54:28.702387+0000","last_active":"2024-09-22T09:54:28.702387+0000","last_peered":"2024-09-22T09:54:28.702387+0000","last_clean":"2024-09-22T09:54:28.702387+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:54:28.702387+0000","last_undegraded":"2024-09-22T09:54:28.702387+0000","last_fullsized":"2024-09-22T09:54:28.702387+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.702304+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:11.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'258","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.856222+0000","last_change":"2024-09-22T09:54:22.856222+0000","last_active":"2024-09-22T09:54:22.856222+0000","last_peered":"2024-09-22T09:54:22.856222+0000","last_clean":"2024-09-22T09:54:22.856222+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:54:22.856222+0000","last_undegraded":"2024-09-22T09:54:22.856222+0000","last_fullsized":"2024-09-22T09:54:22.856222+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'258","last_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_deep_scrub":"262'258","last_deep_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.856126+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:10.632167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1203,"num_read_kb":6055,"num_write":1103,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1453,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.819710+0000","last_change":"2024-09-22T08:42:17.433014+0000","last_active":"2024-09-22T09:54:13.819710+0000","last_peered":"2024-09-22T09:54:13.819710+0000","last_clean":"2024-09-22T09:54:13.819710+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:13.819710+0000","last_undegraded":"2024-09-22T09:54:13.819710+0000","last_fullsized":"2024-09-22T09:54:13.819710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'132","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.818334+0000","last_change":"2024-09-22T08:42:19.457240+0000","last_active":"2024-09-22T09:52:52.818334+0000","last_peered":"2024-09-22T09:52:52.818334+0000","last_clean":"2024-09-22T09:52:52.818334+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:52:52.818334+0000","last_undegraded":"2024-09-22T09:52:52.818334+0000","last_fullsized":"2024-09-22T09:52:52.818334+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'757","reported_seq":2731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.198614+0000","last_change":"2024-09-22T08:42:21.479394+0000","last_active":"2024-09-22T09:54:14.198614+0000","last_peered":"2024-09-22T09:54:14.198614+0000","last_clean":"2024-09-22T09:54:14.198614+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:14.198614+0000","last_undegraded":"2024-09-22T09:54:14.198614+0000","last_fullsized":"2024-09-22T09:54:14.198614+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'118","reported_seq":617,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.558129+0000","last_change":"2024-09-22T08:42:23.526928+0000","last_active":"2024-09-22T09:51:12.558129+0000","last_peered":"2024-09-22T09:51:12.558129+0000","last_clean":"2024-09-22T09:51:12.558129+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:51:12.558129+0000","last_undegraded":"2024-09-22T09:51:12.558129+0000","last_fullsized":"2024-09-22T09:51:12.558129+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:44:16.995273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.222747+0000","last_change":"2024-09-22T09:54:31.222655+0000","last_active":"2024-09-22T09:54:31.222747+0000","last_peered":"2024-09-22T09:54:31.222747+0000","last_clean":"2024-09-22T09:54:31.222747+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:54:31.222747+0000","last_undegraded":"2024-09-22T09:54:31.222747+0000","last_fullsized":"2024-09-22T09:54:31.222747+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4209","last_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_deep_scrub":"262'4209","last_deep_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.222546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:03.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'188","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.824881+0000","last_change":"2024-09-22T09:54:29.824881+0000","last_active":"2024-09-22T09:54:29.824881+0000","last_peered":"2024-09-22T09:54:29.824881+0000","last_clean":"2024-09-22T09:54:29.824881+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:54:29.824881+0000","last_undegraded":"2024-09-22T09:54:29.824881+0000","last_fullsized":"2024-09-22T09:54:29.824881+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.824757+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:54.380784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":707,"num_read_kb":142631,"num_write":847,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.565147+0000","last_change":"2024-09-22T08:42:17.428207+0000","last_active":"2024-09-22T09:52:02.565147+0000","last_peered":"2024-09-22T09:52:02.565147+0000","last_clean":"2024-09-22T09:52:02.565147+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:52:02.565147+0000","last_undegraded":"2024-09-22T09:52:02.565147+0000","last_fullsized":"2024-09-22T09:52:02.565147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:58:36.330654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'223","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.011367+0000","last_change":"2024-09-22T08:42:19.459817+0000","last_active":"2024-09-22T09:54:14.011367+0000","last_peered":"2024-09-22T09:54:14.011367+0000","last_clean":"2024-09-22T09:54:14.011367+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:54:14.011367+0000","last_undegraded":"2024-09-22T09:54:14.011367+0000","last_fullsized":"2024-09-22T09:54:14.011367+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":186,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.684803+0000","last_change":"2024-09-22T08:42:21.481035+0000","last_active":"2024-09-22T09:52:07.684803+0000","last_peered":"2024-09-22T09:52:07.684803+0000","last_clean":"2024-09-22T09:52:07.684803+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:52:07.684803+0000","last_undegraded":"2024-09-22T09:52:07.684803+0000","last_fullsized":"2024-09-22T09:52:07.684803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'130","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:48.452137+0000","last_change":"2024-09-22T08:42:23.529103+0000","last_active":"2024-09-22T09:51:48.452137+0000","last_peered":"2024-09-22T09:51:48.452137+0000","last_clean":"2024-09-22T09:51:48.452137+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:51:48.452137+0000","last_undegraded":"2024-09-22T09:51:48.452137+0000","last_fullsized":"2024-09-22T09:51:48.452137+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:43.270586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.953765+0000","last_change":"2024-09-22T09:54:29.953765+0000","last_active":"2024-09-22T09:54:29.953765+0000","last_peered":"2024-09-22T09:54:29.953765+0000","last_clean":"2024-09-22T09:54:29.953765+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:54:29.953765+0000","last_undegraded":"2024-09-22T09:54:29.953765+0000","last_fullsized":"2024-09-22T09:54:29.953765+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.953655+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:28.167803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.574870+0000","last_change":"2024-09-22T09:54:22.574870+0000","last_active":"2024-09-22T09:54:22.574870+0000","last_peered":"2024-09-22T09:54:22.574870+0000","last_clean":"2024-09-22T09:54:22.574870+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:54:22.574870+0000","last_undegraded":"2024-09-22T09:54:22.574870+0000","last_fullsized":"2024-09-22T09:54:22.574870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.574784+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:51.565048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":538,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.531543+0000","last_change":"2024-09-22T09:54:22.531543+0000","last_active":"2024-09-22T09:54:22.531543+0000","last_peered":"2024-09-22T09:54:22.531543+0000","last_clean":"2024-09-22T09:54:22.531543+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:54:22.531543+0000","last_undegraded":"2024-09-22T09:54:22.531543+0000","last_fullsized":"2024-09-22T09:54:22.531543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.531426+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:15.733698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'265","reported_seq":928,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.914080+0000","last_change":"2024-09-22T09:54:20.914080+0000","last_active":"2024-09-22T09:54:20.914080+0000","last_peered":"2024-09-22T09:54:20.914080+0000","last_clean":"2024-09-22T09:54:20.914080+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:54:20.914080+0000","last_undegraded":"2024-09-22T09:54:20.914080+0000","last_fullsized":"2024-09-22T09:54:20.914080+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'265","last_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_deep_scrub":"262'265","last_deep_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.913993+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:34.016179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":19734,"num_write":1091,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524909+0000","last_change":"2024-09-22T08:42:17.430962+0000","last_active":"2024-09-22T09:51:02.524909+0000","last_peered":"2024-09-22T09:51:02.524909+0000","last_clean":"2024-09-22T09:51:02.524909+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:51:02.524909+0000","last_undegraded":"2024-09-22T09:51:02.524909+0000","last_fullsized":"2024-09-22T09:51:02.524909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:31:38.741426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'321","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.126335+0000","last_change":"2024-09-22T08:42:19.458458+0000","last_active":"2024-09-22T09:54:14.126335+0000","last_peered":"2024-09-22T09:54:14.126335+0000","last_clean":"2024-09-22T09:54:14.126335+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:14.126335+0000","last_undegraded":"2024-09-22T09:54:14.126335+0000","last_fullsized":"2024-09-22T09:54:14.126335+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:21.464285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":739,"num_write":494,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.668007+0000","last_change":"2024-09-22T08:42:21.476608+0000","last_active":"2024-09-22T09:51:42.668007+0000","last_peered":"2024-09-22T09:51:42.668007+0000","last_clean":"2024-09-22T09:51:42.668007+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:51:42.668007+0000","last_undegraded":"2024-09-22T09:51:42.668007+0000","last_fullsized":"2024-09-22T09:51:42.668007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:13:00.388229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'205","reported_seq":913,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.706774+0000","last_change":"2024-09-22T08:42:23.527973+0000","last_active":"2024-09-22T09:52:36.706774+0000","last_peered":"2024-09-22T09:52:36.706774+0000","last_clean":"2024-09-22T09:52:36.706774+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:52:36.706774+0000","last_undegraded":"2024-09-22T09:52:36.706774+0000","last_fullsized":"2024-09-22T09:52:36.706774+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:38.241959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'137","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.023195+0000","last_change":"2024-09-22T09:54:30.023195+0000","last_active":"2024-09-22T09:54:30.023195+0000","last_peered":"2024-09-22T09:54:30.023195+0000","last_clean":"2024-09-22T09:54:30.023195+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:54:30.023195+0000","last_undegraded":"2024-09-22T09:54:30.023195+0000","last_fullsized":"2024-09-22T09:54:30.023195+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.023101+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:48.412441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.540005+0000","last_change":"2024-09-22T09:54:23.540005+0000","last_active":"2024-09-22T09:54:23.540005+0000","last_peered":"2024-09-22T09:54:23.540005+0000","last_clean":"2024-09-22T09:54:23.540005+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:54:23.540005+0000","last_undegraded":"2024-09-22T09:54:23.540005+0000","last_fullsized":"2024-09-22T09:54:23.540005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:38.423290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'211","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.137314+0000","last_change":"2024-09-22T09:54:20.137314+0000","last_active":"2024-09-22T09:54:20.137314+0000","last_peered":"2024-09-22T09:54:20.137314+0000","last_clean":"2024-09-22T09:54:20.137314+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:54:20.137314+0000","last_undegraded":"2024-09-22T09:54:20.137314+0000","last_fullsized":"2024-09-22T09:54:20.137314+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.137215+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:24.795199+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":801,"num_read_kb":134895,"num_write":909,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.688003+0000","last_change":"2024-09-22T08:42:17.440799+0000","last_active":"2024-09-22T09:51:37.688003+0000","last_peered":"2024-09-22T09:51:37.688003+0000","last_clean":"2024-09-22T09:51:37.688003+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:51:37.688003+0000","last_undegraded":"2024-09-22T09:51:37.688003+0000","last_fullsized":"2024-09-22T09:51:37.688003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:51:27.078620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'900","reported_seq":2712,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.181834+0000","last_change":"2024-09-22T08:42:19.455687+0000","last_active":"2024-09-22T09:54:14.181834+0000","last_peered":"2024-09-22T09:54:14.181834+0000","last_clean":"2024-09-22T09:54:14.181834+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:14.181834+0000","last_undegraded":"2024-09-22T09:54:14.181834+0000","last_fullsized":"2024-09-22T09:54:14.181834+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":801,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:30.282664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22457,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1275,"num_read_kb":1494,"num_write":384,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:22.527988+0000","last_change":"2024-09-22T08:42:21.476397+0000","last_active":"2024-09-22T09:51:22.527988+0000","last_peered":"2024-09-22T09:51:22.527988+0000","last_clean":"2024-09-22T09:51:22.527988+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:51:22.527988+0000","last_undegraded":"2024-09-22T09:51:22.527988+0000","last_fullsized":"2024-09-22T09:51:22.527988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:11.328442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'234","reported_seq":762,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.441069+0000","last_change":"2024-09-22T08:42:23.576879+0000","last_active":"2024-09-22T09:52:07.441069+0000","last_peered":"2024-09-22T09:52:07.441069+0000","last_clean":"2024-09-22T09:52:07.441069+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:52:07.441069+0000","last_undegraded":"2024-09-22T09:52:07.441069+0000","last_fullsized":"2024-09-22T09:52:07.441069+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:11:21.153604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.238536+0000","last_change":"2024-09-22T09:54:29.238536+0000","last_active":"2024-09-22T09:54:29.238536+0000","last_peered":"2024-09-22T09:54:29.238536+0000","last_clean":"2024-09-22T09:54:29.238536+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:54:29.238536+0000","last_undegraded":"2024-09-22T09:54:29.238536+0000","last_fullsized":"2024-09-22T09:54:29.238536+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.238430+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:59.458064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.606824+0000","last_change":"2024-09-22T09:54:19.606824+0000","last_active":"2024-09-22T09:54:19.606824+0000","last_peered":"2024-09-22T09:54:19.606824+0000","last_clean":"2024-09-22T09:54:19.606824+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:54:19.606824+0000","last_undegraded":"2024-09-22T09:54:19.606824+0000","last_fullsized":"2024-09-22T09:54:19.606824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.606739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:03.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'200","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.372421+0000","last_change":"2024-09-22T09:54:19.372330+0000","last_active":"2024-09-22T09:54:19.372421+0000","last_peered":"2024-09-22T09:54:19.372421+0000","last_clean":"2024-09-22T09:54:19.372421+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:54:19.372421+0000","last_undegraded":"2024-09-22T09:54:19.372421+0000","last_fullsized":"2024-09-22T09:54:19.372421+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.372130+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:08.243681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485786,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":19334,"num_write":886,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.607748+0000","last_change":"2024-09-22T09:54:31.607748+0000","last_active":"2024-09-22T09:54:31.607748+0000","last_peered":"2024-09-22T09:54:31.607748+0000","last_clean":"2024-09-22T09:54:31.607748+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:54:31.607748+0000","last_undegraded":"2024-09-22T09:54:31.607748+0000","last_fullsized":"2024-09-22T09:54:31.607748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.607665+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:32.805386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'282","reported_seq":1698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:57.992925+0000","last_change":"2024-09-22T08:42:19.458357+0000","last_active":"2024-09-22T09:53:57.992925+0000","last_peered":"2024-09-22T09:53:57.992925+0000","last_clean":"2024-09-22T09:53:57.992925+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:53:57.992925+0000","last_undegraded":"2024-09-22T09:53:57.992925+0000","last_fullsized":"2024-09-22T09:53:57.992925+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:59.776254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.663363+0000","last_change":"2024-09-22T08:42:21.479092+0000","last_active":"2024-09-22T09:51:07.663363+0000","last_peered":"2024-09-22T09:51:07.663363+0000","last_clean":"2024-09-22T09:51:07.663363+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:51:07.663363+0000","last_undegraded":"2024-09-22T09:51:07.663363+0000","last_fullsized":"2024-09-22T09:51:07.663363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:20:10.715693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.001884+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:37.001884+0000","last_peered":"2024-09-22T09:52:37.001884+0000","last_clean":"2024-09-22T09:52:37.001884+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:37.001884+0000","last_undegraded":"2024-09-22T09:52:37.001884+0000","last_fullsized":"2024-09-22T09:52:37.001884+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.185684+0000","last_change":"2024-09-22T09:54:27.185684+0000","last_active":"2024-09-22T09:54:27.185684+0000","last_peered":"2024-09-22T09:54:27.185684+0000","last_clean":"2024-09-22T09:54:27.185684+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:54:27.185684+0000","last_undegraded":"2024-09-22T09:54:27.185684+0000","last_fullsized":"2024-09-22T09:54:27.185684+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.185594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:13:47.880015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.532865+0000","last_change":"2024-09-22T09:54:21.532865+0000","last_active":"2024-09-22T09:54:21.532865+0000","last_peered":"2024-09-22T09:54:21.532865+0000","last_clean":"2024-09-22T09:54:21.532865+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:54:21.532865+0000","last_undegraded":"2024-09-22T09:54:21.532865+0000","last_fullsized":"2024-09-22T09:54:21.532865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.532772+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:51.708829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'227","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.819318+0000","last_change":"2024-09-22T09:54:21.819318+0000","last_active":"2024-09-22T09:54:21.819318+0000","last_peered":"2024-09-22T09:54:21.819318+0000","last_clean":"2024-09-22T09:54:21.819318+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:54:21.819318+0000","last_undegraded":"2024-09-22T09:54:21.819318+0000","last_fullsized":"2024-09-22T09:54:21.819318+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.819178+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:16.182021+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":44921,"num_write":1103,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663982+0000","last_change":"2024-09-22T08:42:17.437159+0000","last_active":"2024-09-22T09:51:12.663982+0000","last_peered":"2024-09-22T09:51:12.663982+0000","last_clean":"2024-09-22T09:51:12.663982+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:51:12.663982+0000","last_undegraded":"2024-09-22T09:51:12.663982+0000","last_fullsized":"2024-09-22T09:51:12.663982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.902285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'158","reported_seq":718,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:52.565701+0000","last_change":"2024-09-22T08:42:19.456365+0000","last_active":"2024-09-22T09:53:52.565701+0000","last_peered":"2024-09-22T09:53:52.565701+0000","last_clean":"2024-09-22T09:53:52.565701+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:53:52.565701+0000","last_undegraded":"2024-09-22T09:53:52.565701+0000","last_fullsized":"2024-09-22T09:53:52.565701+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:24.107895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.681332+0000","last_change":"2024-09-22T08:42:21.479775+0000","last_active":"2024-09-22T09:51:42.681332+0000","last_peered":"2024-09-22T09:51:42.681332+0000","last_clean":"2024-09-22T09:51:42.681332+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:51:42.681332+0000","last_undegraded":"2024-09-22T09:51:42.681332+0000","last_fullsized":"2024-09-22T09:51:42.681332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:27.626455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'121","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.689264+0000","last_change":"2024-09-22T08:42:23.527151+0000","last_active":"2024-09-22T09:51:47.689264+0000","last_peered":"2024-09-22T09:51:47.689264+0000","last_clean":"2024-09-22T09:51:47.689264+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:51:47.689264+0000","last_undegraded":"2024-09-22T09:51:47.689264+0000","last_fullsized":"2024-09-22T09:51:47.689264+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:32:36.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.192606+0000","last_change":"2024-09-22T09:54:28.192606+0000","last_active":"2024-09-22T09:54:28.192606+0000","last_peered":"2024-09-22T09:54:28.192606+0000","last_clean":"2024-09-22T09:54:28.192606+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:54:28.192606+0000","last_undegraded":"2024-09-22T09:54:28.192606+0000","last_fullsized":"2024-09-22T09:54:28.192606+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'257","last_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_deep_scrub":"262'257","last_deep_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.192506+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:18.079606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'191","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.574375+0000","last_change":"2024-09-22T09:54:23.574375+0000","last_active":"2024-09-22T09:54:23.574375+0000","last_peered":"2024-09-22T09:54:23.574375+0000","last_clean":"2024-09-22T09:54:23.574375+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:54:23.574375+0000","last_undegraded":"2024-09-22T09:54:23.574375+0000","last_fullsized":"2024-09-22T09:54:23.574375+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.574287+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:41:15.794001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":36411,"num_write":937,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.371252+0000","last_change":"2024-09-22T09:54:20.371252+0000","last_active":"2024-09-22T09:54:20.371252+0000","last_peered":"2024-09-22T09:54:20.371252+0000","last_clean":"2024-09-22T09:54:20.371252+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:54:20.371252+0000","last_undegraded":"2024-09-22T09:54:20.371252+0000","last_fullsized":"2024-09-22T09:54:20.371252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:51.950137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662643+0000","last_change":"2024-09-22T08:42:17.436067+0000","last_active":"2024-09-22T09:51:02.662643+0000","last_peered":"2024-09-22T09:51:02.662643+0000","last_clean":"2024-09-22T09:51:02.662643+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:51:02.662643+0000","last_undegraded":"2024-09-22T09:51:02.662643+0000","last_fullsized":"2024-09-22T09:51:02.662643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:08.963170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'358","reported_seq":1046,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.137009+0000","last_change":"2024-09-22T08:42:19.456910+0000","last_active":"2024-09-22T09:54:14.137009+0000","last_peered":"2024-09-22T09:54:14.137009+0000","last_clean":"2024-09-22T09:54:14.137009+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:14.137009+0000","last_undegraded":"2024-09-22T09:54:14.137009+0000","last_fullsized":"2024-09-22T09:54:14.137009+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18381,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1194,"num_read_kb":1339,"num_write":1770,"num_write_kb":1581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557458+0000","last_change":"2024-09-22T08:42:21.481570+0000","last_active":"2024-09-22T09:51:07.557458+0000","last_peered":"2024-09-22T09:51:07.557458+0000","last_clean":"2024-09-22T09:51:07.557458+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:51:07.557458+0000","last_undegraded":"2024-09-22T09:51:07.557458+0000","last_fullsized":"2024-09-22T09:51:07.557458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:52.544367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'151","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.731303+0000","last_change":"2024-09-22T08:42:23.578322+0000","last_active":"2024-09-22T09:54:00.731303+0000","last_peered":"2024-09-22T09:54:00.731303+0000","last_clean":"2024-09-22T09:54:00.731303+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:54:00.731303+0000","last_undegraded":"2024-09-22T09:54:00.731303+0000","last_fullsized":"2024-09-22T09:54:00.731303+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.996833+0000","last_change":"2024-09-22T09:54:28.996833+0000","last_active":"2024-09-22T09:54:28.996833+0000","last_peered":"2024-09-22T09:54:28.996833+0000","last_clean":"2024-09-22T09:54:28.996833+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:54:28.996833+0000","last_undegraded":"2024-09-22T09:54:28.996833+0000","last_fullsized":"2024-09-22T09:54:28.996833+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.996744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:52.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'220","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.328955+0000","last_change":"2024-09-22T09:54:21.328955+0000","last_active":"2024-09-22T09:54:21.328955+0000","last_peered":"2024-09-22T09:54:21.328955+0000","last_clean":"2024-09-22T09:54:21.328955+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:54:21.328955+0000","last_undegraded":"2024-09-22T09:54:21.328955+0000","last_fullsized":"2024-09-22T09:54:21.328955+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.328852+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:00.573762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":1845,"num_write":1046,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.569365+0000","last_change":"2024-09-22T09:54:33.569365+0000","last_active":"2024-09-22T09:54:33.569365+0000","last_peered":"2024-09-22T09:54:33.569365+0000","last_clean":"2024-09-22T09:54:33.569365+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:54:33.569365+0000","last_undegraded":"2024-09-22T09:54:33.569365+0000","last_fullsized":"2024-09-22T09:54:33.569365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.569236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:24.238329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.916275+0000","last_change":"2024-09-22T09:54:33.916275+0000","last_active":"2024-09-22T09:54:33.916275+0000","last_peered":"2024-09-22T09:54:33.916275+0000","last_clean":"2024-09-22T09:54:33.916275+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:54:33.916275+0000","last_undegraded":"2024-09-22T09:54:33.916275+0000","last_fullsized":"2024-09-22T09:54:33.916275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.916178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:47.667923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'215","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.922563+0000","last_change":"2024-09-22T08:42:19.456840+0000","last_active":"2024-09-22T09:52:52.922563+0000","last_peered":"2024-09-22T09:52:52.922563+0000","last_clean":"2024-09-22T09:52:52.922563+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:52:52.922563+0000","last_undegraded":"2024-09-22T09:52:52.922563+0000","last_fullsized":"2024-09-22T09:52:52.922563+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:19.484900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'764","reported_seq":4645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.195596+0000","last_change":"2024-09-22T08:42:21.481370+0000","last_active":"2024-09-22T09:54:14.195596+0000","last_peered":"2024-09-22T09:54:14.195596+0000","last_clean":"2024-09-22T09:54:14.195596+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:14.195596+0000","last_undegraded":"2024-09-22T09:54:14.195596+0000","last_fullsized":"2024-09-22T09:54:14.195596+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":701,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":698,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:33.133370+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:52:33.133370+0000","last_peered":"2024-09-22T09:52:33.133370+0000","last_clean":"2024-09-22T09:52:33.133370+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:52:33.133370+0000","last_undegraded":"2024-09-22T09:52:33.133370+0000","last_fullsized":"2024-09-22T09:52:33.133370+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:08.457091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":796,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.673230+0000","last_change":"2024-09-22T08:42:15.435920+0000","last_active":"2024-09-22T09:52:27.673230+0000","last_peered":"2024-09-22T09:52:27.673230+0000","last_clean":"2024-09-22T09:52:27.673230+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:52:27.673230+0000","last_undegraded":"2024-09-22T09:52:27.673230+0000","last_fullsized":"2024-09-22T09:52:27.673230+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.930818+0000","last_change":"2024-09-22T09:54:26.930818+0000","last_active":"2024-09-22T09:54:26.930818+0000","last_peered":"2024-09-22T09:54:26.930818+0000","last_clean":"2024-09-22T09:54:26.930818+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:54:26.930818+0000","last_undegraded":"2024-09-22T09:54:26.930818+0000","last_fullsized":"2024-09-22T09:54:26.930818+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'170","last_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_deep_scrub":"262'170","last_deep_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.930623+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.742051+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.243823+0000","last_change":"2024-09-22T09:54:23.243823+0000","last_active":"2024-09-22T09:54:23.243823+0000","last_peered":"2024-09-22T09:54:23.243823+0000","last_clean":"2024-09-22T09:54:23.243823+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:54:23.243823+0000","last_undegraded":"2024-09-22T09:54:23.243823+0000","last_fullsized":"2024-09-22T09:54:23.243823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.243731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.724488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556800+0000","last_change":"2024-09-22T08:42:17.440772+0000","last_active":"2024-09-22T09:51:02.556800+0000","last_peered":"2024-09-22T09:51:02.556800+0000","last_clean":"2024-09-22T09:51:02.556800+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:51:02.556800+0000","last_undegraded":"2024-09-22T09:51:02.556800+0000","last_fullsized":"2024-09-22T09:51:02.556800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:54.715553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'134","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.892504+0000","last_change":"2024-09-22T08:42:19.457603+0000","last_active":"2024-09-22T09:52:52.892504+0000","last_peered":"2024-09-22T09:52:52.892504+0000","last_clean":"2024-09-22T09:52:52.892504+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:52:52.892504+0000","last_undegraded":"2024-09-22T09:52:52.892504+0000","last_fullsized":"2024-09-22T09:52:52.892504+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:47.850122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'755","reported_seq":2856,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.830968+0000","last_change":"2024-09-22T08:42:21.478082+0000","last_active":"2024-09-22T09:54:13.830968+0000","last_peered":"2024-09-22T09:54:13.830968+0000","last_clean":"2024-09-22T09:54:13.830968+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:13.830968+0000","last_undegraded":"2024-09-22T09:54:13.830968+0000","last_fullsized":"2024-09-22T09:54:13.830968+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:57.519253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'148","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.671609+0000","last_change":"2024-09-22T08:42:23.525171+0000","last_active":"2024-09-22T09:52:12.671609+0000","last_peered":"2024-09-22T09:52:12.671609+0000","last_clean":"2024-09-22T09:52:12.671609+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:52:12.671609+0000","last_undegraded":"2024-09-22T09:52:12.671609+0000","last_fullsized":"2024-09-22T09:52:12.671609+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.737112+0000","last_change":"2024-09-22T09:54:24.737112+0000","last_active":"2024-09-22T09:54:24.737112+0000","last_peered":"2024-09-22T09:54:24.737112+0000","last_clean":"2024-09-22T09:54:24.737112+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:54:24.737112+0000","last_undegraded":"2024-09-22T09:54:24.737112+0000","last_fullsized":"2024-09-22T09:54:24.737112+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.737027+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:50.396120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'190","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.103347+0000","last_change":"2024-09-22T09:54:19.103347+0000","last_active":"2024-09-22T09:54:19.103347+0000","last_peered":"2024-09-22T09:54:19.103347+0000","last_clean":"2024-09-22T09:54:19.103347+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:54:19.103347+0000","last_undegraded":"2024-09-22T09:54:19.103347+0000","last_fullsized":"2024-09-22T09:54:19.103347+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.103240+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:24.385903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":406,"num_write":850,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.761018+0000","last_change":"2024-09-22T09:54:23.761018+0000","last_active":"2024-09-22T09:54:23.761018+0000","last_peered":"2024-09-22T09:54:23.761018+0000","last_clean":"2024-09-22T09:54:23.761018+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:54:23.761018+0000","last_undegraded":"2024-09-22T09:54:23.761018+0000","last_fullsized":"2024-09-22T09:54:23.761018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.760940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:58.487042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.673207+0000","last_change":"2024-09-22T08:42:17.440887+0000","last_active":"2024-09-22T09:52:27.673207+0000","last_peered":"2024-09-22T09:52:27.673207+0000","last_clean":"2024-09-22T09:52:27.673207+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:52:27.673207+0000","last_undegraded":"2024-09-22T09:52:27.673207+0000","last_fullsized":"2024-09-22T09:52:27.673207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'357","reported_seq":1092,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.190538+0000","last_change":"2024-09-22T08:42:19.455440+0000","last_active":"2024-09-22T09:54:14.190538+0000","last_peered":"2024-09-22T09:54:14.190538+0000","last_clean":"2024-09-22T09:54:14.190538+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:14.190538+0000","last_undegraded":"2024-09-22T09:54:14.190538+0000","last_fullsized":"2024-09-22T09:54:14.190538+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:31.127669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23842,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":535,"num_read_kb":775,"num_write":284,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":493,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662903+0000","last_change":"2024-09-22T08:42:21.481354+0000","last_active":"2024-09-22T09:51:07.662903+0000","last_peered":"2024-09-22T09:51:07.662903+0000","last_clean":"2024-09-22T09:51:07.662903+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:51:07.662903+0000","last_undegraded":"2024-09-22T09:51:07.662903+0000","last_fullsized":"2024-09-22T09:51:07.662903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:55.654023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'92","reported_seq":591,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.692664+0000","last_change":"2024-09-22T08:42:23.528079+0000","last_active":"2024-09-22T09:52:12.692664+0000","last_peered":"2024-09-22T09:52:12.692664+0000","last_clean":"2024-09-22T09:52:12.692664+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:52:12.692664+0000","last_undegraded":"2024-09-22T09:52:12.692664+0000","last_fullsized":"2024-09-22T09:52:12.692664+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.695358+0000","last_change":"2024-09-22T09:54:29.695304+0000","last_active":"2024-09-22T09:54:29.695358+0000","last_peered":"2024-09-22T09:54:29.695358+0000","last_clean":"2024-09-22T09:54:29.695358+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:54:29.695358+0000","last_undegraded":"2024-09-22T09:54:29.695358+0000","last_fullsized":"2024-09-22T09:54:29.695358+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.695223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:41.769762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'197","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.797488+0000","last_change":"2024-09-22T09:54:20.797488+0000","last_active":"2024-09-22T09:54:20.797488+0000","last_peered":"2024-09-22T09:54:20.797488+0000","last_clean":"2024-09-22T09:54:20.797488+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:54:20.797488+0000","last_undegraded":"2024-09-22T09:54:20.797488+0000","last_fullsized":"2024-09-22T09:54:20.797488+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.797355+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:31.306053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":56883,"num_write":855,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.214275+0000","last_change":"2024-09-22T09:54:35.214218+0000","last_active":"2024-09-22T09:54:35.214275+0000","last_peered":"2024-09-22T09:54:35.214275+0000","last_clean":"2024-09-22T09:54:35.214275+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:54:35.214275+0000","last_undegraded":"2024-09-22T09:54:35.214275+0000","last_fullsized":"2024-09-22T09:54:35.214275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.214127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:27.814976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'171","reported_seq":757,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.054853+0000","last_change":"2024-09-22T08:42:19.459166+0000","last_active":"2024-09-22T09:54:14.054853+0000","last_peered":"2024-09-22T09:54:14.054853+0000","last_clean":"2024-09-22T09:54:14.054853+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:54:14.054853+0000","last_undegraded":"2024-09-22T09:54:14.054853+0000","last_fullsized":"2024-09-22T09:54:14.054853+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:35:04.933821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":323,"num_write":134,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654407+0000","last_change":"2024-09-22T08:42:21.480559+0000","last_active":"2024-09-22T09:50:02.654407+0000","last_peered":"2024-09-22T09:50:02.654407+0000","last_clean":"2024-09-22T09:50:02.654407+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:50:02.654407+0000","last_undegraded":"2024-09-22T09:50:02.654407+0000","last_fullsized":"2024-09-22T09:50:02.654407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:17:57.860472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":649,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:00.060711+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:51:00.060711+0000","last_peered":"2024-09-22T09:51:00.060711+0000","last_clean":"2024-09-22T09:51:00.060711+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:51:00.060711+0000","last_undegraded":"2024-09-22T09:51:00.060711+0000","last_fullsized":"2024-09-22T09:51:00.060711+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:00.026997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.256299+0000","last_change":"2024-09-22T09:54:30.256211+0000","last_active":"2024-09-22T09:54:30.256299+0000","last_peered":"2024-09-22T09:54:30.256299+0000","last_clean":"2024-09-22T09:54:30.256299+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:54:30.256299+0000","last_undegraded":"2024-09-22T09:54:30.256299+0000","last_fullsized":"2024-09-22T09:54:30.256299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.256110+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:21.124251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'226","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.531189+0000","last_change":"2024-09-22T09:54:29.531189+0000","last_active":"2024-09-22T09:54:29.531189+0000","last_peered":"2024-09-22T09:54:29.531189+0000","last_clean":"2024-09-22T09:54:29.531189+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:54:29.531189+0000","last_undegraded":"2024-09-22T09:54:29.531189+0000","last_fullsized":"2024-09-22T09:54:29.531189+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.531048+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:58.938306+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":50629,"num_write":1055,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:17.671871+0000","last_change":"2024-09-22T08:42:17.440629+0000","last_active":"2024-09-22T09:52:17.671871+0000","last_peered":"2024-09-22T09:52:17.671871+0000","last_clean":"2024-09-22T09:52:17.671871+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:52:17.671871+0000","last_undegraded":"2024-09-22T09:52:17.671871+0000","last_fullsized":"2024-09-22T09:52:17.671871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'53","reported_seq":565,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.547272+0000","last_change":"2024-09-22T08:42:19.456534+0000","last_active":"2024-09-22T09:52:52.547272+0000","last_peered":"2024-09-22T09:52:52.547272+0000","last_clean":"2024-09-22T09:52:52.547272+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:52:52.547272+0000","last_undegraded":"2024-09-22T09:52:52.547272+0000","last_fullsized":"2024-09-22T09:52:52.547272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:45.983322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.515570+0000","last_change":"2024-09-22T08:42:21.476849+0000","last_active":"2024-09-22T09:50:02.515570+0000","last_peered":"2024-09-22T09:50:02.515570+0000","last_clean":"2024-09-22T09:50:02.515570+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:50:02.515570+0000","last_undegraded":"2024-09-22T09:50:02.515570+0000","last_fullsized":"2024-09-22T09:50:02.515570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:43.656268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'188","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.634796+0000","last_change":"2024-09-22T08:42:23.526388+0000","last_active":"2024-09-22T09:52:35.634796+0000","last_peered":"2024-09-22T09:52:35.634796+0000","last_clean":"2024-09-22T09:52:35.634796+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:52:35.634796+0000","last_undegraded":"2024-09-22T09:52:35.634796+0000","last_fullsized":"2024-09-22T09:52:35.634796+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:29.029640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.804620+0000","last_change":"2024-09-22T09:54:30.804559+0000","last_active":"2024-09-22T09:54:30.804620+0000","last_peered":"2024-09-22T09:54:30.804620+0000","last_clean":"2024-09-22T09:54:30.804620+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:54:30.804620+0000","last_undegraded":"2024-09-22T09:54:30.804620+0000","last_fullsized":"2024-09-22T09:54:30.804620+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.804467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:02.621427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'206","reported_seq":853,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.611605+0000","last_change":"2024-09-22T09:54:24.611605+0000","last_active":"2024-09-22T09:54:24.611605+0000","last_peered":"2024-09-22T09:54:24.611605+0000","last_clean":"2024-09-22T09:54:24.611605+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:54:24.611605+0000","last_undegraded":"2024-09-22T09:54:24.611605+0000","last_fullsized":"2024-09-22T09:54:24.611605+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.611501+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:30.061595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":559,"num_read_kb":27137,"num_write":994,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:17.536738+0000","last_change":"2024-09-22T08:42:17.430472+0000","last_active":"2024-09-22T09:52:17.536738+0000","last_peered":"2024-09-22T09:52:17.536738+0000","last_clean":"2024-09-22T09:52:17.536738+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:52:17.536738+0000","last_undegraded":"2024-09-22T09:52:17.536738+0000","last_fullsized":"2024-09-22T09:52:17.536738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'197","reported_seq":799,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.942912+0000","last_change":"2024-09-22T08:42:19.459846+0000","last_active":"2024-09-22T09:54:13.942912+0000","last_peered":"2024-09-22T09:54:13.942912+0000","last_clean":"2024-09-22T09:54:13.942912+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:54:13.942912+0000","last_undegraded":"2024-09-22T09:54:13.942912+0000","last_fullsized":"2024-09-22T09:54:13.942912+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:22:37.691592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":325,"num_write":146,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.667537+0000","last_change":"2024-09-22T08:42:21.479495+0000","last_active":"2024-09-22T09:50:02.667537+0000","last_peered":"2024-09-22T09:50:02.667537+0000","last_clean":"2024-09-22T09:50:02.667537+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:50:02.667537+0000","last_undegraded":"2024-09-22T09:50:02.667537+0000","last_fullsized":"2024-09-22T09:50:02.667537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:56.016803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'184","reported_seq":752,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.144194+0000","last_change":"2024-09-22T08:42:23.527658+0000","last_active":"2024-09-22T09:50:22.144194+0000","last_peered":"2024-09-22T09:50:22.144194+0000","last_clean":"2024-09-22T09:50:22.144194+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:50:22.144194+0000","last_undegraded":"2024-09-22T09:50:22.144194+0000","last_fullsized":"2024-09-22T09:50:22.144194+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:34.867859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'174","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.801443+0000","last_change":"2024-09-22T09:54:36.801369+0000","last_active":"2024-09-22T09:54:36.801443+0000","last_peered":"2024-09-22T09:54:36.801443+0000","last_clean":"2024-09-22T09:54:36.801443+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:54:36.801443+0000","last_undegraded":"2024-09-22T09:54:36.801443+0000","last_fullsized":"2024-09-22T09:54:36.801443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.801284+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:30.780204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'205","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.092900+0000","last_change":"2024-09-22T09:54:23.092900+0000","last_active":"2024-09-22T09:54:23.092900+0000","last_peered":"2024-09-22T09:54:23.092900+0000","last_clean":"2024-09-22T09:54:23.092900+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:54:23.092900+0000","last_undegraded":"2024-09-22T09:54:23.092900+0000","last_fullsized":"2024-09-22T09:54:23.092900+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.092809+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:04.164807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":41854,"num_write":1021,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.914168+0000","last_change":"2024-09-22T09:54:35.914104+0000","last_active":"2024-09-22T09:54:35.914168+0000","last_peered":"2024-09-22T09:54:35.914168+0000","last_clean":"2024-09-22T09:54:35.914168+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:54:35.914168+0000","last_undegraded":"2024-09-22T09:54:35.914168+0000","last_fullsized":"2024-09-22T09:54:35.914168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.914016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:45.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'148","reported_seq":725,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.922802+0000","last_change":"2024-09-22T08:42:19.453111+0000","last_active":"2024-09-22T09:54:13.922802+0000","last_peered":"2024-09-22T09:54:13.922802+0000","last_clean":"2024-09-22T09:54:13.922802+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:54:13.922802+0000","last_undegraded":"2024-09-22T09:54:13.922802+0000","last_fullsized":"2024-09-22T09:54:13.922802+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:24.508041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":223,"num_write":104,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654861+0000","last_change":"2024-09-22T08:42:21.475223+0000","last_active":"2024-09-22T09:50:02.654861+0000","last_peered":"2024-09-22T09:50:02.654861+0000","last_clean":"2024-09-22T09:50:02.654861+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:50:02.654861+0000","last_undegraded":"2024-09-22T09:50:02.654861+0000","last_fullsized":"2024-09-22T09:50:02.654861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:12:09.164154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.919258+0000","last_change":"2024-09-22T09:54:31.919258+0000","last_active":"2024-09-22T09:54:31.919258+0000","last_peered":"2024-09-22T09:54:31.919258+0000","last_clean":"2024-09-22T09:54:31.919258+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:54:31.919258+0000","last_undegraded":"2024-09-22T09:54:31.919258+0000","last_fullsized":"2024-09-22T09:54:31.919258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'88","last_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_deep_scrub":"262'88","last_deep_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.919161+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:25.614663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'205","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.829750+0000","last_change":"2024-09-22T09:54:23.829750+0000","last_active":"2024-09-22T09:54:23.829750+0000","last_peered":"2024-09-22T09:54:23.829750+0000","last_clean":"2024-09-22T09:54:23.829750+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:54:23.829750+0000","last_undegraded":"2024-09-22T09:54:23.829750+0000","last_fullsized":"2024-09-22T09:54:23.829750+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.829600+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:05.399205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":584,"num_read_kb":68522,"num_write":916,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.673660+0000","last_change":"2024-09-22T08:42:17.438090+0000","last_active":"2024-09-22T09:52:27.673660+0000","last_peered":"2024-09-22T09:52:27.673660+0000","last_clean":"2024-09-22T09:52:27.673660+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:52:27.673660+0000","last_undegraded":"2024-09-22T09:52:27.673660+0000","last_fullsized":"2024-09-22T09:52:27.673660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'235","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.120201+0000","last_change":"2024-09-22T08:42:19.455805+0000","last_active":"2024-09-22T09:54:14.120201+0000","last_peered":"2024-09-22T09:54:14.120201+0000","last_clean":"2024-09-22T09:54:14.120201+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:14.120201+0000","last_undegraded":"2024-09-22T09:54:14.120201+0000","last_fullsized":"2024-09-22T09:54:14.120201+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:30:46.845015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22939,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":353,"num_read_kb":545,"num_write":228,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.672389+0000","last_change":"2024-09-22T08:42:21.482536+0000","last_active":"2024-09-22T09:49:52.672389+0000","last_peered":"2024-09-22T09:49:52.672389+0000","last_clean":"2024-09-22T09:49:52.672389+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:49:52.672389+0000","last_undegraded":"2024-09-22T09:49:52.672389+0000","last_fullsized":"2024-09-22T09:49:52.672389+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:08:16.490768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:15.317977+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:50:15.317977+0000","last_peered":"2024-09-22T09:50:15.317977+0000","last_clean":"2024-09-22T09:50:15.317977+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:50:15.317977+0000","last_undegraded":"2024-09-22T09:50:15.317977+0000","last_fullsized":"2024-09-22T09:50:15.317977+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:39:49.491628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.022554+0000","last_change":"2024-09-22T09:54:33.022554+0000","last_active":"2024-09-22T09:54:33.022554+0000","last_peered":"2024-09-22T09:54:33.022554+0000","last_clean":"2024-09-22T09:54:33.022554+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:54:33.022554+0000","last_undegraded":"2024-09-22T09:54:33.022554+0000","last_fullsized":"2024-09-22T09:54:33.022554+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.022460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:44.487313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'225","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.283055+0000","last_change":"2024-09-22T09:54:22.283055+0000","last_active":"2024-09-22T09:54:22.283055+0000","last_peered":"2024-09-22T09:54:22.283055+0000","last_clean":"2024-09-22T09:54:22.283055+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:54:22.283055+0000","last_undegraded":"2024-09-22T09:54:22.283055+0000","last_fullsized":"2024-09-22T09:54:22.283055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'225","last_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_deep_scrub":"262'225","last_deep_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.282952+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:16:25.985099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5108,"num_write":1161,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.898739+0000","last_change":"2024-09-22T09:54:36.898739+0000","last_active":"2024-09-22T09:54:36.898739+0000","last_peered":"2024-09-22T09:54:36.898739+0000","last_clean":"2024-09-22T09:54:36.898739+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:54:36.898739+0000","last_undegraded":"2024-09-22T09:54:36.898739+0000","last_fullsized":"2024-09-22T09:54:36.898739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.898653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:53.057131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'206","reported_seq":805,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.930200+0000","last_change":"2024-09-22T08:42:19.454425+0000","last_active":"2024-09-22T09:54:13.930200+0000","last_peered":"2024-09-22T09:54:13.930200+0000","last_clean":"2024-09-22T09:54:13.930200+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:54:13.930200+0000","last_undegraded":"2024-09-22T09:54:13.930200+0000","last_fullsized":"2024-09-22T09:54:13.930200+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:32.598763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":279,"num_read_kb":343,"num_write":184,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.426248+0000","last_change":"2024-09-22T08:42:21.476913+0000","last_active":"2024-09-22T09:49:52.426248+0000","last_peered":"2024-09-22T09:49:52.426248+0000","last_clean":"2024-09-22T09:49:52.426248+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:49:52.426248+0000","last_undegraded":"2024-09-22T09:49:52.426248+0000","last_fullsized":"2024-09-22T09:49:52.426248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:43.637608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'167","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:35.287498+0000","last_change":"2024-09-22T08:42:23.524343+0000","last_active":"2024-09-22T09:52:35.287498+0000","last_peered":"2024-09-22T09:52:35.287498+0000","last_clean":"2024-09-22T09:52:35.287498+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:52:35.287498+0000","last_undegraded":"2024-09-22T09:52:35.287498+0000","last_fullsized":"2024-09-22T09:52:35.287498+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:59.405036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.652648+0000","last_change":"2024-09-22T08:42:15.441307+0000","last_active":"2024-09-22T09:49:47.652648+0000","last_peered":"2024-09-22T09:49:47.652648+0000","last_clean":"2024-09-22T09:49:47.652648+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:49:47.652648+0000","last_undegraded":"2024-09-22T09:49:47.652648+0000","last_fullsized":"2024-09-22T09:49:47.652648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:11:01.398679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'192","reported_seq":925,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.801488+0000","last_change":"2024-09-22T09:54:22.801488+0000","last_active":"2024-09-22T09:54:22.801488+0000","last_peered":"2024-09-22T09:54:22.801488+0000","last_clean":"2024-09-22T09:54:22.801488+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:54:22.801488+0000","last_undegraded":"2024-09-22T09:54:22.801488+0000","last_fullsized":"2024-09-22T09:54:22.801488+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'192","last_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_deep_scrub":"262'192","last_deep_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.801355+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:29.354984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1210,"num_read_kb":5814,"num_write":981,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.545954+0000","last_change":"2024-09-22T08:42:17.435464+0000","last_active":"2024-09-22T09:49:47.545954+0000","last_peered":"2024-09-22T09:49:47.545954+0000","last_clean":"2024-09-22T09:49:47.545954+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:49:47.545954+0000","last_undegraded":"2024-09-22T09:49:47.545954+0000","last_fullsized":"2024-09-22T09:49:47.545954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:47:38.411752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'160","reported_seq":750,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.097288+0000","last_change":"2024-09-22T08:42:19.458421+0000","last_active":"2024-09-22T09:54:14.097288+0000","last_peered":"2024-09-22T09:54:14.097288+0000","last_clean":"2024-09-22T09:54:14.097288+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:54:14.097288+0000","last_undegraded":"2024-09-22T09:54:14.097288+0000","last_fullsized":"2024-09-22T09:54:14.097288+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:17.997133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":298,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.431784+0000","last_change":"2024-09-22T08:42:21.482356+0000","last_active":"2024-09-22T09:50:42.431784+0000","last_peered":"2024-09-22T09:50:42.431784+0000","last_clean":"2024-09-22T09:50:42.431784+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:50:42.431784+0000","last_undegraded":"2024-09-22T09:50:42.431784+0000","last_fullsized":"2024-09-22T09:50:42.431784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:32.679904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'112","reported_seq":606,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.729613+0000","last_change":"2024-09-22T08:42:23.524273+0000","last_active":"2024-09-22T09:54:00.729613+0000","last_peered":"2024-09-22T09:54:00.729613+0000","last_clean":"2024-09-22T09:54:00.729613+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:00.729613+0000","last_undegraded":"2024-09-22T09:54:00.729613+0000","last_fullsized":"2024-09-22T09:54:00.729613+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:36:17.604133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":875,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.691931+0000","last_change":"2024-09-22T09:54:25.691931+0000","last_active":"2024-09-22T09:54:25.691931+0000","last_peered":"2024-09-22T09:54:25.691931+0000","last_clean":"2024-09-22T09:54:25.691931+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:54:25.691931+0000","last_undegraded":"2024-09-22T09:54:25.691931+0000","last_fullsized":"2024-09-22T09:54:25.691931+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.691841+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.638310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'240","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.101130+0000","last_change":"2024-09-22T09:54:22.101130+0000","last_active":"2024-09-22T09:54:22.101130+0000","last_peered":"2024-09-22T09:54:22.101130+0000","last_clean":"2024-09-22T09:54:22.101130+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:54:22.101130+0000","last_undegraded":"2024-09-22T09:54:22.101130+0000","last_fullsized":"2024-09-22T09:54:22.101130+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.101055+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:06.230927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":123234,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":495,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.425590+0000","last_change":"2024-09-22T08:42:17.435752+0000","last_active":"2024-09-22T09:49:47.425590+0000","last_peered":"2024-09-22T09:49:47.425590+0000","last_clean":"2024-09-22T09:49:47.425590+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:49:47.425590+0000","last_undegraded":"2024-09-22T09:49:47.425590+0000","last_fullsized":"2024-09-22T09:49:47.425590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:10.922721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'121","reported_seq":663,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.917079+0000","last_change":"2024-09-22T08:42:19.453093+0000","last_active":"2024-09-22T09:52:52.917079+0000","last_peered":"2024-09-22T09:52:52.917079+0000","last_clean":"2024-09-22T09:52:52.917079+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:52:52.917079+0000","last_undegraded":"2024-09-22T09:52:52.917079+0000","last_fullsized":"2024-09-22T09:52:52.917079+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'759","reported_seq":4731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.823952+0000","last_change":"2024-09-22T08:42:21.480171+0000","last_active":"2024-09-22T09:54:13.823952+0000","last_peered":"2024-09-22T09:54:13.823952+0000","last_clean":"2024-09-22T09:54:13.823952+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:13.823952+0000","last_undegraded":"2024-09-22T09:54:13.823952+0000","last_fullsized":"2024-09-22T09:54:13.823952+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:05.223141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'146","reported_seq":642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.660200+0000","last_change":"2024-09-22T08:42:23.528243+0000","last_active":"2024-09-22T09:52:36.660200+0000","last_peered":"2024-09-22T09:52:36.660200+0000","last_clean":"2024-09-22T09:52:36.660200+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:52:36.660200+0000","last_undegraded":"2024-09-22T09:52:36.660200+0000","last_fullsized":"2024-09-22T09:52:36.660200+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:46.020648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.678447+0000","last_change":"2024-09-22T09:54:32.678447+0000","last_active":"2024-09-22T09:54:32.678447+0000","last_peered":"2024-09-22T09:54:32.678447+0000","last_clean":"2024-09-22T09:54:32.678447+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:54:32.678447+0000","last_undegraded":"2024-09-22T09:54:32.678447+0000","last_fullsized":"2024-09-22T09:54:32.678447+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.678357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:18.763576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'293","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.668274+0000","last_change":"2024-09-22T09:54:22.668274+0000","last_active":"2024-09-22T09:54:22.668274+0000","last_peered":"2024-09-22T09:54:22.668274+0000","last_clean":"2024-09-22T09:54:22.668274+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:54:22.668274+0000","last_undegraded":"2024-09-22T09:54:22.668274+0000","last_fullsized":"2024-09-22T09:54:22.668274+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'293","last_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_deep_scrub":"262'293","last_deep_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.668200+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:57.525651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1304,"num_read_kb":50200,"num_write":1267,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"36'3","reported_seq":973,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.392394+0000","last_change":"2024-09-22T08:42:17.430502+0000","last_active":"2024-09-22T09:54:13.392394+0000","last_peered":"2024-09-22T09:54:13.392394+0000","last_clean":"2024-09-22T09:54:13.392394+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:13.392394+0000","last_undegraded":"2024-09-22T09:54:13.392394+0000","last_fullsized":"2024-09-22T09:54:13.392394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:02.208302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'214","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.147141+0000","last_change":"2024-09-22T08:42:19.455535+0000","last_active":"2024-09-22T09:54:14.147141+0000","last_peered":"2024-09-22T09:54:14.147141+0000","last_clean":"2024-09-22T09:54:14.147141+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:54:14.147141+0000","last_undegraded":"2024-09-22T09:54:14.147141+0000","last_fullsized":"2024-09-22T09:54:14.147141+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:56:46.902494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6055,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":273,"num_read_kb":326,"num_write":162,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:02.654816+0000","last_change":"2024-09-22T08:42:21.476713+0000","last_active":"2024-09-22T09:50:02.654816+0000","last_peered":"2024-09-22T09:50:02.654816+0000","last_clean":"2024-09-22T09:50:02.654816+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:50:02.654816+0000","last_undegraded":"2024-09-22T09:50:02.654816+0000","last_fullsized":"2024-09-22T09:50:02.654816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:07.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'140","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.539387+0000","last_change":"2024-09-22T08:42:23.517176+0000","last_active":"2024-09-22T09:52:32.539387+0000","last_peered":"2024-09-22T09:52:32.539387+0000","last_clean":"2024-09-22T09:52:32.539387+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:52:32.539387+0000","last_undegraded":"2024-09-22T09:52:32.539387+0000","last_fullsized":"2024-09-22T09:52:32.539387+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:54:01.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.725674+0000","last_change":"2024-09-22T09:54:31.725674+0000","last_active":"2024-09-22T09:54:31.725674+0000","last_peered":"2024-09-22T09:54:31.725674+0000","last_clean":"2024-09-22T09:54:31.725674+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:54:31.725674+0000","last_undegraded":"2024-09-22T09:54:31.725674+0000","last_fullsized":"2024-09-22T09:54:31.725674+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.725590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:46.484791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'213","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.635302+0000","last_change":"2024-09-22T09:54:23.635302+0000","last_active":"2024-09-22T09:54:23.635302+0000","last_peered":"2024-09-22T09:54:23.635302+0000","last_clean":"2024-09-22T09:54:23.635302+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:54:23.635302+0000","last_undegraded":"2024-09-22T09:54:23.635302+0000","last_fullsized":"2024-09-22T09:54:23.635302+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.635178+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:34.216176+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26654,"num_write":910,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:47.671704+0000","last_change":"2024-09-22T08:42:17.434837+0000","last_active":"2024-09-22T09:49:47.671704+0000","last_peered":"2024-09-22T09:49:47.671704+0000","last_clean":"2024-09-22T09:49:47.671704+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:49:47.671704+0000","last_undegraded":"2024-09-22T09:49:47.671704+0000","last_fullsized":"2024-09-22T09:49:47.671704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:13:44.721168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'144","reported_seq":724,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.162790+0000","last_change":"2024-09-22T08:42:19.455628+0000","last_active":"2024-09-22T09:54:14.162790+0000","last_peered":"2024-09-22T09:54:14.162790+0000","last_clean":"2024-09-22T09:54:14.162790+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:54:14.162790+0000","last_undegraded":"2024-09-22T09:54:14.162790+0000","last_fullsized":"2024-09-22T09:54:14.162790+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:24:09.361619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6811,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":273,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:07.668079+0000","last_change":"2024-09-22T08:42:21.476902+0000","last_active":"2024-09-22T09:50:07.668079+0000","last_peered":"2024-09-22T09:50:07.668079+0000","last_clean":"2024-09-22T09:50:07.668079+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:50:07.668079+0000","last_undegraded":"2024-09-22T09:50:07.668079+0000","last_fullsized":"2024-09-22T09:50:07.668079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:09:29.159677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:35.376679+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:51:35.376679+0000","last_peered":"2024-09-22T09:51:35.376679+0000","last_clean":"2024-09-22T09:51:35.376679+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:51:35.376679+0000","last_undegraded":"2024-09-22T09:51:35.376679+0000","last_fullsized":"2024-09-22T09:51:35.376679+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:41:11.855073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.772041+0000","last_change":"2024-09-22T09:54:35.772041+0000","last_active":"2024-09-22T09:54:35.772041+0000","last_peered":"2024-09-22T09:54:35.772041+0000","last_clean":"2024-09-22T09:54:35.772041+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:54:35.772041+0000","last_undegraded":"2024-09-22T09:54:35.772041+0000","last_fullsized":"2024-09-22T09:54:35.772041+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.771951+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:46.651125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'277","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.864381+0000","last_change":"2024-09-22T09:54:24.864311+0000","last_active":"2024-09-22T09:54:24.864381+0000","last_peered":"2024-09-22T09:54:24.864381+0000","last_clean":"2024-09-22T09:54:24.864381+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:54:24.864381+0000","last_undegraded":"2024-09-22T09:54:24.864381+0000","last_fullsized":"2024-09-22T09:54:24.864381+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.864187+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:28.585786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":745,"num_read_kb":35485,"num_write":1188,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:57.547433+0000","last_change":"2024-09-22T08:42:17.428752+0000","last_active":"2024-09-22T09:49:57.547433+0000","last_peered":"2024-09-22T09:49:57.547433+0000","last_clean":"2024-09-22T09:49:57.547433+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:49:57.547433+0000","last_undegraded":"2024-09-22T09:49:57.547433+0000","last_fullsized":"2024-09-22T09:49:57.547433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:16.401601+0000","last_clean_scrub_stamp":"2024-09-22T08:42:16.401601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:24.944481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'115","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.077934+0000","last_change":"2024-09-22T08:42:19.453726+0000","last_active":"2024-09-22T09:54:14.077934+0000","last_peered":"2024-09-22T09:54:14.077934+0000","last_clean":"2024-09-22T09:54:14.077934+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:54:14.077934+0000","last_undegraded":"2024-09-22T09:54:14.077934+0000","last_fullsized":"2024-09-22T09:54:14.077934+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:38:05.029554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":258,"num_write":80,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.546807+0000","last_change":"2024-09-22T08:42:21.478595+0000","last_active":"2024-09-22T09:49:52.546807+0000","last_peered":"2024-09-22T09:49:52.546807+0000","last_clean":"2024-09-22T09:49:52.546807+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:49:52.546807+0000","last_undegraded":"2024-09-22T09:49:52.546807+0000","last_fullsized":"2024-09-22T09:49:52.546807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:19.682078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'159","reported_seq":1627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.954159+0000","last_change":"2024-09-22T08:42:23.526111+0000","last_active":"2024-09-22T09:52:32.954159+0000","last_peered":"2024-09-22T09:52:32.954159+0000","last_clean":"2024-09-22T09:52:32.954159+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:52:32.954159+0000","last_undegraded":"2024-09-22T09:52:32.954159+0000","last_fullsized":"2024-09-22T09:52:32.954159+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:23.624323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5265,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.687043+0000","last_change":"2024-09-22T09:54:30.687043+0000","last_active":"2024-09-22T09:54:30.687043+0000","last_peered":"2024-09-22T09:54:30.687043+0000","last_clean":"2024-09-22T09:54:30.687043+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:54:30.687043+0000","last_undegraded":"2024-09-22T09:54:30.687043+0000","last_fullsized":"2024-09-22T09:54:30.687043+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4461","last_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_deep_scrub":"262'4461","last_deep_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.686961+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:59.557234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'237","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.054638+0000","last_change":"2024-09-22T09:54:24.054638+0000","last_active":"2024-09-22T09:54:24.054638+0000","last_peered":"2024-09-22T09:54:24.054638+0000","last_clean":"2024-09-22T09:54:24.054638+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:54:24.054638+0000","last_undegraded":"2024-09-22T09:54:24.054638+0000","last_fullsized":"2024-09-22T09:54:24.054638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.054495+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:26:50.248679+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":602,"num_read_kb":45002,"num_write":1097,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.198471+0000","last_change":"2024-09-22T09:54:37.198471+0000","last_active":"2024-09-22T09:54:37.198471+0000","last_peered":"2024-09-22T09:54:37.198471+0000","last_clean":"2024-09-22T09:54:37.198471+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:54:37.198471+0000","last_undegraded":"2024-09-22T09:54:37.198471+0000","last_fullsized":"2024-09-22T09:54:37.198471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.198370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:57.482827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'218","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.110815+0000","last_change":"2024-09-22T08:42:19.454027+0000","last_active":"2024-09-22T09:54:14.110815+0000","last_peered":"2024-09-22T09:54:14.110815+0000","last_clean":"2024-09-22T09:54:14.110815+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:54:14.110815+0000","last_undegraded":"2024-09-22T09:54:14.110815+0000","last_fullsized":"2024-09-22T09:54:14.110815+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:18.429700+0000","last_clean_scrub_stamp":"2024-09-22T08:42:18.429700+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:04:10.523969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":792,"num_write":216,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:49:52.653425+0000","last_change":"2024-09-22T08:42:21.477428+0000","last_active":"2024-09-22T09:49:52.653425+0000","last_peered":"2024-09-22T09:49:52.653425+0000","last_clean":"2024-09-22T09:49:52.653425+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:49:52.653425+0000","last_undegraded":"2024-09-22T09:49:52.653425+0000","last_fullsized":"2024-09-22T09:49:52.653425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:24.672129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'126","reported_seq":633,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:59.396183+0000","last_change":"2024-09-22T08:42:23.527124+0000","last_active":"2024-09-22T09:53:59.396183+0000","last_peered":"2024-09-22T09:53:59.396183+0000","last_clean":"2024-09-22T09:53:59.396183+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:53:59.396183+0000","last_undegraded":"2024-09-22T09:53:59.396183+0000","last_fullsized":"2024-09-22T09:53:59.396183+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:33:53.459446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.181260+0000","last_change":"2024-09-22T09:54:34.181260+0000","last_active":"2024-09-22T09:54:34.181260+0000","last_peered":"2024-09-22T09:54:34.181260+0000","last_clean":"2024-09-22T09:54:34.181260+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:54:34.181260+0000","last_undegraded":"2024-09-22T09:54:34.181260+0000","last_fullsized":"2024-09-22T09:54:34.181260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'179","last_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_deep_scrub":"262'179","last_deep_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.181177+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:28.301187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'198","reported_seq":859,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.782744+0000","last_change":"2024-09-22T09:54:24.782744+0000","last_active":"2024-09-22T09:54:24.782744+0000","last_peered":"2024-09-22T09:54:24.782744+0000","last_clean":"2024-09-22T09:54:24.782744+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:54:24.782744+0000","last_undegraded":"2024-09-22T09:54:24.782744+0000","last_fullsized":"2024-09-22T09:54:24.782744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.782631+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:03:28.457706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":68297,"num_write":940,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":977,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.209160+0000","last_change":"2024-09-22T09:54:32.209160+0000","last_active":"2024-09-22T09:54:32.209160+0000","last_peered":"2024-09-22T09:54:32.209160+0000","last_clean":"2024-09-22T09:54:32.209160+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:54:32.209160+0000","last_undegraded":"2024-09-22T09:54:32.209160+0000","last_fullsized":"2024-09-22T09:54:32.209160+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.209076+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.157428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'194","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.679547+0000","last_change":"2024-09-22T09:54:24.679547+0000","last_active":"2024-09-22T09:54:24.679547+0000","last_peered":"2024-09-22T09:54:24.679547+0000","last_clean":"2024-09-22T09:54:24.679547+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:54:24.679547+0000","last_undegraded":"2024-09-22T09:54:24.679547+0000","last_fullsized":"2024-09-22T09:54:24.679547+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.679384+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:52.319029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":8670,"num_write":934,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.382536+0000","last_change":"2024-09-22T09:54:35.382536+0000","last_active":"2024-09-22T09:54:35.382536+0000","last_peered":"2024-09-22T09:54:35.382536+0000","last_clean":"2024-09-22T09:54:35.382536+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:54:35.382536+0000","last_undegraded":"2024-09-22T09:54:35.382536+0000","last_fullsized":"2024-09-22T09:54:35.382536+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.382442+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:41.378476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'197","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.543796+0000","last_change":"2024-09-22T09:54:26.543796+0000","last_active":"2024-09-22T09:54:26.543796+0000","last_peered":"2024-09-22T09:54:26.543796+0000","last_clean":"2024-09-22T09:54:26.543796+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:54:26.543796+0000","last_undegraded":"2024-09-22T09:54:26.543796+0000","last_fullsized":"2024-09-22T09:54:26.543796+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.543655+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:59.656939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":611,"num_read_kb":542,"num_write":1015,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.195206+0000","last_change":"2024-09-22T09:54:33.195206+0000","last_active":"2024-09-22T09:54:33.195206+0000","last_peered":"2024-09-22T09:54:33.195206+0000","last_clean":"2024-09-22T09:54:33.195206+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:54:33.195206+0000","last_undegraded":"2024-09-22T09:54:33.195206+0000","last_fullsized":"2024-09-22T09:54:33.195206+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.195108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:04.521832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'205","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.083506+0000","last_change":"2024-09-22T09:54:25.083506+0000","last_active":"2024-09-22T09:54:25.083506+0000","last_peered":"2024-09-22T09:54:25.083506+0000","last_clean":"2024-09-22T09:54:25.083506+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:54:25.083506+0000","last_undegraded":"2024-09-22T09:54:25.083506+0000","last_fullsized":"2024-09-22T09:54:25.083506+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.083235+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:40.697324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":724,"num_read_kb":18552,"num_write":938,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":835,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663562+0000","last_change":"2024-09-22T08:42:15.436338+0000","last_active":"2024-09-22T09:51:12.663562+0000","last_peered":"2024-09-22T09:51:12.663562+0000","last_clean":"2024-09-22T09:51:12.663562+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:51:12.663562+0000","last_undegraded":"2024-09-22T09:51:12.663562+0000","last_fullsized":"2024-09-22T09:51:12.663562+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:58.108852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'222","reported_seq":878,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.900669+0000","last_change":"2024-09-22T09:54:25.900669+0000","last_active":"2024-09-22T09:54:25.900669+0000","last_peered":"2024-09-22T09:54:25.900669+0000","last_clean":"2024-09-22T09:54:25.900669+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:54:25.900669+0000","last_undegraded":"2024-09-22T09:54:25.900669+0000","last_fullsized":"2024-09-22T09:54:25.900669+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.900557+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:40.029656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":30794,"num_write":966,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'220","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.668933+0000","last_change":"2024-09-22T09:54:33.668933+0000","last_active":"2024-09-22T09:54:33.668933+0000","last_peered":"2024-09-22T09:54:33.668933+0000","last_clean":"2024-09-22T09:54:33.668933+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:54:33.668933+0000","last_undegraded":"2024-09-22T09:54:33.668933+0000","last_fullsized":"2024-09-22T09:54:33.668933+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.668849+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:00.473679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'282","reported_seq":980,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.200420+0000","last_change":"2024-09-22T09:54:26.200420+0000","last_active":"2024-09-22T09:54:26.200420+0000","last_peered":"2024-09-22T09:54:26.200420+0000","last_clean":"2024-09-22T09:54:26.200420+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:54:26.200420+0000","last_undegraded":"2024-09-22T09:54:26.200420+0000","last_fullsized":"2024-09-22T09:54:26.200420+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.200277+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:20.326052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242911,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":757,"num_read_kb":37026,"num_write":1221,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.662275+0000","last_change":"2024-09-22T08:42:15.440845+0000","last_active":"2024-09-22T09:51:02.662275+0000","last_peered":"2024-09-22T09:51:02.662275+0000","last_clean":"2024-09-22T09:51:02.662275+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:51:02.662275+0000","last_undegraded":"2024-09-22T09:51:02.662275+0000","last_fullsized":"2024-09-22T09:51:02.662275+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:47:42.146384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'210","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.829055+0000","last_change":"2024-09-22T09:54:25.829055+0000","last_active":"2024-09-22T09:54:25.829055+0000","last_peered":"2024-09-22T09:54:25.829055+0000","last_clean":"2024-09-22T09:54:25.829055+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:54:25.829055+0000","last_undegraded":"2024-09-22T09:54:25.829055+0000","last_fullsized":"2024-09-22T09:54:25.829055+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.828882+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:15.511659+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":7650,"num_write":1038,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886298+0000","last_change":"2024-09-22T09:54:32.886298+0000","last_active":"2024-09-22T09:54:32.886298+0000","last_peered":"2024-09-22T09:54:32.886298+0000","last_clean":"2024-09-22T09:54:32.886298+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:54:32.886298+0000","last_undegraded":"2024-09-22T09:54:32.886298+0000","last_fullsized":"2024-09-22T09:54:32.886298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886187+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:19.355885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'229","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.850468+0000","last_change":"2024-09-22T09:54:31.850468+0000","last_active":"2024-09-22T09:54:31.850468+0000","last_peered":"2024-09-22T09:54:31.850468+0000","last_clean":"2024-09-22T09:54:31.850468+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:54:31.850468+0000","last_undegraded":"2024-09-22T09:54:31.850468+0000","last_fullsized":"2024-09-22T09:54:31.850468+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.850380+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:23.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":20476,"num_write":1023,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.087299+0000","last_change":"2024-09-22T09:54:35.087235+0000","last_active":"2024-09-22T09:54:35.087299+0000","last_peered":"2024-09-22T09:54:35.087299+0000","last_clean":"2024-09-22T09:54:35.087299+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:54:35.087299+0000","last_undegraded":"2024-09-22T09:54:35.087299+0000","last_fullsized":"2024-09-22T09:54:35.087299+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.087135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:07.485045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'186","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.512435+0000","last_change":"2024-09-22T09:54:27.512435+0000","last_active":"2024-09-22T09:54:27.512435+0000","last_peered":"2024-09-22T09:54:27.512435+0000","last_clean":"2024-09-22T09:54:27.512435+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:54:27.512435+0000","last_undegraded":"2024-09-22T09:54:27.512435+0000","last_fullsized":"2024-09-22T09:54:27.512435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.512262+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:12.723891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":7230,"num_write":907,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.708613+0000","last_change":"2024-09-22T09:54:36.708533+0000","last_active":"2024-09-22T09:54:36.708613+0000","last_peered":"2024-09-22T09:54:36.708613+0000","last_clean":"2024-09-22T09:54:36.708613+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:54:36.708613+0000","last_undegraded":"2024-09-22T09:54:36.708613+0000","last_fullsized":"2024-09-22T09:54:36.708613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.708407+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:19.337819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'226","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.887055+0000","last_change":"2024-09-22T09:54:27.887055+0000","last_active":"2024-09-22T09:54:27.887055+0000","last_peered":"2024-09-22T09:54:27.887055+0000","last_clean":"2024-09-22T09:54:27.887055+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:54:27.887055+0000","last_undegraded":"2024-09-22T09:54:27.887055+0000","last_fullsized":"2024-09-22T09:54:27.887055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.886918+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:01.730176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1623,"num_read_kb":135465,"num_write":994,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'143","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.688731+0000","last_change":"2024-09-22T09:54:26.688731+0000","last_active":"2024-09-22T09:54:26.688731+0000","last_peered":"2024-09-22T09:54:26.688731+0000","last_clean":"2024-09-22T09:54:26.688731+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:54:26.688731+0000","last_undegraded":"2024-09-22T09:54:26.688731+0000","last_fullsized":"2024-09-22T09:54:26.688731+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.688639+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:53.157417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'180","reported_seq":793,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.510853+0000","last_change":"2024-09-22T09:54:28.510853+0000","last_active":"2024-09-22T09:54:28.510853+0000","last_peered":"2024-09-22T09:54:28.510853+0000","last_clean":"2024-09-22T09:54:28.510853+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:54:28.510853+0000","last_undegraded":"2024-09-22T09:54:28.510853+0000","last_fullsized":"2024-09-22T09:54:28.510853+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'180","last_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_deep_scrub":"262'180","last_deep_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.510744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.855576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170178,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":30385,"num_write":838,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.664254+0000","last_change":"2024-09-22T09:54:34.664254+0000","last_active":"2024-09-22T09:54:34.664254+0000","last_peered":"2024-09-22T09:54:34.664254+0000","last_clean":"2024-09-22T09:54:34.664254+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:54:34.664254+0000","last_undegraded":"2024-09-22T09:54:34.664254+0000","last_fullsized":"2024-09-22T09:54:34.664254+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.664136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:52.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.042434+0000","last_change":"2024-09-22T09:54:26.042434+0000","last_active":"2024-09-22T09:54:26.042434+0000","last_peered":"2024-09-22T09:54:26.042434+0000","last_clean":"2024-09-22T09:54:26.042434+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:54:26.042434+0000","last_undegraded":"2024-09-22T09:54:26.042434+0000","last_fullsized":"2024-09-22T09:54:26.042434+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.042281+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:00.923861+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":23430,"num_write":912,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.612459+0000","last_change":"2024-09-22T09:54:35.612459+0000","last_active":"2024-09-22T09:54:35.612459+0000","last_peered":"2024-09-22T09:54:35.612459+0000","last_clean":"2024-09-22T09:54:35.612459+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:54:35.612459+0000","last_undegraded":"2024-09-22T09:54:35.612459+0000","last_fullsized":"2024-09-22T09:54:35.612459+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'276","last_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_deep_scrub":"262'276","last_deep_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.612365+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:05.176874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'212","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.863062+0000","last_change":"2024-09-22T09:54:26.863062+0000","last_active":"2024-09-22T09:54:26.863062+0000","last_peered":"2024-09-22T09:54:26.863062+0000","last_clean":"2024-09-22T09:54:26.863062+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:54:26.863062+0000","last_undegraded":"2024-09-22T09:54:26.863062+0000","last_fullsized":"2024-09-22T09:54:26.863062+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.862976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:17.663525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":16539,"num_write":978,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.043413+0000","last_change":"2024-09-22T09:54:34.043413+0000","last_active":"2024-09-22T09:54:34.043413+0000","last_peered":"2024-09-22T09:54:34.043413+0000","last_clean":"2024-09-22T09:54:34.043413+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:54:34.043413+0000","last_undegraded":"2024-09-22T09:54:34.043413+0000","last_fullsized":"2024-09-22T09:54:34.043413+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.043310+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:36.199673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'199","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.591536+0000","last_change":"2024-09-22T09:54:32.591536+0000","last_active":"2024-09-22T09:54:32.591536+0000","last_peered":"2024-09-22T09:54:32.591536+0000","last_clean":"2024-09-22T09:54:32.591536+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:54:32.591536+0000","last_undegraded":"2024-09-22T09:54:32.591536+0000","last_fullsized":"2024-09-22T09:54:32.591536+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.591400+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:24.382819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":32145,"num_write":913,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.669984+0000","last_change":"2024-09-22T08:42:15.436821+0000","last_active":"2024-09-22T09:52:02.669984+0000","last_peered":"2024-09-22T09:52:02.669984+0000","last_clean":"2024-09-22T09:52:02.669984+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:52:02.669984+0000","last_undegraded":"2024-09-22T09:52:02.669984+0000","last_fullsized":"2024-09-22T09:52:02.669984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:14.371876+0000","last_clean_scrub_stamp":"2024-09-22T08:42:14.371876+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:30.622726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'203","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.684314+0000","last_change":"2024-09-22T09:54:27.684247+0000","last_active":"2024-09-22T09:54:27.684314+0000","last_peered":"2024-09-22T09:54:27.684314+0000","last_clean":"2024-09-22T09:54:27.684314+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:54:27.684314+0000","last_undegraded":"2024-09-22T09:54:27.684314+0000","last_fullsized":"2024-09-22T09:54:27.684314+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.684082+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:03.070485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493665,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":31835,"num_write":1011,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.613984+0000","last_change":"2024-09-22T09:54:34.613984+0000","last_active":"2024-09-22T09:54:34.613984+0000","last_peered":"2024-09-22T09:54:34.613984+0000","last_clean":"2024-09-22T09:54:34.613984+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:54:34.613984+0000","last_undegraded":"2024-09-22T09:54:34.613984+0000","last_fullsized":"2024-09-22T09:54:34.613984+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'154","last_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_deep_scrub":"262'154","last_deep_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.613865+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'227","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.479127+0000","last_change":"2024-09-22T09:54:29.479067+0000","last_active":"2024-09-22T09:54:29.479127+0000","last_peered":"2024-09-22T09:54:29.479127+0000","last_clean":"2024-09-22T09:54:29.479127+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:54:29.479127+0000","last_undegraded":"2024-09-22T09:54:29.479127+0000","last_fullsized":"2024-09-22T09:54:29.479127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.478897+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:08.606241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242963,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":33540,"num_write":1138,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'203","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.379662+0000","last_change":"2024-09-22T09:54:31.379607+0000","last_active":"2024-09-22T09:54:31.379662+0000","last_peered":"2024-09-22T09:54:31.379662+0000","last_clean":"2024-09-22T09:54:31.379662+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:54:31.379662+0000","last_undegraded":"2024-09-22T09:54:31.379662+0000","last_fullsized":"2024-09-22T09:54:31.379662+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.379436+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:11.349573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":478,"num_read_kb":16611,"num_write":909,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":780,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.056645+0000","last_change":"2024-09-22T09:54:36.056645+0000","last_active":"2024-09-22T09:54:36.056645+0000","last_peered":"2024-09-22T09:54:36.056645+0000","last_clean":"2024-09-22T09:54:36.056645+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:54:36.056645+0000","last_undegraded":"2024-09-22T09:54:36.056645+0000","last_fullsized":"2024-09-22T09:54:36.056645+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.056545+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:56.184943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'230","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.226521+0000","last_change":"2024-09-22T09:54:25.226461+0000","last_active":"2024-09-22T09:54:25.226521+0000","last_peered":"2024-09-22T09:54:25.226521+0000","last_clean":"2024-09-22T09:54:25.226521+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:54:25.226521+0000","last_undegraded":"2024-09-22T09:54:25.226521+0000","last_fullsized":"2024-09-22T09:54:25.226521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'230","last_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_deep_scrub":"262'230","last_deep_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.226345+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:28.279869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":659,"num_read_kb":76384,"num_write":1027,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.389356+0000","last_change":"2024-09-22T09:54:37.389356+0000","last_active":"2024-09-22T09:54:37.389356+0000","last_peered":"2024-09-22T09:54:37.389356+0000","last_clean":"2024-09-22T09:54:37.389356+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:54:37.389356+0000","last_undegraded":"2024-09-22T09:54:37.389356+0000","last_fullsized":"2024-09-22T09:54:37.389356+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.389263+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:02.716245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1596,"ondisk_log_size":1596,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":415,"ondisk_log_size":415,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":372077,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":10012,"num_read_kb":12519,"num_write":7007,"num_write_kb":3209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1744,"ondisk_log_size":1744,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8753,"num_omap_keys":38,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3780,"ondisk_log_size":3780,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":105523402,"num_objects":166,"num_object_clones":0,"num_object_copies":664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42464,"num_read_kb":2399835,"num_write":63370,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142622720,"data_stored":142622720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":189640,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189064,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543021,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265880,"kb_used_data":22280,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94105960,"statfs":{"total":96636764160,"available":96364503040,"internally_reserved":0,"allocated":22814720,"data_stored":20815259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543021,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291592,"kb_used_data":21624,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94080248,"statfs":{"total":96636764160,"available":96338173952,"internally_reserved":0,"allocated":22142976,"data_stored":20214796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543023,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117552,"kb_used_data":19808,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94254288,"statfs":{"total":96636764160,"available":96516390912,"internally_reserved":0,"allocated":20283392,"data_stored":18282616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543022,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138192,"kb_used_data":26496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94233648,"statfs":{"total":96636764160,"available":96495255552,"internally_reserved":0,"allocated":27131904,"data_stored":25227113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543021,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18263996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543025,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91232,"kb_used_data":19792,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280608,"statfs":{"total":96636764160,"available":96543342592,"internally_reserved":0,"allocated":20267008,"data_stored":18362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543021,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149548,"kb_used_data":19868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94222292,"statfs":{"total":96636764160,"available":96483627008,"internally_reserved":0,"allocated":20344832,"data_stored":18397529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543023,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257584,"kb_used_data":23712,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94114256,"statfs":{"total":96636764160,"available":96372998144,"internally_reserved":0,"allocated":24281088,"data_stored":22309261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16138240,"data_stored":16138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":16105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":16003072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22970368,"data_stored":22970368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16023552,"data_stored":16023552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17956864,"data_stored":17956864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17965056,"data_stored":17965056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:54:42.796 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.796 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.796 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.797 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.798 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.799 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.800 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.801 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.802 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.803 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.804 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.805 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.806 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.807 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.808 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.809 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.810 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.811 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.812 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.813 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.814 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.815 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.816 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.817 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.818 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.819 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.820 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.821 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.822 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.823 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.824 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.825 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.826 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-22T08:42:16.401601+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-22T08:42:18.429700+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=18, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.827 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.828 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.828 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.828 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-22T08:42:14.371876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=14, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:54:42.828 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:55:02.829 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:55:03.183 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:55:03.194 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:55:03.196 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2450,"stamp":"2024-09-22T09:55:02.439726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106502740,"num_objects":492,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":190601,"num_read_kb":2910687,"num_write":128942,"num_write_kb":2504267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":747416,"num_omap_keys":1772,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13162,"ondisk_log_size":13162,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1548568,"kb_used_data":173336,"kb_used_omap":12,"kb_used_meta":1375091,"kb_avail":753426152,"statfs":{"total":773094113280,"available":771508379648,"internally_reserved":0,"allocated":177496064,"data_stored":161872998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1408093745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19514,"num_omap_keys":55,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005116"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.675620+0000","last_change":"2024-09-22T09:20:12.866243+0000","last_active":"2024-09-22T09:50:12.675620+0000","last_peered":"2024-09-22T09:50:12.675620+0000","last_clean":"2024-09-22T09:50:12.675620+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:50:12.675620+0000","last_undegraded":"2024-09-22T09:50:12.675620+0000","last_fullsized":"2024-09-22T09:50:12.675620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:46:42.053079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'8","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.705974+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:42.705974+0000","last_peered":"2024-09-22T09:53:42.705974+0000","last_clean":"2024-09-22T09:53:42.705974+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:53:42.705974+0000","last_undegraded":"2024-09-22T09:53:42.705974+0000","last_fullsized":"2024-09-22T09:53:42.705974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:34.823180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.662972+0000","last_change":"2024-09-22T09:01:07.464043+0000","last_active":"2024-09-22T09:51:07.662972+0000","last_peered":"2024-09-22T09:51:07.662972+0000","last_clean":"2024-09-22T09:51:07.662972+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:51:07.662972+0000","last_undegraded":"2024-09-22T09:51:07.662972+0000","last_fullsized":"2024-09-22T09:51:07.662972+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:52:27.678467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":102,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664745+0000","last_change":"2024-09-22T08:57:04.404157+0000","last_active":"2024-09-22T09:51:17.664745+0000","last_peered":"2024-09-22T09:51:17.664745+0000","last_clean":"2024-09-22T09:51:17.664745+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:51:17.664745+0000","last_undegraded":"2024-09-22T09:51:17.664745+0000","last_fullsized":"2024-09-22T09:51:17.664745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:06:21.009919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":34,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.602742+0000","last_change":"2024-09-22T09:54:50.602742+0000","last_active":"2024-09-22T09:54:50.602742+0000","last_peered":"2024-09-22T09:54:50.602742+0000","last_clean":"2024-09-22T09:54:50.602742+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:54:50.602742+0000","last_undegraded":"2024-09-22T09:54:50.602742+0000","last_fullsized":"2024-09-22T09:54:50.602742+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.602649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:34.691467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'9","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:42.579860+0000","last_change":"2024-09-22T09:01:11.513344+0000","last_active":"2024-09-22T09:53:42.579860+0000","last_peered":"2024-09-22T09:53:42.579860+0000","last_clean":"2024-09-22T09:53:42.579860+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:53:42.579860+0000","last_undegraded":"2024-09-22T09:53:42.579860+0000","last_fullsized":"2024-09-22T09:53:42.579860+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:38.829624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":18432,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.176703+0000","last_change":"2024-09-22T09:54:54.176703+0000","last_active":"2024-09-22T09:54:54.176703+0000","last_peered":"2024-09-22T09:54:54.176703+0000","last_clean":"2024-09-22T09:54:54.176703+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:54:54.176703+0000","last_undegraded":"2024-09-22T09:54:54.176703+0000","last_fullsized":"2024-09-22T09:54:54.176703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.176615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:35.381475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":104,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.653745+0000","last_change":"2024-09-22T09:54:42.653745+0000","last_active":"2024-09-22T09:54:42.653745+0000","last_peered":"2024-09-22T09:54:42.653745+0000","last_clean":"2024-09-22T09:54:42.653745+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:54:42.653745+0000","last_undegraded":"2024-09-22T09:54:42.653745+0000","last_fullsized":"2024-09-22T09:54:42.653745+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'13","last_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_deep_scrub":"262'13","last_deep_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.653671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:37.734493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.680335+0000","last_change":"2024-09-22T09:20:12.865933+0000","last_active":"2024-09-22T09:51:37.680335+0000","last_peered":"2024-09-22T09:51:37.680335+0000","last_clean":"2024-09-22T09:51:37.680335+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:51:37.680335+0000","last_undegraded":"2024-09-22T09:51:37.680335+0000","last_fullsized":"2024-09-22T09:51:37.680335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:27.822051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.664009+0000","last_change":"2024-09-22T09:01:11.518482+0000","last_active":"2024-09-22T09:51:12.664009+0000","last_peered":"2024-09-22T09:51:12.664009+0000","last_clean":"2024-09-22T09:51:12.664009+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:51:12.664009+0000","last_undegraded":"2024-09-22T09:51:12.664009+0000","last_fullsized":"2024-09-22T09:51:12.664009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:40:17.510096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'4","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.616284+0000","last_change":"2024-09-22T09:54:46.616284+0000","last_active":"2024-09-22T09:54:46.616284+0000","last_peered":"2024-09-22T09:54:46.616284+0000","last_clean":"2024-09-22T09:54:46.616284+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:54:46.616284+0000","last_undegraded":"2024-09-22T09:54:46.616284+0000","last_fullsized":"2024-09-22T09:54:46.616284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.616197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:24.250059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":619,"num_write":4,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":155,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670956+0000","last_change":"2024-09-22T08:57:04.400881+0000","last_active":"2024-09-22T09:52:07.670956+0000","last_peered":"2024-09-22T09:52:07.670956+0000","last_clean":"2024-09-22T09:52:07.670956+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:52:07.670956+0000","last_undegraded":"2024-09-22T09:52:07.670956+0000","last_fullsized":"2024-09-22T09:52:07.670956+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557579+0000","last_change":"2024-09-22T09:01:07.448989+0000","last_active":"2024-09-22T09:51:07.557579+0000","last_peered":"2024-09-22T09:51:07.557579+0000","last_clean":"2024-09-22T09:51:07.557579+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:51:07.557579+0000","last_undegraded":"2024-09-22T09:51:07.557579+0000","last_fullsized":"2024-09-22T09:51:07.557579+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:10:31.023887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670673+0000","last_change":"2024-09-22T08:57:04.401301+0000","last_active":"2024-09-22T09:52:07.670673+0000","last_peered":"2024-09-22T09:52:07.670673+0000","last_clean":"2024-09-22T09:52:07.670673+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:52:07.670673+0000","last_undegraded":"2024-09-22T09:52:07.670673+0000","last_fullsized":"2024-09-22T09:52:07.670673+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.671292+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:52:12.671292+0000","last_peered":"2024-09-22T09:52:12.671292+0000","last_clean":"2024-09-22T09:52:12.671292+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:52:12.671292+0000","last_undegraded":"2024-09-22T09:52:12.671292+0000","last_fullsized":"2024-09-22T09:52:12.671292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:02.691217+0000","last_change":"2024-09-22T09:01:47.326385+0000","last_active":"2024-09-22T09:52:02.691217+0000","last_peered":"2024-09-22T09:52:02.691217+0000","last_clean":"2024-09-22T09:52:02.691217+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:52:02.691217+0000","last_undegraded":"2024-09-22T09:52:02.691217+0000","last_fullsized":"2024-09-22T09:52:02.691217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.669135+0000","last_change":"2024-09-22T09:01:07.460354+0000","last_active":"2024-09-22T09:51:52.669135+0000","last_peered":"2024-09-22T09:51:52.669135+0000","last_clean":"2024-09-22T09:51:52.669135+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:51:52.669135+0000","last_undegraded":"2024-09-22T09:51:52.669135+0000","last_fullsized":"2024-09-22T09:51:52.669135+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:11.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.670615+0000","last_change":"2024-09-22T08:57:04.404299+0000","last_active":"2024-09-22T09:52:07.670615+0000","last_peered":"2024-09-22T09:52:07.670615+0000","last_clean":"2024-09-22T09:52:07.670615+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:52:07.670615+0000","last_undegraded":"2024-09-22T09:52:07.670615+0000","last_fullsized":"2024-09-22T09:52:07.670615+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.436955+0000","last_change":"2024-09-22T09:20:12.870173+0000","last_active":"2024-09-22T09:51:27.436955+0000","last_peered":"2024-09-22T09:51:27.436955+0000","last_clean":"2024-09-22T09:51:27.436955+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:51:27.436955+0000","last_undegraded":"2024-09-22T09:51:27.436955+0000","last_fullsized":"2024-09-22T09:51:27.436955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:51.242818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.070429+0000","last_change":"2024-09-22T09:54:55.070429+0000","last_active":"2024-09-22T09:54:55.070429+0000","last_peered":"2024-09-22T09:54:55.070429+0000","last_clean":"2024-09-22T09:54:55.070429+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:54:55.070429+0000","last_undegraded":"2024-09-22T09:54:55.070429+0000","last_fullsized":"2024-09-22T09:54:55.070429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.070344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:57.666280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:07.565901+0000","last_change":"2024-09-22T09:01:07.454304+0000","last_active":"2024-09-22T09:52:07.565901+0000","last_peered":"2024-09-22T09:52:07.565901+0000","last_clean":"2024-09-22T09:52:07.565901+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:52:07.565901+0000","last_undegraded":"2024-09-22T09:52:07.565901+0000","last_fullsized":"2024-09-22T09:52:07.565901+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":269,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.114568+0000","last_change":"2024-09-22T09:54:51.114568+0000","last_active":"2024-09-22T09:54:51.114568+0000","last_peered":"2024-09-22T09:54:51.114568+0000","last_clean":"2024-09-22T09:54:51.114568+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:54:51.114568+0000","last_undegraded":"2024-09-22T09:54:51.114568+0000","last_fullsized":"2024-09-22T09:54:51.114568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'70","last_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_deep_scrub":"262'70","last_deep_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.114477+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:41.369972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'1","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517262+0000","last_change":"2024-09-22T09:20:12.874380+0000","last_active":"2024-09-22T09:50:12.517262+0000","last_peered":"2024-09-22T09:50:12.517262+0000","last_clean":"2024-09-22T09:50:12.517262+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:50:12.517262+0000","last_undegraded":"2024-09-22T09:50:12.517262+0000","last_fullsized":"2024-09-22T09:50:12.517262+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:16.396844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'8","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.033215+0000","last_change":"2024-09-22T09:01:11.509711+0000","last_active":"2024-09-22T09:54:14.033215+0000","last_peered":"2024-09-22T09:54:14.033215+0000","last_clean":"2024-09-22T09:54:14.033215+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:54:14.033215+0000","last_undegraded":"2024-09-22T09:54:14.033215+0000","last_fullsized":"2024-09-22T09:54:14.033215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:24.603438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.557485+0000","last_change":"2024-09-22T09:01:07.460697+0000","last_active":"2024-09-22T09:51:07.557485+0000","last_peered":"2024-09-22T09:51:07.557485+0000","last_clean":"2024-09-22T09:51:07.557485+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:51:07.557485+0000","last_undegraded":"2024-09-22T09:51:07.557485+0000","last_fullsized":"2024-09-22T09:51:07.557485+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:43:32.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":228,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:22.657453+0000","last_change":"2024-09-22T08:57:04.399219+0000","last_active":"2024-09-22T09:50:22.657453+0000","last_peered":"2024-09-22T09:50:22.657453+0000","last_clean":"2024-09-22T09:50:22.657453+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:50:22.657453+0000","last_undegraded":"2024-09-22T09:50:22.657453+0000","last_fullsized":"2024-09-22T09:50:22.657453+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:31.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:12.517311+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:50:12.517311+0000","last_peered":"2024-09-22T09:50:12.517311+0000","last_clean":"2024-09-22T09:50:12.517311+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:50:12.517311+0000","last_undegraded":"2024-09-22T09:50:12.517311+0000","last_fullsized":"2024-09-22T09:50:12.517311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:17:06.743201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:37.683649+0000","last_change":"2024-09-22T09:01:07.465234+0000","last_active":"2024-09-22T09:53:37.683649+0000","last_peered":"2024-09-22T09:53:37.683649+0000","last_clean":"2024-09-22T09:53:37.683649+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:53:37.683649+0000","last_undegraded":"2024-09-22T09:53:37.683649+0000","last_fullsized":"2024-09-22T09:53:37.683649+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:44:07.955004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":135,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.177569+0000","last_change":"2024-09-22T09:54:50.177569+0000","last_active":"2024-09-22T09:54:50.177569+0000","last_peered":"2024-09-22T09:54:50.177569+0000","last_clean":"2024-09-22T09:54:50.177569+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:54:50.177569+0000","last_undegraded":"2024-09-22T09:54:50.177569+0000","last_fullsized":"2024-09-22T09:54:50.177569+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'25","last_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_deep_scrub":"262'25","last_deep_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.177482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:53.841646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.430680+0000","last_change":"2024-09-22T09:20:12.868859+0000","last_active":"2024-09-22T09:50:32.430680+0000","last_peered":"2024-09-22T09:50:32.430680+0000","last_clean":"2024-09-22T09:50:32.430680+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:50:32.430680+0000","last_undegraded":"2024-09-22T09:50:32.430680+0000","last_fullsized":"2024-09-22T09:50:32.430680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:50.179219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669452+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:51:57.669452+0000","last_peered":"2024-09-22T09:51:57.669452+0000","last_clean":"2024-09-22T09:51:57.669452+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:51:57.669452+0000","last_undegraded":"2024-09-22T09:51:57.669452+0000","last_fullsized":"2024-09-22T09:51:57.669452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.061174+0000","last_change":"2024-09-22T09:01:07.458438+0000","last_active":"2024-09-22T09:54:14.061174+0000","last_peered":"2024-09-22T09:54:14.061174+0000","last_clean":"2024-09-22T09:54:14.061174+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:54:14.061174+0000","last_undegraded":"2024-09-22T09:54:14.061174+0000","last_fullsized":"2024-09-22T09:54:14.061174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":80,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656803+0000","last_change":"2024-09-22T08:57:04.404059+0000","last_active":"2024-09-22T09:50:17.656803+0000","last_peered":"2024-09-22T09:50:17.656803+0000","last_clean":"2024-09-22T09:50:17.656803+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:50:17.656803+0000","last_undegraded":"2024-09-22T09:50:17.656803+0000","last_fullsized":"2024-09-22T09:50:17.656803+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:54.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.623648+0000","last_change":"2024-09-22T09:54:49.623648+0000","last_active":"2024-09-22T09:54:49.623648+0000","last_peered":"2024-09-22T09:54:49.623648+0000","last_clean":"2024-09-22T09:54:49.623648+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:54:49.623648+0000","last_undegraded":"2024-09-22T09:54:49.623648+0000","last_fullsized":"2024-09-22T09:54:49.623648+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.623509+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:10.004394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'3","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674681+0000","last_change":"2024-09-22T09:01:11.520707+0000","last_active":"2024-09-22T09:52:37.674681+0000","last_peered":"2024-09-22T09:52:37.674681+0000","last_clean":"2024-09-22T09:52:37.674681+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:52:37.674681+0000","last_undegraded":"2024-09-22T09:52:37.674681+0000","last_fullsized":"2024-09-22T09:52:37.674681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:25.291582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.049531+0000","last_change":"2024-09-22T09:01:07.459639+0000","last_active":"2024-09-22T09:54:14.049531+0000","last_peered":"2024-09-22T09:54:14.049531+0000","last_clean":"2024-09-22T09:54:14.049531+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:54:14.049531+0000","last_undegraded":"2024-09-22T09:54:14.049531+0000","last_fullsized":"2024-09-22T09:54:14.049531+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:45.950785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":97,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:17.656827+0000","last_change":"2024-09-22T08:57:04.403818+0000","last_active":"2024-09-22T09:50:17.656827+0000","last_peered":"2024-09-22T09:50:17.656827+0000","last_clean":"2024-09-22T09:50:17.656827+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:50:17.656827+0000","last_undegraded":"2024-09-22T09:50:17.656827+0000","last_fullsized":"2024-09-22T09:50:17.656827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:35.858069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.520035+0000","last_change":"2024-09-22T09:20:12.868076+0000","last_active":"2024-09-22T09:50:32.520035+0000","last_peered":"2024-09-22T09:50:32.520035+0000","last_clean":"2024-09-22T09:50:32.520035+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:50:32.520035+0000","last_undegraded":"2024-09-22T09:50:32.520035+0000","last_fullsized":"2024-09-22T09:50:32.520035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:14.473099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669489+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:51:57.669489+0000","last_peered":"2024-09-22T09:51:57.669489+0000","last_clean":"2024-09-22T09:51:57.669489+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:51:57.669489+0000","last_undegraded":"2024-09-22T09:51:57.669489+0000","last_fullsized":"2024-09-22T09:51:57.669489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'6","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.619628+0000","last_change":"2024-09-22T09:54:45.619628+0000","last_active":"2024-09-22T09:54:45.619628+0000","last_peered":"2024-09-22T09:54:45.619628+0000","last_clean":"2024-09-22T09:54:45.619628+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:54:45.619628+0000","last_undegraded":"2024-09-22T09:54:45.619628+0000","last_fullsized":"2024-09-22T09:54:45.619628+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.619539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.272533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":164,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.626473+0000","last_change":"2024-09-22T09:54:41.626473+0000","last_active":"2024-09-22T09:54:41.626473+0000","last_peered":"2024-09-22T09:54:41.626473+0000","last_clean":"2024-09-22T09:54:41.626473+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:54:41.626473+0000","last_undegraded":"2024-09-22T09:54:41.626473+0000","last_fullsized":"2024-09-22T09:54:41.626473+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.626373+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:45.919725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.678417+0000","last_change":"2024-09-22T09:20:12.871240+0000","last_active":"2024-09-22T09:50:32.678417+0000","last_peered":"2024-09-22T09:50:32.678417+0000","last_clean":"2024-09-22T09:50:32.678417+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:50:32.678417+0000","last_undegraded":"2024-09-22T09:50:32.678417+0000","last_fullsized":"2024-09-22T09:50:32.678417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:14.592999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":45,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.564378+0000","last_change":"2024-09-22T09:01:11.511020+0000","last_active":"2024-09-22T09:51:57.564378+0000","last_peered":"2024-09-22T09:51:57.564378+0000","last_clean":"2024-09-22T09:51:57.564378+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:51:57.564378+0000","last_undegraded":"2024-09-22T09:51:57.564378+0000","last_fullsized":"2024-09-22T09:51:57.564378+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.884299+0000","last_change":"2024-09-22T09:01:07.467375+0000","last_active":"2024-09-22T09:54:13.884299+0000","last_peered":"2024-09-22T09:54:13.884299+0000","last_clean":"2024-09-22T09:54:13.884299+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:54:13.884299+0000","last_undegraded":"2024-09-22T09:54:13.884299+0000","last_fullsized":"2024-09-22T09:54:13.884299+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:44:15.087014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":116,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524115+0000","last_change":"2024-09-22T08:57:04.398557+0000","last_active":"2024-09-22T09:50:57.524115+0000","last_peered":"2024-09-22T09:50:57.524115+0000","last_clean":"2024-09-22T09:50:57.524115+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:50:57.524115+0000","last_undegraded":"2024-09-22T09:50:57.524115+0000","last_fullsized":"2024-09-22T09:50:57.524115+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:23:10.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.443873+0000","last_change":"2024-09-22T09:01:11.517827+0000","last_active":"2024-09-22T09:52:32.443873+0000","last_peered":"2024-09-22T09:52:32.443873+0000","last_clean":"2024-09-22T09:52:32.443873+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:52:32.443873+0000","last_undegraded":"2024-09-22T09:52:32.443873+0000","last_fullsized":"2024-09-22T09:52:32.443873+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.049961+0000","last_change":"2024-09-22T09:01:07.453581+0000","last_active":"2024-09-22T09:54:14.049961+0000","last_peered":"2024-09-22T09:54:14.049961+0000","last_clean":"2024-09-22T09:54:14.049961+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:54:14.049961+0000","last_undegraded":"2024-09-22T09:54:14.049961+0000","last_fullsized":"2024-09-22T09:54:14.049961+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":143,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.522672+0000","last_change":"2024-09-22T08:57:04.395812+0000","last_active":"2024-09-22T09:50:47.522672+0000","last_peered":"2024-09-22T09:50:47.522672+0000","last_clean":"2024-09-22T09:50:47.522672+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:50:47.522672+0000","last_undegraded":"2024-09-22T09:50:47.522672+0000","last_fullsized":"2024-09-22T09:50:47.522672+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:57:02.202084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:14.074250+0000","last_change":"2024-09-22T09:01:11.513914+0000","last_active":"2024-09-22T09:54:14.074250+0000","last_peered":"2024-09-22T09:54:14.074250+0000","last_clean":"2024-09-22T09:54:14.074250+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:54:14.074250+0000","last_undegraded":"2024-09-22T09:54:14.074250+0000","last_fullsized":"2024-09-22T09:54:14.074250+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.673250+0000","last_change":"2024-09-22T09:01:07.462921+0000","last_active":"2024-09-22T09:52:27.673250+0000","last_peered":"2024-09-22T09:52:27.673250+0000","last_clean":"2024-09-22T09:52:27.673250+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:52:27.673250+0000","last_undegraded":"2024-09-22T09:52:27.673250+0000","last_fullsized":"2024-09-22T09:52:27.673250+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660599+0000","last_change":"2024-09-22T08:57:04.400630+0000","last_active":"2024-09-22T09:50:47.660599+0000","last_peered":"2024-09-22T09:50:47.660599+0000","last_clean":"2024-09-22T09:50:47.660599+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:50:47.660599+0000","last_undegraded":"2024-09-22T09:50:47.660599+0000","last_fullsized":"2024-09-22T09:50:47.660599+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:14.500164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:32.658750+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:50:32.658750+0000","last_peered":"2024-09-22T09:50:32.658750+0000","last_clean":"2024-09-22T09:50:32.658750+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:50:32.658750+0000","last_undegraded":"2024-09-22T09:50:32.658750+0000","last_fullsized":"2024-09-22T09:50:32.658750+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:57:03.977881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.674078+0000","last_change":"2024-09-22T09:01:11.518434+0000","last_active":"2024-09-22T09:52:32.674078+0000","last_peered":"2024-09-22T09:52:32.674078+0000","last_clean":"2024-09-22T09:52:32.674078+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:52:32.674078+0000","last_undegraded":"2024-09-22T09:52:32.674078+0000","last_fullsized":"2024-09-22T09:52:32.674078+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.085415+0000","last_change":"2024-09-22T09:54:52.085415+0000","last_active":"2024-09-22T09:54:52.085415+0000","last_peered":"2024-09-22T09:54:52.085415+0000","last_clean":"2024-09-22T09:54:52.085415+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:54:52.085415+0000","last_undegraded":"2024-09-22T09:54:52.085415+0000","last_fullsized":"2024-09-22T09:54:52.085415+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.085329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:05.365422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":204,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.554709+0000","last_change":"2024-09-22T08:57:04.399899+0000","last_active":"2024-09-22T09:50:47.554709+0000","last_peered":"2024-09-22T09:50:47.554709+0000","last_clean":"2024-09-22T09:50:47.554709+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:50:47.554709+0000","last_undegraded":"2024-09-22T09:50:47.554709+0000","last_fullsized":"2024-09-22T09:50:47.554709+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:50.004004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.100718+0000","last_change":"2024-09-22T09:54:56.100718+0000","last_active":"2024-09-22T09:54:56.100718+0000","last_peered":"2024-09-22T09:54:56.100718+0000","last_clean":"2024-09-22T09:54:56.100718+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:54:56.100718+0000","last_undegraded":"2024-09-22T09:54:56.100718+0000","last_fullsized":"2024-09-22T09:54:56.100718+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.100608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:54.172117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'10","reported_seq":73,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:13.905312+0000","last_change":"2024-09-22T09:01:07.463084+0000","last_active":"2024-09-22T09:54:13.905312+0000","last_peered":"2024-09-22T09:54:13.905312+0000","last_clean":"2024-09-22T09:54:13.905312+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:54:13.905312+0000","last_undegraded":"2024-09-22T09:54:13.905312+0000","last_fullsized":"2024-09-22T09:54:13.905312+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":185,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:47.660425+0000","last_change":"2024-09-22T08:57:04.398351+0000","last_active":"2024-09-22T09:50:47.660425+0000","last_peered":"2024-09-22T09:50:47.660425+0000","last_clean":"2024-09-22T09:50:47.660425+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:50:47.660425+0000","last_undegraded":"2024-09-22T09:50:47.660425+0000","last_fullsized":"2024-09-22T09:50:47.660425+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:13.677997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.611829+0000","last_change":"2024-09-22T09:54:48.611757+0000","last_active":"2024-09-22T09:54:48.611829+0000","last_peered":"2024-09-22T09:54:48.611829+0000","last_clean":"2024-09-22T09:54:48.611829+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:54:48.611829+0000","last_undegraded":"2024-09-22T09:54:48.611829+0000","last_fullsized":"2024-09-22T09:54:48.611829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.611658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:49.681099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659927+0000","last_change":"2024-09-22T09:01:11.519317+0000","last_active":"2024-09-22T09:50:42.659927+0000","last_peered":"2024-09-22T09:50:42.659927+0000","last_clean":"2024-09-22T09:50:42.659927+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:50:42.659927+0000","last_undegraded":"2024-09-22T09:50:42.659927+0000","last_fullsized":"2024-09-22T09:50:42.659927+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:04.677583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.520944+0000","last_change":"2024-09-22T09:01:07.465206+0000","last_active":"2024-09-22T09:50:37.520944+0000","last_peered":"2024-09-22T09:50:37.520944+0000","last_clean":"2024-09-22T09:50:37.520944+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:50:37.520944+0000","last_undegraded":"2024-09-22T09:50:37.520944+0000","last_fullsized":"2024-09-22T09:50:37.520944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:37:05.815467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":255,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663642+0000","last_change":"2024-09-22T08:57:04.406573+0000","last_active":"2024-09-22T09:51:12.663642+0000","last_peered":"2024-09-22T09:51:12.663642+0000","last_clean":"2024-09-22T09:51:12.663642+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:51:12.663642+0000","last_undegraded":"2024-09-22T09:51:12.663642+0000","last_fullsized":"2024-09-22T09:51:12.663642+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:14.641787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531012+0000","last_change":"2024-09-22T09:20:12.873102+0000","last_active":"2024-09-22T09:51:42.531012+0000","last_peered":"2024-09-22T09:51:42.531012+0000","last_clean":"2024-09-22T09:51:42.531012+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:51:42.531012+0000","last_undegraded":"2024-09-22T09:51:42.531012+0000","last_fullsized":"2024-09-22T09:51:42.531012+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:58:59.598126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:57.677847+0000","last_change":"2024-09-22T09:01:11.519963+0000","last_active":"2024-09-22T09:52:57.677847+0000","last_peered":"2024-09-22T09:52:57.677847+0000","last_clean":"2024-09-22T09:52:57.677847+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:52:57.677847+0000","last_undegraded":"2024-09-22T09:52:57.677847+0000","last_fullsized":"2024-09-22T09:52:57.677847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:05:24.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.590009+0000","last_change":"2024-09-22T09:54:44.590009+0000","last_active":"2024-09-22T09:54:44.590009+0000","last_peered":"2024-09-22T09:54:44.590009+0000","last_clean":"2024-09-22T09:54:44.590009+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:54:44.590009+0000","last_undegraded":"2024-09-22T09:54:44.590009+0000","last_fullsized":"2024-09-22T09:54:44.590009+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.589913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:27.637824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.352830+0000","last_change":"2024-09-22T09:54:57.352830+0000","last_active":"2024-09-22T09:54:57.352830+0000","last_peered":"2024-09-22T09:54:57.352830+0000","last_clean":"2024-09-22T09:54:57.352830+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:54:57.352830+0000","last_undegraded":"2024-09-22T09:54:57.352830+0000","last_fullsized":"2024-09-22T09:54:57.352830+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.352681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:17.910423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.060130+0000","last_change":"2024-09-22T09:54:57.060130+0000","last_active":"2024-09-22T09:54:57.060130+0000","last_peered":"2024-09-22T09:54:57.060130+0000","last_clean":"2024-09-22T09:54:57.060130+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:54:57.060130+0000","last_undegraded":"2024-09-22T09:54:57.060130+0000","last_fullsized":"2024-09-22T09:54:57.060130+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:35.936019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'8","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.261452+0000","last_change":"2024-09-22T09:54:57.261452+0000","last_active":"2024-09-22T09:54:57.261452+0000","last_peered":"2024-09-22T09:54:57.261452+0000","last_clean":"2024-09-22T09:54:57.261452+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:54:57.261452+0000","last_undegraded":"2024-09-22T09:54:57.261452+0000","last_fullsized":"2024-09-22T09:54:57.261452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.261350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:48:28.814513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6192,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.677278+0000","last_change":"2024-09-22T09:01:07.462730+0000","last_active":"2024-09-22T09:52:52.677278+0000","last_peered":"2024-09-22T09:52:52.677278+0000","last_clean":"2024-09-22T09:52:52.677278+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:52:52.677278+0000","last_undegraded":"2024-09-22T09:52:52.677278+0000","last_fullsized":"2024-09-22T09:52:52.677278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:30:50.017452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.080377+0000","last_change":"2024-09-22T09:54:50.080377+0000","last_active":"2024-09-22T09:54:50.080377+0000","last_peered":"2024-09-22T09:54:50.080377+0000","last_clean":"2024-09-22T09:54:50.080377+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:54:50.080377+0000","last_undegraded":"2024-09-22T09:54:50.080377+0000","last_fullsized":"2024-09-22T09:54:50.080377+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.080269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:27:02.040573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:42.540658+0000","last_change":"2024-09-22T09:20:12.875209+0000","last_active":"2024-09-22T09:52:42.540658+0000","last_peered":"2024-09-22T09:52:42.540658+0000","last_clean":"2024-09-22T09:52:42.540658+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:52:42.540658+0000","last_undegraded":"2024-09-22T09:52:42.540658+0000","last_fullsized":"2024-09-22T09:52:42.540658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":46,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:42.659947+0000","last_change":"2024-09-22T09:01:11.512263+0000","last_active":"2024-09-22T09:50:42.659947+0000","last_peered":"2024-09-22T09:50:42.659947+0000","last_clean":"2024-09-22T09:50:42.659947+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:50:42.659947+0000","last_undegraded":"2024-09-22T09:50:42.659947+0000","last_fullsized":"2024-09-22T09:50:42.659947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:56:05.855438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'2","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.164358+0000","last_change":"2024-09-22T09:54:53.164358+0000","last_active":"2024-09-22T09:54:53.164358+0000","last_peered":"2024-09-22T09:54:53.164358+0000","last_clean":"2024-09-22T09:54:53.164358+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:54:53.164358+0000","last_undegraded":"2024-09-22T09:54:53.164358+0000","last_fullsized":"2024-09-22T09:54:53.164358+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.164249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:04.104785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.589417+0000","last_change":"2024-09-22T09:54:40.589417+0000","last_active":"2024-09-22T09:54:40.589417+0000","last_peered":"2024-09-22T09:54:40.589417+0000","last_clean":"2024-09-22T09:54:40.589417+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:54:40.589417+0000","last_undegraded":"2024-09-22T09:54:40.589417+0000","last_fullsized":"2024-09-22T09:54:40.589417+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.589282+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:15.376697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'9","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.575471+0000","last_change":"2024-09-22T09:01:11.514899+0000","last_active":"2024-09-22T09:53:12.575471+0000","last_peered":"2024-09-22T09:53:12.575471+0000","last_clean":"2024-09-22T09:53:12.575471+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:53:12.575471+0000","last_undegraded":"2024-09-22T09:53:12.575471+0000","last_fullsized":"2024-09-22T09:53:12.575471+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:44.933155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.661857+0000","last_change":"2024-09-22T09:01:07.462014+0000","last_active":"2024-09-22T09:50:57.661857+0000","last_peered":"2024-09-22T09:50:57.661857+0000","last_clean":"2024-09-22T09:50:57.661857+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:50:57.661857+0000","last_undegraded":"2024-09-22T09:50:57.661857+0000","last_fullsized":"2024-09-22T09:50:57.661857+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:39.195175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.290995+0000","last_change":"2024-09-22T09:54:57.290995+0000","last_active":"2024-09-22T09:54:57.290995+0000","last_peered":"2024-09-22T09:54:57.290995+0000","last_clean":"2024-09-22T09:54:57.290995+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:54:57.290995+0000","last_undegraded":"2024-09-22T09:54:57.290995+0000","last_fullsized":"2024-09-22T09:54:57.290995+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.290907+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:20.219111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:47.531957+0000","last_change":"2024-09-22T09:20:12.874771+0000","last_active":"2024-09-22T09:51:47.531957+0000","last_peered":"2024-09-22T09:51:47.531957+0000","last_clean":"2024-09-22T09:51:47.531957+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:51:47.531957+0000","last_undegraded":"2024-09-22T09:51:47.531957+0000","last_fullsized":"2024-09-22T09:51:47.531957+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:14:58.784990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524824+0000","last_change":"2024-09-22T09:01:11.520442+0000","last_active":"2024-09-22T09:51:02.524824+0000","last_peered":"2024-09-22T09:51:02.524824+0000","last_clean":"2024-09-22T09:51:02.524824+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:51:02.524824+0000","last_undegraded":"2024-09-22T09:51:02.524824+0000","last_fullsized":"2024-09-22T09:51:02.524824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:13:56.004057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'5","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.141650+0000","last_change":"2024-09-22T09:54:52.141650+0000","last_active":"2024-09-22T09:54:52.141650+0000","last_peered":"2024-09-22T09:54:52.141650+0000","last_clean":"2024-09-22T09:54:52.141650+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:54:52.141650+0000","last_undegraded":"2024-09-22T09:54:52.141650+0000","last_fullsized":"2024-09-22T09:54:52.141650+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.141552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:05.815167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.636984+0000","last_change":"2024-09-22T09:54:55.636984+0000","last_active":"2024-09-22T09:54:55.636984+0000","last_peered":"2024-09-22T09:54:55.636984+0000","last_clean":"2024-09-22T09:54:55.636984+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:54:55.636984+0000","last_undegraded":"2024-09-22T09:54:55.636984+0000","last_fullsized":"2024-09-22T09:54:55.636984+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'16","last_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_deep_scrub":"259'16","last_deep_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.636899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:23.577414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.531034+0000","last_change":"2024-09-22T09:20:12.870433+0000","last_active":"2024-09-22T09:51:42.531034+0000","last_peered":"2024-09-22T09:51:42.531034+0000","last_clean":"2024-09-22T09:51:42.531034+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:51:42.531034+0000","last_undegraded":"2024-09-22T09:51:42.531034+0000","last_fullsized":"2024-09-22T09:51:42.531034+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:14:28.107605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.213978+0000","last_change":"2024-09-22T09:54:56.213978+0000","last_active":"2024-09-22T09:54:56.213978+0000","last_peered":"2024-09-22T09:54:56.213978+0000","last_clean":"2024-09-22T09:54:56.213978+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:54:56.213978+0000","last_undegraded":"2024-09-22T09:54:56.213978+0000","last_fullsized":"2024-09-22T09:54:56.213978+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.213880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:10.951353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'14","reported_seq":85,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:12.680090+0000","last_change":"2024-09-22T09:01:07.461182+0000","last_active":"2024-09-22T09:53:12.680090+0000","last_peered":"2024-09-22T09:53:12.680090+0000","last_clean":"2024-09-22T09:53:12.680090+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:53:12.680090+0000","last_undegraded":"2024-09-22T09:53:12.680090+0000","last_fullsized":"2024-09-22T09:53:12.680090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:17.994245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32770,"num_write":29,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":209,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664151+0000","last_change":"2024-09-22T08:57:04.400236+0000","last_active":"2024-09-22T09:51:17.664151+0000","last_peered":"2024-09-22T09:51:17.664151+0000","last_clean":"2024-09-22T09:51:17.664151+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:51:17.664151+0000","last_undegraded":"2024-09-22T09:51:17.664151+0000","last_fullsized":"2024-09-22T09:51:17.664151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:07.886442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667970+0000","last_change":"2024-09-22T09:20:12.876893+0000","last_active":"2024-09-22T09:51:42.667970+0000","last_peered":"2024-09-22T09:51:42.667970+0000","last_clean":"2024-09-22T09:51:42.667970+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:51:42.667970+0000","last_undegraded":"2024-09-22T09:51:42.667970+0000","last_fullsized":"2024-09-22T09:51:42.667970+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:03:26.407091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'2","reported_seq":50,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:22.546212+0000","last_change":"2024-09-22T09:01:11.514098+0000","last_active":"2024-09-22T09:53:22.546212+0000","last_peered":"2024-09-22T09:53:22.546212+0000","last_clean":"2024-09-22T09:53:22.546212+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:53:22.546212+0000","last_undegraded":"2024-09-22T09:53:22.546212+0000","last_fullsized":"2024-09-22T09:53:22.546212+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:32.880714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:37.553218+0000","last_change":"2024-09-22T09:01:07.460716+0000","last_active":"2024-09-22T09:50:37.553218+0000","last_peered":"2024-09-22T09:50:37.553218+0000","last_clean":"2024-09-22T09:50:37.553218+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:50:37.553218+0000","last_undegraded":"2024-09-22T09:50:37.553218+0000","last_fullsized":"2024-09-22T09:50:37.553218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:57:54.494945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":82,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.044365+0000","last_change":"2024-09-22T09:54:48.044365+0000","last_active":"2024-09-22T09:54:48.044365+0000","last_peered":"2024-09-22T09:54:48.044365+0000","last_clean":"2024-09-22T09:54:48.044365+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:54:48.044365+0000","last_undegraded":"2024-09-22T09:54:48.044365+0000","last_fullsized":"2024-09-22T09:54:48.044365+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.044281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:08.840441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.528690+0000","last_change":"2024-09-22T09:20:12.874797+0000","last_active":"2024-09-22T09:51:27.528690+0000","last_peered":"2024-09-22T09:51:27.528690+0000","last_clean":"2024-09-22T09:51:27.528690+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:51:27.528690+0000","last_undegraded":"2024-09-22T09:51:27.528690+0000","last_fullsized":"2024-09-22T09:51:27.528690+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:06:15.060146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":48,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664683+0000","last_change":"2024-09-22T09:01:11.515135+0000","last_active":"2024-09-22T09:51:17.664683+0000","last_peered":"2024-09-22T09:51:17.664683+0000","last_clean":"2024-09-22T09:51:17.664683+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:51:17.664683+0000","last_undegraded":"2024-09-22T09:51:17.664683+0000","last_fullsized":"2024-09-22T09:51:17.664683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:09.017769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525619+0000","last_change":"2024-09-22T09:01:07.459656+0000","last_active":"2024-09-22T09:51:07.525619+0000","last_peered":"2024-09-22T09:51:07.525619+0000","last_clean":"2024-09-22T09:51:07.525619+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:51:07.525619+0000","last_undegraded":"2024-09-22T09:51:07.525619+0000","last_fullsized":"2024-09-22T09:51:07.525619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:30:22.590289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":174,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664776+0000","last_change":"2024-09-22T08:57:04.403735+0000","last_active":"2024-09-22T09:51:17.664776+0000","last_peered":"2024-09-22T09:51:17.664776+0000","last_clean":"2024-09-22T09:51:17.664776+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:51:17.664776+0000","last_undegraded":"2024-09-22T09:51:17.664776+0000","last_fullsized":"2024-09-22T09:51:17.664776+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:46.765073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.686646+0000","last_change":"2024-09-22T09:20:12.873094+0000","last_active":"2024-09-22T09:51:27.686646+0000","last_peered":"2024-09-22T09:51:27.686646+0000","last_clean":"2024-09-22T09:51:27.686646+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:51:27.686646+0000","last_undegraded":"2024-09-22T09:51:27.686646+0000","last_fullsized":"2024-09-22T09:51:27.686646+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:02.780015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.680915+0000","last_change":"2024-09-22T09:01:11.518385+0000","last_active":"2024-09-22T09:53:17.680915+0000","last_peered":"2024-09-22T09:53:17.680915+0000","last_clean":"2024-09-22T09:53:17.680915+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:53:17.680915+0000","last_undegraded":"2024-09-22T09:53:17.680915+0000","last_fullsized":"2024-09-22T09:53:17.680915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:35.079376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.616296+0000","last_change":"2024-09-22T09:54:43.616296+0000","last_active":"2024-09-22T09:54:43.616296+0000","last_peered":"2024-09-22T09:54:43.616296+0000","last_clean":"2024-09-22T09:54:43.616296+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:54:43.616296+0000","last_undegraded":"2024-09-22T09:54:43.616296+0000","last_fullsized":"2024-09-22T09:54:43.616296+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.616202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:24.035439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.060358+0000","last_change":"2024-09-22T09:54:49.060358+0000","last_active":"2024-09-22T09:54:49.060358+0000","last_peered":"2024-09-22T09:54:49.060358+0000","last_clean":"2024-09-22T09:54:49.060358+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:54:49.060358+0000","last_undegraded":"2024-09-22T09:54:49.060358+0000","last_fullsized":"2024-09-22T09:54:49.060358+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.060271+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:07.985627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:22.442726+0000","last_change":"2024-09-22T09:20:12.867808+0000","last_active":"2024-09-22T09:52:22.442726+0000","last_peered":"2024-09-22T09:52:22.442726+0000","last_clean":"2024-09-22T09:52:22.442726+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:52:22.442726+0000","last_undegraded":"2024-09-22T09:52:22.442726+0000","last_fullsized":"2024-09-22T09:52:22.442726+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.524973+0000","last_change":"2024-09-22T09:01:11.504874+0000","last_active":"2024-09-22T09:51:02.524973+0000","last_peered":"2024-09-22T09:51:02.524973+0000","last_clean":"2024-09-22T09:51:02.524973+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:51:02.524973+0000","last_undegraded":"2024-09-22T09:51:02.524973+0000","last_fullsized":"2024-09-22T09:51:02.524973+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:03:57.767979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.682038+0000","last_change":"2024-09-22T09:01:07.462925+0000","last_active":"2024-09-22T09:50:57.682038+0000","last_peered":"2024-09-22T09:50:57.682038+0000","last_clean":"2024-09-22T09:50:57.682038+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:50:57.682038+0000","last_undegraded":"2024-09-22T09:50:57.682038+0000","last_fullsized":"2024-09-22T09:50:57.682038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:14:28.085094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.632934+0000","last_change":"2024-09-22T09:54:56.632934+0000","last_active":"2024-09-22T09:54:56.632934+0000","last_peered":"2024-09-22T09:54:56.632934+0000","last_clean":"2024-09-22T09:54:56.632934+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:54:56.632934+0000","last_undegraded":"2024-09-22T09:54:56.632934+0000","last_fullsized":"2024-09-22T09:54:56.632934+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.632844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:02.629215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.560215+0000","last_change":"2024-09-22T09:20:12.872736+0000","last_active":"2024-09-22T09:51:27.560215+0000","last_peered":"2024-09-22T09:51:27.560215+0000","last_clean":"2024-09-22T09:51:27.560215+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:51:27.560215+0000","last_undegraded":"2024-09-22T09:51:27.560215+0000","last_fullsized":"2024-09-22T09:51:27.560215+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:44.046049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":47,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:02.556902+0000","last_change":"2024-09-22T09:01:11.514873+0000","last_active":"2024-09-22T09:51:02.556902+0000","last_peered":"2024-09-22T09:51:02.556902+0000","last_clean":"2024-09-22T09:51:02.556902+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:51:02.556902+0000","last_undegraded":"2024-09-22T09:51:02.556902+0000","last_fullsized":"2024-09-22T09:51:02.556902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:23.901178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:50:57.524176+0000","last_change":"2024-09-22T09:01:07.465221+0000","last_active":"2024-09-22T09:50:57.524176+0000","last_peered":"2024-09-22T09:50:57.524176+0000","last_clean":"2024-09-22T09:50:57.524176+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:50:57.524176+0000","last_undegraded":"2024-09-22T09:50:57.524176+0000","last_fullsized":"2024-09-22T09:50:57.524176+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:20.088192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.195435+0000","last_change":"2024-09-22T09:54:48.195435+0000","last_active":"2024-09-22T09:54:48.195435+0000","last_peered":"2024-09-22T09:54:48.195435+0000","last_clean":"2024-09-22T09:54:48.195435+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:54:48.195435+0000","last_undegraded":"2024-09-22T09:54:48.195435+0000","last_fullsized":"2024-09-22T09:54:48.195435+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.195335+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:58.456901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.591719+0000","last_change":"2024-09-22T09:54:47.591661+0000","last_active":"2024-09-22T09:54:47.591719+0000","last_peered":"2024-09-22T09:54:47.591719+0000","last_clean":"2024-09-22T09:54:47.591719+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:54:47.591719+0000","last_undegraded":"2024-09-22T09:54:47.591719+0000","last_fullsized":"2024-09-22T09:54:47.591719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.591568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:58.864458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.176665+0000","last_change":"2024-09-22T09:54:55.176665+0000","last_active":"2024-09-22T09:54:55.176665+0000","last_peered":"2024-09-22T09:54:55.176665+0000","last_clean":"2024-09-22T09:54:55.176665+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:54:55.176665+0000","last_undegraded":"2024-09-22T09:54:55.176665+0000","last_fullsized":"2024-09-22T09:54:55.176665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.176572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:04.433248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527097+0000","last_change":"2024-09-22T09:01:07.464119+0000","last_active":"2024-09-22T09:51:17.527097+0000","last_peered":"2024-09-22T09:51:17.527097+0000","last_clean":"2024-09-22T09:51:17.527097+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:51:17.527097+0000","last_undegraded":"2024-09-22T09:51:17.527097+0000","last_fullsized":"2024-09-22T09:51:17.527097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:52.183054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":146,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.685064+0000","last_change":"2024-09-22T08:57:04.399468+0000","last_active":"2024-09-22T09:51:17.685064+0000","last_peered":"2024-09-22T09:51:17.685064+0000","last_clean":"2024-09-22T09:51:17.685064+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:51:17.685064+0000","last_undegraded":"2024-09-22T09:51:17.685064+0000","last_fullsized":"2024-09-22T09:51:17.685064+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:34.025187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:42.675607+0000","last_change":"2024-09-22T09:20:12.877252+0000","last_active":"2024-09-22T09:52:42.675607+0000","last_peered":"2024-09-22T09:52:42.675607+0000","last_clean":"2024-09-22T09:52:42.675607+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:52:42.675607+0000","last_undegraded":"2024-09-22T09:52:42.675607+0000","last_fullsized":"2024-09-22T09:52:42.675607+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.684990+0000","last_change":"2024-09-22T09:01:11.511636+0000","last_active":"2024-09-22T09:51:17.684990+0000","last_peered":"2024-09-22T09:51:17.684990+0000","last_clean":"2024-09-22T09:51:17.684990+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:51:17.684990+0000","last_undegraded":"2024-09-22T09:51:17.684990+0000","last_fullsized":"2024-09-22T09:51:17.684990+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:10:52.929028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:07.525556+0000","last_change":"2024-09-22T09:01:07.464938+0000","last_active":"2024-09-22T09:51:07.525556+0000","last_peered":"2024-09-22T09:51:07.525556+0000","last_clean":"2024-09-22T09:51:07.525556+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:51:07.525556+0000","last_undegraded":"2024-09-22T09:51:07.525556+0000","last_fullsized":"2024-09-22T09:51:07.525556+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:06.429720+0000","last_clean_scrub_stamp":"2024-09-22T09:01:06.429720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:21:26.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":133,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.591055+0000","last_change":"2024-09-22T09:54:54.591055+0000","last_active":"2024-09-22T09:54:54.591055+0000","last_peered":"2024-09-22T09:54:54.591055+0000","last_clean":"2024-09-22T09:54:54.591055+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:54:54.591055+0000","last_undegraded":"2024-09-22T09:54:54.591055+0000","last_fullsized":"2024-09-22T09:54:54.591055+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.590974+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:49.440381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:27.665899+0000","last_change":"2024-09-22T09:20:12.875675+0000","last_active":"2024-09-22T09:51:27.665899+0000","last_peered":"2024-09-22T09:51:27.665899+0000","last_clean":"2024-09-22T09:51:27.665899+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:51:27.665899+0000","last_undegraded":"2024-09-22T09:51:27.665899+0000","last_fullsized":"2024-09-22T09:51:27.665899+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:42.424738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.070211+0000","last_change":"2024-09-22T09:54:53.070211+0000","last_active":"2024-09-22T09:54:53.070211+0000","last_peered":"2024-09-22T09:54:53.070211+0000","last_clean":"2024-09-22T09:54:53.070211+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:54:53.070211+0000","last_undegraded":"2024-09-22T09:54:53.070211+0000","last_fullsized":"2024-09-22T09:54:53.070211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.070103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:14.514297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.159120+0000","last_change":"2024-09-22T09:54:51.159120+0000","last_active":"2024-09-22T09:54:51.159120+0000","last_peered":"2024-09-22T09:54:51.159120+0000","last_clean":"2024-09-22T09:54:51.159120+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:54:51.159120+0000","last_undegraded":"2024-09-22T09:54:51.159120+0000","last_fullsized":"2024-09-22T09:54:51.159120+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.159033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:48.125155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.070001+0000","last_change":"2024-09-22T09:54:47.070001+0000","last_active":"2024-09-22T09:54:47.070001+0000","last_peered":"2024-09-22T09:54:47.070001+0000","last_clean":"2024-09-22T09:54:47.070001+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:54:47.070001+0000","last_undegraded":"2024-09-22T09:54:47.070001+0000","last_fullsized":"2024-09-22T09:54:47.070001+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.069893+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:47.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:32.529417+0000","last_change":"2024-09-22T09:20:12.876371+0000","last_active":"2024-09-22T09:51:32.529417+0000","last_peered":"2024-09-22T09:51:32.529417+0000","last_clean":"2024-09-22T09:51:32.529417+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:51:32.529417+0000","last_undegraded":"2024-09-22T09:51:32.529417+0000","last_fullsized":"2024-09-22T09:51:32.529417+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:40.688186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":52,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:17.576360+0000","last_change":"2024-09-22T09:01:11.508099+0000","last_active":"2024-09-22T09:53:17.576360+0000","last_peered":"2024-09-22T09:53:17.576360+0000","last_clean":"2024-09-22T09:53:17.576360+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:53:17.576360+0000","last_undegraded":"2024-09-22T09:53:17.576360+0000","last_fullsized":"2024-09-22T09:53:17.576360+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:50.149277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'10","reported_seq":85,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.043090+0000","last_change":"2024-09-22T09:54:54.043090+0000","last_active":"2024-09-22T09:54:54.043090+0000","last_peered":"2024-09-22T09:54:54.043090+0000","last_clean":"2024-09-22T09:54:54.043090+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:54:54.043090+0000","last_undegraded":"2024-09-22T09:54:54.043090+0000","last_fullsized":"2024-09-22T09:54:54.043090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.043004+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:50.731747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25607,"num_write":10,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":238,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.527117+0000","last_change":"2024-09-22T08:57:04.396165+0000","last_active":"2024-09-22T09:51:17.527117+0000","last_peered":"2024-09-22T09:51:17.527117+0000","last_clean":"2024-09-22T09:51:17.527117+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:51:17.527117+0000","last_undegraded":"2024-09-22T09:51:17.527117+0000","last_fullsized":"2024-09-22T09:51:17.527117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:57:03.347503+0000","last_clean_scrub_stamp":"2024-09-22T08:57:03.347503+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:07:38.802564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'215","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.577099+0000","last_change":"2024-09-22T09:54:31.577099+0000","last_active":"2024-09-22T09:54:31.577099+0000","last_peered":"2024-09-22T09:54:31.577099+0000","last_clean":"2024-09-22T09:54:31.577099+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:54:31.577099+0000","last_undegraded":"2024-09-22T09:54:31.577099+0000","last_fullsized":"2024-09-22T09:54:31.577099+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'215","last_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_deep_scrub":"262'215","last_deep_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.576998+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:44.998984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":13876,"num_write":999,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'142","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.412304+0000","last_change":"2024-09-22T09:54:38.412245+0000","last_active":"2024-09-22T09:54:38.412304+0000","last_peered":"2024-09-22T09:54:38.412304+0000","last_clean":"2024-09-22T09:54:38.412304+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:54:38.412304+0000","last_undegraded":"2024-09-22T09:54:38.412304+0000","last_fullsized":"2024-09-22T09:54:38.412304+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.412165+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.712245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'143","reported_seq":807,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.231015+0000","last_change":"2024-09-22T09:54:24.231015+0000","last_active":"2024-09-22T09:54:24.231015+0000","last_peered":"2024-09-22T09:54:24.231015+0000","last_clean":"2024-09-22T09:54:24.231015+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:54:24.231015+0000","last_undegraded":"2024-09-22T09:54:24.231015+0000","last_fullsized":"2024-09-22T09:54:24.231015+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.230885+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:36.854502+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":432,"num_read_kb":103374,"num_write":683,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.607885+0000","last_change":"2024-09-22T09:54:37.607829+0000","last_active":"2024-09-22T09:54:37.607885+0000","last_peered":"2024-09-22T09:54:37.607885+0000","last_clean":"2024-09-22T09:54:37.607885+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:54:37.607885+0000","last_undegraded":"2024-09-22T09:54:37.607885+0000","last_fullsized":"2024-09-22T09:54:37.607885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'77","last_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_deep_scrub":"262'77","last_deep_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.607734+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:59.160167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'209","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.013430+0000","last_change":"2024-09-22T09:54:28.013430+0000","last_active":"2024-09-22T09:54:28.013430+0000","last_peered":"2024-09-22T09:54:28.013430+0000","last_clean":"2024-09-22T09:54:28.013430+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:54:28.013430+0000","last_undegraded":"2024-09-22T09:54:28.013430+0000","last_fullsized":"2024-09-22T09:54:28.013430+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.013255+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:24.596859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":4356,"num_write":984,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.677030+0000","last_change":"2024-09-22T09:54:37.676977+0000","last_active":"2024-09-22T09:54:37.677030+0000","last_peered":"2024-09-22T09:54:37.677030+0000","last_clean":"2024-09-22T09:54:37.677030+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:54:37.677030+0000","last_undegraded":"2024-09-22T09:54:37.677030+0000","last_fullsized":"2024-09-22T09:54:37.677030+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.676887+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:21.391589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'211","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.380352+0000","last_change":"2024-09-22T09:54:33.380352+0000","last_active":"2024-09-22T09:54:33.380352+0000","last_peered":"2024-09-22T09:54:33.380352+0000","last_clean":"2024-09-22T09:54:33.380352+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:54:33.380352+0000","last_undegraded":"2024-09-22T09:54:33.380352+0000","last_fullsized":"2024-09-22T09:54:33.380352+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.380242+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:52.978925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":600,"num_read_kb":1083,"num_write":1003,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.063066+0000","last_change":"2024-09-22T09:54:37.063002+0000","last_active":"2024-09-22T09:54:37.063066+0000","last_peered":"2024-09-22T09:54:37.063066+0000","last_clean":"2024-09-22T09:54:37.063066+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:54:37.063066+0000","last_undegraded":"2024-09-22T09:54:37.063066+0000","last_fullsized":"2024-09-22T09:54:37.063066+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'351","last_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_deep_scrub":"262'351","last_deep_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.062905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:49.568320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'204","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.546105+0000","last_change":"2024-09-22T09:54:28.546046+0000","last_active":"2024-09-22T09:54:28.546105+0000","last_peered":"2024-09-22T09:54:28.546105+0000","last_clean":"2024-09-22T09:54:28.546105+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:54:28.546105+0000","last_undegraded":"2024-09-22T09:54:28.546105+0000","last_fullsized":"2024-09-22T09:54:28.546105+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.545908+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:30.243289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":570,"num_read_kb":6282,"num_write":914,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.949036+0000","last_change":"2024-09-22T09:54:34.949036+0000","last_active":"2024-09-22T09:54:34.949036+0000","last_peered":"2024-09-22T09:54:34.949036+0000","last_clean":"2024-09-22T09:54:34.949036+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:54:34.949036+0000","last_undegraded":"2024-09-22T09:54:34.949036+0000","last_fullsized":"2024-09-22T09:54:34.949036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'106","last_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_deep_scrub":"262'106","last_deep_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.948920+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:26.051361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.423640+0000","last_change":"2024-09-22T09:54:30.423574+0000","last_active":"2024-09-22T09:54:30.423640+0000","last_peered":"2024-09-22T09:54:30.423640+0000","last_clean":"2024-09-22T09:54:30.423640+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:54:30.423640+0000","last_undegraded":"2024-09-22T09:54:30.423640+0000","last_fullsized":"2024-09-22T09:54:30.423640+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.423472+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:42.929221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":691,"num_read_kb":1734,"num_write":933,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4554","reported_seq":5331,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.602965+0000","last_change":"2024-09-22T09:54:39.602965+0000","last_active":"2024-09-22T09:54:39.602965+0000","last_peered":"2024-09-22T09:54:39.602965+0000","last_clean":"2024-09-22T09:54:39.602965+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:54:39.602965+0000","last_undegraded":"2024-09-22T09:54:39.602965+0000","last_fullsized":"2024-09-22T09:54:39.602965+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4554","last_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_deep_scrub":"262'4554","last_deep_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.602864+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":3000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:58.038441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26027,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'324","reported_seq":1036,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.569192+0000","last_change":"2024-09-22T09:54:30.569112+0000","last_active":"2024-09-22T09:54:30.569192+0000","last_peered":"2024-09-22T09:54:30.569192+0000","last_clean":"2024-09-22T09:54:30.569192+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:54:30.569192+0000","last_undegraded":"2024-09-22T09:54:30.569192+0000","last_fullsized":"2024-09-22T09:54:30.569192+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.568978+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:49:58.439696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":40392,"num_write":1278,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'118","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.338351+0000","last_change":"2024-09-22T09:54:40.338351+0000","last_active":"2024-09-22T09:54:40.338351+0000","last_peered":"2024-09-22T09:54:40.338351+0000","last_clean":"2024-09-22T09:54:40.338351+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:54:40.338351+0000","last_undegraded":"2024-09-22T09:54:40.338351+0000","last_fullsized":"2024-09-22T09:54:40.338351+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.338247+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:47.134708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'206","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.815019+0000","last_change":"2024-09-22T09:54:34.814919+0000","last_active":"2024-09-22T09:54:34.815019+0000","last_peered":"2024-09-22T09:54:34.815019+0000","last_clean":"2024-09-22T09:54:34.815019+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:54:34.815019+0000","last_undegraded":"2024-09-22T09:54:34.815019+0000","last_fullsized":"2024-09-22T09:54:34.815019+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.814749+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:27.535584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":708,"num_read_kb":60138,"num_write":928,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":825,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.622414+0000","last_change":"2024-09-22T09:54:30.622414+0000","last_active":"2024-09-22T09:54:30.622414+0000","last_peered":"2024-09-22T09:54:30.622414+0000","last_clean":"2024-09-22T09:54:30.622414+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:54:30.622414+0000","last_undegraded":"2024-09-22T09:54:30.622414+0000","last_fullsized":"2024-09-22T09:54:30.622414+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.622328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:28.359393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.679959+0000","last_change":"2024-09-22T09:54:35.679903+0000","last_active":"2024-09-22T09:54:35.679959+0000","last_peered":"2024-09-22T09:54:35.679959+0000","last_clean":"2024-09-22T09:54:35.679959+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:54:35.679959+0000","last_undegraded":"2024-09-22T09:54:35.679959+0000","last_fullsized":"2024-09-22T09:54:35.679959+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.679816+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:58:37.331041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'216","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.502853+0000","last_change":"2024-09-22T09:54:27.502790+0000","last_active":"2024-09-22T09:54:27.502853+0000","last_peered":"2024-09-22T09:54:27.502853+0000","last_clean":"2024-09-22T09:54:27.502853+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:54:27.502853+0000","last_undegraded":"2024-09-22T09:54:27.502853+0000","last_fullsized":"2024-09-22T09:54:27.502853+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'216","last_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_deep_scrub":"262'216","last_deep_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.502656+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:28.950343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":44934,"num_write":915,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.573561+0000","last_change":"2024-09-22T09:54:36.573483+0000","last_active":"2024-09-22T09:54:36.573561+0000","last_peered":"2024-09-22T09:54:36.573561+0000","last_clean":"2024-09-22T09:54:36.573561+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:54:36.573561+0000","last_undegraded":"2024-09-22T09:54:36.573561+0000","last_fullsized":"2024-09-22T09:54:36.573561+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.573367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:13.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'137","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.908255+0000","last_change":"2024-09-22T09:54:27.908195+0000","last_active":"2024-09-22T09:54:27.908255+0000","last_peered":"2024-09-22T09:54:27.908255+0000","last_clean":"2024-09-22T09:54:27.908255+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:54:27.908255+0000","last_undegraded":"2024-09-22T09:54:27.908255+0000","last_fullsized":"2024-09-22T09:54:27.908255+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.908076+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:25:43.835693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":4340,"num_write":703,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.342805+0000","last_change":"2024-09-22T09:54:36.342751+0000","last_active":"2024-09-22T09:54:36.342805+0000","last_peered":"2024-09-22T09:54:36.342805+0000","last_clean":"2024-09-22T09:54:36.342805+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:54:36.342805+0000","last_undegraded":"2024-09-22T09:54:36.342805+0000","last_fullsized":"2024-09-22T09:54:36.342805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.342669+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:11.894761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'200","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.931855+0000","last_change":"2024-09-22T09:54:28.931797+0000","last_active":"2024-09-22T09:54:28.931855+0000","last_peered":"2024-09-22T09:54:28.931855+0000","last_clean":"2024-09-22T09:54:28.931855+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:54:28.931855+0000","last_undegraded":"2024-09-22T09:54:28.931855+0000","last_fullsized":"2024-09-22T09:54:28.931855+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.931664+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:23.475431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":44793,"num_write":917,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'263","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.645932+0000","last_change":"2024-09-22T09:54:28.645828+0000","last_active":"2024-09-22T09:54:28.645932+0000","last_peered":"2024-09-22T09:54:28.645932+0000","last_clean":"2024-09-22T09:54:28.645932+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:54:28.645932+0000","last_undegraded":"2024-09-22T09:54:28.645932+0000","last_fullsized":"2024-09-22T09:54:28.645932+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.645693+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:27.752376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'208","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.766157+0000","last_change":"2024-09-22T09:54:23.766105+0000","last_active":"2024-09-22T09:54:23.766157+0000","last_peered":"2024-09-22T09:54:23.766157+0000","last_clean":"2024-09-22T09:54:23.766157+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:54:23.766157+0000","last_undegraded":"2024-09-22T09:54:23.766157+0000","last_fullsized":"2024-09-22T09:54:23.766157+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.765983+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:24.208701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":639,"num_write":1016,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'336","reported_seq":985,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.625494+0000","last_change":"2024-09-22T09:54:29.625420+0000","last_active":"2024-09-22T09:54:29.625494+0000","last_peered":"2024-09-22T09:54:29.625494+0000","last_clean":"2024-09-22T09:54:29.625494+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:54:29.625494+0000","last_undegraded":"2024-09-22T09:54:29.625494+0000","last_fullsized":"2024-09-22T09:54:29.625494+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.625322+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:56.414721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'231","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.834864+0000","last_change":"2024-09-22T09:54:28.834762+0000","last_active":"2024-09-22T09:54:28.834864+0000","last_peered":"2024-09-22T09:54:28.834864+0000","last_clean":"2024-09-22T09:54:28.834864+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:54:28.834864+0000","last_undegraded":"2024-09-22T09:54:28.834864+0000","last_fullsized":"2024-09-22T09:54:28.834864+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.834665+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:27.131540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":35016,"num_write":919,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'68","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.646773+0000","last_change":"2024-09-22T09:54:38.646721+0000","last_active":"2024-09-22T09:54:38.646773+0000","last_peered":"2024-09-22T09:54:38.646773+0000","last_clean":"2024-09-22T09:54:38.646773+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:54:38.646773+0000","last_undegraded":"2024-09-22T09:54:38.646773+0000","last_fullsized":"2024-09-22T09:54:38.646773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'68","last_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_deep_scrub":"262'68","last_deep_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.646631+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:11.600548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'204","reported_seq":1076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.044214+0000","last_change":"2024-09-22T09:54:27.044159+0000","last_active":"2024-09-22T09:54:27.044214+0000","last_peered":"2024-09-22T09:54:27.044214+0000","last_clean":"2024-09-22T09:54:27.044214+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:54:27.044214+0000","last_undegraded":"2024-09-22T09:54:27.044214+0000","last_fullsized":"2024-09-22T09:54:27.044214+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.044042+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:26.911985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1343,"num_read_kb":71433,"num_write":1020,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'129","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.611141+0000","last_change":"2024-09-22T09:54:55.611071+0000","last_active":"2024-09-22T09:54:55.611141+0000","last_peered":"2024-09-22T09:54:55.611141+0000","last_clean":"2024-09-22T09:54:55.611141+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:54:55.611141+0000","last_undegraded":"2024-09-22T09:54:55.611141+0000","last_fullsized":"2024-09-22T09:54:55.611141+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.610956+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:34.518683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":711,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886309+0000","last_change":"2024-09-22T09:54:32.886256+0000","last_active":"2024-09-22T09:54:32.886309+0000","last_peered":"2024-09-22T09:54:32.886309+0000","last_clean":"2024-09-22T09:54:32.886309+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:54:32.886309+0000","last_undegraded":"2024-09-22T09:54:32.886309+0000","last_fullsized":"2024-09-22T09:54:32.886309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886167+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:30.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'246","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.453792+0000","last_change":"2024-09-22T09:54:26.453733+0000","last_active":"2024-09-22T09:54:26.453792+0000","last_peered":"2024-09-22T09:54:26.453792+0000","last_clean":"2024-09-22T09:54:26.453792+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:54:26.453792+0000","last_undegraded":"2024-09-22T09:54:26.453792+0000","last_fullsized":"2024-09-22T09:54:26.453792+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.453584+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:12.566992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":724,"num_read_kb":75224,"num_write":1095,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.295856+0000","last_change":"2024-09-22T09:54:44.295796+0000","last_active":"2024-09-22T09:54:44.295856+0000","last_peered":"2024-09-22T09:54:44.295856+0000","last_clean":"2024-09-22T09:54:44.295856+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:54:44.295856+0000","last_undegraded":"2024-09-22T09:54:44.295856+0000","last_fullsized":"2024-09-22T09:54:44.295856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.295705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:40.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'220","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.066941+0000","last_change":"2024-09-22T09:54:44.066889+0000","last_active":"2024-09-22T09:54:44.066941+0000","last_peered":"2024-09-22T09:54:44.066941+0000","last_clean":"2024-09-22T09:54:44.066941+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:54:44.066941+0000","last_undegraded":"2024-09-22T09:54:44.066941+0000","last_fullsized":"2024-09-22T09:54:44.066941+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.066792+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:06.960949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":291,"num_read_kb":380,"num_write":172,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.570773+0000","last_change":"2024-09-22T09:54:51.570712+0000","last_active":"2024-09-22T09:54:51.570773+0000","last_peered":"2024-09-22T09:54:51.570773+0000","last_clean":"2024-09-22T09:54:51.570773+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:54:51.570773+0000","last_undegraded":"2024-09-22T09:54:51.570773+0000","last_fullsized":"2024-09-22T09:54:51.570773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.570620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:59.625436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'143","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.367581+0000","last_change":"2024-09-22T09:54:56.367581+0000","last_active":"2024-09-22T09:54:56.367581+0000","last_peered":"2024-09-22T09:54:56.367581+0000","last_clean":"2024-09-22T09:54:56.367581+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:54:56.367581+0000","last_undegraded":"2024-09-22T09:54:56.367581+0000","last_fullsized":"2024-09-22T09:54:56.367581+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.367482+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:19.773727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.356729+0000","last_change":"2024-09-22T09:54:34.356652+0000","last_active":"2024-09-22T09:54:34.356729+0000","last_peered":"2024-09-22T09:54:34.356729+0000","last_clean":"2024-09-22T09:54:34.356729+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:54:34.356729+0000","last_undegraded":"2024-09-22T09:54:34.356729+0000","last_fullsized":"2024-09-22T09:54:34.356729+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'241","last_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_deep_scrub":"262'241","last_deep_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.356567+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:12.922893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.085670+0000","last_change":"2024-09-22T09:54:21.085625+0000","last_active":"2024-09-22T09:54:21.085670+0000","last_peered":"2024-09-22T09:54:21.085670+0000","last_clean":"2024-09-22T09:54:21.085670+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:54:21.085670+0000","last_undegraded":"2024-09-22T09:54:21.085670+0000","last_fullsized":"2024-09-22T09:54:21.085670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.085544+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:19.372506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":43802,"num_write":911,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.706253+0000","last_change":"2024-09-22T09:54:44.706190+0000","last_active":"2024-09-22T09:54:44.706253+0000","last_peered":"2024-09-22T09:54:44.706253+0000","last_clean":"2024-09-22T09:54:44.706253+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:54:44.706253+0000","last_undegraded":"2024-09-22T09:54:44.706253+0000","last_fullsized":"2024-09-22T09:54:44.706253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.706103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.288230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'102","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.613924+0000","last_change":"2024-09-22T09:54:47.613835+0000","last_active":"2024-09-22T09:54:47.613924+0000","last_peered":"2024-09-22T09:54:47.613924+0000","last_clean":"2024-09-22T09:54:47.613924+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:54:47.613924+0000","last_undegraded":"2024-09-22T09:54:47.613924+0000","last_fullsized":"2024-09-22T09:54:47.613924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'102","last_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_deep_scrub":"262'102","last_deep_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.613723+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:07.426920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.610569+0000","last_change":"2024-09-22T09:54:51.610489+0000","last_active":"2024-09-22T09:54:51.610569+0000","last_peered":"2024-09-22T09:54:51.610569+0000","last_clean":"2024-09-22T09:54:51.610569+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:54:51.610569+0000","last_undegraded":"2024-09-22T09:54:51.610569+0000","last_fullsized":"2024-09-22T09:54:51.610569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.610373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:03.585252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'112","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.186599+0000","last_change":"2024-09-22T09:54:54.186548+0000","last_active":"2024-09-22T09:54:54.186599+0000","last_peered":"2024-09-22T09:54:54.186599+0000","last_clean":"2024-09-22T09:54:54.186599+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:54:54.186599+0000","last_undegraded":"2024-09-22T09:54:54.186599+0000","last_fullsized":"2024-09-22T09:54:54.186599+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.186462+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:40.537153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.045828+0000","last_change":"2024-09-22T09:54:31.045733+0000","last_active":"2024-09-22T09:54:31.045828+0000","last_peered":"2024-09-22T09:54:31.045828+0000","last_clean":"2024-09-22T09:54:31.045828+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:54:31.045828+0000","last_undegraded":"2024-09-22T09:54:31.045828+0000","last_fullsized":"2024-09-22T09:54:31.045828+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.045630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:36:20.196950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'246","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.640226+0000","last_change":"2024-09-22T09:54:21.640226+0000","last_active":"2024-09-22T09:54:21.640226+0000","last_peered":"2024-09-22T09:54:21.640226+0000","last_clean":"2024-09-22T09:54:21.640226+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:54:21.640226+0000","last_undegraded":"2024-09-22T09:54:21.640226+0000","last_fullsized":"2024-09-22T09:54:21.640226+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.640096+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.038690+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":41488,"num_write":1122,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"262'5","reported_seq":984,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.691015+0000","last_change":"2024-09-22T09:54:45.690912+0000","last_active":"2024-09-22T09:54:45.691015+0000","last_peered":"2024-09-22T09:54:45.691015+0000","last_clean":"2024-09-22T09:54:45.691015+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:45.691015+0000","last_undegraded":"2024-09-22T09:54:45.691015+0000","last_fullsized":"2024-09-22T09:54:45.691015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.690818+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:10.394599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'147","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.635381+0000","last_change":"2024-09-22T09:54:37.635267+0000","last_active":"2024-09-22T09:54:37.635381+0000","last_peered":"2024-09-22T09:54:37.635381+0000","last_clean":"2024-09-22T09:54:37.635381+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:54:37.635381+0000","last_undegraded":"2024-09-22T09:54:37.635381+0000","last_fullsized":"2024-09-22T09:54:37.635381+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.635149+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:19.442915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'747","reported_seq":2945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.596952+0000","last_change":"2024-09-22T09:54:50.596897+0000","last_active":"2024-09-22T09:54:50.596952+0000","last_peered":"2024-09-22T09:54:50.596952+0000","last_clean":"2024-09-22T09:54:50.596952+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:50.596952+0000","last_undegraded":"2024-09-22T09:54:50.596952+0000","last_fullsized":"2024-09-22T09:54:50.596952+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'747","last_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_deep_scrub":"262'747","last_deep_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.596813+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:33.365832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'220","reported_seq":1057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.645529+0000","last_change":"2024-09-22T09:54:56.645439+0000","last_active":"2024-09-22T09:54:56.645529+0000","last_peered":"2024-09-22T09:54:56.645529+0000","last_clean":"2024-09-22T09:54:56.645529+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:54:56.645529+0000","last_undegraded":"2024-09-22T09:54:56.645529+0000","last_fullsized":"2024-09-22T09:54:56.645529+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.645339+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:58.691212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.841822+0000","last_change":"2024-09-22T09:54:33.841700+0000","last_active":"2024-09-22T09:54:33.841822+0000","last_peered":"2024-09-22T09:54:33.841822+0000","last_clean":"2024-09-22T09:54:33.841822+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:54:33.841822+0000","last_undegraded":"2024-09-22T09:54:33.841822+0000","last_fullsized":"2024-09-22T09:54:33.841822+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'126","last_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_deep_scrub":"262'126","last_deep_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.841584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:42.546104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'178","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.765183+0000","last_change":"2024-09-22T09:54:22.765090+0000","last_active":"2024-09-22T09:54:22.765183+0000","last_peered":"2024-09-22T09:54:22.765183+0000","last_clean":"2024-09-22T09:54:22.765183+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:54:22.765183+0000","last_undegraded":"2024-09-22T09:54:22.765183+0000","last_fullsized":"2024-09-22T09:54:22.765183+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'178","last_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_deep_scrub":"262'178","last_deep_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.764975+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:45.588343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":49818,"num_write":846,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.314863+0000","last_change":"2024-09-22T09:54:41.314799+0000","last_active":"2024-09-22T09:54:41.314863+0000","last_peered":"2024-09-22T09:54:41.314863+0000","last_clean":"2024-09-22T09:54:41.314863+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:54:41.314863+0000","last_undegraded":"2024-09-22T09:54:41.314863+0000","last_fullsized":"2024-09-22T09:54:41.314863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.314713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:29.075728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'155","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.591755+0000","last_change":"2024-09-22T09:54:45.591689+0000","last_active":"2024-09-22T09:54:45.591755+0000","last_peered":"2024-09-22T09:54:45.591755+0000","last_clean":"2024-09-22T09:54:45.591755+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:54:45.591755+0000","last_undegraded":"2024-09-22T09:54:45.591755+0000","last_fullsized":"2024-09-22T09:54:45.591755+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.591608+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:04.286884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":274,"num_write":110,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'756","reported_seq":2410,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.693901+0000","last_change":"2024-09-22T09:54:55.693845+0000","last_active":"2024-09-22T09:54:55.693901+0000","last_peered":"2024-09-22T09:54:55.693901+0000","last_clean":"2024-09-22T09:54:55.693901+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:55.693901+0000","last_undegraded":"2024-09-22T09:54:55.693901+0000","last_fullsized":"2024-09-22T09:54:55.693901+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.693756+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:43.607812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.420090+0000","last_change":"2024-09-22T09:54:32.420090+0000","last_active":"2024-09-22T09:54:32.420090+0000","last_peered":"2024-09-22T09:54:32.420090+0000","last_clean":"2024-09-22T09:54:32.420090+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:54:32.420090+0000","last_undegraded":"2024-09-22T09:54:32.420090+0000","last_fullsized":"2024-09-22T09:54:32.420090+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.419968+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:58.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'193","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.589508+0000","last_change":"2024-09-22T09:54:20.589426+0000","last_active":"2024-09-22T09:54:20.589508+0000","last_peered":"2024-09-22T09:54:20.589508+0000","last_clean":"2024-09-22T09:54:20.589508+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:54:20.589508+0000","last_undegraded":"2024-09-22T09:54:20.589508+0000","last_fullsized":"2024-09-22T09:54:20.589508+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.589319+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.187304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":37265,"num_write":903,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.612874+0000","last_change":"2024-09-22T09:54:39.612874+0000","last_active":"2024-09-22T09:54:39.612874+0000","last_peered":"2024-09-22T09:54:39.612874+0000","last_clean":"2024-09-22T09:54:39.612874+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:54:39.612874+0000","last_undegraded":"2024-09-22T09:54:39.612874+0000","last_fullsized":"2024-09-22T09:54:39.612874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.612789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:31.057982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'261","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.270530+0000","last_change":"2024-09-22T09:54:45.270530+0000","last_active":"2024-09-22T09:54:45.270530+0000","last_peered":"2024-09-22T09:54:45.270530+0000","last_clean":"2024-09-22T09:54:45.270530+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:54:45.270530+0000","last_undegraded":"2024-09-22T09:54:45.270530+0000","last_fullsized":"2024-09-22T09:54:45.270530+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'261","last_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_deep_scrub":"262'261","last_deep_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.270420+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:42.250477+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6788,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":355,"num_read_kb":422,"num_write":210,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.156730+0000","last_change":"2024-09-22T09:54:42.156730+0000","last_active":"2024-09-22T09:54:42.156730+0000","last_peered":"2024-09-22T09:54:42.156730+0000","last_clean":"2024-09-22T09:54:42.156730+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:54:42.156730+0000","last_undegraded":"2024-09-22T09:54:42.156730+0000","last_fullsized":"2024-09-22T09:54:42.156730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.156637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:54:18.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'585","reported_seq":1416,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.318921+0000","last_change":"2024-09-22T09:54:51.318921+0000","last_active":"2024-09-22T09:54:51.318921+0000","last_peered":"2024-09-22T09:54:51.318921+0000","last_clean":"2024-09-22T09:54:51.318921+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:51.318921+0000","last_undegraded":"2024-09-22T09:54:51.318921+0000","last_fullsized":"2024-09-22T09:54:51.318921+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'585","last_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_deep_scrub":"262'585","last_deep_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.318823+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:14.774473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":1004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.714675+0000","last_change":"2024-09-22T09:54:25.714675+0000","last_active":"2024-09-22T09:54:25.714675+0000","last_peered":"2024-09-22T09:54:25.714675+0000","last_clean":"2024-09-22T09:54:25.714675+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:54:25.714675+0000","last_undegraded":"2024-09-22T09:54:25.714675+0000","last_fullsized":"2024-09-22T09:54:25.714675+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.714587+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:22:34.018478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'229","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.529569+0000","last_change":"2024-09-22T09:54:24.529569+0000","last_active":"2024-09-22T09:54:24.529569+0000","last_peered":"2024-09-22T09:54:24.529569+0000","last_clean":"2024-09-22T09:54:24.529569+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:54:24.529569+0000","last_undegraded":"2024-09-22T09:54:24.529569+0000","last_fullsized":"2024-09-22T09:54:24.529569+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.529439+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:38.886184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":43078,"num_write":996,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.616335+0000","last_change":"2024-09-22T09:54:32.616335+0000","last_active":"2024-09-22T09:54:32.616335+0000","last_peered":"2024-09-22T09:54:32.616335+0000","last_clean":"2024-09-22T09:54:32.616335+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:54:32.616335+0000","last_undegraded":"2024-09-22T09:54:32.616335+0000","last_fullsized":"2024-09-22T09:54:32.616335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.616231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:46.763351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'156","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.618841+0000","last_change":"2024-09-22T09:54:47.618841+0000","last_active":"2024-09-22T09:54:47.618841+0000","last_peered":"2024-09-22T09:54:47.618841+0000","last_clean":"2024-09-22T09:54:47.618841+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:54:47.618841+0000","last_undegraded":"2024-09-22T09:54:47.618841+0000","last_fullsized":"2024-09-22T09:54:47.618841+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'156","last_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_deep_scrub":"262'156","last_deep_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.618725+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:25.667231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":232,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:52.668804+0000","last_change":"2024-09-22T08:42:21.478003+0000","last_active":"2024-09-22T09:51:52.668804+0000","last_peered":"2024-09-22T09:51:52.668804+0000","last_clean":"2024-09-22T09:51:52.668804+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:51:52.668804+0000","last_undegraded":"2024-09-22T09:51:52.668804+0000","last_fullsized":"2024-09-22T09:51:52.668804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:57.454846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2546","reported_seq":4390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.009360+0000","last_change":"2024-09-22T09:54:44.009360+0000","last_active":"2024-09-22T09:54:44.009360+0000","last_peered":"2024-09-22T09:54:44.009360+0000","last_clean":"2024-09-22T09:54:44.009360+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:54:44.009360+0000","last_undegraded":"2024-09-22T09:54:44.009360+0000","last_fullsized":"2024-09-22T09:54:44.009360+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2546","last_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_deep_scrub":"262'2546","last_deep_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.009269+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":2500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:56.015174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1208,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.925826+0000","last_change":"2024-09-22T09:54:30.925826+0000","last_active":"2024-09-22T09:54:30.925826+0000","last_peered":"2024-09-22T09:54:30.925826+0000","last_clean":"2024-09-22T09:54:30.925826+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:54:30.925826+0000","last_undegraded":"2024-09-22T09:54:30.925826+0000","last_fullsized":"2024-09-22T09:54:30.925826+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'595","last_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_deep_scrub":"262'595","last_deep_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.925742+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:22.030833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'249","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.496340+0000","last_change":"2024-09-22T09:54:25.496340+0000","last_active":"2024-09-22T09:54:25.496340+0000","last_peered":"2024-09-22T09:54:25.496340+0000","last_clean":"2024-09-22T09:54:25.496340+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:54:25.496340+0000","last_undegraded":"2024-09-22T09:54:25.496340+0000","last_fullsized":"2024-09-22T09:54:25.496340+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'249","last_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_deep_scrub":"262'249","last_deep_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.496221+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:36.135437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":17581,"num_write":1026,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.594837+0000","last_change":"2024-09-22T09:54:34.594837+0000","last_active":"2024-09-22T09:54:34.594837+0000","last_peered":"2024-09-22T09:54:34.594837+0000","last_clean":"2024-09-22T09:54:34.594837+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:54:34.594837+0000","last_undegraded":"2024-09-22T09:54:34.594837+0000","last_fullsized":"2024-09-22T09:54:34.594837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.594730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:44.826276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'205","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.614475+0000","last_change":"2024-09-22T09:54:47.614475+0000","last_active":"2024-09-22T09:54:47.614475+0000","last_peered":"2024-09-22T09:54:47.614475+0000","last_clean":"2024-09-22T09:54:47.614475+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:54:47.614475+0000","last_undegraded":"2024-09-22T09:54:47.614475+0000","last_fullsized":"2024-09-22T09:54:47.614475+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.614376+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:22.763339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6515,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":336,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'759","reported_seq":2733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.172282+0000","last_change":"2024-09-22T09:54:48.172282+0000","last_active":"2024-09-22T09:54:48.172282+0000","last_peered":"2024-09-22T09:54:48.172282+0000","last_clean":"2024-09-22T09:54:48.172282+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:48.172282+0000","last_undegraded":"2024-09-22T09:54:48.172282+0000","last_fullsized":"2024-09-22T09:54:48.172282+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.172190+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:13.572393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'120","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.102960+0000","last_change":"2024-09-22T09:54:51.102960+0000","last_active":"2024-09-22T09:54:51.102960+0000","last_peered":"2024-09-22T09:54:51.102960+0000","last_clean":"2024-09-22T09:54:51.102960+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:54:51.102960+0000","last_undegraded":"2024-09-22T09:54:51.102960+0000","last_fullsized":"2024-09-22T09:54:51.102960+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.102863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:28.997939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.039780+0000","last_change":"2024-09-22T09:54:32.039780+0000","last_active":"2024-09-22T09:54:32.039780+0000","last_peered":"2024-09-22T09:54:32.039780+0000","last_clean":"2024-09-22T09:54:32.039780+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:54:32.039780+0000","last_undegraded":"2024-09-22T09:54:32.039780+0000","last_fullsized":"2024-09-22T09:54:32.039780+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.039644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:49.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'210","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.582258+0000","last_change":"2024-09-22T09:54:25.582258+0000","last_active":"2024-09-22T09:54:25.582258+0000","last_peered":"2024-09-22T09:54:25.582258+0000","last_clean":"2024-09-22T09:54:25.582258+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:54:25.582258+0000","last_undegraded":"2024-09-22T09:54:25.582258+0000","last_fullsized":"2024-09-22T09:54:25.582258+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.582157+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:50.691745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":60855,"num_write":915,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.585259+0000","last_change":"2024-09-22T09:54:33.585259+0000","last_active":"2024-09-22T09:54:33.585259+0000","last_peered":"2024-09-22T09:54:33.585259+0000","last_clean":"2024-09-22T09:54:33.585259+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:54:33.585259+0000","last_undegraded":"2024-09-22T09:54:33.585259+0000","last_fullsized":"2024-09-22T09:54:33.585259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.585167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:48.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.053559+0000","last_change":"2024-09-22T09:54:42.053559+0000","last_active":"2024-09-22T09:54:42.053559+0000","last_peered":"2024-09-22T09:54:42.053559+0000","last_clean":"2024-09-22T09:54:42.053559+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:42.053559+0000","last_undegraded":"2024-09-22T09:54:42.053559+0000","last_fullsized":"2024-09-22T09:54:42.053559+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.053464+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:38.800886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":297,"num_read_kb":387,"num_write":144,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.595291+0000","last_change":"2024-09-22T09:54:38.595291+0000","last_active":"2024-09-22T09:54:38.595291+0000","last_peered":"2024-09-22T09:54:38.595291+0000","last_clean":"2024-09-22T09:54:38.595291+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:54:38.595291+0000","last_undegraded":"2024-09-22T09:54:38.595291+0000","last_fullsized":"2024-09-22T09:54:38.595291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.595189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:49.766642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'143","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.157662+0000","last_change":"2024-09-22T09:54:47.157662+0000","last_active":"2024-09-22T09:54:47.157662+0000","last_peered":"2024-09-22T09:54:47.157662+0000","last_clean":"2024-09-22T09:54:47.157662+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:54:47.157662+0000","last_undegraded":"2024-09-22T09:54:47.157662+0000","last_fullsized":"2024-09-22T09:54:47.157662+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.157571+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:55.768204+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.695111+0000","last_change":"2024-09-22T09:54:26.695111+0000","last_active":"2024-09-22T09:54:26.695111+0000","last_peered":"2024-09-22T09:54:26.695111+0000","last_clean":"2024-09-22T09:54:26.695111+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:54:26.695111+0000","last_undegraded":"2024-09-22T09:54:26.695111+0000","last_fullsized":"2024-09-22T09:54:26.695111+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.695015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:37.239794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'366","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.883932+0000","last_change":"2024-09-22T09:54:21.883932+0000","last_active":"2024-09-22T09:54:21.883932+0000","last_peered":"2024-09-22T09:54:21.883932+0000","last_clean":"2024-09-22T09:54:21.883932+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:54:21.883932+0000","last_undegraded":"2024-09-22T09:54:21.883932+0000","last_fullsized":"2024-09-22T09:54:21.883932+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.883821+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:21.748018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1019,"num_read_kb":7434,"num_write":1387,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.591498+0000","last_change":"2024-09-22T09:54:35.591498+0000","last_active":"2024-09-22T09:54:35.591498+0000","last_peered":"2024-09-22T09:54:35.591498+0000","last_clean":"2024-09-22T09:54:35.591498+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:54:35.591498+0000","last_undegraded":"2024-09-22T09:54:35.591498+0000","last_fullsized":"2024-09-22T09:54:35.591498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.591372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:34.926025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'172","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.579674+0000","last_change":"2024-09-22T09:54:45.579674+0000","last_active":"2024-09-22T09:54:45.579674+0000","last_peered":"2024-09-22T09:54:45.579674+0000","last_clean":"2024-09-22T09:54:45.579674+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:54:45.579674+0000","last_undegraded":"2024-09-22T09:54:45.579674+0000","last_fullsized":"2024-09-22T09:54:45.579674+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.579593+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:11.237734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":182,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:17.672374+0000","last_change":"2024-09-22T08:42:21.483302+0000","last_active":"2024-09-22T09:52:17.672374+0000","last_peered":"2024-09-22T09:52:17.672374+0000","last_clean":"2024-09-22T09:52:17.672374+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:52:17.672374+0000","last_undegraded":"2024-09-22T09:52:17.672374+0000","last_fullsized":"2024-09-22T09:52:17.672374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:20.436825+0000","last_clean_scrub_stamp":"2024-09-22T08:42:20.436825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'134","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:53:49.283254+0000","last_change":"2024-09-22T08:42:23.528419+0000","last_active":"2024-09-22T09:53:49.283254+0000","last_peered":"2024-09-22T09:53:49.283254+0000","last_clean":"2024-09-22T09:53:49.283254+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:53:49.283254+0000","last_undegraded":"2024-09-22T09:53:49.283254+0000","last_fullsized":"2024-09-22T09:53:49.283254+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.718751+0000","last_change":"2024-09-22T09:54:27.718751+0000","last_active":"2024-09-22T09:54:27.718751+0000","last_peered":"2024-09-22T09:54:27.718751+0000","last_clean":"2024-09-22T09:54:27.718751+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:54:27.718751+0000","last_undegraded":"2024-09-22T09:54:27.718751+0000","last_fullsized":"2024-09-22T09:54:27.718751+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.718664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:52.332290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'237","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.813127+0000","last_change":"2024-09-22T09:54:21.813127+0000","last_active":"2024-09-22T09:54:21.813127+0000","last_peered":"2024-09-22T09:54:21.813127+0000","last_clean":"2024-09-22T09:54:21.813127+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:54:21.813127+0000","last_undegraded":"2024-09-22T09:54:21.813127+0000","last_fullsized":"2024-09-22T09:54:21.813127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.812963+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:20.379997+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242950,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":767,"num_read_kb":42930,"num_write":1126,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.200568+0000","last_change":"2024-09-22T09:54:36.200568+0000","last_active":"2024-09-22T09:54:36.200568+0000","last_peered":"2024-09-22T09:54:36.200568+0000","last_clean":"2024-09-22T09:54:36.200568+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:54:36.200568+0000","last_undegraded":"2024-09-22T09:54:36.200568+0000","last_fullsized":"2024-09-22T09:54:36.200568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.200478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:14.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'199","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.623404+0000","last_change":"2024-09-22T09:54:36.623404+0000","last_active":"2024-09-22T09:54:36.623404+0000","last_peered":"2024-09-22T09:54:36.623404+0000","last_clean":"2024-09-22T09:54:36.623404+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:54:36.623404+0000","last_undegraded":"2024-09-22T09:54:36.623404+0000","last_fullsized":"2024-09-22T09:54:36.623404+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.623296+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:27.880579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'722","reported_seq":2504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.636408+0000","last_change":"2024-09-22T09:54:39.636408+0000","last_active":"2024-09-22T09:54:39.636408+0000","last_peered":"2024-09-22T09:54:39.636408+0000","last_clean":"2024-09-22T09:54:39.636408+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:39.636408+0000","last_undegraded":"2024-09-22T09:54:39.636408+0000","last_fullsized":"2024-09-22T09:54:39.636408+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'722","last_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_deep_scrub":"262'722","last_deep_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.636312+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:26.968453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'142","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.217597+0000","last_change":"2024-09-22T09:54:45.217597+0000","last_active":"2024-09-22T09:54:45.217597+0000","last_peered":"2024-09-22T09:54:45.217597+0000","last_clean":"2024-09-22T09:54:45.217597+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:54:45.217597+0000","last_undegraded":"2024-09-22T09:54:45.217597+0000","last_fullsized":"2024-09-22T09:54:45.217597+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.217484+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:33.960189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.702387+0000","last_change":"2024-09-22T09:54:28.702387+0000","last_active":"2024-09-22T09:54:28.702387+0000","last_peered":"2024-09-22T09:54:28.702387+0000","last_clean":"2024-09-22T09:54:28.702387+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:54:28.702387+0000","last_undegraded":"2024-09-22T09:54:28.702387+0000","last_fullsized":"2024-09-22T09:54:28.702387+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.702304+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:11.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'258","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.856222+0000","last_change":"2024-09-22T09:54:22.856222+0000","last_active":"2024-09-22T09:54:22.856222+0000","last_peered":"2024-09-22T09:54:22.856222+0000","last_clean":"2024-09-22T09:54:22.856222+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:54:22.856222+0000","last_undegraded":"2024-09-22T09:54:22.856222+0000","last_fullsized":"2024-09-22T09:54:22.856222+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'258","last_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_deep_scrub":"262'258","last_deep_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.856126+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:10.632167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1203,"num_read_kb":6055,"num_write":1103,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1463,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.292562+0000","last_change":"2024-09-22T09:54:42.292562+0000","last_active":"2024-09-22T09:54:42.292562+0000","last_peered":"2024-09-22T09:54:42.292562+0000","last_clean":"2024-09-22T09:54:42.292562+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:42.292562+0000","last_undegraded":"2024-09-22T09:54:42.292562+0000","last_fullsized":"2024-09-22T09:54:42.292562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.292452+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:15.247545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'137","reported_seq":680,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.616883+0000","last_change":"2024-09-22T09:54:48.616883+0000","last_active":"2024-09-22T09:54:48.616883+0000","last_peered":"2024-09-22T09:54:48.616883+0000","last_clean":"2024-09-22T09:54:48.616883+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:54:48.616883+0000","last_undegraded":"2024-09-22T09:54:48.616883+0000","last_fullsized":"2024-09-22T09:54:48.616883+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.616758+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:33.434488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'757","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.965816+0000","last_change":"2024-09-22T09:54:39.965816+0000","last_active":"2024-09-22T09:54:39.965816+0000","last_peered":"2024-09-22T09:54:39.965816+0000","last_clean":"2024-09-22T09:54:39.965816+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:39.965816+0000","last_undegraded":"2024-09-22T09:54:39.965816+0000","last_fullsized":"2024-09-22T09:54:39.965816+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'757","last_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_deep_scrub":"262'757","last_deep_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.965733+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:52.549736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'120","reported_seq":627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.624151+0000","last_change":"2024-09-22T09:54:52.624151+0000","last_active":"2024-09-22T09:54:52.624151+0000","last_peered":"2024-09-22T09:54:52.624151+0000","last_clean":"2024-09-22T09:54:52.624151+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:54:52.624151+0000","last_undegraded":"2024-09-22T09:54:52.624151+0000","last_fullsized":"2024-09-22T09:54:52.624151+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.624066+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:54.701435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.222747+0000","last_change":"2024-09-22T09:54:31.222655+0000","last_active":"2024-09-22T09:54:31.222747+0000","last_peered":"2024-09-22T09:54:31.222747+0000","last_clean":"2024-09-22T09:54:31.222747+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:54:31.222747+0000","last_undegraded":"2024-09-22T09:54:31.222747+0000","last_fullsized":"2024-09-22T09:54:31.222747+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4209","last_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_deep_scrub":"262'4209","last_deep_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.222546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:03.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'188","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.824881+0000","last_change":"2024-09-22T09:54:29.824881+0000","last_active":"2024-09-22T09:54:29.824881+0000","last_peered":"2024-09-22T09:54:29.824881+0000","last_clean":"2024-09-22T09:54:29.824881+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:54:29.824881+0000","last_undegraded":"2024-09-22T09:54:29.824881+0000","last_fullsized":"2024-09-22T09:54:29.824881+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.824757+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:54.380784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":707,"num_read_kb":142631,"num_write":847,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.595584+0000","last_change":"2024-09-22T09:54:40.595584+0000","last_active":"2024-09-22T09:54:40.595584+0000","last_peered":"2024-09-22T09:54:40.595584+0000","last_clean":"2024-09-22T09:54:40.595584+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:54:40.595584+0000","last_undegraded":"2024-09-22T09:54:40.595584+0000","last_fullsized":"2024-09-22T09:54:40.595584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.595487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:01.540605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'231","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.313887+0000","last_change":"2024-09-22T09:54:47.313887+0000","last_active":"2024-09-22T09:54:47.313887+0000","last_peered":"2024-09-22T09:54:47.313887+0000","last_clean":"2024-09-22T09:54:47.313887+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:54:47.313887+0000","last_undegraded":"2024-09-22T09:54:47.313887+0000","last_fullsized":"2024-09-22T09:54:47.313887+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.313763+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:24.558381+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":186,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.924774+0000","last_change":"2024-09-22T09:54:38.924774+0000","last_active":"2024-09-22T09:54:38.924774+0000","last_peered":"2024-09-22T09:54:38.924774+0000","last_clean":"2024-09-22T09:54:38.924774+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:54:38.924774+0000","last_undegraded":"2024-09-22T09:54:38.924774+0000","last_fullsized":"2024-09-22T09:54:38.924774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.924672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:45.017694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'134","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.173214+0000","last_change":"2024-09-22T09:54:46.173214+0000","last_active":"2024-09-22T09:54:46.173214+0000","last_peered":"2024-09-22T09:54:46.173214+0000","last_clean":"2024-09-22T09:54:46.173214+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:54:46.173214+0000","last_undegraded":"2024-09-22T09:54:46.173214+0000","last_fullsized":"2024-09-22T09:54:46.173214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.173116+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:14.836807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.953765+0000","last_change":"2024-09-22T09:54:29.953765+0000","last_active":"2024-09-22T09:54:29.953765+0000","last_peered":"2024-09-22T09:54:29.953765+0000","last_clean":"2024-09-22T09:54:29.953765+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:54:29.953765+0000","last_undegraded":"2024-09-22T09:54:29.953765+0000","last_fullsized":"2024-09-22T09:54:29.953765+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.953655+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:28.167803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.574870+0000","last_change":"2024-09-22T09:54:22.574870+0000","last_active":"2024-09-22T09:54:22.574870+0000","last_peered":"2024-09-22T09:54:22.574870+0000","last_clean":"2024-09-22T09:54:22.574870+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:54:22.574870+0000","last_undegraded":"2024-09-22T09:54:22.574870+0000","last_fullsized":"2024-09-22T09:54:22.574870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.574784+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:51.565048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.531626+0000","last_change":"2024-09-22T09:54:22.531543+0000","last_active":"2024-09-22T09:54:22.531626+0000","last_peered":"2024-09-22T09:54:22.531626+0000","last_clean":"2024-09-22T09:54:22.531626+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:54:22.531626+0000","last_undegraded":"2024-09-22T09:54:22.531626+0000","last_fullsized":"2024-09-22T09:54:22.531626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.531426+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:15.733698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'265","reported_seq":928,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.914080+0000","last_change":"2024-09-22T09:54:20.914080+0000","last_active":"2024-09-22T09:54:20.914080+0000","last_peered":"2024-09-22T09:54:20.914080+0000","last_clean":"2024-09-22T09:54:20.914080+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:54:20.914080+0000","last_undegraded":"2024-09-22T09:54:20.914080+0000","last_fullsized":"2024-09-22T09:54:20.914080+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'265","last_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_deep_scrub":"262'265","last_deep_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.913993+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:34.016179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":19734,"num_write":1091,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.605619+0000","last_change":"2024-09-22T09:54:38.605619+0000","last_active":"2024-09-22T09:54:38.605619+0000","last_peered":"2024-09-22T09:54:38.605619+0000","last_clean":"2024-09-22T09:54:38.605619+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:54:38.605619+0000","last_undegraded":"2024-09-22T09:54:38.605619+0000","last_fullsized":"2024-09-22T09:54:38.605619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.605481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.706887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'328","reported_seq":1049,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.305495+0000","last_change":"2024-09-22T09:54:46.305495+0000","last_active":"2024-09-22T09:54:46.305495+0000","last_peered":"2024-09-22T09:54:46.305495+0000","last_clean":"2024-09-22T09:54:46.305495+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:46.305495+0000","last_undegraded":"2024-09-22T09:54:46.305495+0000","last_fullsized":"2024-09-22T09:54:46.305495+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'328","last_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_deep_scrub":"262'328","last_deep_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.305404+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:41.226802+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":739,"num_write":494,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89468,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.187781+0000","last_change":"2024-09-22T09:54:47.187781+0000","last_active":"2024-09-22T09:54:47.187781+0000","last_peered":"2024-09-22T09:54:47.187781+0000","last_clean":"2024-09-22T09:54:47.187781+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:54:47.187781+0000","last_undegraded":"2024-09-22T09:54:47.187781+0000","last_fullsized":"2024-09-22T09:54:47.187781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.187615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:06.531153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'207","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.999122+0000","last_change":"2024-09-22T09:54:41.999122+0000","last_active":"2024-09-22T09:54:41.999122+0000","last_peered":"2024-09-22T09:54:41.999122+0000","last_clean":"2024-09-22T09:54:41.999122+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:54:41.999122+0000","last_undegraded":"2024-09-22T09:54:41.999122+0000","last_fullsized":"2024-09-22T09:54:41.999122+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.999009+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.532488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'137","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.023195+0000","last_change":"2024-09-22T09:54:30.023195+0000","last_active":"2024-09-22T09:54:30.023195+0000","last_peered":"2024-09-22T09:54:30.023195+0000","last_clean":"2024-09-22T09:54:30.023195+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:54:30.023195+0000","last_undegraded":"2024-09-22T09:54:30.023195+0000","last_fullsized":"2024-09-22T09:54:30.023195+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.023101+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:48.412441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.540005+0000","last_change":"2024-09-22T09:54:23.540005+0000","last_active":"2024-09-22T09:54:23.540005+0000","last_peered":"2024-09-22T09:54:23.540005+0000","last_clean":"2024-09-22T09:54:23.540005+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:54:23.540005+0000","last_undegraded":"2024-09-22T09:54:23.540005+0000","last_fullsized":"2024-09-22T09:54:23.540005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:38.423290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'211","reported_seq":920,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.137314+0000","last_change":"2024-09-22T09:54:20.137314+0000","last_active":"2024-09-22T09:54:20.137314+0000","last_peered":"2024-09-22T09:54:20.137314+0000","last_clean":"2024-09-22T09:54:20.137314+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:54:20.137314+0000","last_undegraded":"2024-09-22T09:54:20.137314+0000","last_fullsized":"2024-09-22T09:54:20.137314+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.137215+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:24.795199+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":801,"num_read_kb":134895,"num_write":909,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.376894+0000","last_change":"2024-09-22T09:54:39.376894+0000","last_active":"2024-09-22T09:54:39.376894+0000","last_peered":"2024-09-22T09:54:39.376894+0000","last_clean":"2024-09-22T09:54:39.376894+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:54:39.376894+0000","last_undegraded":"2024-09-22T09:54:39.376894+0000","last_fullsized":"2024-09-22T09:54:39.376894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.376795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:57.132187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'907","reported_seq":2727,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.170075+0000","last_change":"2024-09-22T09:54:39.170075+0000","last_active":"2024-09-22T09:54:39.170075+0000","last_peered":"2024-09-22T09:54:39.170075+0000","last_clean":"2024-09-22T09:54:39.170075+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:39.170075+0000","last_undegraded":"2024-09-22T09:54:39.170075+0000","last_fullsized":"2024-09-22T09:54:39.170075+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'907","last_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_deep_scrub":"262'907","last_deep_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.169979+0000","objects_scrubbed":11,"log_size":106,"log_dups_size":801,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.079705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22457,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1275,"num_read_kb":1494,"num_write":384,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.587719+0000","last_change":"2024-09-22T09:54:49.587719+0000","last_active":"2024-09-22T09:54:49.587719+0000","last_peered":"2024-09-22T09:54:49.587719+0000","last_clean":"2024-09-22T09:54:49.587719+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:54:49.587719+0000","last_undegraded":"2024-09-22T09:54:49.587719+0000","last_fullsized":"2024-09-22T09:54:49.587719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.587615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:43.905843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'236","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.203000+0000","last_change":"2024-09-22T09:54:49.203000+0000","last_active":"2024-09-22T09:54:49.203000+0000","last_peered":"2024-09-22T09:54:49.203000+0000","last_clean":"2024-09-22T09:54:49.203000+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:54:49.203000+0000","last_undegraded":"2024-09-22T09:54:49.203000+0000","last_fullsized":"2024-09-22T09:54:49.203000+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.202908+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:40.344451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.238536+0000","last_change":"2024-09-22T09:54:29.238536+0000","last_active":"2024-09-22T09:54:29.238536+0000","last_peered":"2024-09-22T09:54:29.238536+0000","last_clean":"2024-09-22T09:54:29.238536+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:54:29.238536+0000","last_undegraded":"2024-09-22T09:54:29.238536+0000","last_fullsized":"2024-09-22T09:54:29.238536+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.238430+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:59.458064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.606871+0000","last_change":"2024-09-22T09:54:19.606824+0000","last_active":"2024-09-22T09:54:19.606871+0000","last_peered":"2024-09-22T09:54:19.606871+0000","last_clean":"2024-09-22T09:54:19.606871+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:54:19.606871+0000","last_undegraded":"2024-09-22T09:54:19.606871+0000","last_fullsized":"2024-09-22T09:54:19.606871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.606739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:03.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'200","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.372421+0000","last_change":"2024-09-22T09:54:19.372330+0000","last_active":"2024-09-22T09:54:19.372421+0000","last_peered":"2024-09-22T09:54:19.372421+0000","last_clean":"2024-09-22T09:54:19.372421+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:54:19.372421+0000","last_undegraded":"2024-09-22T09:54:19.372421+0000","last_fullsized":"2024-09-22T09:54:19.372421+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.372130+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:08.243681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485786,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":19334,"num_write":886,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.607748+0000","last_change":"2024-09-22T09:54:31.607748+0000","last_active":"2024-09-22T09:54:31.607748+0000","last_peered":"2024-09-22T09:54:31.607748+0000","last_clean":"2024-09-22T09:54:31.607748+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:54:31.607748+0000","last_undegraded":"2024-09-22T09:54:31.607748+0000","last_fullsized":"2024-09-22T09:54:31.607748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.607665+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:32.805386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'291","reported_seq":1715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.628229+0000","last_change":"2024-09-22T09:54:43.628229+0000","last_active":"2024-09-22T09:54:43.628229+0000","last_peered":"2024-09-22T09:54:43.628229+0000","last_clean":"2024-09-22T09:54:43.628229+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:54:43.628229+0000","last_undegraded":"2024-09-22T09:54:43.628229+0000","last_fullsized":"2024-09-22T09:54:43.628229+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.628119+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:18.536067+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.148605+0000","last_change":"2024-09-22T09:54:46.148605+0000","last_active":"2024-09-22T09:54:46.148605+0000","last_peered":"2024-09-22T09:54:46.148605+0000","last_clean":"2024-09-22T09:54:46.148605+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:54:46.148605+0000","last_undegraded":"2024-09-22T09:54:46.148605+0000","last_fullsized":"2024-09-22T09:54:46.148605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.148415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:12.701927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'243","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.001884+0000","last_change":"2024-09-22T08:42:23.528193+0000","last_active":"2024-09-22T09:52:37.001884+0000","last_peered":"2024-09-22T09:52:37.001884+0000","last_clean":"2024-09-22T09:52:37.001884+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:52:37.001884+0000","last_undegraded":"2024-09-22T09:52:37.001884+0000","last_fullsized":"2024-09-22T09:52:37.001884+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":785,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.185684+0000","last_change":"2024-09-22T09:54:27.185684+0000","last_active":"2024-09-22T09:54:27.185684+0000","last_peered":"2024-09-22T09:54:27.185684+0000","last_clean":"2024-09-22T09:54:27.185684+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:54:27.185684+0000","last_undegraded":"2024-09-22T09:54:27.185684+0000","last_fullsized":"2024-09-22T09:54:27.185684+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.185594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:13:47.880015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":540,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.532921+0000","last_change":"2024-09-22T09:54:21.532865+0000","last_active":"2024-09-22T09:54:21.532921+0000","last_peered":"2024-09-22T09:54:21.532921+0000","last_clean":"2024-09-22T09:54:21.532921+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:54:21.532921+0000","last_undegraded":"2024-09-22T09:54:21.532921+0000","last_fullsized":"2024-09-22T09:54:21.532921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.532772+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:51.708829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'227","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.819318+0000","last_change":"2024-09-22T09:54:21.819318+0000","last_active":"2024-09-22T09:54:21.819318+0000","last_peered":"2024-09-22T09:54:21.819318+0000","last_clean":"2024-09-22T09:54:21.819318+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:54:21.819318+0000","last_undegraded":"2024-09-22T09:54:21.819318+0000","last_fullsized":"2024-09-22T09:54:21.819318+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.819178+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:16.182021+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":44921,"num_write":1103,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.025877+0000","last_change":"2024-09-22T09:54:39.025877+0000","last_active":"2024-09-22T09:54:39.025877+0000","last_peered":"2024-09-22T09:54:39.025877+0000","last_clean":"2024-09-22T09:54:39.025877+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:54:39.025877+0000","last_undegraded":"2024-09-22T09:54:39.025877+0000","last_fullsized":"2024-09-22T09:54:39.025877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.025757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:38:02.089422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'165","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.654289+0000","last_change":"2024-09-22T09:54:46.654289+0000","last_active":"2024-09-22T09:54:46.654289+0000","last_peered":"2024-09-22T09:54:46.654289+0000","last_clean":"2024-09-22T09:54:46.654289+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:54:46.654289+0000","last_undegraded":"2024-09-22T09:54:46.654289+0000","last_fullsized":"2024-09-22T09:54:46.654289+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.654189+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:59.224861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.933152+0000","last_change":"2024-09-22T09:54:37.933152+0000","last_active":"2024-09-22T09:54:37.933152+0000","last_peered":"2024-09-22T09:54:37.933152+0000","last_clean":"2024-09-22T09:54:37.933152+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:54:37.933152+0000","last_undegraded":"2024-09-22T09:54:37.933152+0000","last_fullsized":"2024-09-22T09:54:37.933152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.933066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:08.133408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.305658+0000","last_change":"2024-09-22T09:54:52.305658+0000","last_active":"2024-09-22T09:54:52.305658+0000","last_peered":"2024-09-22T09:54:52.305658+0000","last_clean":"2024-09-22T09:54:52.305658+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:54:52.305658+0000","last_undegraded":"2024-09-22T09:54:52.305658+0000","last_fullsized":"2024-09-22T09:54:52.305658+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.305571+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:00.676431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":939,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.192606+0000","last_change":"2024-09-22T09:54:28.192606+0000","last_active":"2024-09-22T09:54:28.192606+0000","last_peered":"2024-09-22T09:54:28.192606+0000","last_clean":"2024-09-22T09:54:28.192606+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:54:28.192606+0000","last_undegraded":"2024-09-22T09:54:28.192606+0000","last_fullsized":"2024-09-22T09:54:28.192606+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'257","last_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_deep_scrub":"262'257","last_deep_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.192506+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:18.079606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'191","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.574375+0000","last_change":"2024-09-22T09:54:23.574375+0000","last_active":"2024-09-22T09:54:23.574375+0000","last_peered":"2024-09-22T09:54:23.574375+0000","last_clean":"2024-09-22T09:54:23.574375+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:54:23.574375+0000","last_undegraded":"2024-09-22T09:54:23.574375+0000","last_fullsized":"2024-09-22T09:54:23.574375+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.574287+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:41:15.794001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":36411,"num_write":937,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.371305+0000","last_change":"2024-09-22T09:54:20.371252+0000","last_active":"2024-09-22T09:54:20.371305+0000","last_peered":"2024-09-22T09:54:20.371305+0000","last_clean":"2024-09-22T09:54:20.371305+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:54:20.371305+0000","last_undegraded":"2024-09-22T09:54:20.371305+0000","last_fullsized":"2024-09-22T09:54:20.371305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:51.950137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.048408+0000","last_change":"2024-09-22T09:54:38.048408+0000","last_active":"2024-09-22T09:54:38.048408+0000","last_peered":"2024-09-22T09:54:38.048408+0000","last_clean":"2024-09-22T09:54:38.048408+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:54:38.048408+0000","last_undegraded":"2024-09-22T09:54:38.048408+0000","last_fullsized":"2024-09-22T09:54:38.048408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.048305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:53.382564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'366","reported_seq":1062,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.076719+0000","last_change":"2024-09-22T09:54:41.076719+0000","last_active":"2024-09-22T09:54:41.076719+0000","last_peered":"2024-09-22T09:54:41.076719+0000","last_clean":"2024-09-22T09:54:41.076719+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:41.076719+0000","last_undegraded":"2024-09-22T09:54:41.076719+0000","last_fullsized":"2024-09-22T09:54:41.076719+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.076609+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.553978+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18381,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1194,"num_read_kb":1339,"num_write":1770,"num_write_kb":1581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.632165+0000","last_change":"2024-09-22T09:54:49.632165+0000","last_active":"2024-09-22T09:54:49.632165+0000","last_peered":"2024-09-22T09:54:49.632165+0000","last_clean":"2024-09-22T09:54:49.632165+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:54:49.632165+0000","last_undegraded":"2024-09-22T09:54:49.632165+0000","last_fullsized":"2024-09-22T09:54:49.632165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.632078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:50.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'155","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.236268+0000","last_change":"2024-09-22T09:54:55.236268+0000","last_active":"2024-09-22T09:54:55.236268+0000","last_peered":"2024-09-22T09:54:55.236268+0000","last_clean":"2024-09-22T09:54:55.236268+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:54:55.236268+0000","last_undegraded":"2024-09-22T09:54:55.236268+0000","last_fullsized":"2024-09-22T09:54:55.236268+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.236153+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:00.942710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":714,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.996833+0000","last_change":"2024-09-22T09:54:28.996833+0000","last_active":"2024-09-22T09:54:28.996833+0000","last_peered":"2024-09-22T09:54:28.996833+0000","last_clean":"2024-09-22T09:54:28.996833+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:54:28.996833+0000","last_undegraded":"2024-09-22T09:54:28.996833+0000","last_fullsized":"2024-09-22T09:54:28.996833+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.996744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:52.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'220","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.328955+0000","last_change":"2024-09-22T09:54:21.328955+0000","last_active":"2024-09-22T09:54:21.328955+0000","last_peered":"2024-09-22T09:54:21.328955+0000","last_clean":"2024-09-22T09:54:21.328955+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:54:21.328955+0000","last_undegraded":"2024-09-22T09:54:21.328955+0000","last_fullsized":"2024-09-22T09:54:21.328955+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.328852+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:00.573762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":1845,"num_write":1046,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.569365+0000","last_change":"2024-09-22T09:54:33.569365+0000","last_active":"2024-09-22T09:54:33.569365+0000","last_peered":"2024-09-22T09:54:33.569365+0000","last_clean":"2024-09-22T09:54:33.569365+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:54:33.569365+0000","last_undegraded":"2024-09-22T09:54:33.569365+0000","last_fullsized":"2024-09-22T09:54:33.569365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.569236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:24.238329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.916275+0000","last_change":"2024-09-22T09:54:33.916275+0000","last_active":"2024-09-22T09:54:33.916275+0000","last_peered":"2024-09-22T09:54:33.916275+0000","last_clean":"2024-09-22T09:54:33.916275+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:54:33.916275+0000","last_undegraded":"2024-09-22T09:54:33.916275+0000","last_fullsized":"2024-09-22T09:54:33.916275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.916178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:47.667923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'223","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.185335+0000","last_change":"2024-09-22T09:54:41.185335+0000","last_active":"2024-09-22T09:54:41.185335+0000","last_peered":"2024-09-22T09:54:41.185335+0000","last_clean":"2024-09-22T09:54:41.185335+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:54:41.185335+0000","last_undegraded":"2024-09-22T09:54:41.185335+0000","last_fullsized":"2024-09-22T09:54:41.185335+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.185242+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:52:21.839182+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'765","reported_seq":4654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.303774+0000","last_change":"2024-09-22T09:54:49.303774+0000","last_active":"2024-09-22T09:54:49.303774+0000","last_peered":"2024-09-22T09:54:49.303774+0000","last_clean":"2024-09-22T09:54:49.303774+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:49.303774+0000","last_undegraded":"2024-09-22T09:54:49.303774+0000","last_fullsized":"2024-09-22T09:54:49.303774+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'765","last_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_deep_scrub":"262'765","last_deep_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.303693+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:46.394231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'170","reported_seq":699,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:00.734389+0000","last_change":"2024-09-22T08:42:23.577286+0000","last_active":"2024-09-22T09:54:00.734389+0000","last_peered":"2024-09-22T09:54:00.734389+0000","last_clean":"2024-09-22T09:54:00.734389+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:54:00.734389+0000","last_undegraded":"2024-09-22T09:54:00.734389+0000","last_fullsized":"2024-09-22T09:54:00.734389+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.749272+0000","last_change":"2024-09-22T09:54:43.749272+0000","last_active":"2024-09-22T09:54:43.749272+0000","last_peered":"2024-09-22T09:54:43.749272+0000","last_clean":"2024-09-22T09:54:43.749272+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:54:43.749272+0000","last_undegraded":"2024-09-22T09:54:43.749272+0000","last_fullsized":"2024-09-22T09:54:43.749272+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.749180+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:20.977184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.930818+0000","last_change":"2024-09-22T09:54:26.930818+0000","last_active":"2024-09-22T09:54:26.930818+0000","last_peered":"2024-09-22T09:54:26.930818+0000","last_clean":"2024-09-22T09:54:26.930818+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:54:26.930818+0000","last_undegraded":"2024-09-22T09:54:26.930818+0000","last_fullsized":"2024-09-22T09:54:26.930818+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'170","last_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_deep_scrub":"262'170","last_deep_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.930623+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.742051+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.243823+0000","last_change":"2024-09-22T09:54:23.243823+0000","last_active":"2024-09-22T09:54:23.243823+0000","last_peered":"2024-09-22T09:54:23.243823+0000","last_clean":"2024-09-22T09:54:23.243823+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:54:23.243823+0000","last_undegraded":"2024-09-22T09:54:23.243823+0000","last_fullsized":"2024-09-22T09:54:23.243823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.243731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.724488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.554916+0000","last_change":"2024-09-22T09:54:42.554916+0000","last_active":"2024-09-22T09:54:42.554916+0000","last_peered":"2024-09-22T09:54:42.554916+0000","last_clean":"2024-09-22T09:54:42.554916+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:54:42.554916+0000","last_undegraded":"2024-09-22T09:54:42.554916+0000","last_fullsized":"2024-09-22T09:54:42.554916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.554834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:29.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'140","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.606454+0000","last_change":"2024-09-22T09:54:44.606454+0000","last_active":"2024-09-22T09:54:44.606454+0000","last_peered":"2024-09-22T09:54:44.606454+0000","last_clean":"2024-09-22T09:54:44.606454+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:54:44.606454+0000","last_undegraded":"2024-09-22T09:54:44.606454+0000","last_fullsized":"2024-09-22T09:54:44.606454+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.606361+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:44.675948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'756","reported_seq":2865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.720928+0000","last_change":"2024-09-22T09:54:56.720928+0000","last_active":"2024-09-22T09:54:56.720928+0000","last_peered":"2024-09-22T09:54:56.720928+0000","last_clean":"2024-09-22T09:54:56.720928+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:56.720928+0000","last_undegraded":"2024-09-22T09:54:56.720928+0000","last_fullsized":"2024-09-22T09:54:56.720928+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.720830+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:57.526171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.146261+0000","last_change":"2024-09-22T09:54:53.146261+0000","last_active":"2024-09-22T09:54:53.146261+0000","last_peered":"2024-09-22T09:54:53.146261+0000","last_clean":"2024-09-22T09:54:53.146261+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:54:53.146261+0000","last_undegraded":"2024-09-22T09:54:53.146261+0000","last_fullsized":"2024-09-22T09:54:53.146261+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.146161+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:03.242553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.737112+0000","last_change":"2024-09-22T09:54:24.737112+0000","last_active":"2024-09-22T09:54:24.737112+0000","last_peered":"2024-09-22T09:54:24.737112+0000","last_clean":"2024-09-22T09:54:24.737112+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:54:24.737112+0000","last_undegraded":"2024-09-22T09:54:24.737112+0000","last_fullsized":"2024-09-22T09:54:24.737112+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.737027+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:50.396120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'190","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.103347+0000","last_change":"2024-09-22T09:54:19.103347+0000","last_active":"2024-09-22T09:54:19.103347+0000","last_peered":"2024-09-22T09:54:19.103347+0000","last_clean":"2024-09-22T09:54:19.103347+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:54:19.103347+0000","last_undegraded":"2024-09-22T09:54:19.103347+0000","last_fullsized":"2024-09-22T09:54:19.103347+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.103240+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:24.385903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":406,"num_write":850,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.761018+0000","last_change":"2024-09-22T09:54:23.761018+0000","last_active":"2024-09-22T09:54:23.761018+0000","last_peered":"2024-09-22T09:54:23.761018+0000","last_clean":"2024-09-22T09:54:23.761018+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:54:23.761018+0000","last_undegraded":"2024-09-22T09:54:23.761018+0000","last_fullsized":"2024-09-22T09:54:23.761018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.760940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:58.487042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.826138+0000","last_change":"2024-09-22T09:54:40.826138+0000","last_active":"2024-09-22T09:54:40.826138+0000","last_peered":"2024-09-22T09:54:40.826138+0000","last_clean":"2024-09-22T09:54:40.826138+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:54:40.826138+0000","last_undegraded":"2024-09-22T09:54:40.826138+0000","last_fullsized":"2024-09-22T09:54:40.826138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.826044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:59.306569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'363","reported_seq":1106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.606035+0000","last_change":"2024-09-22T09:54:42.606035+0000","last_active":"2024-09-22T09:54:42.606035+0000","last_peered":"2024-09-22T09:54:42.606035+0000","last_clean":"2024-09-22T09:54:42.606035+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:42.606035+0000","last_undegraded":"2024-09-22T09:54:42.606035+0000","last_fullsized":"2024-09-22T09:54:42.606035+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'363","last_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_deep_scrub":"262'363","last_deep_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.605926+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:24.566627+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23842,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":535,"num_read_kb":775,"num_write":284,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.703279+0000","last_change":"2024-09-22T09:54:52.703279+0000","last_active":"2024-09-22T09:54:52.703279+0000","last_peered":"2024-09-22T09:54:52.703279+0000","last_clean":"2024-09-22T09:54:52.703279+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:54:52.703279+0000","last_undegraded":"2024-09-22T09:54:52.703279+0000","last_fullsized":"2024-09-22T09:54:52.703279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.703173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:09.004394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'94","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.340062+0000","last_change":"2024-09-22T09:54:53.340062+0000","last_active":"2024-09-22T09:54:53.340062+0000","last_peered":"2024-09-22T09:54:53.340062+0000","last_clean":"2024-09-22T09:54:53.340062+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:54:53.340062+0000","last_undegraded":"2024-09-22T09:54:53.340062+0000","last_fullsized":"2024-09-22T09:54:53.340062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.339953+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:01.903544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'127","reported_seq":685,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:36.943054+0000","last_change":"2024-09-22T08:42:23.528130+0000","last_active":"2024-09-22T09:52:36.943054+0000","last_peered":"2024-09-22T09:52:36.943054+0000","last_clean":"2024-09-22T09:52:36.943054+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:52:36.943054+0000","last_undegraded":"2024-09-22T09:52:36.943054+0000","last_fullsized":"2024-09-22T09:52:36.943054+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:46:31.968276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.695358+0000","last_change":"2024-09-22T09:54:29.695304+0000","last_active":"2024-09-22T09:54:29.695358+0000","last_peered":"2024-09-22T09:54:29.695358+0000","last_clean":"2024-09-22T09:54:29.695358+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:54:29.695358+0000","last_undegraded":"2024-09-22T09:54:29.695358+0000","last_fullsized":"2024-09-22T09:54:29.695358+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.695223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:41.769762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'197","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.797555+0000","last_change":"2024-09-22T09:54:20.797488+0000","last_active":"2024-09-22T09:54:20.797555+0000","last_peered":"2024-09-22T09:54:20.797555+0000","last_clean":"2024-09-22T09:54:20.797555+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:54:20.797555+0000","last_undegraded":"2024-09-22T09:54:20.797555+0000","last_fullsized":"2024-09-22T09:54:20.797555+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.797355+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:31.306053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":56883,"num_write":855,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.214275+0000","last_change":"2024-09-22T09:54:35.214218+0000","last_active":"2024-09-22T09:54:35.214275+0000","last_peered":"2024-09-22T09:54:35.214275+0000","last_clean":"2024-09-22T09:54:35.214275+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:54:35.214275+0000","last_undegraded":"2024-09-22T09:54:35.214275+0000","last_fullsized":"2024-09-22T09:54:35.214275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.214127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:27.814976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'176","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.627965+0000","last_change":"2024-09-22T09:54:49.627965+0000","last_active":"2024-09-22T09:54:49.627965+0000","last_peered":"2024-09-22T09:54:49.627965+0000","last_clean":"2024-09-22T09:54:49.627965+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:54:49.627965+0000","last_undegraded":"2024-09-22T09:54:49.627965+0000","last_fullsized":"2024-09-22T09:54:49.627965+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.627852+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:21.906351+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":323,"num_write":134,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.691597+0000","last_change":"2024-09-22T09:54:54.691597+0000","last_active":"2024-09-22T09:54:54.691597+0000","last_peered":"2024-09-22T09:54:54.691597+0000","last_clean":"2024-09-22T09:54:54.691597+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:54:54.691597+0000","last_undegraded":"2024-09-22T09:54:54.691597+0000","last_fullsized":"2024-09-22T09:54:54.691597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.691502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:25.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'146","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:37.674733+0000","last_change":"2024-09-22T08:42:23.528381+0000","last_active":"2024-09-22T09:52:37.674733+0000","last_peered":"2024-09-22T09:52:37.674733+0000","last_clean":"2024-09-22T09:52:37.674733+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:52:37.674733+0000","last_undegraded":"2024-09-22T09:52:37.674733+0000","last_fullsized":"2024-09-22T09:52:37.674733+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.256299+0000","last_change":"2024-09-22T09:54:30.256211+0000","last_active":"2024-09-22T09:54:30.256299+0000","last_peered":"2024-09-22T09:54:30.256299+0000","last_clean":"2024-09-22T09:54:30.256299+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:54:30.256299+0000","last_undegraded":"2024-09-22T09:54:30.256299+0000","last_fullsized":"2024-09-22T09:54:30.256299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.256110+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:21.124251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'226","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.531250+0000","last_change":"2024-09-22T09:54:29.531189+0000","last_active":"2024-09-22T09:54:29.531250+0000","last_peered":"2024-09-22T09:54:29.531250+0000","last_clean":"2024-09-22T09:54:29.531250+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:54:29.531250+0000","last_undegraded":"2024-09-22T09:54:29.531250+0000","last_fullsized":"2024-09-22T09:54:29.531250+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.531048+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:58.938306+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":50629,"num_write":1055,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.766423+0000","last_change":"2024-09-22T09:54:42.766423+0000","last_active":"2024-09-22T09:54:42.766423+0000","last_peered":"2024-09-22T09:54:42.766423+0000","last_clean":"2024-09-22T09:54:42.766423+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:54:42.766423+0000","last_undegraded":"2024-09-22T09:54:42.766423+0000","last_fullsized":"2024-09-22T09:54:42.766423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.766349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:21.722448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'56","reported_seq":577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.058832+0000","last_change":"2024-09-22T09:54:43.058832+0000","last_active":"2024-09-22T09:54:43.058832+0000","last_peered":"2024-09-22T09:54:43.058832+0000","last_clean":"2024-09-22T09:54:43.058832+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:54:43.058832+0000","last_undegraded":"2024-09-22T09:54:43.058832+0000","last_fullsized":"2024-09-22T09:54:43.058832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'56","last_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_deep_scrub":"262'56","last_deep_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.058746+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:58.206035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.568163+0000","last_change":"2024-09-22T09:54:48.568163+0000","last_active":"2024-09-22T09:54:48.568163+0000","last_peered":"2024-09-22T09:54:48.568163+0000","last_clean":"2024-09-22T09:54:48.568163+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:54:48.568163+0000","last_undegraded":"2024-09-22T09:54:48.568163+0000","last_fullsized":"2024-09-22T09:54:48.568163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.568064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:27.614483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'191","reported_seq":719,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.256425+0000","last_change":"2024-09-22T09:54:56.256359+0000","last_active":"2024-09-22T09:54:56.256425+0000","last_peered":"2024-09-22T09:54:56.256425+0000","last_clean":"2024-09-22T09:54:56.256425+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:54:56.256425+0000","last_undegraded":"2024-09-22T09:54:56.256425+0000","last_fullsized":"2024-09-22T09:54:56.256425+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.256268+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:51.889250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.804620+0000","last_change":"2024-09-22T09:54:30.804559+0000","last_active":"2024-09-22T09:54:30.804620+0000","last_peered":"2024-09-22T09:54:30.804620+0000","last_clean":"2024-09-22T09:54:30.804620+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:54:30.804620+0000","last_undegraded":"2024-09-22T09:54:30.804620+0000","last_fullsized":"2024-09-22T09:54:30.804620+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.804467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:02.621427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'206","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.611670+0000","last_change":"2024-09-22T09:54:24.611605+0000","last_active":"2024-09-22T09:54:24.611670+0000","last_peered":"2024-09-22T09:54:24.611670+0000","last_clean":"2024-09-22T09:54:24.611670+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:54:24.611670+0000","last_undegraded":"2024-09-22T09:54:24.611670+0000","last_fullsized":"2024-09-22T09:54:24.611670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.611501+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:30.061595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":559,"num_read_kb":27137,"num_write":994,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.609807+0000","last_change":"2024-09-22T09:54:40.609807+0000","last_active":"2024-09-22T09:54:40.609807+0000","last_peered":"2024-09-22T09:54:40.609807+0000","last_clean":"2024-09-22T09:54:40.609807+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:54:40.609807+0000","last_undegraded":"2024-09-22T09:54:40.609807+0000","last_fullsized":"2024-09-22T09:54:40.609807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.609720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:04.398179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'202","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.641002+0000","last_change":"2024-09-22T09:54:50.641002+0000","last_active":"2024-09-22T09:54:50.641002+0000","last_peered":"2024-09-22T09:54:50.641002+0000","last_clean":"2024-09-22T09:54:50.641002+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:54:50.641002+0000","last_undegraded":"2024-09-22T09:54:50.641002+0000","last_fullsized":"2024-09-22T09:54:50.641002+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.640907+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:17.725830+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":325,"num_write":146,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.951738+0000","last_change":"2024-09-22T09:54:40.951666+0000","last_active":"2024-09-22T09:54:40.951738+0000","last_peered":"2024-09-22T09:54:40.951738+0000","last_clean":"2024-09-22T09:54:40.951738+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:54:40.951738+0000","last_undegraded":"2024-09-22T09:54:40.951738+0000","last_fullsized":"2024-09-22T09:54:40.951738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.951575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:17.627570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'185","reported_seq":762,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.343566+0000","last_change":"2024-09-22T09:54:55.343493+0000","last_active":"2024-09-22T09:54:55.343566+0000","last_peered":"2024-09-22T09:54:55.343566+0000","last_clean":"2024-09-22T09:54:55.343566+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:54:55.343566+0000","last_undegraded":"2024-09-22T09:54:55.343566+0000","last_fullsized":"2024-09-22T09:54:55.343566+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.343408+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:52.216646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'174","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.801443+0000","last_change":"2024-09-22T09:54:36.801369+0000","last_active":"2024-09-22T09:54:36.801443+0000","last_peered":"2024-09-22T09:54:36.801443+0000","last_clean":"2024-09-22T09:54:36.801443+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:54:36.801443+0000","last_undegraded":"2024-09-22T09:54:36.801443+0000","last_fullsized":"2024-09-22T09:54:36.801443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.801284+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:30.780204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'205","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.092956+0000","last_change":"2024-09-22T09:54:23.092900+0000","last_active":"2024-09-22T09:54:23.092956+0000","last_peered":"2024-09-22T09:54:23.092956+0000","last_clean":"2024-09-22T09:54:23.092956+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:54:23.092956+0000","last_undegraded":"2024-09-22T09:54:23.092956+0000","last_fullsized":"2024-09-22T09:54:23.092956+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.092809+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:04.164807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":41854,"num_write":1021,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.914168+0000","last_change":"2024-09-22T09:54:35.914104+0000","last_active":"2024-09-22T09:54:35.914168+0000","last_peered":"2024-09-22T09:54:35.914168+0000","last_clean":"2024-09-22T09:54:35.914168+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:54:35.914168+0000","last_undegraded":"2024-09-22T09:54:35.914168+0000","last_fullsized":"2024-09-22T09:54:35.914168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.914016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:45.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'152","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.619933+0000","last_change":"2024-09-22T09:54:44.619933+0000","last_active":"2024-09-22T09:54:44.619933+0000","last_peered":"2024-09-22T09:54:44.619933+0000","last_clean":"2024-09-22T09:54:44.619933+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:54:44.619933+0000","last_undegraded":"2024-09-22T09:54:44.619933+0000","last_fullsized":"2024-09-22T09:54:44.619933+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'152","last_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_deep_scrub":"262'152","last_deep_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.619832+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:45.455510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":223,"num_write":104,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.156080+0000","last_change":"2024-09-22T09:54:49.156080+0000","last_active":"2024-09-22T09:54:49.156080+0000","last_peered":"2024-09-22T09:54:49.156080+0000","last_clean":"2024-09-22T09:54:49.156080+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:54:49.156080+0000","last_undegraded":"2024-09-22T09:54:49.156080+0000","last_fullsized":"2024-09-22T09:54:49.156080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.155977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:22.199690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":666,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.919258+0000","last_change":"2024-09-22T09:54:31.919258+0000","last_active":"2024-09-22T09:54:31.919258+0000","last_peered":"2024-09-22T09:54:31.919258+0000","last_clean":"2024-09-22T09:54:31.919258+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:54:31.919258+0000","last_undegraded":"2024-09-22T09:54:31.919258+0000","last_fullsized":"2024-09-22T09:54:31.919258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'88","last_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_deep_scrub":"262'88","last_deep_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.919161+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:25.614663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'205","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.829858+0000","last_change":"2024-09-22T09:54:23.829750+0000","last_active":"2024-09-22T09:54:23.829858+0000","last_peered":"2024-09-22T09:54:23.829858+0000","last_clean":"2024-09-22T09:54:23.829858+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:54:23.829858+0000","last_undegraded":"2024-09-22T09:54:23.829858+0000","last_fullsized":"2024-09-22T09:54:23.829858+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.829600+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:05.399205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":584,"num_read_kb":68522,"num_write":916,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.030334+0000","last_change":"2024-09-22T09:54:40.030334+0000","last_active":"2024-09-22T09:54:40.030334+0000","last_peered":"2024-09-22T09:54:40.030334+0000","last_clean":"2024-09-22T09:54:40.030334+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:54:40.030334+0000","last_undegraded":"2024-09-22T09:54:40.030334+0000","last_fullsized":"2024-09-22T09:54:40.030334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.030227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:27.501559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'240","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.184292+0000","last_change":"2024-09-22T09:54:38.184221+0000","last_active":"2024-09-22T09:54:38.184292+0000","last_peered":"2024-09-22T09:54:38.184292+0000","last_clean":"2024-09-22T09:54:38.184292+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:38.184292+0000","last_undegraded":"2024-09-22T09:54:38.184292+0000","last_fullsized":"2024-09-22T09:54:38.184292+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.184124+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:23:09.313158+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22939,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":353,"num_read_kb":545,"num_write":228,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.317500+0000","last_change":"2024-09-22T09:54:50.317446+0000","last_active":"2024-09-22T09:54:50.317500+0000","last_peered":"2024-09-22T09:54:50.317500+0000","last_clean":"2024-09-22T09:54:50.317500+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:54:50.317500+0000","last_undegraded":"2024-09-22T09:54:50.317500+0000","last_fullsized":"2024-09-22T09:54:50.317500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.317363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.217756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'194","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:27.673289+0000","last_change":"2024-09-22T08:42:23.578025+0000","last_active":"2024-09-22T09:52:27.673289+0000","last_peered":"2024-09-22T09:52:27.673289+0000","last_clean":"2024-09-22T09:52:27.673289+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:52:27.673289+0000","last_undegraded":"2024-09-22T09:52:27.673289+0000","last_fullsized":"2024-09-22T09:52:27.673289+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.022554+0000","last_change":"2024-09-22T09:54:33.022554+0000","last_active":"2024-09-22T09:54:33.022554+0000","last_peered":"2024-09-22T09:54:33.022554+0000","last_clean":"2024-09-22T09:54:33.022554+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:54:33.022554+0000","last_undegraded":"2024-09-22T09:54:33.022554+0000","last_fullsized":"2024-09-22T09:54:33.022554+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.022460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:44.487313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'225","reported_seq":887,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.283055+0000","last_change":"2024-09-22T09:54:22.283055+0000","last_active":"2024-09-22T09:54:22.283055+0000","last_peered":"2024-09-22T09:54:22.283055+0000","last_clean":"2024-09-22T09:54:22.283055+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:54:22.283055+0000","last_undegraded":"2024-09-22T09:54:22.283055+0000","last_fullsized":"2024-09-22T09:54:22.283055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'225","last_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_deep_scrub":"262'225","last_deep_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.282952+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:16:25.985099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5108,"num_write":1161,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.898739+0000","last_change":"2024-09-22T09:54:36.898739+0000","last_active":"2024-09-22T09:54:36.898739+0000","last_peered":"2024-09-22T09:54:36.898739+0000","last_clean":"2024-09-22T09:54:36.898739+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:54:36.898739+0000","last_undegraded":"2024-09-22T09:54:36.898739+0000","last_fullsized":"2024-09-22T09:54:36.898739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.898653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:53.057131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'214","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.603612+0000","last_change":"2024-09-22T09:54:46.603533+0000","last_active":"2024-09-22T09:54:46.603612+0000","last_peered":"2024-09-22T09:54:46.603612+0000","last_clean":"2024-09-22T09:54:46.603612+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:54:46.603612+0000","last_undegraded":"2024-09-22T09:54:46.603612+0000","last_fullsized":"2024-09-22T09:54:46.603612+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.603406+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:10.085025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":279,"num_read_kb":343,"num_write":184,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.145446+0000","last_change":"2024-09-22T09:54:43.145372+0000","last_active":"2024-09-22T09:54:43.145446+0000","last_peered":"2024-09-22T09:54:43.145446+0000","last_clean":"2024-09-22T09:54:43.145446+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:54:43.145446+0000","last_undegraded":"2024-09-22T09:54:43.145446+0000","last_fullsized":"2024-09-22T09:54:43.145446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:47.362163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'173","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.061065+0000","last_change":"2024-09-22T09:54:46.060996+0000","last_active":"2024-09-22T09:54:46.061065+0000","last_peered":"2024-09-22T09:54:46.061065+0000","last_clean":"2024-09-22T09:54:46.061065+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:54:46.061065+0000","last_undegraded":"2024-09-22T09:54:46.061065+0000","last_fullsized":"2024-09-22T09:54:46.061065+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.060901+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:32.950276+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.831015+0000","last_change":"2024-09-22T09:54:38.830960+0000","last_active":"2024-09-22T09:54:38.831015+0000","last_peered":"2024-09-22T09:54:38.831015+0000","last_clean":"2024-09-22T09:54:38.831015+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:54:38.831015+0000","last_undegraded":"2024-09-22T09:54:38.831015+0000","last_fullsized":"2024-09-22T09:54:38.831015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.830853+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:26.729478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'192","reported_seq":926,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.801551+0000","last_change":"2024-09-22T09:54:22.801488+0000","last_active":"2024-09-22T09:54:22.801551+0000","last_peered":"2024-09-22T09:54:22.801551+0000","last_clean":"2024-09-22T09:54:22.801551+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:54:22.801551+0000","last_undegraded":"2024-09-22T09:54:22.801551+0000","last_fullsized":"2024-09-22T09:54:22.801551+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'192","last_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_deep_scrub":"262'192","last_deep_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.801355+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:29.354984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1210,"num_read_kb":5814,"num_write":981,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.557269+0000","last_change":"2024-09-22T09:54:43.557207+0000","last_active":"2024-09-22T09:54:43.557269+0000","last_peered":"2024-09-22T09:54:43.557269+0000","last_clean":"2024-09-22T09:54:43.557269+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:54:43.557269+0000","last_undegraded":"2024-09-22T09:54:43.557269+0000","last_fullsized":"2024-09-22T09:54:43.557269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.557120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:55.802787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'165","reported_seq":763,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.681387+0000","last_change":"2024-09-22T09:54:51.681387+0000","last_active":"2024-09-22T09:54:51.681387+0000","last_peered":"2024-09-22T09:54:51.681387+0000","last_clean":"2024-09-22T09:54:51.681387+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:54:51.681387+0000","last_undegraded":"2024-09-22T09:54:51.681387+0000","last_fullsized":"2024-09-22T09:54:51.681387+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.681288+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.079311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":298,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.177280+0000","last_change":"2024-09-22T09:54:44.177280+0000","last_active":"2024-09-22T09:54:44.177280+0000","last_peered":"2024-09-22T09:54:44.177280+0000","last_clean":"2024-09-22T09:54:44.177280+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:54:44.177280+0000","last_undegraded":"2024-09-22T09:54:44.177280+0000","last_fullsized":"2024-09-22T09:54:44.177280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.177187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:19.025037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'118","reported_seq":621,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.318392+0000","last_change":"2024-09-22T09:54:54.318392+0000","last_active":"2024-09-22T09:54:54.318392+0000","last_peered":"2024-09-22T09:54:54.318392+0000","last_clean":"2024-09-22T09:54:54.318392+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:54.318392+0000","last_undegraded":"2024-09-22T09:54:54.318392+0000","last_fullsized":"2024-09-22T09:54:54.318392+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.318291+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:38.349114+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.691988+0000","last_change":"2024-09-22T09:54:25.691931+0000","last_active":"2024-09-22T09:54:25.691988+0000","last_peered":"2024-09-22T09:54:25.691988+0000","last_clean":"2024-09-22T09:54:25.691988+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:54:25.691988+0000","last_undegraded":"2024-09-22T09:54:25.691988+0000","last_fullsized":"2024-09-22T09:54:25.691988+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.691841+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.638310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'240","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.101189+0000","last_change":"2024-09-22T09:54:22.101130+0000","last_active":"2024-09-22T09:54:22.101189+0000","last_peered":"2024-09-22T09:54:22.101189+0000","last_clean":"2024-09-22T09:54:22.101189+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:54:22.101189+0000","last_undegraded":"2024-09-22T09:54:22.101189+0000","last_fullsized":"2024-09-22T09:54:22.101189+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.101055+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:06.230927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":123234,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.210365+0000","last_change":"2024-09-22T09:54:40.210304+0000","last_active":"2024-09-22T09:54:40.210365+0000","last_peered":"2024-09-22T09:54:40.210365+0000","last_clean":"2024-09-22T09:54:40.210365+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:54:40.210365+0000","last_undegraded":"2024-09-22T09:54:40.210365+0000","last_fullsized":"2024-09-22T09:54:40.210365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.210210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:43.908095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'128","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.603142+0000","last_change":"2024-09-22T09:54:48.603142+0000","last_active":"2024-09-22T09:54:48.603142+0000","last_peered":"2024-09-22T09:54:48.603142+0000","last_clean":"2024-09-22T09:54:48.603142+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:54:48.603142+0000","last_undegraded":"2024-09-22T09:54:48.603142+0000","last_fullsized":"2024-09-22T09:54:48.603142+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'128","last_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_deep_scrub":"262'128","last_deep_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.603050+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:49.371561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'759","reported_seq":4739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.958949+0000","last_change":"2024-09-22T09:54:42.958949+0000","last_active":"2024-09-22T09:54:42.958949+0000","last_peered":"2024-09-22T09:54:42.958949+0000","last_clean":"2024-09-22T09:54:42.958949+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:42.958949+0000","last_undegraded":"2024-09-22T09:54:42.958949+0000","last_fullsized":"2024-09-22T09:54:42.958949+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.958819+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:45.949669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'148","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.581940+0000","last_change":"2024-09-22T09:54:52.581940+0000","last_active":"2024-09-22T09:54:52.581940+0000","last_peered":"2024-09-22T09:54:52.581940+0000","last_clean":"2024-09-22T09:54:52.581940+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:54:52.581940+0000","last_undegraded":"2024-09-22T09:54:52.581940+0000","last_fullsized":"2024-09-22T09:54:52.581940+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.581848+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:34.153212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":725,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.678521+0000","last_change":"2024-09-22T09:54:32.678447+0000","last_active":"2024-09-22T09:54:32.678521+0000","last_peered":"2024-09-22T09:54:32.678521+0000","last_clean":"2024-09-22T09:54:32.678521+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:54:32.678521+0000","last_undegraded":"2024-09-22T09:54:32.678521+0000","last_fullsized":"2024-09-22T09:54:32.678521+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.678357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:18.763576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'293","reported_seq":1033,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.668274+0000","last_change":"2024-09-22T09:54:22.668274+0000","last_active":"2024-09-22T09:54:22.668274+0000","last_peered":"2024-09-22T09:54:22.668274+0000","last_clean":"2024-09-22T09:54:22.668274+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:54:22.668274+0000","last_undegraded":"2024-09-22T09:54:22.668274+0000","last_fullsized":"2024-09-22T09:54:22.668274+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'293","last_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_deep_scrub":"262'293","last_deep_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.668200+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:57.525651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1304,"num_read_kb":50200,"num_write":1267,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"262'4","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.607268+0000","last_change":"2024-09-22T09:54:41.607211+0000","last_active":"2024-09-22T09:54:41.607268+0000","last_peered":"2024-09-22T09:54:41.607268+0000","last_clean":"2024-09-22T09:54:41.607268+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:41.607268+0000","last_undegraded":"2024-09-22T09:54:41.607268+0000","last_fullsized":"2024-09-22T09:54:41.607268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.607128+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:13.784197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'222","reported_seq":833,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.293890+0000","last_change":"2024-09-22T09:54:48.293890+0000","last_active":"2024-09-22T09:54:48.293890+0000","last_peered":"2024-09-22T09:54:48.293890+0000","last_clean":"2024-09-22T09:54:48.293890+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:54:48.293890+0000","last_undegraded":"2024-09-22T09:54:48.293890+0000","last_fullsized":"2024-09-22T09:54:48.293890+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.293771+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:35.851163+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6055,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":273,"num_read_kb":326,"num_write":162,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.123632+0000","last_change":"2024-09-22T09:54:50.123578+0000","last_active":"2024-09-22T09:54:50.123632+0000","last_peered":"2024-09-22T09:54:50.123632+0000","last_clean":"2024-09-22T09:54:50.123632+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:54:50.123632+0000","last_undegraded":"2024-09-22T09:54:50.123632+0000","last_fullsized":"2024-09-22T09:54:50.123632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.123483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:56.260363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'144","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.622400+0000","last_change":"2024-09-22T09:54:54.622339+0000","last_active":"2024-09-22T09:54:54.622400+0000","last_peered":"2024-09-22T09:54:54.622400+0000","last_clean":"2024-09-22T09:54:54.622400+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:54:54.622400+0000","last_undegraded":"2024-09-22T09:54:54.622400+0000","last_fullsized":"2024-09-22T09:54:54.622400+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'144","last_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_deep_scrub":"262'144","last_deep_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.622250+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:09.716918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.725728+0000","last_change":"2024-09-22T09:54:31.725674+0000","last_active":"2024-09-22T09:54:31.725728+0000","last_peered":"2024-09-22T09:54:31.725728+0000","last_clean":"2024-09-22T09:54:31.725728+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:54:31.725728+0000","last_undegraded":"2024-09-22T09:54:31.725728+0000","last_fullsized":"2024-09-22T09:54:31.725728+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.725590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:46.484791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'213","reported_seq":818,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.635302+0000","last_change":"2024-09-22T09:54:23.635302+0000","last_active":"2024-09-22T09:54:23.635302+0000","last_peered":"2024-09-22T09:54:23.635302+0000","last_clean":"2024-09-22T09:54:23.635302+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:54:23.635302+0000","last_undegraded":"2024-09-22T09:54:23.635302+0000","last_fullsized":"2024-09-22T09:54:23.635302+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.635178+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:34.216176+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26654,"num_write":910,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.259561+0000","last_change":"2024-09-22T09:54:43.259487+0000","last_active":"2024-09-22T09:54:43.259561+0000","last_peered":"2024-09-22T09:54:43.259561+0000","last_clean":"2024-09-22T09:54:43.259561+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:54:43.259561+0000","last_undegraded":"2024-09-22T09:54:43.259561+0000","last_fullsized":"2024-09-22T09:54:43.259561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.259390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:20.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'149","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.104170+0000","last_change":"2024-09-22T09:54:45.104115+0000","last_active":"2024-09-22T09:54:45.104170+0000","last_peered":"2024-09-22T09:54:45.104170+0000","last_clean":"2024-09-22T09:54:45.104170+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:54:45.104170+0000","last_undegraded":"2024-09-22T09:54:45.104170+0000","last_fullsized":"2024-09-22T09:54:45.104170+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.104013+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:03.942310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6811,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":273,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.046201+0000","last_change":"2024-09-22T09:54:45.046144+0000","last_active":"2024-09-22T09:54:45.046201+0000","last_peered":"2024-09-22T09:54:45.046201+0000","last_clean":"2024-09-22T09:54:45.046201+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:54:45.046201+0000","last_undegraded":"2024-09-22T09:54:45.046201+0000","last_fullsized":"2024-09-22T09:54:45.046201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.046060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:52:11.746875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'143","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:32.674144+0000","last_change":"2024-09-22T08:42:23.578032+0000","last_active":"2024-09-22T09:52:32.674144+0000","last_peered":"2024-09-22T09:52:32.674144+0000","last_clean":"2024-09-22T09:52:32.674144+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:52:32.674144+0000","last_undegraded":"2024-09-22T09:52:32.674144+0000","last_fullsized":"2024-09-22T09:52:32.674144+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T08:42:22.461616+0000","last_clean_scrub_stamp":"2024-09-22T08:42:22.461616+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":890,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.772041+0000","last_change":"2024-09-22T09:54:35.772041+0000","last_active":"2024-09-22T09:54:35.772041+0000","last_peered":"2024-09-22T09:54:35.772041+0000","last_clean":"2024-09-22T09:54:35.772041+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:54:35.772041+0000","last_undegraded":"2024-09-22T09:54:35.772041+0000","last_fullsized":"2024-09-22T09:54:35.772041+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.771951+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:46.651125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'277","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.864381+0000","last_change":"2024-09-22T09:54:24.864311+0000","last_active":"2024-09-22T09:54:24.864381+0000","last_peered":"2024-09-22T09:54:24.864381+0000","last_clean":"2024-09-22T09:54:24.864381+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:54:24.864381+0000","last_undegraded":"2024-09-22T09:54:24.864381+0000","last_fullsized":"2024-09-22T09:54:24.864381+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.864187+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:28.585786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":745,"num_read_kb":35485,"num_write":1188,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.589608+0000","last_change":"2024-09-22T09:54:41.589523+0000","last_active":"2024-09-22T09:54:41.589608+0000","last_peered":"2024-09-22T09:54:41.589608+0000","last_clean":"2024-09-22T09:54:41.589608+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:54:41.589608+0000","last_undegraded":"2024-09-22T09:54:41.589608+0000","last_fullsized":"2024-09-22T09:54:41.589608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.589412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:53.383562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'117","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.656741+0000","last_change":"2024-09-22T09:54:53.656741+0000","last_active":"2024-09-22T09:54:53.656741+0000","last_peered":"2024-09-22T09:54:53.656741+0000","last_clean":"2024-09-22T09:54:53.656741+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:54:53.656741+0000","last_undegraded":"2024-09-22T09:54:53.656741+0000","last_fullsized":"2024-09-22T09:54:53.656741+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.656660+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:11.088340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":258,"num_write":80,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.625537+0000","last_change":"2024-09-22T09:54:50.625479+0000","last_active":"2024-09-22T09:54:50.625537+0000","last_peered":"2024-09-22T09:54:50.625537+0000","last_clean":"2024-09-22T09:54:50.625537+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:54:50.625537+0000","last_undegraded":"2024-09-22T09:54:50.625537+0000","last_fullsized":"2024-09-22T09:54:50.625537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.625391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:36.473029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'165","reported_seq":1642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.619056+0000","last_change":"2024-09-22T09:54:53.618972+0000","last_active":"2024-09-22T09:54:53.619056+0000","last_peered":"2024-09-22T09:54:53.619056+0000","last_clean":"2024-09-22T09:54:53.619056+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:54:53.619056+0000","last_undegraded":"2024-09-22T09:54:53.619056+0000","last_fullsized":"2024-09-22T09:54:53.619056+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.618875+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:04.804623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.687095+0000","last_change":"2024-09-22T09:54:30.687043+0000","last_active":"2024-09-22T09:54:30.687095+0000","last_peered":"2024-09-22T09:54:30.687095+0000","last_clean":"2024-09-22T09:54:30.687095+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:54:30.687095+0000","last_undegraded":"2024-09-22T09:54:30.687095+0000","last_fullsized":"2024-09-22T09:54:30.687095+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4461","last_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_deep_scrub":"262'4461","last_deep_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.686961+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:59.557234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'237","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.054638+0000","last_change":"2024-09-22T09:54:24.054638+0000","last_active":"2024-09-22T09:54:24.054638+0000","last_peered":"2024-09-22T09:54:24.054638+0000","last_clean":"2024-09-22T09:54:24.054638+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:54:24.054638+0000","last_undegraded":"2024-09-22T09:54:24.054638+0000","last_fullsized":"2024-09-22T09:54:24.054638+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.054495+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:26:50.248679+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":602,"num_read_kb":45002,"num_write":1097,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.198471+0000","last_change":"2024-09-22T09:54:37.198471+0000","last_active":"2024-09-22T09:54:37.198471+0000","last_peered":"2024-09-22T09:54:37.198471+0000","last_clean":"2024-09-22T09:54:37.198471+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:54:37.198471+0000","last_undegraded":"2024-09-22T09:54:37.198471+0000","last_fullsized":"2024-09-22T09:54:37.198471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.198370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:57.482827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'222","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.607437+0000","last_change":"2024-09-22T09:54:46.607378+0000","last_active":"2024-09-22T09:54:46.607437+0000","last_peered":"2024-09-22T09:54:46.607437+0000","last_clean":"2024-09-22T09:54:46.607437+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:54:46.607437+0000","last_undegraded":"2024-09-22T09:54:46.607437+0000","last_fullsized":"2024-09-22T09:54:46.607437+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.607285+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:00.061934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":792,"num_write":216,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.133185+0000","last_change":"2024-09-22T09:54:52.133089+0000","last_active":"2024-09-22T09:54:52.133185+0000","last_peered":"2024-09-22T09:54:52.133185+0000","last_clean":"2024-09-22T09:54:52.133185+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:54:52.133185+0000","last_undegraded":"2024-09-22T09:54:52.133185+0000","last_fullsized":"2024-09-22T09:54:52.133185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.132987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:10.463039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'129","reported_seq":644,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.608859+0000","last_change":"2024-09-22T09:54:53.608859+0000","last_active":"2024-09-22T09:54:53.608859+0000","last_peered":"2024-09-22T09:54:53.608859+0000","last_clean":"2024-09-22T09:54:53.608859+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:54:53.608859+0000","last_undegraded":"2024-09-22T09:54:53.608859+0000","last_fullsized":"2024-09-22T09:54:53.608859+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.608769+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:07.256774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.181260+0000","last_change":"2024-09-22T09:54:34.181260+0000","last_active":"2024-09-22T09:54:34.181260+0000","last_peered":"2024-09-22T09:54:34.181260+0000","last_clean":"2024-09-22T09:54:34.181260+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:54:34.181260+0000","last_undegraded":"2024-09-22T09:54:34.181260+0000","last_fullsized":"2024-09-22T09:54:34.181260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'179","last_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_deep_scrub":"262'179","last_deep_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.181177+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:28.301187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'198","reported_seq":859,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.782744+0000","last_change":"2024-09-22T09:54:24.782744+0000","last_active":"2024-09-22T09:54:24.782744+0000","last_peered":"2024-09-22T09:54:24.782744+0000","last_clean":"2024-09-22T09:54:24.782744+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:54:24.782744+0000","last_undegraded":"2024-09-22T09:54:24.782744+0000","last_fullsized":"2024-09-22T09:54:24.782744+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.782631+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:03:28.457706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":68297,"num_write":940,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":977,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.209160+0000","last_change":"2024-09-22T09:54:32.209160+0000","last_active":"2024-09-22T09:54:32.209160+0000","last_peered":"2024-09-22T09:54:32.209160+0000","last_clean":"2024-09-22T09:54:32.209160+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:54:32.209160+0000","last_undegraded":"2024-09-22T09:54:32.209160+0000","last_fullsized":"2024-09-22T09:54:32.209160+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.209076+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.157428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'194","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.679547+0000","last_change":"2024-09-22T09:54:24.679547+0000","last_active":"2024-09-22T09:54:24.679547+0000","last_peered":"2024-09-22T09:54:24.679547+0000","last_clean":"2024-09-22T09:54:24.679547+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:54:24.679547+0000","last_undegraded":"2024-09-22T09:54:24.679547+0000","last_fullsized":"2024-09-22T09:54:24.679547+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.679384+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:52.319029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":8670,"num_write":934,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.382536+0000","last_change":"2024-09-22T09:54:35.382536+0000","last_active":"2024-09-22T09:54:35.382536+0000","last_peered":"2024-09-22T09:54:35.382536+0000","last_clean":"2024-09-22T09:54:35.382536+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:54:35.382536+0000","last_undegraded":"2024-09-22T09:54:35.382536+0000","last_fullsized":"2024-09-22T09:54:35.382536+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.382442+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:41.378476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'197","reported_seq":830,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.543796+0000","last_change":"2024-09-22T09:54:26.543796+0000","last_active":"2024-09-22T09:54:26.543796+0000","last_peered":"2024-09-22T09:54:26.543796+0000","last_clean":"2024-09-22T09:54:26.543796+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:54:26.543796+0000","last_undegraded":"2024-09-22T09:54:26.543796+0000","last_fullsized":"2024-09-22T09:54:26.543796+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.543655+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:59.656939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":611,"num_read_kb":542,"num_write":1015,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.195206+0000","last_change":"2024-09-22T09:54:33.195206+0000","last_active":"2024-09-22T09:54:33.195206+0000","last_peered":"2024-09-22T09:54:33.195206+0000","last_clean":"2024-09-22T09:54:33.195206+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:54:33.195206+0000","last_undegraded":"2024-09-22T09:54:33.195206+0000","last_fullsized":"2024-09-22T09:54:33.195206+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.195108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:04.521832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'205","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.083506+0000","last_change":"2024-09-22T09:54:25.083506+0000","last_active":"2024-09-22T09:54:25.083506+0000","last_peered":"2024-09-22T09:54:25.083506+0000","last_clean":"2024-09-22T09:54:25.083506+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:54:25.083506+0000","last_undegraded":"2024-09-22T09:54:25.083506+0000","last_fullsized":"2024-09-22T09:54:25.083506+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.083235+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:40.697324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":724,"num_read_kb":18552,"num_write":938,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.803183+0000","last_change":"2024-09-22T09:54:37.803183+0000","last_active":"2024-09-22T09:54:37.803183+0000","last_peered":"2024-09-22T09:54:37.803183+0000","last_clean":"2024-09-22T09:54:37.803183+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:54:37.803183+0000","last_undegraded":"2024-09-22T09:54:37.803183+0000","last_fullsized":"2024-09-22T09:54:37.803183+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.803092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:22.441183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'222","reported_seq":878,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.900669+0000","last_change":"2024-09-22T09:54:25.900669+0000","last_active":"2024-09-22T09:54:25.900669+0000","last_peered":"2024-09-22T09:54:25.900669+0000","last_clean":"2024-09-22T09:54:25.900669+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:54:25.900669+0000","last_undegraded":"2024-09-22T09:54:25.900669+0000","last_fullsized":"2024-09-22T09:54:25.900669+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.900557+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:40.029656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":30794,"num_write":966,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'220","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.668933+0000","last_change":"2024-09-22T09:54:33.668933+0000","last_active":"2024-09-22T09:54:33.668933+0000","last_peered":"2024-09-22T09:54:33.668933+0000","last_clean":"2024-09-22T09:54:33.668933+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:54:33.668933+0000","last_undegraded":"2024-09-22T09:54:33.668933+0000","last_fullsized":"2024-09-22T09:54:33.668933+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.668849+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:00.473679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'282","reported_seq":980,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.200420+0000","last_change":"2024-09-22T09:54:26.200420+0000","last_active":"2024-09-22T09:54:26.200420+0000","last_peered":"2024-09-22T09:54:26.200420+0000","last_clean":"2024-09-22T09:54:26.200420+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:54:26.200420+0000","last_undegraded":"2024-09-22T09:54:26.200420+0000","last_fullsized":"2024-09-22T09:54:26.200420+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.200277+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:20.326052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242911,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":757,"num_read_kb":37026,"num_write":1221,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":793,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.820348+0000","last_change":"2024-09-22T09:54:39.820348+0000","last_active":"2024-09-22T09:54:39.820348+0000","last_peered":"2024-09-22T09:54:39.820348+0000","last_clean":"2024-09-22T09:54:39.820348+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:54:39.820348+0000","last_undegraded":"2024-09-22T09:54:39.820348+0000","last_fullsized":"2024-09-22T09:54:39.820348+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.820264+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:38.159333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'210","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.829055+0000","last_change":"2024-09-22T09:54:25.829055+0000","last_active":"2024-09-22T09:54:25.829055+0000","last_peered":"2024-09-22T09:54:25.829055+0000","last_clean":"2024-09-22T09:54:25.829055+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:54:25.829055+0000","last_undegraded":"2024-09-22T09:54:25.829055+0000","last_fullsized":"2024-09-22T09:54:25.829055+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.828882+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:15.511659+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":7650,"num_write":1038,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":640,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886298+0000","last_change":"2024-09-22T09:54:32.886298+0000","last_active":"2024-09-22T09:54:32.886298+0000","last_peered":"2024-09-22T09:54:32.886298+0000","last_clean":"2024-09-22T09:54:32.886298+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:54:32.886298+0000","last_undegraded":"2024-09-22T09:54:32.886298+0000","last_fullsized":"2024-09-22T09:54:32.886298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886187+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:19.355885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'229","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.850468+0000","last_change":"2024-09-22T09:54:31.850468+0000","last_active":"2024-09-22T09:54:31.850468+0000","last_peered":"2024-09-22T09:54:31.850468+0000","last_clean":"2024-09-22T09:54:31.850468+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:54:31.850468+0000","last_undegraded":"2024-09-22T09:54:31.850468+0000","last_fullsized":"2024-09-22T09:54:31.850468+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.850380+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:23.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":20476,"num_write":1023,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.087299+0000","last_change":"2024-09-22T09:54:35.087235+0000","last_active":"2024-09-22T09:54:35.087299+0000","last_peered":"2024-09-22T09:54:35.087299+0000","last_clean":"2024-09-22T09:54:35.087299+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:54:35.087299+0000","last_undegraded":"2024-09-22T09:54:35.087299+0000","last_fullsized":"2024-09-22T09:54:35.087299+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.087135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:07.485045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'186","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.512435+0000","last_change":"2024-09-22T09:54:27.512435+0000","last_active":"2024-09-22T09:54:27.512435+0000","last_peered":"2024-09-22T09:54:27.512435+0000","last_clean":"2024-09-22T09:54:27.512435+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:54:27.512435+0000","last_undegraded":"2024-09-22T09:54:27.512435+0000","last_fullsized":"2024-09-22T09:54:27.512435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.512262+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:12.723891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":7230,"num_write":907,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.708613+0000","last_change":"2024-09-22T09:54:36.708533+0000","last_active":"2024-09-22T09:54:36.708613+0000","last_peered":"2024-09-22T09:54:36.708613+0000","last_clean":"2024-09-22T09:54:36.708613+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:54:36.708613+0000","last_undegraded":"2024-09-22T09:54:36.708613+0000","last_fullsized":"2024-09-22T09:54:36.708613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.708407+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:19.337819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'226","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.887055+0000","last_change":"2024-09-22T09:54:27.887055+0000","last_active":"2024-09-22T09:54:27.887055+0000","last_peered":"2024-09-22T09:54:27.887055+0000","last_clean":"2024-09-22T09:54:27.887055+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:54:27.887055+0000","last_undegraded":"2024-09-22T09:54:27.887055+0000","last_fullsized":"2024-09-22T09:54:27.887055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.886918+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:01.730176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1623,"num_read_kb":135465,"num_write":994,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'143","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.688731+0000","last_change":"2024-09-22T09:54:26.688731+0000","last_active":"2024-09-22T09:54:26.688731+0000","last_peered":"2024-09-22T09:54:26.688731+0000","last_clean":"2024-09-22T09:54:26.688731+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:54:26.688731+0000","last_undegraded":"2024-09-22T09:54:26.688731+0000","last_fullsized":"2024-09-22T09:54:26.688731+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.688639+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:53.157417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'180","reported_seq":793,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.510853+0000","last_change":"2024-09-22T09:54:28.510853+0000","last_active":"2024-09-22T09:54:28.510853+0000","last_peered":"2024-09-22T09:54:28.510853+0000","last_clean":"2024-09-22T09:54:28.510853+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:54:28.510853+0000","last_undegraded":"2024-09-22T09:54:28.510853+0000","last_fullsized":"2024-09-22T09:54:28.510853+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'180","last_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_deep_scrub":"262'180","last_deep_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.510744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.855576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170178,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":30385,"num_write":838,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.664254+0000","last_change":"2024-09-22T09:54:34.664254+0000","last_active":"2024-09-22T09:54:34.664254+0000","last_peered":"2024-09-22T09:54:34.664254+0000","last_clean":"2024-09-22T09:54:34.664254+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:54:34.664254+0000","last_undegraded":"2024-09-22T09:54:34.664254+0000","last_fullsized":"2024-09-22T09:54:34.664254+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.664136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:52.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.042434+0000","last_change":"2024-09-22T09:54:26.042434+0000","last_active":"2024-09-22T09:54:26.042434+0000","last_peered":"2024-09-22T09:54:26.042434+0000","last_clean":"2024-09-22T09:54:26.042434+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:54:26.042434+0000","last_undegraded":"2024-09-22T09:54:26.042434+0000","last_fullsized":"2024-09-22T09:54:26.042434+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.042281+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:00.923861+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":23430,"num_write":912,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.612459+0000","last_change":"2024-09-22T09:54:35.612459+0000","last_active":"2024-09-22T09:54:35.612459+0000","last_peered":"2024-09-22T09:54:35.612459+0000","last_clean":"2024-09-22T09:54:35.612459+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:54:35.612459+0000","last_undegraded":"2024-09-22T09:54:35.612459+0000","last_fullsized":"2024-09-22T09:54:35.612459+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'276","last_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_deep_scrub":"262'276","last_deep_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.612365+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:05.176874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'212","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.863062+0000","last_change":"2024-09-22T09:54:26.863062+0000","last_active":"2024-09-22T09:54:26.863062+0000","last_peered":"2024-09-22T09:54:26.863062+0000","last_clean":"2024-09-22T09:54:26.863062+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:54:26.863062+0000","last_undegraded":"2024-09-22T09:54:26.863062+0000","last_fullsized":"2024-09-22T09:54:26.863062+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.862976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:17.663525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":16539,"num_write":978,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.043413+0000","last_change":"2024-09-22T09:54:34.043413+0000","last_active":"2024-09-22T09:54:34.043413+0000","last_peered":"2024-09-22T09:54:34.043413+0000","last_clean":"2024-09-22T09:54:34.043413+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:54:34.043413+0000","last_undegraded":"2024-09-22T09:54:34.043413+0000","last_fullsized":"2024-09-22T09:54:34.043413+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.043310+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:36.199673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'199","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.591536+0000","last_change":"2024-09-22T09:54:32.591536+0000","last_active":"2024-09-22T09:54:32.591536+0000","last_peered":"2024-09-22T09:54:32.591536+0000","last_clean":"2024-09-22T09:54:32.591536+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:54:32.591536+0000","last_undegraded":"2024-09-22T09:54:32.591536+0000","last_fullsized":"2024-09-22T09:54:32.591536+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.591400+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:24.382819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":32145,"num_write":913,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.799963+0000","last_change":"2024-09-22T09:54:41.799963+0000","last_active":"2024-09-22T09:54:41.799963+0000","last_peered":"2024-09-22T09:54:41.799963+0000","last_clean":"2024-09-22T09:54:41.799963+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:54:41.799963+0000","last_undegraded":"2024-09-22T09:54:41.799963+0000","last_fullsized":"2024-09-22T09:54:41.799963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'91","last_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_deep_scrub":"262'91","last_deep_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.799878+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:39:52.935799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'203","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.684314+0000","last_change":"2024-09-22T09:54:27.684247+0000","last_active":"2024-09-22T09:54:27.684314+0000","last_peered":"2024-09-22T09:54:27.684314+0000","last_clean":"2024-09-22T09:54:27.684314+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:54:27.684314+0000","last_undegraded":"2024-09-22T09:54:27.684314+0000","last_fullsized":"2024-09-22T09:54:27.684314+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.684082+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:03.070485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493665,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":31835,"num_write":1011,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.613984+0000","last_change":"2024-09-22T09:54:34.613984+0000","last_active":"2024-09-22T09:54:34.613984+0000","last_peered":"2024-09-22T09:54:34.613984+0000","last_clean":"2024-09-22T09:54:34.613984+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:54:34.613984+0000","last_undegraded":"2024-09-22T09:54:34.613984+0000","last_fullsized":"2024-09-22T09:54:34.613984+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'154","last_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_deep_scrub":"262'154","last_deep_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.613865+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'227","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.479127+0000","last_change":"2024-09-22T09:54:29.479067+0000","last_active":"2024-09-22T09:54:29.479127+0000","last_peered":"2024-09-22T09:54:29.479127+0000","last_clean":"2024-09-22T09:54:29.479127+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:54:29.479127+0000","last_undegraded":"2024-09-22T09:54:29.479127+0000","last_fullsized":"2024-09-22T09:54:29.479127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.478897+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:08.606241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242963,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":33540,"num_write":1138,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'203","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.379662+0000","last_change":"2024-09-22T09:54:31.379607+0000","last_active":"2024-09-22T09:54:31.379662+0000","last_peered":"2024-09-22T09:54:31.379662+0000","last_clean":"2024-09-22T09:54:31.379662+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:54:31.379662+0000","last_undegraded":"2024-09-22T09:54:31.379662+0000","last_fullsized":"2024-09-22T09:54:31.379662+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.379436+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:11.349573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":478,"num_read_kb":16611,"num_write":909,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.056709+0000","last_change":"2024-09-22T09:54:36.056645+0000","last_active":"2024-09-22T09:54:36.056709+0000","last_peered":"2024-09-22T09:54:36.056709+0000","last_clean":"2024-09-22T09:54:36.056709+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:54:36.056709+0000","last_undegraded":"2024-09-22T09:54:36.056709+0000","last_fullsized":"2024-09-22T09:54:36.056709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.056545+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:56.184943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'230","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.226521+0000","last_change":"2024-09-22T09:54:25.226461+0000","last_active":"2024-09-22T09:54:25.226521+0000","last_peered":"2024-09-22T09:54:25.226521+0000","last_clean":"2024-09-22T09:54:25.226521+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:54:25.226521+0000","last_undegraded":"2024-09-22T09:54:25.226521+0000","last_fullsized":"2024-09-22T09:54:25.226521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'230","last_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_deep_scrub":"262'230","last_deep_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.226345+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:28.279869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":659,"num_read_kb":76384,"num_write":1027,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.389454+0000","last_change":"2024-09-22T09:54:37.389356+0000","last_active":"2024-09-22T09:54:37.389454+0000","last_peered":"2024-09-22T09:54:37.389454+0000","last_clean":"2024-09-22T09:54:37.389454+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:54:37.389454+0000","last_undegraded":"2024-09-22T09:54:37.389454+0000","last_fullsized":"2024-09-22T09:54:37.389454+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.389263+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:02.716245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1328,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":372077,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":10012,"num_read_kb":12519,"num_write":7007,"num_write_kb":3209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710212,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1817,"ondisk_log_size":1817,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35500,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":105523402,"num_objects":166,"num_object_clones":0,"num_object_copies":664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42464,"num_read_kb":2399835,"num_write":63370,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142622720,"data_stored":142622720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":189640,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189064,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543025,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265880,"kb_used_data":22280,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94105960,"statfs":{"total":96636764160,"available":96364503040,"internally_reserved":0,"allocated":22814720,"data_stored":20815259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543025,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291592,"kb_used_data":21624,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94080248,"statfs":{"total":96636764160,"available":96338173952,"internally_reserved":0,"allocated":22142976,"data_stored":20214796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543027,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100912,"kb_used_data":19808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94270928,"statfs":{"total":96636764160,"available":96533430272,"internally_reserved":0,"allocated":20283392,"data_stored":18282616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543026,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138192,"kb_used_data":26496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94233648,"statfs":{"total":96636764160,"available":96495255552,"internally_reserved":0,"allocated":27131904,"data_stored":25227113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543025,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18263996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543029,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91232,"kb_used_data":19792,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280608,"statfs":{"total":96636764160,"available":96543342592,"internally_reserved":0,"allocated":20267008,"data_stored":18362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543025,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149548,"kb_used_data":19868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94222292,"statfs":{"total":96636764160,"available":96483627008,"internally_reserved":0,"allocated":20344832,"data_stored":18397529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543027,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261744,"kb_used_data":23712,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110096,"statfs":{"total":96636764160,"available":96368738304,"internally_reserved":0,"allocated":24281088,"data_stored":22309261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16138240,"data_stored":16138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":16105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":16003072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22970368,"data_stored":22970368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16023552,"data_stored":16023552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17956864,"data_stored":17956864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17965056,"data_stored":17965056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.252 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.253 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.254 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.255 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.256 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.257 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.258 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.259 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.260 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.261 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-22T09:01:06.429720+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=6, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.262 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.262 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.262 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.262 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-22T08:57:03.347503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=57, tm_sec=3, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.263 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.263 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-22T08:42:20.436825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=20, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.263 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.264 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.264 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.265 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.265 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.265 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.266 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-22T08:42:22.461616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=8, tm_min=42, tm_sec=22, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:03.266 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:55:23.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:55:23.624 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:55:23.635 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:55:23.637 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2460,"stamp":"2024-09-22T09:55:22.448985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106502740,"num_objects":492,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":190601,"num_read_kb":2910687,"num_write":128942,"num_write_kb":2504267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749049,"num_omap_keys":1784,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13181,"ondisk_log_size":13181,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1548568,"kb_used_data":173336,"kb_used_omap":12,"kb_used_meta":1375091,"kb_avail":753426152,"statfs":{"total":773094113280,"available":771508379648,"internally_reserved":0,"allocated":177496064,"data_stored":161872998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1408093745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005232"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.299256+0000","last_change":"2024-09-22T09:55:07.299206+0000","last_active":"2024-09-22T09:55:07.299256+0000","last_peered":"2024-09-22T09:55:07.299256+0000","last_clean":"2024-09-22T09:55:07.299256+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:55:07.299256+0000","last_undegraded":"2024-09-22T09:55:07.299256+0000","last_fullsized":"2024-09-22T09:55:07.299256+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:07.299125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:07.299125+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.299125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:15.995717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'8","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.318067+0000","last_change":"2024-09-22T09:55:03.318067+0000","last_active":"2024-09-22T09:55:03.318067+0000","last_peered":"2024-09-22T09:55:03.318067+0000","last_clean":"2024-09-22T09:55:03.318067+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:55:03.318067+0000","last_undegraded":"2024-09-22T09:55:03.318067+0000","last_fullsized":"2024-09-22T09:55:03.318067+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:55:03.317973+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:55:03.317973+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.317973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:33.605682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.704703+0000","last_change":"2024-09-22T09:55:11.704703+0000","last_active":"2024-09-22T09:55:11.704703+0000","last_peered":"2024-09-22T09:55:11.704703+0000","last_clean":"2024-09-22T09:55:11.704703+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:55:11.704703+0000","last_undegraded":"2024-09-22T09:55:11.704703+0000","last_fullsized":"2024-09-22T09:55:11.704703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.704595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.704595+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.704595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:18.273590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":110,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.287753+0000","last_change":"2024-09-22T09:55:06.287753+0000","last_active":"2024-09-22T09:55:06.287753+0000","last_peered":"2024-09-22T09:55:06.287753+0000","last_clean":"2024-09-22T09:55:06.287753+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:55:06.287753+0000","last_undegraded":"2024-09-22T09:55:06.287753+0000","last_fullsized":"2024-09-22T09:55:06.287753+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-22T09:55:06.287655+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-22T09:55:06.287655+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.287655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:03.789868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.602831+0000","last_change":"2024-09-22T09:54:50.602742+0000","last_active":"2024-09-22T09:54:50.602831+0000","last_peered":"2024-09-22T09:54:50.602831+0000","last_clean":"2024-09-22T09:54:50.602831+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:54:50.602831+0000","last_undegraded":"2024-09-22T09:54:50.602831+0000","last_fullsized":"2024-09-22T09:54:50.602831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.602649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:34.691467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'9","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.657204+0000","last_change":"2024-09-22T09:55:07.657204+0000","last_active":"2024-09-22T09:55:07.657204+0000","last_peered":"2024-09-22T09:55:07.657204+0000","last_clean":"2024-09-22T09:55:07.657204+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:55:07.657204+0000","last_undegraded":"2024-09-22T09:55:07.657204+0000","last_fullsized":"2024-09-22T09:55:07.657204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:07.657111+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:07.657111+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.657111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:05.008295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":18432,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.176703+0000","last_change":"2024-09-22T09:54:54.176703+0000","last_active":"2024-09-22T09:54:54.176703+0000","last_peered":"2024-09-22T09:54:54.176703+0000","last_clean":"2024-09-22T09:54:54.176703+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:54:54.176703+0000","last_undegraded":"2024-09-22T09:54:54.176703+0000","last_fullsized":"2024-09-22T09:54:54.176703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.176615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:35.381475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.653812+0000","last_change":"2024-09-22T09:54:42.653745+0000","last_active":"2024-09-22T09:54:42.653812+0000","last_peered":"2024-09-22T09:54:42.653812+0000","last_clean":"2024-09-22T09:54:42.653812+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:54:42.653812+0000","last_undegraded":"2024-09-22T09:54:42.653812+0000","last_fullsized":"2024-09-22T09:54:42.653812+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'13","last_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_deep_scrub":"262'13","last_deep_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.653671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:37.734493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.078951+0000","last_change":"2024-09-22T09:54:59.078951+0000","last_active":"2024-09-22T09:54:59.078951+0000","last_peered":"2024-09-22T09:54:59.078951+0000","last_clean":"2024-09-22T09:54:59.078951+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:54:59.078951+0000","last_undegraded":"2024-09-22T09:54:59.078951+0000","last_fullsized":"2024-09-22T09:54:59.078951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.078866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.078866+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.078866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:10.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.386655+0000","last_change":"2024-09-22T09:55:14.386655+0000","last_active":"2024-09-22T09:55:14.386655+0000","last_peered":"2024-09-22T09:55:14.386655+0000","last_clean":"2024-09-22T09:55:14.386655+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:55:14.386655+0000","last_undegraded":"2024-09-22T09:55:14.386655+0000","last_fullsized":"2024-09-22T09:55:14.386655+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-22T09:55:14.386562+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-22T09:55:14.386562+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.386562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:33.973994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'4","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.616342+0000","last_change":"2024-09-22T09:54:46.616284+0000","last_active":"2024-09-22T09:54:46.616342+0000","last_peered":"2024-09-22T09:54:46.616342+0000","last_clean":"2024-09-22T09:54:46.616342+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:54:46.616342+0000","last_undegraded":"2024-09-22T09:54:46.616342+0000","last_fullsized":"2024-09-22T09:54:46.616342+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.616197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:24.250059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":619,"num_write":4,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":163,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.312049+0000","last_change":"2024-09-22T09:55:00.312049+0000","last_active":"2024-09-22T09:55:00.312049+0000","last_peered":"2024-09-22T09:55:00.312049+0000","last_clean":"2024-09-22T09:55:00.312049+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:55:00.312049+0000","last_undegraded":"2024-09-22T09:55:00.312049+0000","last_fullsized":"2024-09-22T09:55:00.312049+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-22T09:55:00.311954+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-22T09:55:00.311954+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.311954+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:01.955525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666624+0000","last_change":"2024-09-22T09:20:12.872367+0000","last_active":"2024-09-22T09:51:37.666624+0000","last_peered":"2024-09-22T09:51:37.666624+0000","last_clean":"2024-09-22T09:51:37.666624+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:51:37.666624+0000","last_undegraded":"2024-09-22T09:51:37.666624+0000","last_fullsized":"2024-09-22T09:51:37.666624+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:11:21.169557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":49,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:17.664253+0000","last_change":"2024-09-22T09:01:11.520077+0000","last_active":"2024-09-22T09:51:17.664253+0000","last_peered":"2024-09-22T09:51:17.664253+0000","last_clean":"2024-09-22T09:51:17.664253+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:51:17.664253+0000","last_undegraded":"2024-09-22T09:51:17.664253+0000","last_fullsized":"2024-09-22T09:51:17.664253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:27.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.712793+0000","last_change":"2024-09-22T09:55:02.712729+0000","last_active":"2024-09-22T09:55:02.712793+0000","last_peered":"2024-09-22T09:55:02.712793+0000","last_clean":"2024-09-22T09:55:02.712793+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:55:02.712793+0000","last_undegraded":"2024-09-22T09:55:02.712793+0000","last_fullsized":"2024-09-22T09:55:02.712793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.712642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.712642+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.712642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:52.549386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.782015+0000","last_change":"2024-09-22T09:55:08.782015+0000","last_active":"2024-09-22T09:55:08.782015+0000","last_peered":"2024-09-22T09:55:08.782015+0000","last_clean":"2024-09-22T09:55:08.782015+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:55:08.782015+0000","last_undegraded":"2024-09-22T09:55:08.782015+0000","last_fullsized":"2024-09-22T09:55:08.782015+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'22","last_scrub_stamp":"2024-09-22T09:55:08.781930+0000","last_deep_scrub":"262'22","last_deep_scrub_stamp":"2024-09-22T09:55:08.781930+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.781930+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:29.623449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:12.671292+0000","last_change":"2024-09-22T09:20:12.868694+0000","last_active":"2024-09-22T09:52:12.671292+0000","last_peered":"2024-09-22T09:52:12.671292+0000","last_clean":"2024-09-22T09:52:12.671292+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:52:12.671292+0000","last_undegraded":"2024-09-22T09:52:12.671292+0000","last_fullsized":"2024-09-22T09:52:12.671292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:41:02.365814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.274507+0000","last_change":"2024-09-22T09:55:04.274507+0000","last_active":"2024-09-22T09:55:04.274507+0000","last_peered":"2024-09-22T09:55:04.274507+0000","last_clean":"2024-09-22T09:55:04.274507+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:55:04.274507+0000","last_undegraded":"2024-09-22T09:55:04.274507+0000","last_fullsized":"2024-09-22T09:55:04.274507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-22T09:55:04.274420+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-22T09:55:04.274420+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.274420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:34.645383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.260782+0000","last_change":"2024-09-22T09:55:09.260782+0000","last_active":"2024-09-22T09:55:09.260782+0000","last_peered":"2024-09-22T09:55:09.260782+0000","last_clean":"2024-09-22T09:55:09.260782+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:55:09.260782+0000","last_undegraded":"2024-09-22T09:55:09.260782+0000","last_fullsized":"2024-09-22T09:55:09.260782+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.260676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.260676+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.260676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:41.080885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.791950+0000","last_change":"2024-09-22T09:55:07.791950+0000","last_active":"2024-09-22T09:55:07.791950+0000","last_peered":"2024-09-22T09:55:07.791950+0000","last_clean":"2024-09-22T09:55:07.791950+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:55:07.791950+0000","last_undegraded":"2024-09-22T09:55:07.791950+0000","last_fullsized":"2024-09-22T09:55:07.791950+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-22T09:55:07.791862+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-22T09:55:07.791862+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.791862+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:20.525249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.346337+0000","last_change":"2024-09-22T09:55:02.346337+0000","last_active":"2024-09-22T09:55:02.346337+0000","last_peered":"2024-09-22T09:55:02.346337+0000","last_clean":"2024-09-22T09:55:02.346337+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:55:02.346337+0000","last_undegraded":"2024-09-22T09:55:02.346337+0000","last_fullsized":"2024-09-22T09:55:02.346337+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.346255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.346255+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.346255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:22.616932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.070429+0000","last_change":"2024-09-22T09:54:55.070429+0000","last_active":"2024-09-22T09:54:55.070429+0000","last_peered":"2024-09-22T09:54:55.070429+0000","last_clean":"2024-09-22T09:54:55.070429+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:54:55.070429+0000","last_undegraded":"2024-09-22T09:54:55.070429+0000","last_fullsized":"2024-09-22T09:54:55.070429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.070344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:57.666280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.657818+0000","last_change":"2024-09-22T09:55:00.657818+0000","last_active":"2024-09-22T09:55:00.657818+0000","last_peered":"2024-09-22T09:55:00.657818+0000","last_clean":"2024-09-22T09:55:00.657818+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:55:00.657818+0000","last_undegraded":"2024-09-22T09:55:00.657818+0000","last_fullsized":"2024-09-22T09:55:00.657818+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-22T09:55:00.657727+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-22T09:55:00.657727+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.657727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:12.801374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":269,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.114568+0000","last_change":"2024-09-22T09:54:51.114568+0000","last_active":"2024-09-22T09:54:51.114568+0000","last_peered":"2024-09-22T09:54:51.114568+0000","last_clean":"2024-09-22T09:54:51.114568+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:54:51.114568+0000","last_undegraded":"2024-09-22T09:54:51.114568+0000","last_fullsized":"2024-09-22T09:54:51.114568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'70","last_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_deep_scrub":"262'70","last_deep_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.114477+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:41.369972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.633499+0000","last_change":"2024-09-22T09:55:16.633499+0000","last_active":"2024-09-22T09:55:16.633499+0000","last_peered":"2024-09-22T09:55:16.633499+0000","last_clean":"2024-09-22T09:55:16.633499+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:55:16.633499+0000","last_undegraded":"2024-09-22T09:55:16.633499+0000","last_fullsized":"2024-09-22T09:55:16.633499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:16.633418+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:16.633418+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.633418+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:38:44.345861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'8","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.074052+0000","last_change":"2024-09-22T09:54:58.074052+0000","last_active":"2024-09-22T09:54:58.074052+0000","last_peered":"2024-09-22T09:54:58.074052+0000","last_clean":"2024-09-22T09:54:58.074052+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:54:58.074052+0000","last_undegraded":"2024-09-22T09:54:58.074052+0000","last_fullsized":"2024-09-22T09:54:58.074052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:58.073963+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:58.073963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.073963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:21.083891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.667417+0000","last_change":"2024-09-22T09:55:01.667417+0000","last_active":"2024-09-22T09:55:01.667417+0000","last_peered":"2024-09-22T09:55:01.667417+0000","last_clean":"2024-09-22T09:55:01.667417+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:55:01.667417+0000","last_undegraded":"2024-09-22T09:55:01.667417+0000","last_fullsized":"2024-09-22T09:55:01.667417+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-22T09:55:01.667319+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-22T09:55:01.667319+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.667319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:05.634286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":237,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.340004+0000","last_change":"2024-09-22T09:55:01.339941+0000","last_active":"2024-09-22T09:55:01.340004+0000","last_peered":"2024-09-22T09:55:01.340004+0000","last_clean":"2024-09-22T09:55:01.340004+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:55:01.340004+0000","last_undegraded":"2024-09-22T09:55:01.340004+0000","last_fullsized":"2024-09-22T09:55:01.340004+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'63","last_scrub_stamp":"2024-09-22T09:55:01.339847+0000","last_deep_scrub":"262'63","last_deep_scrub_stamp":"2024-09-22T09:55:01.339847+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.339847+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:31.790761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:42.540752+0000","last_change":"2024-09-22T09:20:12.874024+0000","last_active":"2024-09-22T09:52:42.540752+0000","last_peered":"2024-09-22T09:52:42.540752+0000","last_clean":"2024-09-22T09:52:42.540752+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:52:42.540752+0000","last_undegraded":"2024-09-22T09:52:42.540752+0000","last_fullsized":"2024-09-22T09:52:42.540752+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":51,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:12.663518+0000","last_change":"2024-09-22T09:01:11.520371+0000","last_active":"2024-09-22T09:51:12.663518+0000","last_peered":"2024-09-22T09:51:12.663518+0000","last_clean":"2024-09-22T09:51:12.663518+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:51:12.663518+0000","last_undegraded":"2024-09-22T09:51:12.663518+0000","last_fullsized":"2024-09-22T09:51:12.663518+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:59:23.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.337960+0000","last_change":"2024-09-22T09:55:16.337960+0000","last_active":"2024-09-22T09:55:16.337960+0000","last_peered":"2024-09-22T09:55:16.337960+0000","last_clean":"2024-09-22T09:55:16.337960+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:55:16.337960+0000","last_undegraded":"2024-09-22T09:55:16.337960+0000","last_fullsized":"2024-09-22T09:55:16.337960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:55:16.337858+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:55:16.337858+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.337858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:08.285786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.177622+0000","last_change":"2024-09-22T09:54:50.177569+0000","last_active":"2024-09-22T09:54:50.177622+0000","last_peered":"2024-09-22T09:54:50.177622+0000","last_clean":"2024-09-22T09:54:50.177622+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:54:50.177622+0000","last_undegraded":"2024-09-22T09:54:50.177622+0000","last_fullsized":"2024-09-22T09:54:50.177622+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'25","last_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_deep_scrub":"262'25","last_deep_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.177482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:53.841646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.377245+0000","last_change":"2024-09-22T09:55:01.377182+0000","last_active":"2024-09-22T09:55:01.377245+0000","last_peered":"2024-09-22T09:55:01.377245+0000","last_clean":"2024-09-22T09:55:01.377245+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:55:01.377245+0000","last_undegraded":"2024-09-22T09:55:01.377245+0000","last_fullsized":"2024-09-22T09:55:01.377245+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:01.377097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:01.377097+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.377097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:02.041936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669452+0000","last_change":"2024-09-22T09:01:11.521313+0000","last_active":"2024-09-22T09:51:57.669452+0000","last_peered":"2024-09-22T09:51:57.669452+0000","last_clean":"2024-09-22T09:51:57.669452+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:51:57.669452+0000","last_undegraded":"2024-09-22T09:51:57.669452+0000","last_fullsized":"2024-09-22T09:51:57.669452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'3","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.294492+0000","last_change":"2024-09-22T09:55:01.294492+0000","last_active":"2024-09-22T09:55:01.294492+0000","last_peered":"2024-09-22T09:55:01.294492+0000","last_clean":"2024-09-22T09:55:01.294492+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:55:01.294492+0000","last_undegraded":"2024-09-22T09:55:01.294492+0000","last_fullsized":"2024-09-22T09:55:01.294492+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:01.294365+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:01.294365+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.294365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:07.313318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.288712+0000","last_change":"2024-09-22T09:55:05.288619+0000","last_active":"2024-09-22T09:55:05.288712+0000","last_peered":"2024-09-22T09:55:05.288712+0000","last_clean":"2024-09-22T09:55:05.288712+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:55:05.288712+0000","last_undegraded":"2024-09-22T09:55:05.288712+0000","last_fullsized":"2024-09-22T09:55:05.288712+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:05.288488+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:05.288488+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.288488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:19.865310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.623732+0000","last_change":"2024-09-22T09:54:49.623648+0000","last_active":"2024-09-22T09:54:49.623732+0000","last_peered":"2024-09-22T09:54:49.623732+0000","last_clean":"2024-09-22T09:54:49.623732+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:54:49.623732+0000","last_undegraded":"2024-09-22T09:54:49.623732+0000","last_fullsized":"2024-09-22T09:54:49.623732+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.623509+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:10.004394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'3","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.670462+0000","last_change":"2024-09-22T09:55:16.670462+0000","last_active":"2024-09-22T09:55:16.670462+0000","last_peered":"2024-09-22T09:55:16.670462+0000","last_clean":"2024-09-22T09:55:16.670462+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:55:16.670462+0000","last_undegraded":"2024-09-22T09:55:16.670462+0000","last_fullsized":"2024-09-22T09:55:16.670462+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:16.670372+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:16.670372+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.670372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:48.008633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.668017+0000","last_change":"2024-09-22T09:55:06.668017+0000","last_active":"2024-09-22T09:55:06.668017+0000","last_peered":"2024-09-22T09:55:06.668017+0000","last_clean":"2024-09-22T09:55:06.668017+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:55:06.668017+0000","last_undegraded":"2024-09-22T09:55:06.668017+0000","last_fullsized":"2024-09-22T09:55:06.668017+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:06.667915+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:06.667915+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.667915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:43.559548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.769578+0000","last_change":"2024-09-22T09:55:06.769526+0000","last_active":"2024-09-22T09:55:06.769578+0000","last_peered":"2024-09-22T09:55:06.769578+0000","last_clean":"2024-09-22T09:55:06.769578+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:55:06.769578+0000","last_undegraded":"2024-09-22T09:55:06.769578+0000","last_fullsized":"2024-09-22T09:55:06.769578+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'13","last_scrub_stamp":"2024-09-22T09:55:06.769446+0000","last_deep_scrub":"262'13","last_deep_scrub_stamp":"2024-09-22T09:55:06.769446+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.769446+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:29.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.604877+0000","last_change":"2024-09-22T09:55:15.604877+0000","last_active":"2024-09-22T09:55:15.604877+0000","last_peered":"2024-09-22T09:55:15.604877+0000","last_clean":"2024-09-22T09:55:15.604877+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:55:15.604877+0000","last_undegraded":"2024-09-22T09:55:15.604877+0000","last_fullsized":"2024-09-22T09:55:15.604877+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.604790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.604790+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.604790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:15.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:57.669489+0000","last_change":"2024-09-22T09:01:11.518349+0000","last_active":"2024-09-22T09:51:57.669489+0000","last_peered":"2024-09-22T09:51:57.669489+0000","last_clean":"2024-09-22T09:51:57.669489+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:51:57.669489+0000","last_undegraded":"2024-09-22T09:51:57.669489+0000","last_fullsized":"2024-09-22T09:51:57.669489+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:01:10.480249+0000","last_clean_scrub_stamp":"2024-09-22T09:01:10.480249+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'6","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.619628+0000","last_change":"2024-09-22T09:54:45.619628+0000","last_active":"2024-09-22T09:54:45.619628+0000","last_peered":"2024-09-22T09:54:45.619628+0000","last_clean":"2024-09-22T09:54:45.619628+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:54:45.619628+0000","last_undegraded":"2024-09-22T09:54:45.619628+0000","last_fullsized":"2024-09-22T09:54:45.619628+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.619539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.272533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":165,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.626578+0000","last_change":"2024-09-22T09:54:41.626473+0000","last_active":"2024-09-22T09:54:41.626578+0000","last_peered":"2024-09-22T09:54:41.626578+0000","last_clean":"2024-09-22T09:54:41.626578+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:54:41.626578+0000","last_undegraded":"2024-09-22T09:54:41.626578+0000","last_fullsized":"2024-09-22T09:54:41.626578+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.626373+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:45.919725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.277450+0000","last_change":"2024-09-22T09:55:06.277388+0000","last_active":"2024-09-22T09:55:06.277450+0000","last_peered":"2024-09-22T09:55:06.277450+0000","last_clean":"2024-09-22T09:55:06.277450+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:55:06.277450+0000","last_undegraded":"2024-09-22T09:55:06.277450+0000","last_fullsized":"2024-09-22T09:55:06.277450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:06.277298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:06.277298+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.277298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:26.628164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.647121+0000","last_change":"2024-09-22T09:55:05.647121+0000","last_active":"2024-09-22T09:55:05.647121+0000","last_peered":"2024-09-22T09:55:05.647121+0000","last_clean":"2024-09-22T09:55:05.647121+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:55:05.647121+0000","last_undegraded":"2024-09-22T09:55:05.647121+0000","last_fullsized":"2024-09-22T09:55:05.647121+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.647031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.647031+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.647031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:55:53.229021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'3","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.268332+0000","last_change":"2024-09-22T09:55:10.268332+0000","last_active":"2024-09-22T09:55:10.268332+0000","last_peered":"2024-09-22T09:55:10.268332+0000","last_clean":"2024-09-22T09:55:10.268332+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:55:10.268332+0000","last_undegraded":"2024-09-22T09:55:10.268332+0000","last_fullsized":"2024-09-22T09:55:10.268332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:10.268246+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:10.268246+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.268246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:24.677753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.570076+0000","last_change":"2024-09-22T09:54:59.570076+0000","last_active":"2024-09-22T09:54:59.570076+0000","last_peered":"2024-09-22T09:54:59.570076+0000","last_clean":"2024-09-22T09:54:59.570076+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:54:59.570076+0000","last_undegraded":"2024-09-22T09:54:59.570076+0000","last_fullsized":"2024-09-22T09:54:59.570076+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-22T09:54:59.569984+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-22T09:54:59.569984+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.569984+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:47.447204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666719+0000","last_change":"2024-09-22T09:20:12.870452+0000","last_active":"2024-09-22T09:51:37.666719+0000","last_peered":"2024-09-22T09:51:37.666719+0000","last_clean":"2024-09-22T09:51:37.666719+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:51:37.666719+0000","last_undegraded":"2024-09-22T09:51:37.666719+0000","last_fullsized":"2024-09-22T09:51:37.666719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:04.747269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.321513+0000","last_change":"2024-09-22T09:54:59.321513+0000","last_active":"2024-09-22T09:54:59.321513+0000","last_peered":"2024-09-22T09:54:59.321513+0000","last_clean":"2024-09-22T09:54:59.321513+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:54:59.321513+0000","last_undegraded":"2024-09-22T09:54:59.321513+0000","last_fullsized":"2024-09-22T09:54:59.321513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.321425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.321425+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.321425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:40.029186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.678602+0000","last_change":"2024-09-22T09:54:59.678602+0000","last_active":"2024-09-22T09:54:59.678602+0000","last_peered":"2024-09-22T09:54:59.678602+0000","last_clean":"2024-09-22T09:54:59.678602+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:54:59.678602+0000","last_undegraded":"2024-09-22T09:54:59.678602+0000","last_fullsized":"2024-09-22T09:54:59.678602+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:59.678522+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:59.678522+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.678522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:45.522871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":151,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.539835+0000","last_change":"2024-09-22T09:54:58.539835+0000","last_active":"2024-09-22T09:54:58.539835+0000","last_peered":"2024-09-22T09:54:58.539835+0000","last_clean":"2024-09-22T09:54:58.539835+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:54:58.539835+0000","last_undegraded":"2024-09-22T09:54:58.539835+0000","last_fullsized":"2024-09-22T09:54:58.539835+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-22T09:54:58.539747+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-22T09:54:58.539747+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.539747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:34.870059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.667348+0000","last_change":"2024-09-22T09:20:12.877232+0000","last_active":"2024-09-22T09:51:37.667348+0000","last_peered":"2024-09-22T09:51:37.667348+0000","last_clean":"2024-09-22T09:51:37.667348+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:51:37.667348+0000","last_undegraded":"2024-09-22T09:51:37.667348+0000","last_fullsized":"2024-09-22T09:51:37.667348+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:49:46.667777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.293206+0000","last_change":"2024-09-22T09:54:58.293206+0000","last_active":"2024-09-22T09:54:58.293206+0000","last_peered":"2024-09-22T09:54:58.293206+0000","last_clean":"2024-09-22T09:54:58.293206+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:54:58.293206+0000","last_undegraded":"2024-09-22T09:54:58.293206+0000","last_fullsized":"2024-09-22T09:54:58.293206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:58.293096+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:58.293096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.293096+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:38.665602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.751876+0000","last_change":"2024-09-22T09:55:09.751876+0000","last_active":"2024-09-22T09:55:09.751876+0000","last_peered":"2024-09-22T09:55:09.751876+0000","last_clean":"2024-09-22T09:55:09.751876+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:55:09.751876+0000","last_undegraded":"2024-09-22T09:55:09.751876+0000","last_fullsized":"2024-09-22T09:55:09.751876+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.751763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.751763+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.751763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:02.086449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":193,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.307311+0000","last_change":"2024-09-22T09:54:58.307311+0000","last_active":"2024-09-22T09:54:58.307311+0000","last_peered":"2024-09-22T09:54:58.307311+0000","last_clean":"2024-09-22T09:54:58.307311+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:54:58.307311+0000","last_undegraded":"2024-09-22T09:54:58.307311+0000","last_fullsized":"2024-09-22T09:54:58.307311+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'47","last_scrub_stamp":"2024-09-22T09:54:58.307221+0000","last_deep_scrub":"262'47","last_deep_scrub_stamp":"2024-09-22T09:54:58.307221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.307221+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:53.602519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"261'1","reported_seq":29,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:52:52.677218+0000","last_change":"2024-09-22T09:20:12.876295+0000","last_active":"2024-09-22T09:52:52.677218+0000","last_peered":"2024-09-22T09:52:52.677218+0000","last_clean":"2024-09-22T09:52:52.677218+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:52:52.677218+0000","last_undegraded":"2024-09-22T09:52:52.677218+0000","last_fullsized":"2024-09-22T09:52:52.677218+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.623610+0000","last_change":"2024-09-22T09:55:15.623610+0000","last_active":"2024-09-22T09:55:15.623610+0000","last_peered":"2024-09-22T09:55:15.623610+0000","last_clean":"2024-09-22T09:55:15.623610+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:55:15.623610+0000","last_undegraded":"2024-09-22T09:55:15.623610+0000","last_fullsized":"2024-09-22T09:55:15.623610+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.623519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.623519+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.623519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:40.661986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.085415+0000","last_change":"2024-09-22T09:54:52.085415+0000","last_active":"2024-09-22T09:54:52.085415+0000","last_peered":"2024-09-22T09:54:52.085415+0000","last_clean":"2024-09-22T09:54:52.085415+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:54:52.085415+0000","last_undegraded":"2024-09-22T09:54:52.085415+0000","last_fullsized":"2024-09-22T09:54:52.085415+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.085329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:05.365422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":212,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.642309+0000","last_change":"2024-09-22T09:54:57.642309+0000","last_active":"2024-09-22T09:54:57.642309+0000","last_peered":"2024-09-22T09:54:57.642309+0000","last_clean":"2024-09-22T09:54:57.642309+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:54:57.642309+0000","last_undegraded":"2024-09-22T09:54:57.642309+0000","last_fullsized":"2024-09-22T09:54:57.642309+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'51","last_scrub_stamp":"2024-09-22T09:54:57.642220+0000","last_deep_scrub":"262'51","last_deep_scrub_stamp":"2024-09-22T09:54:57.642220+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.642220+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:56.012954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'1","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:37.666694+0000","last_change":"2024-09-22T09:20:12.870206+0000","last_active":"2024-09-22T09:51:37.666694+0000","last_peered":"2024-09-22T09:51:37.666694+0000","last_clean":"2024-09-22T09:51:37.666694+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:51:37.666694+0000","last_undegraded":"2024-09-22T09:51:37.666694+0000","last_fullsized":"2024-09-22T09:51:37.666694+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:04.590058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.100718+0000","last_change":"2024-09-22T09:54:56.100718+0000","last_active":"2024-09-22T09:54:56.100718+0000","last_peered":"2024-09-22T09:54:56.100718+0000","last_clean":"2024-09-22T09:54:56.100718+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:54:56.100718+0000","last_undegraded":"2024-09-22T09:54:56.100718+0000","last_fullsized":"2024-09-22T09:54:56.100718+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.100608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:54.172117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'10","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.336348+0000","last_change":"2024-09-22T09:55:00.336348+0000","last_active":"2024-09-22T09:55:00.336348+0000","last_peered":"2024-09-22T09:55:00.336348+0000","last_clean":"2024-09-22T09:55:00.336348+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:55:00.336348+0000","last_undegraded":"2024-09-22T09:55:00.336348+0000","last_fullsized":"2024-09-22T09:55:00.336348+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-22T09:55:00.336266+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-22T09:55:00.336266+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.336266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:55.102546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":193,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.760681+0000","last_change":"2024-09-22T09:55:05.760681+0000","last_active":"2024-09-22T09:55:05.760681+0000","last_peered":"2024-09-22T09:55:05.760681+0000","last_clean":"2024-09-22T09:55:05.760681+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:55:05.760681+0000","last_undegraded":"2024-09-22T09:55:05.760681+0000","last_fullsized":"2024-09-22T09:55:05.760681+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-22T09:55:05.760577+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-22T09:55:05.760577+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.760577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:30.637051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.611829+0000","last_change":"2024-09-22T09:54:48.611757+0000","last_active":"2024-09-22T09:54:48.611829+0000","last_peered":"2024-09-22T09:54:48.611829+0000","last_clean":"2024-09-22T09:54:48.611829+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:54:48.611829+0000","last_undegraded":"2024-09-22T09:54:48.611829+0000","last_fullsized":"2024-09-22T09:54:48.611829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.611658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:49.681099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.669572+0000","last_change":"2024-09-22T09:55:14.669572+0000","last_active":"2024-09-22T09:55:14.669572+0000","last_peered":"2024-09-22T09:55:14.669572+0000","last_clean":"2024-09-22T09:55:14.669572+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:55:14.669572+0000","last_undegraded":"2024-09-22T09:55:14.669572+0000","last_fullsized":"2024-09-22T09:55:14.669572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:55:14.669474+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:55:14.669474+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.669474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:13.017990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.619158+0000","last_change":"2024-09-22T09:55:04.619103+0000","last_active":"2024-09-22T09:55:04.619158+0000","last_peered":"2024-09-22T09:55:04.619158+0000","last_clean":"2024-09-22T09:55:04.619158+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:55:04.619158+0000","last_undegraded":"2024-09-22T09:55:04.619158+0000","last_fullsized":"2024-09-22T09:55:04.619158+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.618987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.618987+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.618987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:32.215926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":263,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.720070+0000","last_change":"2024-09-22T09:55:10.720070+0000","last_active":"2024-09-22T09:55:10.720070+0000","last_peered":"2024-09-22T09:55:10.720070+0000","last_clean":"2024-09-22T09:55:10.720070+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:55:10.720070+0000","last_undegraded":"2024-09-22T09:55:10.720070+0000","last_fullsized":"2024-09-22T09:55:10.720070+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'71","last_scrub_stamp":"2024-09-22T09:55:10.719971+0000","last_deep_scrub":"262'71","last_deep_scrub_stamp":"2024-09-22T09:55:10.719971+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.719971+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:33:03.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.645771+0000","last_change":"2024-09-22T09:55:10.645771+0000","last_active":"2024-09-22T09:55:10.645771+0000","last_peered":"2024-09-22T09:55:10.645771+0000","last_clean":"2024-09-22T09:55:10.645771+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:55:10.645771+0000","last_undegraded":"2024-09-22T09:55:10.645771+0000","last_fullsized":"2024-09-22T09:55:10.645771+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:10.645678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:10.645678+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.645678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:56.114444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.702586+0000","last_change":"2024-09-22T09:55:12.702586+0000","last_active":"2024-09-22T09:55:12.702586+0000","last_peered":"2024-09-22T09:55:12.702586+0000","last_clean":"2024-09-22T09:55:12.702586+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:55:12.702586+0000","last_undegraded":"2024-09-22T09:55:12.702586+0000","last_fullsized":"2024-09-22T09:55:12.702586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:12.702491+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:12.702491+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.702491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:33.715570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.590107+0000","last_change":"2024-09-22T09:54:44.590009+0000","last_active":"2024-09-22T09:54:44.590107+0000","last_peered":"2024-09-22T09:54:44.590107+0000","last_clean":"2024-09-22T09:54:44.590107+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:54:44.590107+0000","last_undegraded":"2024-09-22T09:54:44.590107+0000","last_fullsized":"2024-09-22T09:54:44.590107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.589913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:27.637824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":113,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.352830+0000","last_change":"2024-09-22T09:54:57.352830+0000","last_active":"2024-09-22T09:54:57.352830+0000","last_peered":"2024-09-22T09:54:57.352830+0000","last_clean":"2024-09-22T09:54:57.352830+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:54:57.352830+0000","last_undegraded":"2024-09-22T09:54:57.352830+0000","last_fullsized":"2024-09-22T09:54:57.352830+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.352681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:17.910423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.060130+0000","last_change":"2024-09-22T09:54:57.060130+0000","last_active":"2024-09-22T09:54:57.060130+0000","last_peered":"2024-09-22T09:54:57.060130+0000","last_clean":"2024-09-22T09:54:57.060130+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:54:57.060130+0000","last_undegraded":"2024-09-22T09:54:57.060130+0000","last_fullsized":"2024-09-22T09:54:57.060130+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:35.936019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'8","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.261452+0000","last_change":"2024-09-22T09:54:57.261452+0000","last_active":"2024-09-22T09:54:57.261452+0000","last_peered":"2024-09-22T09:54:57.261452+0000","last_clean":"2024-09-22T09:54:57.261452+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:54:57.261452+0000","last_undegraded":"2024-09-22T09:54:57.261452+0000","last_fullsized":"2024-09-22T09:54:57.261452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.261350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:48:28.814513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6192,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.309762+0000","last_change":"2024-09-22T09:55:08.309762+0000","last_active":"2024-09-22T09:55:08.309762+0000","last_peered":"2024-09-22T09:55:08.309762+0000","last_clean":"2024-09-22T09:55:08.309762+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:55:08.309762+0000","last_undegraded":"2024-09-22T09:55:08.309762+0000","last_fullsized":"2024-09-22T09:55:08.309762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:08.309660+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:08.309660+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.309660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:33.849852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.080377+0000","last_change":"2024-09-22T09:54:50.080377+0000","last_active":"2024-09-22T09:54:50.080377+0000","last_peered":"2024-09-22T09:54:50.080377+0000","last_clean":"2024-09-22T09:54:50.080377+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:54:50.080377+0000","last_undegraded":"2024-09-22T09:54:50.080377+0000","last_fullsized":"2024-09-22T09:54:50.080377+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.080269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:27:02.040573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.618885+0000","last_change":"2024-09-22T09:55:12.618885+0000","last_active":"2024-09-22T09:55:12.618885+0000","last_peered":"2024-09-22T09:55:12.618885+0000","last_clean":"2024-09-22T09:55:12.618885+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:55:12.618885+0000","last_undegraded":"2024-09-22T09:55:12.618885+0000","last_fullsized":"2024-09-22T09:55:12.618885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:12.618799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:12.618799+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.618799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:35.106983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.715841+0000","last_change":"2024-09-22T09:55:13.715841+0000","last_active":"2024-09-22T09:55:13.715841+0000","last_peered":"2024-09-22T09:55:13.715841+0000","last_clean":"2024-09-22T09:55:13.715841+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:55:13.715841+0000","last_undegraded":"2024-09-22T09:55:13.715841+0000","last_fullsized":"2024-09-22T09:55:13.715841+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:13.715721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:13.715721+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.715721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'2","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.164358+0000","last_change":"2024-09-22T09:54:53.164358+0000","last_active":"2024-09-22T09:54:53.164358+0000","last_peered":"2024-09-22T09:54:53.164358+0000","last_clean":"2024-09-22T09:54:53.164358+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:54:53.164358+0000","last_undegraded":"2024-09-22T09:54:53.164358+0000","last_fullsized":"2024-09-22T09:54:53.164358+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.164249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:04.104785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":132,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.589417+0000","last_change":"2024-09-22T09:54:40.589417+0000","last_active":"2024-09-22T09:54:40.589417+0000","last_peered":"2024-09-22T09:54:40.589417+0000","last_clean":"2024-09-22T09:54:40.589417+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:54:40.589417+0000","last_undegraded":"2024-09-22T09:54:40.589417+0000","last_fullsized":"2024-09-22T09:54:40.589417+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.589282+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:15.376697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:51:42.667548+0000","last_change":"2024-09-22T09:20:12.869263+0000","last_active":"2024-09-22T09:51:42.667548+0000","last_peered":"2024-09-22T09:51:42.667548+0000","last_clean":"2024-09-22T09:51:42.667548+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:51:42.667548+0000","last_undegraded":"2024-09-22T09:51:42.667548+0000","last_fullsized":"2024-09-22T09:51:42.667548+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:20:11.832137+0000","last_clean_scrub_stamp":"2024-09-22T09:20:11.832137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:26.595123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'9","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.687612+0000","last_change":"2024-09-22T09:55:06.687612+0000","last_active":"2024-09-22T09:55:06.687612+0000","last_peered":"2024-09-22T09:55:06.687612+0000","last_clean":"2024-09-22T09:55:06.687612+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:55:06.687612+0000","last_undegraded":"2024-09-22T09:55:06.687612+0000","last_fullsized":"2024-09-22T09:55:06.687612+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:06.687524+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:06.687524+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.687524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:05.525768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.261280+0000","last_change":"2024-09-22T09:55:04.261218+0000","last_active":"2024-09-22T09:55:04.261280+0000","last_peered":"2024-09-22T09:55:04.261280+0000","last_clean":"2024-09-22T09:55:04.261280+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:55:04.261280+0000","last_undegraded":"2024-09-22T09:55:04.261280+0000","last_fullsized":"2024-09-22T09:55:04.261280+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.261125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.261125+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.261125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:28.099874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":130,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.290995+0000","last_change":"2024-09-22T09:54:57.290995+0000","last_active":"2024-09-22T09:54:57.290995+0000","last_peered":"2024-09-22T09:54:57.290995+0000","last_clean":"2024-09-22T09:54:57.290995+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:54:57.290995+0000","last_undegraded":"2024-09-22T09:54:57.290995+0000","last_fullsized":"2024-09-22T09:54:57.290995+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.290907+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:20.219111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.570846+0000","last_change":"2024-09-22T09:55:14.570846+0000","last_active":"2024-09-22T09:55:14.570846+0000","last_peered":"2024-09-22T09:55:14.570846+0000","last_clean":"2024-09-22T09:55:14.570846+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:55:14.570846+0000","last_undegraded":"2024-09-22T09:55:14.570846+0000","last_fullsized":"2024-09-22T09:55:14.570846+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:14.570759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:14.570759+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.570759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:05.905833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.709091+0000","last_change":"2024-09-22T09:55:07.709091+0000","last_active":"2024-09-22T09:55:07.709091+0000","last_peered":"2024-09-22T09:55:07.709091+0000","last_clean":"2024-09-22T09:55:07.709091+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:55:07.709091+0000","last_undegraded":"2024-09-22T09:55:07.709091+0000","last_fullsized":"2024-09-22T09:55:07.709091+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:07.709010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:07.709010+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.709010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:39.663076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'5","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.141743+0000","last_change":"2024-09-22T09:54:52.141650+0000","last_active":"2024-09-22T09:54:52.141743+0000","last_peered":"2024-09-22T09:54:52.141743+0000","last_clean":"2024-09-22T09:54:52.141743+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:54:52.141743+0000","last_undegraded":"2024-09-22T09:54:52.141743+0000","last_fullsized":"2024-09-22T09:54:52.141743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.141552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:05.815167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.636984+0000","last_change":"2024-09-22T09:54:55.636984+0000","last_active":"2024-09-22T09:54:55.636984+0000","last_peered":"2024-09-22T09:54:55.636984+0000","last_clean":"2024-09-22T09:54:55.636984+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:54:55.636984+0000","last_undegraded":"2024-09-22T09:54:55.636984+0000","last_fullsized":"2024-09-22T09:54:55.636984+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'16","last_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_deep_scrub":"259'16","last_deep_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.636899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:23.577414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.589500+0000","last_change":"2024-09-22T09:55:13.589500+0000","last_active":"2024-09-22T09:55:13.589500+0000","last_peered":"2024-09-22T09:55:13.589500+0000","last_clean":"2024-09-22T09:55:13.589500+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:55:13.589500+0000","last_undegraded":"2024-09-22T09:55:13.589500+0000","last_fullsized":"2024-09-22T09:55:13.589500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:13.589417+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:13.589417+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.589417+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:04.333745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.214054+0000","last_change":"2024-09-22T09:54:56.213978+0000","last_active":"2024-09-22T09:54:56.214054+0000","last_peered":"2024-09-22T09:54:56.214054+0000","last_clean":"2024-09-22T09:54:56.214054+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:54:56.214054+0000","last_undegraded":"2024-09-22T09:54:56.214054+0000","last_fullsized":"2024-09-22T09:54:56.214054+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.213880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:10.951353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'14","reported_seq":93,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.275345+0000","last_change":"2024-09-22T09:55:07.275345+0000","last_active":"2024-09-22T09:55:07.275345+0000","last_peered":"2024-09-22T09:55:07.275345+0000","last_clean":"2024-09-22T09:55:07.275345+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:55:07.275345+0000","last_undegraded":"2024-09-22T09:55:07.275345+0000","last_fullsized":"2024-09-22T09:55:07.275345+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'14","last_scrub_stamp":"2024-09-22T09:55:07.275221+0000","last_deep_scrub":"262'14","last_deep_scrub_stamp":"2024-09-22T09:55:07.275221+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.275221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:19.440545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32770,"num_write":29,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":217,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.795465+0000","last_change":"2024-09-22T09:55:04.795465+0000","last_active":"2024-09-22T09:55:04.795465+0000","last_peered":"2024-09-22T09:55:04.795465+0000","last_clean":"2024-09-22T09:55:04.795465+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:55:04.795465+0000","last_undegraded":"2024-09-22T09:55:04.795465+0000","last_fullsized":"2024-09-22T09:55:04.795465+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'53","last_scrub_stamp":"2024-09-22T09:55:04.795364+0000","last_deep_scrub":"262'53","last_deep_scrub_stamp":"2024-09-22T09:55:04.795364+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.795364+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:06.070986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.307279+0000","last_change":"2024-09-22T09:55:11.307279+0000","last_active":"2024-09-22T09:55:11.307279+0000","last_peered":"2024-09-22T09:55:11.307279+0000","last_clean":"2024-09-22T09:55:11.307279+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:55:11.307279+0000","last_undegraded":"2024-09-22T09:55:11.307279+0000","last_fullsized":"2024-09-22T09:55:11.307279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.307177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.307177+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.307177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:39.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.683769+0000","last_change":"2024-09-22T09:55:08.683769+0000","last_active":"2024-09-22T09:55:08.683769+0000","last_peered":"2024-09-22T09:55:08.683769+0000","last_clean":"2024-09-22T09:55:08.683769+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:55:08.683769+0000","last_undegraded":"2024-09-22T09:55:08.683769+0000","last_fullsized":"2024-09-22T09:55:08.683769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:08.683683+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:08.683683+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.683683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:06.732852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.629130+0000","last_change":"2024-09-22T09:54:58.629056+0000","last_active":"2024-09-22T09:54:58.629130+0000","last_peered":"2024-09-22T09:54:58.629130+0000","last_clean":"2024-09-22T09:54:58.629130+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:54:58.629130+0000","last_undegraded":"2024-09-22T09:54:58.629130+0000","last_fullsized":"2024-09-22T09:54:58.629130+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:58.628948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:58.628948+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.628948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:05.510102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":82,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.044365+0000","last_change":"2024-09-22T09:54:48.044365+0000","last_active":"2024-09-22T09:54:48.044365+0000","last_peered":"2024-09-22T09:54:48.044365+0000","last_clean":"2024-09-22T09:54:48.044365+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:54:48.044365+0000","last_undegraded":"2024-09-22T09:54:48.044365+0000","last_fullsized":"2024-09-22T09:54:48.044365+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.044281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:08.840441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.639361+0000","last_change":"2024-09-22T09:55:09.639361+0000","last_active":"2024-09-22T09:55:09.639361+0000","last_peered":"2024-09-22T09:55:09.639361+0000","last_clean":"2024-09-22T09:55:09.639361+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:55:09.639361+0000","last_undegraded":"2024-09-22T09:55:09.639361+0000","last_fullsized":"2024-09-22T09:55:09.639361+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.639267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.639267+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.639267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:45.487261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.353791+0000","last_change":"2024-09-22T09:55:13.353791+0000","last_active":"2024-09-22T09:55:13.353791+0000","last_peered":"2024-09-22T09:55:13.353791+0000","last_clean":"2024-09-22T09:55:13.353791+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:55:13.353791+0000","last_undegraded":"2024-09-22T09:55:13.353791+0000","last_fullsized":"2024-09-22T09:55:13.353791+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:13.353650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:13.353650+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.353650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:44.560042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.584366+0000","last_change":"2024-09-22T09:55:02.584305+0000","last_active":"2024-09-22T09:55:02.584366+0000","last_peered":"2024-09-22T09:55:02.584366+0000","last_clean":"2024-09-22T09:55:02.584366+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:55:02.584366+0000","last_undegraded":"2024-09-22T09:55:02.584366+0000","last_fullsized":"2024-09-22T09:55:02.584366+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.584220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.584220+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.584220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:40.366252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":182,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.277070+0000","last_change":"2024-09-22T09:55:03.277070+0000","last_active":"2024-09-22T09:55:03.277070+0000","last_peered":"2024-09-22T09:55:03.277070+0000","last_clean":"2024-09-22T09:55:03.277070+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:55:03.277070+0000","last_undegraded":"2024-09-22T09:55:03.277070+0000","last_fullsized":"2024-09-22T09:55:03.277070+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'41","last_scrub_stamp":"2024-09-22T09:55:03.276991+0000","last_deep_scrub":"262'41","last_deep_scrub_stamp":"2024-09-22T09:55:03.276991+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.276991+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:16.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.286881+0000","last_change":"2024-09-22T09:55:05.286881+0000","last_active":"2024-09-22T09:55:05.286881+0000","last_peered":"2024-09-22T09:55:05.286881+0000","last_clean":"2024-09-22T09:55:05.286881+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:55:05.286881+0000","last_undegraded":"2024-09-22T09:55:05.286881+0000","last_fullsized":"2024-09-22T09:55:05.286881+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.286778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.286778+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.286778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:59.955031+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.352402+0000","last_change":"2024-09-22T09:55:12.352402+0000","last_active":"2024-09-22T09:55:12.352402+0000","last_peered":"2024-09-22T09:55:12.352402+0000","last_clean":"2024-09-22T09:55:12.352402+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:55:12.352402+0000","last_undegraded":"2024-09-22T09:55:12.352402+0000","last_fullsized":"2024-09-22T09:55:12.352402+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:12.352316+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:12.352316+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.352316+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:48.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.616296+0000","last_change":"2024-09-22T09:54:43.616296+0000","last_active":"2024-09-22T09:54:43.616296+0000","last_peered":"2024-09-22T09:54:43.616296+0000","last_clean":"2024-09-22T09:54:43.616296+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:54:43.616296+0000","last_undegraded":"2024-09-22T09:54:43.616296+0000","last_fullsized":"2024-09-22T09:54:43.616296+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.616202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:24.035439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.060358+0000","last_change":"2024-09-22T09:54:49.060358+0000","last_active":"2024-09-22T09:54:49.060358+0000","last_peered":"2024-09-22T09:54:49.060358+0000","last_clean":"2024-09-22T09:54:49.060358+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:54:49.060358+0000","last_undegraded":"2024-09-22T09:54:49.060358+0000","last_fullsized":"2024-09-22T09:54:49.060358+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.060271+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:07.985627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.328898+0000","last_change":"2024-09-22T09:55:00.328898+0000","last_active":"2024-09-22T09:55:00.328898+0000","last_peered":"2024-09-22T09:55:00.328898+0000","last_clean":"2024-09-22T09:55:00.328898+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:55:00.328898+0000","last_undegraded":"2024-09-22T09:55:00.328898+0000","last_fullsized":"2024-09-22T09:55:00.328898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:00.328795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:00.328795+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.328795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:22.344571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.650308+0000","last_change":"2024-09-22T09:55:05.650308+0000","last_active":"2024-09-22T09:55:05.650308+0000","last_peered":"2024-09-22T09:55:05.650308+0000","last_clean":"2024-09-22T09:55:05.650308+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:55:05.650308+0000","last_undegraded":"2024-09-22T09:55:05.650308+0000","last_fullsized":"2024-09-22T09:55:05.650308+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.650184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.650184+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.650184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:48:12.819372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.362086+0000","last_change":"2024-09-22T09:54:59.362009+0000","last_active":"2024-09-22T09:54:59.362086+0000","last_peered":"2024-09-22T09:54:59.362086+0000","last_clean":"2024-09-22T09:54:59.362086+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:54:59.362086+0000","last_undegraded":"2024-09-22T09:54:59.362086+0000","last_fullsized":"2024-09-22T09:54:59.362086+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.361928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.361928+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.361928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:22.741296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.632934+0000","last_change":"2024-09-22T09:54:56.632934+0000","last_active":"2024-09-22T09:54:56.632934+0000","last_peered":"2024-09-22T09:54:56.632934+0000","last_clean":"2024-09-22T09:54:56.632934+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:54:56.632934+0000","last_undegraded":"2024-09-22T09:54:56.632934+0000","last_fullsized":"2024-09-22T09:54:56.632934+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.632844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:02.629215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.662294+0000","last_change":"2024-09-22T09:55:08.662294+0000","last_active":"2024-09-22T09:55:08.662294+0000","last_peered":"2024-09-22T09:55:08.662294+0000","last_clean":"2024-09-22T09:55:08.662294+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:55:08.662294+0000","last_undegraded":"2024-09-22T09:55:08.662294+0000","last_fullsized":"2024-09-22T09:55:08.662294+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:08.662190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:08.662190+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.662190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:26.825434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.670815+0000","last_change":"2024-09-22T09:55:04.670815+0000","last_active":"2024-09-22T09:55:04.670815+0000","last_peered":"2024-09-22T09:55:04.670815+0000","last_clean":"2024-09-22T09:55:04.670815+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:55:04.670815+0000","last_undegraded":"2024-09-22T09:55:04.670815+0000","last_fullsized":"2024-09-22T09:55:04.670815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.670731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.670731+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.670731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:39.596218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.620985+0000","last_change":"2024-09-22T09:55:03.620880+0000","last_active":"2024-09-22T09:55:03.620985+0000","last_peered":"2024-09-22T09:55:03.620985+0000","last_clean":"2024-09-22T09:55:03.620985+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:55:03.620985+0000","last_undegraded":"2024-09-22T09:55:03.620985+0000","last_fullsized":"2024-09-22T09:55:03.620985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:55:03.620774+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:55:03.620774+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.620774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:12.908822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":138,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.195435+0000","last_change":"2024-09-22T09:54:48.195435+0000","last_active":"2024-09-22T09:54:48.195435+0000","last_peered":"2024-09-22T09:54:48.195435+0000","last_clean":"2024-09-22T09:54:48.195435+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:54:48.195435+0000","last_undegraded":"2024-09-22T09:54:48.195435+0000","last_fullsized":"2024-09-22T09:54:48.195435+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.195335+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:58.456901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.591719+0000","last_change":"2024-09-22T09:54:47.591661+0000","last_active":"2024-09-22T09:54:47.591719+0000","last_peered":"2024-09-22T09:54:47.591719+0000","last_clean":"2024-09-22T09:54:47.591719+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:54:47.591719+0000","last_undegraded":"2024-09-22T09:54:47.591719+0000","last_fullsized":"2024-09-22T09:54:47.591719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.591568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:58.864458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.176665+0000","last_change":"2024-09-22T09:54:55.176665+0000","last_active":"2024-09-22T09:54:55.176665+0000","last_peered":"2024-09-22T09:54:55.176665+0000","last_clean":"2024-09-22T09:54:55.176665+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:54:55.176665+0000","last_undegraded":"2024-09-22T09:54:55.176665+0000","last_fullsized":"2024-09-22T09:54:55.176665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.176572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:04.433248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.535153+0000","last_change":"2024-09-22T09:55:00.535098+0000","last_active":"2024-09-22T09:55:00.535153+0000","last_peered":"2024-09-22T09:55:00.535153+0000","last_clean":"2024-09-22T09:55:00.535153+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:55:00.535153+0000","last_undegraded":"2024-09-22T09:55:00.535153+0000","last_fullsized":"2024-09-22T09:55:00.535153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:00.535014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:00.535014+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.535014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:34.862326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":154,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.327932+0000","last_change":"2024-09-22T09:54:58.327932+0000","last_active":"2024-09-22T09:54:58.327932+0000","last_peered":"2024-09-22T09:54:58.327932+0000","last_clean":"2024-09-22T09:54:58.327932+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:54:58.327932+0000","last_undegraded":"2024-09-22T09:54:58.327932+0000","last_fullsized":"2024-09-22T09:54:58.327932+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-22T09:54:58.327838+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-22T09:54:58.327838+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.327838+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:01.210523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:17.380996+0000","last_change":"2024-09-22T09:55:17.380996+0000","last_active":"2024-09-22T09:55:17.380996+0000","last_peered":"2024-09-22T09:55:17.380996+0000","last_clean":"2024-09-22T09:55:17.380996+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:55:17.380996+0000","last_undegraded":"2024-09-22T09:55:17.380996+0000","last_fullsized":"2024-09-22T09:55:17.380996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:17.380887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:17.380887+0000","last_clean_scrub_stamp":"2024-09-22T09:55:17.380887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:20.264989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.280085+0000","last_change":"2024-09-22T09:55:02.280085+0000","last_active":"2024-09-22T09:55:02.280085+0000","last_peered":"2024-09-22T09:55:02.280085+0000","last_clean":"2024-09-22T09:55:02.280085+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:55:02.280085+0000","last_undegraded":"2024-09-22T09:55:02.280085+0000","last_fullsized":"2024-09-22T09:55:02.280085+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.279992+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:08.793662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.548013+0000","last_change":"2024-09-22T09:55:01.547937+0000","last_active":"2024-09-22T09:55:01.548013+0000","last_peered":"2024-09-22T09:55:01.548013+0000","last_clean":"2024-09-22T09:55:01.548013+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:55:01.548013+0000","last_undegraded":"2024-09-22T09:55:01.548013+0000","last_fullsized":"2024-09-22T09:55:01.548013+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:01.547815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:01.547815+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.547815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:21:05.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":133,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.591055+0000","last_change":"2024-09-22T09:54:54.591055+0000","last_active":"2024-09-22T09:54:54.591055+0000","last_peered":"2024-09-22T09:54:54.591055+0000","last_clean":"2024-09-22T09:54:54.591055+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:54:54.591055+0000","last_undegraded":"2024-09-22T09:54:54.591055+0000","last_fullsized":"2024-09-22T09:54:54.591055+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.590974+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:49.440381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.363463+0000","last_change":"2024-09-22T09:55:15.363463+0000","last_active":"2024-09-22T09:55:15.363463+0000","last_peered":"2024-09-22T09:55:15.363463+0000","last_clean":"2024-09-22T09:55:15.363463+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:55:15.363463+0000","last_undegraded":"2024-09-22T09:55:15.363463+0000","last_fullsized":"2024-09-22T09:55:15.363463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.363367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.363367+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.363367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:09.064084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.070211+0000","last_change":"2024-09-22T09:54:53.070211+0000","last_active":"2024-09-22T09:54:53.070211+0000","last_peered":"2024-09-22T09:54:53.070211+0000","last_clean":"2024-09-22T09:54:53.070211+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:54:53.070211+0000","last_undegraded":"2024-09-22T09:54:53.070211+0000","last_fullsized":"2024-09-22T09:54:53.070211+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.070103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:14.514297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.159168+0000","last_change":"2024-09-22T09:54:51.159120+0000","last_active":"2024-09-22T09:54:51.159168+0000","last_peered":"2024-09-22T09:54:51.159168+0000","last_clean":"2024-09-22T09:54:51.159168+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:54:51.159168+0000","last_undegraded":"2024-09-22T09:54:51.159168+0000","last_fullsized":"2024-09-22T09:54:51.159168+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.159033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:48.125155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":127,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.070001+0000","last_change":"2024-09-22T09:54:47.070001+0000","last_active":"2024-09-22T09:54:47.070001+0000","last_peered":"2024-09-22T09:54:47.070001+0000","last_clean":"2024-09-22T09:54:47.070001+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:54:47.070001+0000","last_undegraded":"2024-09-22T09:54:47.070001+0000","last_fullsized":"2024-09-22T09:54:47.070001+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.069893+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:47.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.661755+0000","last_change":"2024-09-22T09:55:11.661755+0000","last_active":"2024-09-22T09:55:11.661755+0000","last_peered":"2024-09-22T09:55:11.661755+0000","last_clean":"2024-09-22T09:55:11.661755+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:55:11.661755+0000","last_undegraded":"2024-09-22T09:55:11.661755+0000","last_fullsized":"2024-09-22T09:55:11.661755+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.661662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.661662+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.661662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:09.039844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.702323+0000","last_change":"2024-09-22T09:55:03.702323+0000","last_active":"2024-09-22T09:55:03.702323+0000","last_peered":"2024-09-22T09:55:03.702323+0000","last_clean":"2024-09-22T09:55:03.702323+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:55:03.702323+0000","last_undegraded":"2024-09-22T09:55:03.702323+0000","last_fullsized":"2024-09-22T09:55:03.702323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:03.702218+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:03.702218+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.702218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:57.125322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'10","reported_seq":86,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.043164+0000","last_change":"2024-09-22T09:54:54.043090+0000","last_active":"2024-09-22T09:54:54.043164+0000","last_peered":"2024-09-22T09:54:54.043164+0000","last_clean":"2024-09-22T09:54:54.043164+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:54:54.043164+0000","last_undegraded":"2024-09-22T09:54:54.043164+0000","last_fullsized":"2024-09-22T09:54:54.043164+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.043004+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:50.731747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25607,"num_write":10,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":247,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.583374+0000","last_change":"2024-09-22T09:54:57.583318+0000","last_active":"2024-09-22T09:54:57.583374+0000","last_peered":"2024-09-22T09:54:57.583374+0000","last_clean":"2024-09-22T09:54:57.583374+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:54:57.583374+0000","last_undegraded":"2024-09-22T09:54:57.583374+0000","last_fullsized":"2024-09-22T09:54:57.583374+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'64","last_scrub_stamp":"2024-09-22T09:54:57.583231+0000","last_deep_scrub":"262'64","last_deep_scrub_stamp":"2024-09-22T09:54:57.583231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.583231+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:39:18.335036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'215","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.577167+0000","last_change":"2024-09-22T09:54:31.577099+0000","last_active":"2024-09-22T09:54:31.577167+0000","last_peered":"2024-09-22T09:54:31.577167+0000","last_clean":"2024-09-22T09:54:31.577167+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:54:31.577167+0000","last_undegraded":"2024-09-22T09:54:31.577167+0000","last_fullsized":"2024-09-22T09:54:31.577167+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'215","last_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_deep_scrub":"262'215","last_deep_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.576998+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:44.998984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":13876,"num_write":999,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'142","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.412304+0000","last_change":"2024-09-22T09:54:38.412245+0000","last_active":"2024-09-22T09:54:38.412304+0000","last_peered":"2024-09-22T09:54:38.412304+0000","last_clean":"2024-09-22T09:54:38.412304+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:54:38.412304+0000","last_undegraded":"2024-09-22T09:54:38.412304+0000","last_fullsized":"2024-09-22T09:54:38.412304+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.412165+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.712245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'143","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.231089+0000","last_change":"2024-09-22T09:54:24.231015+0000","last_active":"2024-09-22T09:54:24.231089+0000","last_peered":"2024-09-22T09:54:24.231089+0000","last_clean":"2024-09-22T09:54:24.231089+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:54:24.231089+0000","last_undegraded":"2024-09-22T09:54:24.231089+0000","last_fullsized":"2024-09-22T09:54:24.231089+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.230885+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:36.854502+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":432,"num_read_kb":103374,"num_write":683,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.607885+0000","last_change":"2024-09-22T09:54:37.607829+0000","last_active":"2024-09-22T09:54:37.607885+0000","last_peered":"2024-09-22T09:54:37.607885+0000","last_clean":"2024-09-22T09:54:37.607885+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:54:37.607885+0000","last_undegraded":"2024-09-22T09:54:37.607885+0000","last_fullsized":"2024-09-22T09:54:37.607885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'77","last_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_deep_scrub":"262'77","last_deep_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.607734+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:59.160167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'209","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.013490+0000","last_change":"2024-09-22T09:54:28.013430+0000","last_active":"2024-09-22T09:54:28.013490+0000","last_peered":"2024-09-22T09:54:28.013490+0000","last_clean":"2024-09-22T09:54:28.013490+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:54:28.013490+0000","last_undegraded":"2024-09-22T09:54:28.013490+0000","last_fullsized":"2024-09-22T09:54:28.013490+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.013255+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:24.596859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":4356,"num_write":984,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.677030+0000","last_change":"2024-09-22T09:54:37.676977+0000","last_active":"2024-09-22T09:54:37.677030+0000","last_peered":"2024-09-22T09:54:37.677030+0000","last_clean":"2024-09-22T09:54:37.677030+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:54:37.677030+0000","last_undegraded":"2024-09-22T09:54:37.677030+0000","last_fullsized":"2024-09-22T09:54:37.677030+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.676887+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:21.391589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'211","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.380352+0000","last_change":"2024-09-22T09:54:33.380352+0000","last_active":"2024-09-22T09:54:33.380352+0000","last_peered":"2024-09-22T09:54:33.380352+0000","last_clean":"2024-09-22T09:54:33.380352+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:54:33.380352+0000","last_undegraded":"2024-09-22T09:54:33.380352+0000","last_fullsized":"2024-09-22T09:54:33.380352+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.380242+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:52.978925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":600,"num_read_kb":1083,"num_write":1003,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.063066+0000","last_change":"2024-09-22T09:54:37.063002+0000","last_active":"2024-09-22T09:54:37.063066+0000","last_peered":"2024-09-22T09:54:37.063066+0000","last_clean":"2024-09-22T09:54:37.063066+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:54:37.063066+0000","last_undegraded":"2024-09-22T09:54:37.063066+0000","last_fullsized":"2024-09-22T09:54:37.063066+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'351","last_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_deep_scrub":"262'351","last_deep_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.062905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:49.568320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'204","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.546105+0000","last_change":"2024-09-22T09:54:28.546046+0000","last_active":"2024-09-22T09:54:28.546105+0000","last_peered":"2024-09-22T09:54:28.546105+0000","last_clean":"2024-09-22T09:54:28.546105+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:54:28.546105+0000","last_undegraded":"2024-09-22T09:54:28.546105+0000","last_fullsized":"2024-09-22T09:54:28.546105+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.545908+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:30.243289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":570,"num_read_kb":6282,"num_write":914,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.949036+0000","last_change":"2024-09-22T09:54:34.949036+0000","last_active":"2024-09-22T09:54:34.949036+0000","last_peered":"2024-09-22T09:54:34.949036+0000","last_clean":"2024-09-22T09:54:34.949036+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:54:34.949036+0000","last_undegraded":"2024-09-22T09:54:34.949036+0000","last_fullsized":"2024-09-22T09:54:34.949036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'106","last_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_deep_scrub":"262'106","last_deep_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.948920+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:26.051361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.423640+0000","last_change":"2024-09-22T09:54:30.423574+0000","last_active":"2024-09-22T09:54:30.423640+0000","last_peered":"2024-09-22T09:54:30.423640+0000","last_clean":"2024-09-22T09:54:30.423640+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:54:30.423640+0000","last_undegraded":"2024-09-22T09:54:30.423640+0000","last_fullsized":"2024-09-22T09:54:30.423640+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.423472+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:42.929221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":691,"num_read_kb":1734,"num_write":933,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4554","reported_seq":5332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.603059+0000","last_change":"2024-09-22T09:54:39.602965+0000","last_active":"2024-09-22T09:54:39.603059+0000","last_peered":"2024-09-22T09:54:39.603059+0000","last_clean":"2024-09-22T09:54:39.603059+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:54:39.603059+0000","last_undegraded":"2024-09-22T09:54:39.603059+0000","last_fullsized":"2024-09-22T09:54:39.603059+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4554","last_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_deep_scrub":"262'4554","last_deep_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.602864+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":3000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:58.038441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26027,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'324","reported_seq":1036,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.569192+0000","last_change":"2024-09-22T09:54:30.569112+0000","last_active":"2024-09-22T09:54:30.569192+0000","last_peered":"2024-09-22T09:54:30.569192+0000","last_clean":"2024-09-22T09:54:30.569192+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:54:30.569192+0000","last_undegraded":"2024-09-22T09:54:30.569192+0000","last_fullsized":"2024-09-22T09:54:30.569192+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.568978+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:49:58.439696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":40392,"num_write":1278,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'118","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.338436+0000","last_change":"2024-09-22T09:54:40.338351+0000","last_active":"2024-09-22T09:54:40.338436+0000","last_peered":"2024-09-22T09:54:40.338436+0000","last_clean":"2024-09-22T09:54:40.338436+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:54:40.338436+0000","last_undegraded":"2024-09-22T09:54:40.338436+0000","last_fullsized":"2024-09-22T09:54:40.338436+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.338247+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:47.134708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'206","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.815019+0000","last_change":"2024-09-22T09:54:34.814919+0000","last_active":"2024-09-22T09:54:34.815019+0000","last_peered":"2024-09-22T09:54:34.815019+0000","last_clean":"2024-09-22T09:54:34.815019+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:54:34.815019+0000","last_undegraded":"2024-09-22T09:54:34.815019+0000","last_fullsized":"2024-09-22T09:54:34.815019+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.814749+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:27.535584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":708,"num_read_kb":60138,"num_write":928,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.622485+0000","last_change":"2024-09-22T09:54:30.622414+0000","last_active":"2024-09-22T09:54:30.622485+0000","last_peered":"2024-09-22T09:54:30.622485+0000","last_clean":"2024-09-22T09:54:30.622485+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:54:30.622485+0000","last_undegraded":"2024-09-22T09:54:30.622485+0000","last_fullsized":"2024-09-22T09:54:30.622485+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.622328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:28.359393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.679959+0000","last_change":"2024-09-22T09:54:35.679903+0000","last_active":"2024-09-22T09:54:35.679959+0000","last_peered":"2024-09-22T09:54:35.679959+0000","last_clean":"2024-09-22T09:54:35.679959+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:54:35.679959+0000","last_undegraded":"2024-09-22T09:54:35.679959+0000","last_fullsized":"2024-09-22T09:54:35.679959+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.679816+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:58:37.331041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'216","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.502853+0000","last_change":"2024-09-22T09:54:27.502790+0000","last_active":"2024-09-22T09:54:27.502853+0000","last_peered":"2024-09-22T09:54:27.502853+0000","last_clean":"2024-09-22T09:54:27.502853+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:54:27.502853+0000","last_undegraded":"2024-09-22T09:54:27.502853+0000","last_fullsized":"2024-09-22T09:54:27.502853+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'216","last_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_deep_scrub":"262'216","last_deep_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.502656+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:28.950343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":44934,"num_write":915,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.573561+0000","last_change":"2024-09-22T09:54:36.573483+0000","last_active":"2024-09-22T09:54:36.573561+0000","last_peered":"2024-09-22T09:54:36.573561+0000","last_clean":"2024-09-22T09:54:36.573561+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:54:36.573561+0000","last_undegraded":"2024-09-22T09:54:36.573561+0000","last_fullsized":"2024-09-22T09:54:36.573561+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.573367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:13.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'137","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.908255+0000","last_change":"2024-09-22T09:54:27.908195+0000","last_active":"2024-09-22T09:54:27.908255+0000","last_peered":"2024-09-22T09:54:27.908255+0000","last_clean":"2024-09-22T09:54:27.908255+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:54:27.908255+0000","last_undegraded":"2024-09-22T09:54:27.908255+0000","last_fullsized":"2024-09-22T09:54:27.908255+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.908076+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:25:43.835693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":4340,"num_write":703,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.342805+0000","last_change":"2024-09-22T09:54:36.342751+0000","last_active":"2024-09-22T09:54:36.342805+0000","last_peered":"2024-09-22T09:54:36.342805+0000","last_clean":"2024-09-22T09:54:36.342805+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:54:36.342805+0000","last_undegraded":"2024-09-22T09:54:36.342805+0000","last_fullsized":"2024-09-22T09:54:36.342805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.342669+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:11.894761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'200","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.931855+0000","last_change":"2024-09-22T09:54:28.931797+0000","last_active":"2024-09-22T09:54:28.931855+0000","last_peered":"2024-09-22T09:54:28.931855+0000","last_clean":"2024-09-22T09:54:28.931855+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:54:28.931855+0000","last_undegraded":"2024-09-22T09:54:28.931855+0000","last_fullsized":"2024-09-22T09:54:28.931855+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.931664+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:23.475431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":44793,"num_write":917,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'263","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.645932+0000","last_change":"2024-09-22T09:54:28.645828+0000","last_active":"2024-09-22T09:54:28.645932+0000","last_peered":"2024-09-22T09:54:28.645932+0000","last_clean":"2024-09-22T09:54:28.645932+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:54:28.645932+0000","last_undegraded":"2024-09-22T09:54:28.645932+0000","last_fullsized":"2024-09-22T09:54:28.645932+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.645693+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:27.752376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'208","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.766157+0000","last_change":"2024-09-22T09:54:23.766105+0000","last_active":"2024-09-22T09:54:23.766157+0000","last_peered":"2024-09-22T09:54:23.766157+0000","last_clean":"2024-09-22T09:54:23.766157+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:54:23.766157+0000","last_undegraded":"2024-09-22T09:54:23.766157+0000","last_fullsized":"2024-09-22T09:54:23.766157+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.765983+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:24.208701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":639,"num_write":1016,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'336","reported_seq":985,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.625494+0000","last_change":"2024-09-22T09:54:29.625420+0000","last_active":"2024-09-22T09:54:29.625494+0000","last_peered":"2024-09-22T09:54:29.625494+0000","last_clean":"2024-09-22T09:54:29.625494+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:54:29.625494+0000","last_undegraded":"2024-09-22T09:54:29.625494+0000","last_fullsized":"2024-09-22T09:54:29.625494+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.625322+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:56.414721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'231","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.834864+0000","last_change":"2024-09-22T09:54:28.834762+0000","last_active":"2024-09-22T09:54:28.834864+0000","last_peered":"2024-09-22T09:54:28.834864+0000","last_clean":"2024-09-22T09:54:28.834864+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:54:28.834864+0000","last_undegraded":"2024-09-22T09:54:28.834864+0000","last_fullsized":"2024-09-22T09:54:28.834864+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.834665+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:27.131540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":35016,"num_write":919,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'68","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.646773+0000","last_change":"2024-09-22T09:54:38.646721+0000","last_active":"2024-09-22T09:54:38.646773+0000","last_peered":"2024-09-22T09:54:38.646773+0000","last_clean":"2024-09-22T09:54:38.646773+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:54:38.646773+0000","last_undegraded":"2024-09-22T09:54:38.646773+0000","last_fullsized":"2024-09-22T09:54:38.646773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'68","last_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_deep_scrub":"262'68","last_deep_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.646631+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:11.600548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'204","reported_seq":1076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.044214+0000","last_change":"2024-09-22T09:54:27.044159+0000","last_active":"2024-09-22T09:54:27.044214+0000","last_peered":"2024-09-22T09:54:27.044214+0000","last_clean":"2024-09-22T09:54:27.044214+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:54:27.044214+0000","last_undegraded":"2024-09-22T09:54:27.044214+0000","last_fullsized":"2024-09-22T09:54:27.044214+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.044042+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:26.911985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1343,"num_read_kb":71433,"num_write":1020,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'129","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.611141+0000","last_change":"2024-09-22T09:54:55.611071+0000","last_active":"2024-09-22T09:54:55.611141+0000","last_peered":"2024-09-22T09:54:55.611141+0000","last_clean":"2024-09-22T09:54:55.611141+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:54:55.611141+0000","last_undegraded":"2024-09-22T09:54:55.611141+0000","last_fullsized":"2024-09-22T09:54:55.611141+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.610956+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:34.518683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":711,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886309+0000","last_change":"2024-09-22T09:54:32.886256+0000","last_active":"2024-09-22T09:54:32.886309+0000","last_peered":"2024-09-22T09:54:32.886309+0000","last_clean":"2024-09-22T09:54:32.886309+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:54:32.886309+0000","last_undegraded":"2024-09-22T09:54:32.886309+0000","last_fullsized":"2024-09-22T09:54:32.886309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886167+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:30.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'246","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.453792+0000","last_change":"2024-09-22T09:54:26.453733+0000","last_active":"2024-09-22T09:54:26.453792+0000","last_peered":"2024-09-22T09:54:26.453792+0000","last_clean":"2024-09-22T09:54:26.453792+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:54:26.453792+0000","last_undegraded":"2024-09-22T09:54:26.453792+0000","last_fullsized":"2024-09-22T09:54:26.453792+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.453584+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:12.566992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":724,"num_read_kb":75224,"num_write":1095,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.295856+0000","last_change":"2024-09-22T09:54:44.295796+0000","last_active":"2024-09-22T09:54:44.295856+0000","last_peered":"2024-09-22T09:54:44.295856+0000","last_clean":"2024-09-22T09:54:44.295856+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:54:44.295856+0000","last_undegraded":"2024-09-22T09:54:44.295856+0000","last_fullsized":"2024-09-22T09:54:44.295856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.295705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:40.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'220","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.066941+0000","last_change":"2024-09-22T09:54:44.066889+0000","last_active":"2024-09-22T09:54:44.066941+0000","last_peered":"2024-09-22T09:54:44.066941+0000","last_clean":"2024-09-22T09:54:44.066941+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:54:44.066941+0000","last_undegraded":"2024-09-22T09:54:44.066941+0000","last_fullsized":"2024-09-22T09:54:44.066941+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.066792+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:06.960949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":291,"num_read_kb":380,"num_write":172,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.570773+0000","last_change":"2024-09-22T09:54:51.570712+0000","last_active":"2024-09-22T09:54:51.570773+0000","last_peered":"2024-09-22T09:54:51.570773+0000","last_clean":"2024-09-22T09:54:51.570773+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:54:51.570773+0000","last_undegraded":"2024-09-22T09:54:51.570773+0000","last_fullsized":"2024-09-22T09:54:51.570773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.570620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:59.625436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'143","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.367638+0000","last_change":"2024-09-22T09:54:56.367581+0000","last_active":"2024-09-22T09:54:56.367638+0000","last_peered":"2024-09-22T09:54:56.367638+0000","last_clean":"2024-09-22T09:54:56.367638+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:54:56.367638+0000","last_undegraded":"2024-09-22T09:54:56.367638+0000","last_fullsized":"2024-09-22T09:54:56.367638+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.367482+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:19.773727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.356729+0000","last_change":"2024-09-22T09:54:34.356652+0000","last_active":"2024-09-22T09:54:34.356729+0000","last_peered":"2024-09-22T09:54:34.356729+0000","last_clean":"2024-09-22T09:54:34.356729+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:54:34.356729+0000","last_undegraded":"2024-09-22T09:54:34.356729+0000","last_fullsized":"2024-09-22T09:54:34.356729+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'241","last_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_deep_scrub":"262'241","last_deep_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.356567+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:12.922893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.085670+0000","last_change":"2024-09-22T09:54:21.085625+0000","last_active":"2024-09-22T09:54:21.085670+0000","last_peered":"2024-09-22T09:54:21.085670+0000","last_clean":"2024-09-22T09:54:21.085670+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:54:21.085670+0000","last_undegraded":"2024-09-22T09:54:21.085670+0000","last_fullsized":"2024-09-22T09:54:21.085670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.085544+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:19.372506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":43802,"num_write":911,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.706253+0000","last_change":"2024-09-22T09:54:44.706190+0000","last_active":"2024-09-22T09:54:44.706253+0000","last_peered":"2024-09-22T09:54:44.706253+0000","last_clean":"2024-09-22T09:54:44.706253+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:54:44.706253+0000","last_undegraded":"2024-09-22T09:54:44.706253+0000","last_fullsized":"2024-09-22T09:54:44.706253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.706103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.288230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'102","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.613924+0000","last_change":"2024-09-22T09:54:47.613835+0000","last_active":"2024-09-22T09:54:47.613924+0000","last_peered":"2024-09-22T09:54:47.613924+0000","last_clean":"2024-09-22T09:54:47.613924+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:54:47.613924+0000","last_undegraded":"2024-09-22T09:54:47.613924+0000","last_fullsized":"2024-09-22T09:54:47.613924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'102","last_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_deep_scrub":"262'102","last_deep_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.613723+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:07.426920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.610569+0000","last_change":"2024-09-22T09:54:51.610489+0000","last_active":"2024-09-22T09:54:51.610569+0000","last_peered":"2024-09-22T09:54:51.610569+0000","last_clean":"2024-09-22T09:54:51.610569+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:54:51.610569+0000","last_undegraded":"2024-09-22T09:54:51.610569+0000","last_fullsized":"2024-09-22T09:54:51.610569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.610373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:03.585252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'112","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.186599+0000","last_change":"2024-09-22T09:54:54.186548+0000","last_active":"2024-09-22T09:54:54.186599+0000","last_peered":"2024-09-22T09:54:54.186599+0000","last_clean":"2024-09-22T09:54:54.186599+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:54:54.186599+0000","last_undegraded":"2024-09-22T09:54:54.186599+0000","last_fullsized":"2024-09-22T09:54:54.186599+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.186462+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:40.537153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.045828+0000","last_change":"2024-09-22T09:54:31.045733+0000","last_active":"2024-09-22T09:54:31.045828+0000","last_peered":"2024-09-22T09:54:31.045828+0000","last_clean":"2024-09-22T09:54:31.045828+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:54:31.045828+0000","last_undegraded":"2024-09-22T09:54:31.045828+0000","last_fullsized":"2024-09-22T09:54:31.045828+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.045630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:36:20.196950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'246","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.640322+0000","last_change":"2024-09-22T09:54:21.640226+0000","last_active":"2024-09-22T09:54:21.640322+0000","last_peered":"2024-09-22T09:54:21.640322+0000","last_clean":"2024-09-22T09:54:21.640322+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:54:21.640322+0000","last_undegraded":"2024-09-22T09:54:21.640322+0000","last_fullsized":"2024-09-22T09:54:21.640322+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.640096+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.038690+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":41488,"num_write":1122,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"262'5","reported_seq":984,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.691015+0000","last_change":"2024-09-22T09:54:45.690912+0000","last_active":"2024-09-22T09:54:45.691015+0000","last_peered":"2024-09-22T09:54:45.691015+0000","last_clean":"2024-09-22T09:54:45.691015+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:45.691015+0000","last_undegraded":"2024-09-22T09:54:45.691015+0000","last_fullsized":"2024-09-22T09:54:45.691015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.690818+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:10.394599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'147","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.635381+0000","last_change":"2024-09-22T09:54:37.635267+0000","last_active":"2024-09-22T09:54:37.635381+0000","last_peered":"2024-09-22T09:54:37.635381+0000","last_clean":"2024-09-22T09:54:37.635381+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:54:37.635381+0000","last_undegraded":"2024-09-22T09:54:37.635381+0000","last_fullsized":"2024-09-22T09:54:37.635381+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.635149+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:19.442915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'747","reported_seq":2945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.596952+0000","last_change":"2024-09-22T09:54:50.596897+0000","last_active":"2024-09-22T09:54:50.596952+0000","last_peered":"2024-09-22T09:54:50.596952+0000","last_clean":"2024-09-22T09:54:50.596952+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:50.596952+0000","last_undegraded":"2024-09-22T09:54:50.596952+0000","last_fullsized":"2024-09-22T09:54:50.596952+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'747","last_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_deep_scrub":"262'747","last_deep_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.596813+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:33.365832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'220","reported_seq":1057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.645529+0000","last_change":"2024-09-22T09:54:56.645439+0000","last_active":"2024-09-22T09:54:56.645529+0000","last_peered":"2024-09-22T09:54:56.645529+0000","last_clean":"2024-09-22T09:54:56.645529+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:54:56.645529+0000","last_undegraded":"2024-09-22T09:54:56.645529+0000","last_fullsized":"2024-09-22T09:54:56.645529+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.645339+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:58.691212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.841822+0000","last_change":"2024-09-22T09:54:33.841700+0000","last_active":"2024-09-22T09:54:33.841822+0000","last_peered":"2024-09-22T09:54:33.841822+0000","last_clean":"2024-09-22T09:54:33.841822+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:54:33.841822+0000","last_undegraded":"2024-09-22T09:54:33.841822+0000","last_fullsized":"2024-09-22T09:54:33.841822+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'126","last_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_deep_scrub":"262'126","last_deep_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.841584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:42.546104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'178","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.765183+0000","last_change":"2024-09-22T09:54:22.765090+0000","last_active":"2024-09-22T09:54:22.765183+0000","last_peered":"2024-09-22T09:54:22.765183+0000","last_clean":"2024-09-22T09:54:22.765183+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:54:22.765183+0000","last_undegraded":"2024-09-22T09:54:22.765183+0000","last_fullsized":"2024-09-22T09:54:22.765183+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'178","last_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_deep_scrub":"262'178","last_deep_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.764975+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:45.588343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":49818,"num_write":846,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.314863+0000","last_change":"2024-09-22T09:54:41.314799+0000","last_active":"2024-09-22T09:54:41.314863+0000","last_peered":"2024-09-22T09:54:41.314863+0000","last_clean":"2024-09-22T09:54:41.314863+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:54:41.314863+0000","last_undegraded":"2024-09-22T09:54:41.314863+0000","last_fullsized":"2024-09-22T09:54:41.314863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.314713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:29.075728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'155","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.591755+0000","last_change":"2024-09-22T09:54:45.591689+0000","last_active":"2024-09-22T09:54:45.591755+0000","last_peered":"2024-09-22T09:54:45.591755+0000","last_clean":"2024-09-22T09:54:45.591755+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:54:45.591755+0000","last_undegraded":"2024-09-22T09:54:45.591755+0000","last_fullsized":"2024-09-22T09:54:45.591755+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.591608+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:04.286884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":274,"num_write":110,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'756","reported_seq":2410,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.693901+0000","last_change":"2024-09-22T09:54:55.693845+0000","last_active":"2024-09-22T09:54:55.693901+0000","last_peered":"2024-09-22T09:54:55.693901+0000","last_clean":"2024-09-22T09:54:55.693901+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:55.693901+0000","last_undegraded":"2024-09-22T09:54:55.693901+0000","last_fullsized":"2024-09-22T09:54:55.693901+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.693756+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:43.607812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.420090+0000","last_change":"2024-09-22T09:54:32.420090+0000","last_active":"2024-09-22T09:54:32.420090+0000","last_peered":"2024-09-22T09:54:32.420090+0000","last_clean":"2024-09-22T09:54:32.420090+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:54:32.420090+0000","last_undegraded":"2024-09-22T09:54:32.420090+0000","last_fullsized":"2024-09-22T09:54:32.420090+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.419968+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:58.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'193","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.589508+0000","last_change":"2024-09-22T09:54:20.589426+0000","last_active":"2024-09-22T09:54:20.589508+0000","last_peered":"2024-09-22T09:54:20.589508+0000","last_clean":"2024-09-22T09:54:20.589508+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:54:20.589508+0000","last_undegraded":"2024-09-22T09:54:20.589508+0000","last_fullsized":"2024-09-22T09:54:20.589508+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.589319+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.187304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":37265,"num_write":903,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.612874+0000","last_change":"2024-09-22T09:54:39.612874+0000","last_active":"2024-09-22T09:54:39.612874+0000","last_peered":"2024-09-22T09:54:39.612874+0000","last_clean":"2024-09-22T09:54:39.612874+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:54:39.612874+0000","last_undegraded":"2024-09-22T09:54:39.612874+0000","last_fullsized":"2024-09-22T09:54:39.612874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.612789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:31.057982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'261","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.270530+0000","last_change":"2024-09-22T09:54:45.270530+0000","last_active":"2024-09-22T09:54:45.270530+0000","last_peered":"2024-09-22T09:54:45.270530+0000","last_clean":"2024-09-22T09:54:45.270530+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:54:45.270530+0000","last_undegraded":"2024-09-22T09:54:45.270530+0000","last_fullsized":"2024-09-22T09:54:45.270530+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'261","last_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_deep_scrub":"262'261","last_deep_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.270420+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:42.250477+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6788,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":355,"num_read_kb":422,"num_write":210,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.156730+0000","last_change":"2024-09-22T09:54:42.156730+0000","last_active":"2024-09-22T09:54:42.156730+0000","last_peered":"2024-09-22T09:54:42.156730+0000","last_clean":"2024-09-22T09:54:42.156730+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:54:42.156730+0000","last_undegraded":"2024-09-22T09:54:42.156730+0000","last_fullsized":"2024-09-22T09:54:42.156730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.156637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:54:18.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'585","reported_seq":1416,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.318921+0000","last_change":"2024-09-22T09:54:51.318921+0000","last_active":"2024-09-22T09:54:51.318921+0000","last_peered":"2024-09-22T09:54:51.318921+0000","last_clean":"2024-09-22T09:54:51.318921+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:51.318921+0000","last_undegraded":"2024-09-22T09:54:51.318921+0000","last_fullsized":"2024-09-22T09:54:51.318921+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'585","last_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_deep_scrub":"262'585","last_deep_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.318823+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:14.774473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":1004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.714675+0000","last_change":"2024-09-22T09:54:25.714675+0000","last_active":"2024-09-22T09:54:25.714675+0000","last_peered":"2024-09-22T09:54:25.714675+0000","last_clean":"2024-09-22T09:54:25.714675+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:54:25.714675+0000","last_undegraded":"2024-09-22T09:54:25.714675+0000","last_fullsized":"2024-09-22T09:54:25.714675+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.714587+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:22:34.018478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'229","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.529569+0000","last_change":"2024-09-22T09:54:24.529569+0000","last_active":"2024-09-22T09:54:24.529569+0000","last_peered":"2024-09-22T09:54:24.529569+0000","last_clean":"2024-09-22T09:54:24.529569+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:54:24.529569+0000","last_undegraded":"2024-09-22T09:54:24.529569+0000","last_fullsized":"2024-09-22T09:54:24.529569+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.529439+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:38.886184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":43078,"num_write":996,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.616335+0000","last_change":"2024-09-22T09:54:32.616335+0000","last_active":"2024-09-22T09:54:32.616335+0000","last_peered":"2024-09-22T09:54:32.616335+0000","last_clean":"2024-09-22T09:54:32.616335+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:54:32.616335+0000","last_undegraded":"2024-09-22T09:54:32.616335+0000","last_fullsized":"2024-09-22T09:54:32.616335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.616231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:46.763351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'156","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.618841+0000","last_change":"2024-09-22T09:54:47.618841+0000","last_active":"2024-09-22T09:54:47.618841+0000","last_peered":"2024-09-22T09:54:47.618841+0000","last_clean":"2024-09-22T09:54:47.618841+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:54:47.618841+0000","last_undegraded":"2024-09-22T09:54:47.618841+0000","last_fullsized":"2024-09-22T09:54:47.618841+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'156","last_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_deep_scrub":"262'156","last_deep_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.618725+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:25.667231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":232,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.708854+0000","last_change":"2024-09-22T09:54:59.708854+0000","last_active":"2024-09-22T09:54:59.708854+0000","last_peered":"2024-09-22T09:54:59.708854+0000","last_clean":"2024-09-22T09:54:59.708854+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:54:59.708854+0000","last_undegraded":"2024-09-22T09:54:59.708854+0000","last_fullsized":"2024-09-22T09:54:59.708854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.708750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.708750+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.708750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2546","reported_seq":4390,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.009360+0000","last_change":"2024-09-22T09:54:44.009360+0000","last_active":"2024-09-22T09:54:44.009360+0000","last_peered":"2024-09-22T09:54:44.009360+0000","last_clean":"2024-09-22T09:54:44.009360+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:54:44.009360+0000","last_undegraded":"2024-09-22T09:54:44.009360+0000","last_fullsized":"2024-09-22T09:54:44.009360+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2546","last_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_deep_scrub":"262'2546","last_deep_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.009269+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":2500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:56.015174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1208,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.925826+0000","last_change":"2024-09-22T09:54:30.925826+0000","last_active":"2024-09-22T09:54:30.925826+0000","last_peered":"2024-09-22T09:54:30.925826+0000","last_clean":"2024-09-22T09:54:30.925826+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:54:30.925826+0000","last_undegraded":"2024-09-22T09:54:30.925826+0000","last_fullsized":"2024-09-22T09:54:30.925826+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'595","last_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_deep_scrub":"262'595","last_deep_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.925742+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:22.030833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'249","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.496340+0000","last_change":"2024-09-22T09:54:25.496340+0000","last_active":"2024-09-22T09:54:25.496340+0000","last_peered":"2024-09-22T09:54:25.496340+0000","last_clean":"2024-09-22T09:54:25.496340+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:54:25.496340+0000","last_undegraded":"2024-09-22T09:54:25.496340+0000","last_fullsized":"2024-09-22T09:54:25.496340+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'249","last_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_deep_scrub":"262'249","last_deep_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.496221+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:36.135437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":17581,"num_write":1026,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.594837+0000","last_change":"2024-09-22T09:54:34.594837+0000","last_active":"2024-09-22T09:54:34.594837+0000","last_peered":"2024-09-22T09:54:34.594837+0000","last_clean":"2024-09-22T09:54:34.594837+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:54:34.594837+0000","last_undegraded":"2024-09-22T09:54:34.594837+0000","last_fullsized":"2024-09-22T09:54:34.594837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.594730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:44.826276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'205","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.614475+0000","last_change":"2024-09-22T09:54:47.614475+0000","last_active":"2024-09-22T09:54:47.614475+0000","last_peered":"2024-09-22T09:54:47.614475+0000","last_clean":"2024-09-22T09:54:47.614475+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:54:47.614475+0000","last_undegraded":"2024-09-22T09:54:47.614475+0000","last_fullsized":"2024-09-22T09:54:47.614475+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.614376+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:22.763339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6515,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":336,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'759","reported_seq":2733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.172282+0000","last_change":"2024-09-22T09:54:48.172282+0000","last_active":"2024-09-22T09:54:48.172282+0000","last_peered":"2024-09-22T09:54:48.172282+0000","last_clean":"2024-09-22T09:54:48.172282+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:48.172282+0000","last_undegraded":"2024-09-22T09:54:48.172282+0000","last_fullsized":"2024-09-22T09:54:48.172282+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.172190+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:13.572393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'120","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.102960+0000","last_change":"2024-09-22T09:54:51.102960+0000","last_active":"2024-09-22T09:54:51.102960+0000","last_peered":"2024-09-22T09:54:51.102960+0000","last_clean":"2024-09-22T09:54:51.102960+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:54:51.102960+0000","last_undegraded":"2024-09-22T09:54:51.102960+0000","last_fullsized":"2024-09-22T09:54:51.102960+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.102863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:28.997939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.039780+0000","last_change":"2024-09-22T09:54:32.039780+0000","last_active":"2024-09-22T09:54:32.039780+0000","last_peered":"2024-09-22T09:54:32.039780+0000","last_clean":"2024-09-22T09:54:32.039780+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:54:32.039780+0000","last_undegraded":"2024-09-22T09:54:32.039780+0000","last_fullsized":"2024-09-22T09:54:32.039780+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.039644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:49.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'210","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.582258+0000","last_change":"2024-09-22T09:54:25.582258+0000","last_active":"2024-09-22T09:54:25.582258+0000","last_peered":"2024-09-22T09:54:25.582258+0000","last_clean":"2024-09-22T09:54:25.582258+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:54:25.582258+0000","last_undegraded":"2024-09-22T09:54:25.582258+0000","last_fullsized":"2024-09-22T09:54:25.582258+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.582157+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:50.691745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":60855,"num_write":915,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.585259+0000","last_change":"2024-09-22T09:54:33.585259+0000","last_active":"2024-09-22T09:54:33.585259+0000","last_peered":"2024-09-22T09:54:33.585259+0000","last_clean":"2024-09-22T09:54:33.585259+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:54:33.585259+0000","last_undegraded":"2024-09-22T09:54:33.585259+0000","last_fullsized":"2024-09-22T09:54:33.585259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.585167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:48.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.053559+0000","last_change":"2024-09-22T09:54:42.053559+0000","last_active":"2024-09-22T09:54:42.053559+0000","last_peered":"2024-09-22T09:54:42.053559+0000","last_clean":"2024-09-22T09:54:42.053559+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:42.053559+0000","last_undegraded":"2024-09-22T09:54:42.053559+0000","last_fullsized":"2024-09-22T09:54:42.053559+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.053464+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:38.800886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":297,"num_read_kb":387,"num_write":144,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.595291+0000","last_change":"2024-09-22T09:54:38.595291+0000","last_active":"2024-09-22T09:54:38.595291+0000","last_peered":"2024-09-22T09:54:38.595291+0000","last_clean":"2024-09-22T09:54:38.595291+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:54:38.595291+0000","last_undegraded":"2024-09-22T09:54:38.595291+0000","last_fullsized":"2024-09-22T09:54:38.595291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.595189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:49.766642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'143","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.157662+0000","last_change":"2024-09-22T09:54:47.157662+0000","last_active":"2024-09-22T09:54:47.157662+0000","last_peered":"2024-09-22T09:54:47.157662+0000","last_clean":"2024-09-22T09:54:47.157662+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:54:47.157662+0000","last_undegraded":"2024-09-22T09:54:47.157662+0000","last_fullsized":"2024-09-22T09:54:47.157662+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.157571+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:55.768204+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.695111+0000","last_change":"2024-09-22T09:54:26.695111+0000","last_active":"2024-09-22T09:54:26.695111+0000","last_peered":"2024-09-22T09:54:26.695111+0000","last_clean":"2024-09-22T09:54:26.695111+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:54:26.695111+0000","last_undegraded":"2024-09-22T09:54:26.695111+0000","last_fullsized":"2024-09-22T09:54:26.695111+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.695015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:37.239794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'366","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.883932+0000","last_change":"2024-09-22T09:54:21.883932+0000","last_active":"2024-09-22T09:54:21.883932+0000","last_peered":"2024-09-22T09:54:21.883932+0000","last_clean":"2024-09-22T09:54:21.883932+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:54:21.883932+0000","last_undegraded":"2024-09-22T09:54:21.883932+0000","last_fullsized":"2024-09-22T09:54:21.883932+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.883821+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:21.748018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1019,"num_read_kb":7434,"num_write":1387,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.591498+0000","last_change":"2024-09-22T09:54:35.591498+0000","last_active":"2024-09-22T09:54:35.591498+0000","last_peered":"2024-09-22T09:54:35.591498+0000","last_clean":"2024-09-22T09:54:35.591498+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:54:35.591498+0000","last_undegraded":"2024-09-22T09:54:35.591498+0000","last_fullsized":"2024-09-22T09:54:35.591498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.591372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:34.926025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'172","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.579674+0000","last_change":"2024-09-22T09:54:45.579674+0000","last_active":"2024-09-22T09:54:45.579674+0000","last_peered":"2024-09-22T09:54:45.579674+0000","last_clean":"2024-09-22T09:54:45.579674+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:54:45.579674+0000","last_undegraded":"2024-09-22T09:54:45.579674+0000","last_fullsized":"2024-09-22T09:54:45.579674+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.579593+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:11.237734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":182,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.281353+0000","last_change":"2024-09-22T09:54:59.281353+0000","last_active":"2024-09-22T09:54:59.281353+0000","last_peered":"2024-09-22T09:54:59.281353+0000","last_clean":"2024-09-22T09:54:59.281353+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:54:59.281353+0000","last_undegraded":"2024-09-22T09:54:59.281353+0000","last_fullsized":"2024-09-22T09:54:59.281353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.281254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.281254+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.281254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:15.007520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'137","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.705175+0000","last_change":"2024-09-22T09:54:57.705175+0000","last_active":"2024-09-22T09:54:57.705175+0000","last_peered":"2024-09-22T09:54:57.705175+0000","last_clean":"2024-09-22T09:54:57.705175+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:54:57.705175+0000","last_undegraded":"2024-09-22T09:54:57.705175+0000","last_fullsized":"2024-09-22T09:54:57.705175+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:57.705083+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:57.705083+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.705083+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:47.471590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.718751+0000","last_change":"2024-09-22T09:54:27.718751+0000","last_active":"2024-09-22T09:54:27.718751+0000","last_peered":"2024-09-22T09:54:27.718751+0000","last_clean":"2024-09-22T09:54:27.718751+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:54:27.718751+0000","last_undegraded":"2024-09-22T09:54:27.718751+0000","last_fullsized":"2024-09-22T09:54:27.718751+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.718664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:52.332290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'237","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.813127+0000","last_change":"2024-09-22T09:54:21.813127+0000","last_active":"2024-09-22T09:54:21.813127+0000","last_peered":"2024-09-22T09:54:21.813127+0000","last_clean":"2024-09-22T09:54:21.813127+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:54:21.813127+0000","last_undegraded":"2024-09-22T09:54:21.813127+0000","last_fullsized":"2024-09-22T09:54:21.813127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.812963+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:20.379997+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242950,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":767,"num_read_kb":42930,"num_write":1126,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.200568+0000","last_change":"2024-09-22T09:54:36.200568+0000","last_active":"2024-09-22T09:54:36.200568+0000","last_peered":"2024-09-22T09:54:36.200568+0000","last_clean":"2024-09-22T09:54:36.200568+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:54:36.200568+0000","last_undegraded":"2024-09-22T09:54:36.200568+0000","last_fullsized":"2024-09-22T09:54:36.200568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.200478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:14.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'199","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.623404+0000","last_change":"2024-09-22T09:54:36.623404+0000","last_active":"2024-09-22T09:54:36.623404+0000","last_peered":"2024-09-22T09:54:36.623404+0000","last_clean":"2024-09-22T09:54:36.623404+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:54:36.623404+0000","last_undegraded":"2024-09-22T09:54:36.623404+0000","last_fullsized":"2024-09-22T09:54:36.623404+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.623296+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:27.880579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'722","reported_seq":2504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.636408+0000","last_change":"2024-09-22T09:54:39.636408+0000","last_active":"2024-09-22T09:54:39.636408+0000","last_peered":"2024-09-22T09:54:39.636408+0000","last_clean":"2024-09-22T09:54:39.636408+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:39.636408+0000","last_undegraded":"2024-09-22T09:54:39.636408+0000","last_fullsized":"2024-09-22T09:54:39.636408+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'722","last_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_deep_scrub":"262'722","last_deep_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.636312+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:26.968453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'142","reported_seq":650,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.217597+0000","last_change":"2024-09-22T09:54:45.217597+0000","last_active":"2024-09-22T09:54:45.217597+0000","last_peered":"2024-09-22T09:54:45.217597+0000","last_clean":"2024-09-22T09:54:45.217597+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:54:45.217597+0000","last_undegraded":"2024-09-22T09:54:45.217597+0000","last_fullsized":"2024-09-22T09:54:45.217597+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.217484+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:33.960189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.702387+0000","last_change":"2024-09-22T09:54:28.702387+0000","last_active":"2024-09-22T09:54:28.702387+0000","last_peered":"2024-09-22T09:54:28.702387+0000","last_clean":"2024-09-22T09:54:28.702387+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:54:28.702387+0000","last_undegraded":"2024-09-22T09:54:28.702387+0000","last_fullsized":"2024-09-22T09:54:28.702387+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.702304+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:11.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'258","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.856222+0000","last_change":"2024-09-22T09:54:22.856222+0000","last_active":"2024-09-22T09:54:22.856222+0000","last_peered":"2024-09-22T09:54:22.856222+0000","last_clean":"2024-09-22T09:54:22.856222+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:54:22.856222+0000","last_undegraded":"2024-09-22T09:54:22.856222+0000","last_fullsized":"2024-09-22T09:54:22.856222+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'258","last_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_deep_scrub":"262'258","last_deep_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.856126+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:10.632167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1203,"num_read_kb":6055,"num_write":1103,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1463,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.292562+0000","last_change":"2024-09-22T09:54:42.292562+0000","last_active":"2024-09-22T09:54:42.292562+0000","last_peered":"2024-09-22T09:54:42.292562+0000","last_clean":"2024-09-22T09:54:42.292562+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:42.292562+0000","last_undegraded":"2024-09-22T09:54:42.292562+0000","last_fullsized":"2024-09-22T09:54:42.292562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.292452+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:15.247545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'137","reported_seq":680,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.616883+0000","last_change":"2024-09-22T09:54:48.616883+0000","last_active":"2024-09-22T09:54:48.616883+0000","last_peered":"2024-09-22T09:54:48.616883+0000","last_clean":"2024-09-22T09:54:48.616883+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:54:48.616883+0000","last_undegraded":"2024-09-22T09:54:48.616883+0000","last_fullsized":"2024-09-22T09:54:48.616883+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.616758+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:33.434488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'757","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.965816+0000","last_change":"2024-09-22T09:54:39.965816+0000","last_active":"2024-09-22T09:54:39.965816+0000","last_peered":"2024-09-22T09:54:39.965816+0000","last_clean":"2024-09-22T09:54:39.965816+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:39.965816+0000","last_undegraded":"2024-09-22T09:54:39.965816+0000","last_fullsized":"2024-09-22T09:54:39.965816+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'757","last_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_deep_scrub":"262'757","last_deep_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.965733+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:52.549736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'120","reported_seq":627,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.624151+0000","last_change":"2024-09-22T09:54:52.624151+0000","last_active":"2024-09-22T09:54:52.624151+0000","last_peered":"2024-09-22T09:54:52.624151+0000","last_clean":"2024-09-22T09:54:52.624151+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:54:52.624151+0000","last_undegraded":"2024-09-22T09:54:52.624151+0000","last_fullsized":"2024-09-22T09:54:52.624151+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.624066+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:54.701435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.222747+0000","last_change":"2024-09-22T09:54:31.222655+0000","last_active":"2024-09-22T09:54:31.222747+0000","last_peered":"2024-09-22T09:54:31.222747+0000","last_clean":"2024-09-22T09:54:31.222747+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:54:31.222747+0000","last_undegraded":"2024-09-22T09:54:31.222747+0000","last_fullsized":"2024-09-22T09:54:31.222747+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4209","last_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_deep_scrub":"262'4209","last_deep_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.222546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:03.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'188","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.824881+0000","last_change":"2024-09-22T09:54:29.824881+0000","last_active":"2024-09-22T09:54:29.824881+0000","last_peered":"2024-09-22T09:54:29.824881+0000","last_clean":"2024-09-22T09:54:29.824881+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:54:29.824881+0000","last_undegraded":"2024-09-22T09:54:29.824881+0000","last_fullsized":"2024-09-22T09:54:29.824881+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.824757+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:54.380784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":707,"num_read_kb":142631,"num_write":847,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.595584+0000","last_change":"2024-09-22T09:54:40.595584+0000","last_active":"2024-09-22T09:54:40.595584+0000","last_peered":"2024-09-22T09:54:40.595584+0000","last_clean":"2024-09-22T09:54:40.595584+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:54:40.595584+0000","last_undegraded":"2024-09-22T09:54:40.595584+0000","last_fullsized":"2024-09-22T09:54:40.595584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.595487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:01.540605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'231","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.313887+0000","last_change":"2024-09-22T09:54:47.313887+0000","last_active":"2024-09-22T09:54:47.313887+0000","last_peered":"2024-09-22T09:54:47.313887+0000","last_clean":"2024-09-22T09:54:47.313887+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:54:47.313887+0000","last_undegraded":"2024-09-22T09:54:47.313887+0000","last_fullsized":"2024-09-22T09:54:47.313887+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.313763+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:24.558381+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":186,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.924774+0000","last_change":"2024-09-22T09:54:38.924774+0000","last_active":"2024-09-22T09:54:38.924774+0000","last_peered":"2024-09-22T09:54:38.924774+0000","last_clean":"2024-09-22T09:54:38.924774+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:54:38.924774+0000","last_undegraded":"2024-09-22T09:54:38.924774+0000","last_fullsized":"2024-09-22T09:54:38.924774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.924672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:45.017694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'134","reported_seq":664,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.173214+0000","last_change":"2024-09-22T09:54:46.173214+0000","last_active":"2024-09-22T09:54:46.173214+0000","last_peered":"2024-09-22T09:54:46.173214+0000","last_clean":"2024-09-22T09:54:46.173214+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:54:46.173214+0000","last_undegraded":"2024-09-22T09:54:46.173214+0000","last_fullsized":"2024-09-22T09:54:46.173214+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.173116+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:14.836807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1035,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.953838+0000","last_change":"2024-09-22T09:54:29.953765+0000","last_active":"2024-09-22T09:54:29.953838+0000","last_peered":"2024-09-22T09:54:29.953838+0000","last_clean":"2024-09-22T09:54:29.953838+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:54:29.953838+0000","last_undegraded":"2024-09-22T09:54:29.953838+0000","last_fullsized":"2024-09-22T09:54:29.953838+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.953655+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:28.167803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.574870+0000","last_change":"2024-09-22T09:54:22.574870+0000","last_active":"2024-09-22T09:54:22.574870+0000","last_peered":"2024-09-22T09:54:22.574870+0000","last_clean":"2024-09-22T09:54:22.574870+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:54:22.574870+0000","last_undegraded":"2024-09-22T09:54:22.574870+0000","last_fullsized":"2024-09-22T09:54:22.574870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.574784+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:51.565048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.531626+0000","last_change":"2024-09-22T09:54:22.531543+0000","last_active":"2024-09-22T09:54:22.531626+0000","last_peered":"2024-09-22T09:54:22.531626+0000","last_clean":"2024-09-22T09:54:22.531626+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:54:22.531626+0000","last_undegraded":"2024-09-22T09:54:22.531626+0000","last_fullsized":"2024-09-22T09:54:22.531626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.531426+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:15.733698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'265","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.914127+0000","last_change":"2024-09-22T09:54:20.914080+0000","last_active":"2024-09-22T09:54:20.914127+0000","last_peered":"2024-09-22T09:54:20.914127+0000","last_clean":"2024-09-22T09:54:20.914127+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:54:20.914127+0000","last_undegraded":"2024-09-22T09:54:20.914127+0000","last_fullsized":"2024-09-22T09:54:20.914127+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'265","last_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_deep_scrub":"262'265","last_deep_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.913993+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:34.016179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":19734,"num_write":1091,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.605708+0000","last_change":"2024-09-22T09:54:38.605619+0000","last_active":"2024-09-22T09:54:38.605708+0000","last_peered":"2024-09-22T09:54:38.605708+0000","last_clean":"2024-09-22T09:54:38.605708+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:54:38.605708+0000","last_undegraded":"2024-09-22T09:54:38.605708+0000","last_fullsized":"2024-09-22T09:54:38.605708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.605481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.706887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'328","reported_seq":1049,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.305495+0000","last_change":"2024-09-22T09:54:46.305495+0000","last_active":"2024-09-22T09:54:46.305495+0000","last_peered":"2024-09-22T09:54:46.305495+0000","last_clean":"2024-09-22T09:54:46.305495+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:46.305495+0000","last_undegraded":"2024-09-22T09:54:46.305495+0000","last_fullsized":"2024-09-22T09:54:46.305495+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'328","last_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_deep_scrub":"262'328","last_deep_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.305404+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:41.226802+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":739,"num_write":494,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89468,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.187781+0000","last_change":"2024-09-22T09:54:47.187781+0000","last_active":"2024-09-22T09:54:47.187781+0000","last_peered":"2024-09-22T09:54:47.187781+0000","last_clean":"2024-09-22T09:54:47.187781+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:54:47.187781+0000","last_undegraded":"2024-09-22T09:54:47.187781+0000","last_fullsized":"2024-09-22T09:54:47.187781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.187615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:06.531153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'207","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.999122+0000","last_change":"2024-09-22T09:54:41.999122+0000","last_active":"2024-09-22T09:54:41.999122+0000","last_peered":"2024-09-22T09:54:41.999122+0000","last_clean":"2024-09-22T09:54:41.999122+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:54:41.999122+0000","last_undegraded":"2024-09-22T09:54:41.999122+0000","last_fullsized":"2024-09-22T09:54:41.999122+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.999009+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.532488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'137","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.023195+0000","last_change":"2024-09-22T09:54:30.023195+0000","last_active":"2024-09-22T09:54:30.023195+0000","last_peered":"2024-09-22T09:54:30.023195+0000","last_clean":"2024-09-22T09:54:30.023195+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:54:30.023195+0000","last_undegraded":"2024-09-22T09:54:30.023195+0000","last_fullsized":"2024-09-22T09:54:30.023195+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.023101+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:48.412441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.540005+0000","last_change":"2024-09-22T09:54:23.540005+0000","last_active":"2024-09-22T09:54:23.540005+0000","last_peered":"2024-09-22T09:54:23.540005+0000","last_clean":"2024-09-22T09:54:23.540005+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:54:23.540005+0000","last_undegraded":"2024-09-22T09:54:23.540005+0000","last_fullsized":"2024-09-22T09:54:23.540005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:38.423290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'211","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.137380+0000","last_change":"2024-09-22T09:54:20.137314+0000","last_active":"2024-09-22T09:54:20.137380+0000","last_peered":"2024-09-22T09:54:20.137380+0000","last_clean":"2024-09-22T09:54:20.137380+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:54:20.137380+0000","last_undegraded":"2024-09-22T09:54:20.137380+0000","last_fullsized":"2024-09-22T09:54:20.137380+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.137215+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:24.795199+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":801,"num_read_kb":134895,"num_write":909,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.376894+0000","last_change":"2024-09-22T09:54:39.376894+0000","last_active":"2024-09-22T09:54:39.376894+0000","last_peered":"2024-09-22T09:54:39.376894+0000","last_clean":"2024-09-22T09:54:39.376894+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:54:39.376894+0000","last_undegraded":"2024-09-22T09:54:39.376894+0000","last_fullsized":"2024-09-22T09:54:39.376894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.376795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:57.132187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'907","reported_seq":2728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.170136+0000","last_change":"2024-09-22T09:54:39.170075+0000","last_active":"2024-09-22T09:54:39.170136+0000","last_peered":"2024-09-22T09:54:39.170136+0000","last_clean":"2024-09-22T09:54:39.170136+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:39.170136+0000","last_undegraded":"2024-09-22T09:54:39.170136+0000","last_fullsized":"2024-09-22T09:54:39.170136+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'907","last_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_deep_scrub":"262'907","last_deep_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.169979+0000","objects_scrubbed":11,"log_size":106,"log_dups_size":801,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.079705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22457,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1275,"num_read_kb":1494,"num_write":384,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.587719+0000","last_change":"2024-09-22T09:54:49.587719+0000","last_active":"2024-09-22T09:54:49.587719+0000","last_peered":"2024-09-22T09:54:49.587719+0000","last_clean":"2024-09-22T09:54:49.587719+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:54:49.587719+0000","last_undegraded":"2024-09-22T09:54:49.587719+0000","last_fullsized":"2024-09-22T09:54:49.587719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.587615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:43.905843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'236","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.203000+0000","last_change":"2024-09-22T09:54:49.203000+0000","last_active":"2024-09-22T09:54:49.203000+0000","last_peered":"2024-09-22T09:54:49.203000+0000","last_clean":"2024-09-22T09:54:49.203000+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:54:49.203000+0000","last_undegraded":"2024-09-22T09:54:49.203000+0000","last_fullsized":"2024-09-22T09:54:49.203000+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.202908+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:40.344451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.238536+0000","last_change":"2024-09-22T09:54:29.238536+0000","last_active":"2024-09-22T09:54:29.238536+0000","last_peered":"2024-09-22T09:54:29.238536+0000","last_clean":"2024-09-22T09:54:29.238536+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:54:29.238536+0000","last_undegraded":"2024-09-22T09:54:29.238536+0000","last_fullsized":"2024-09-22T09:54:29.238536+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.238430+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:59.458064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.606871+0000","last_change":"2024-09-22T09:54:19.606824+0000","last_active":"2024-09-22T09:54:19.606871+0000","last_peered":"2024-09-22T09:54:19.606871+0000","last_clean":"2024-09-22T09:54:19.606871+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:54:19.606871+0000","last_undegraded":"2024-09-22T09:54:19.606871+0000","last_fullsized":"2024-09-22T09:54:19.606871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.606739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:03.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'200","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.372421+0000","last_change":"2024-09-22T09:54:19.372330+0000","last_active":"2024-09-22T09:54:19.372421+0000","last_peered":"2024-09-22T09:54:19.372421+0000","last_clean":"2024-09-22T09:54:19.372421+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:54:19.372421+0000","last_undegraded":"2024-09-22T09:54:19.372421+0000","last_fullsized":"2024-09-22T09:54:19.372421+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.372130+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:08.243681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485786,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":19334,"num_write":886,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.607748+0000","last_change":"2024-09-22T09:54:31.607748+0000","last_active":"2024-09-22T09:54:31.607748+0000","last_peered":"2024-09-22T09:54:31.607748+0000","last_clean":"2024-09-22T09:54:31.607748+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:54:31.607748+0000","last_undegraded":"2024-09-22T09:54:31.607748+0000","last_fullsized":"2024-09-22T09:54:31.607748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.607665+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:32.805386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'291","reported_seq":1715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.628229+0000","last_change":"2024-09-22T09:54:43.628229+0000","last_active":"2024-09-22T09:54:43.628229+0000","last_peered":"2024-09-22T09:54:43.628229+0000","last_clean":"2024-09-22T09:54:43.628229+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:54:43.628229+0000","last_undegraded":"2024-09-22T09:54:43.628229+0000","last_fullsized":"2024-09-22T09:54:43.628229+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.628119+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:18.536067+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.148754+0000","last_change":"2024-09-22T09:54:46.148605+0000","last_active":"2024-09-22T09:54:46.148754+0000","last_peered":"2024-09-22T09:54:46.148754+0000","last_clean":"2024-09-22T09:54:46.148754+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:54:46.148754+0000","last_undegraded":"2024-09-22T09:54:46.148754+0000","last_fullsized":"2024-09-22T09:54:46.148754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.148415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:12.701927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'246","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.724548+0000","last_change":"2024-09-22T09:54:58.724548+0000","last_active":"2024-09-22T09:54:58.724548+0000","last_peered":"2024-09-22T09:54:58.724548+0000","last_clean":"2024-09-22T09:54:58.724548+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:54:58.724548+0000","last_undegraded":"2024-09-22T09:54:58.724548+0000","last_fullsized":"2024-09-22T09:54:58.724548+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:58.724436+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:58.724436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.724436+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:08.461250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.185742+0000","last_change":"2024-09-22T09:54:27.185684+0000","last_active":"2024-09-22T09:54:27.185742+0000","last_peered":"2024-09-22T09:54:27.185742+0000","last_clean":"2024-09-22T09:54:27.185742+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:54:27.185742+0000","last_undegraded":"2024-09-22T09:54:27.185742+0000","last_fullsized":"2024-09-22T09:54:27.185742+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.185594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:13:47.880015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":540,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.532921+0000","last_change":"2024-09-22T09:54:21.532865+0000","last_active":"2024-09-22T09:54:21.532921+0000","last_peered":"2024-09-22T09:54:21.532921+0000","last_clean":"2024-09-22T09:54:21.532921+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:54:21.532921+0000","last_undegraded":"2024-09-22T09:54:21.532921+0000","last_fullsized":"2024-09-22T09:54:21.532921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.532772+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:51.708829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'227","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.819371+0000","last_change":"2024-09-22T09:54:21.819318+0000","last_active":"2024-09-22T09:54:21.819371+0000","last_peered":"2024-09-22T09:54:21.819371+0000","last_clean":"2024-09-22T09:54:21.819371+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:54:21.819371+0000","last_undegraded":"2024-09-22T09:54:21.819371+0000","last_fullsized":"2024-09-22T09:54:21.819371+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.819178+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:16.182021+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":44921,"num_write":1103,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":512,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.025877+0000","last_change":"2024-09-22T09:54:39.025877+0000","last_active":"2024-09-22T09:54:39.025877+0000","last_peered":"2024-09-22T09:54:39.025877+0000","last_clean":"2024-09-22T09:54:39.025877+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:54:39.025877+0000","last_undegraded":"2024-09-22T09:54:39.025877+0000","last_fullsized":"2024-09-22T09:54:39.025877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.025757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:38:02.089422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'165","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.654289+0000","last_change":"2024-09-22T09:54:46.654289+0000","last_active":"2024-09-22T09:54:46.654289+0000","last_peered":"2024-09-22T09:54:46.654289+0000","last_clean":"2024-09-22T09:54:46.654289+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:54:46.654289+0000","last_undegraded":"2024-09-22T09:54:46.654289+0000","last_fullsized":"2024-09-22T09:54:46.654289+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.654189+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:59.224861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.933152+0000","last_change":"2024-09-22T09:54:37.933152+0000","last_active":"2024-09-22T09:54:37.933152+0000","last_peered":"2024-09-22T09:54:37.933152+0000","last_clean":"2024-09-22T09:54:37.933152+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:54:37.933152+0000","last_undegraded":"2024-09-22T09:54:37.933152+0000","last_fullsized":"2024-09-22T09:54:37.933152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.933066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:08.133408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.305658+0000","last_change":"2024-09-22T09:54:52.305658+0000","last_active":"2024-09-22T09:54:52.305658+0000","last_peered":"2024-09-22T09:54:52.305658+0000","last_clean":"2024-09-22T09:54:52.305658+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:54:52.305658+0000","last_undegraded":"2024-09-22T09:54:52.305658+0000","last_fullsized":"2024-09-22T09:54:52.305658+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.305571+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:00.676431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.192712+0000","last_change":"2024-09-22T09:54:28.192606+0000","last_active":"2024-09-22T09:54:28.192712+0000","last_peered":"2024-09-22T09:54:28.192712+0000","last_clean":"2024-09-22T09:54:28.192712+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:54:28.192712+0000","last_undegraded":"2024-09-22T09:54:28.192712+0000","last_fullsized":"2024-09-22T09:54:28.192712+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'257","last_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_deep_scrub":"262'257","last_deep_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.192506+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:18.079606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'191","reported_seq":827,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.574375+0000","last_change":"2024-09-22T09:54:23.574375+0000","last_active":"2024-09-22T09:54:23.574375+0000","last_peered":"2024-09-22T09:54:23.574375+0000","last_clean":"2024-09-22T09:54:23.574375+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:54:23.574375+0000","last_undegraded":"2024-09-22T09:54:23.574375+0000","last_fullsized":"2024-09-22T09:54:23.574375+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.574287+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:41:15.794001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":36411,"num_write":937,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.371305+0000","last_change":"2024-09-22T09:54:20.371252+0000","last_active":"2024-09-22T09:54:20.371305+0000","last_peered":"2024-09-22T09:54:20.371305+0000","last_clean":"2024-09-22T09:54:20.371305+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:54:20.371305+0000","last_undegraded":"2024-09-22T09:54:20.371305+0000","last_fullsized":"2024-09-22T09:54:20.371305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:51.950137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.048496+0000","last_change":"2024-09-22T09:54:38.048408+0000","last_active":"2024-09-22T09:54:38.048496+0000","last_peered":"2024-09-22T09:54:38.048496+0000","last_clean":"2024-09-22T09:54:38.048496+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:54:38.048496+0000","last_undegraded":"2024-09-22T09:54:38.048496+0000","last_fullsized":"2024-09-22T09:54:38.048496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.048305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:53.382564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'366","reported_seq":1062,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.076719+0000","last_change":"2024-09-22T09:54:41.076719+0000","last_active":"2024-09-22T09:54:41.076719+0000","last_peered":"2024-09-22T09:54:41.076719+0000","last_clean":"2024-09-22T09:54:41.076719+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:41.076719+0000","last_undegraded":"2024-09-22T09:54:41.076719+0000","last_fullsized":"2024-09-22T09:54:41.076719+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.076609+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.553978+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18381,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1194,"num_read_kb":1339,"num_write":1770,"num_write_kb":1581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.632222+0000","last_change":"2024-09-22T09:54:49.632165+0000","last_active":"2024-09-22T09:54:49.632222+0000","last_peered":"2024-09-22T09:54:49.632222+0000","last_clean":"2024-09-22T09:54:49.632222+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:54:49.632222+0000","last_undegraded":"2024-09-22T09:54:49.632222+0000","last_fullsized":"2024-09-22T09:54:49.632222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.632078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:50.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'155","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.236268+0000","last_change":"2024-09-22T09:54:55.236268+0000","last_active":"2024-09-22T09:54:55.236268+0000","last_peered":"2024-09-22T09:54:55.236268+0000","last_clean":"2024-09-22T09:54:55.236268+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:54:55.236268+0000","last_undegraded":"2024-09-22T09:54:55.236268+0000","last_fullsized":"2024-09-22T09:54:55.236268+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.236153+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:00.942710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.996886+0000","last_change":"2024-09-22T09:54:28.996833+0000","last_active":"2024-09-22T09:54:28.996886+0000","last_peered":"2024-09-22T09:54:28.996886+0000","last_clean":"2024-09-22T09:54:28.996886+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:54:28.996886+0000","last_undegraded":"2024-09-22T09:54:28.996886+0000","last_fullsized":"2024-09-22T09:54:28.996886+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.996744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:52.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'220","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.329016+0000","last_change":"2024-09-22T09:54:21.328955+0000","last_active":"2024-09-22T09:54:21.329016+0000","last_peered":"2024-09-22T09:54:21.329016+0000","last_clean":"2024-09-22T09:54:21.329016+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:54:21.329016+0000","last_undegraded":"2024-09-22T09:54:21.329016+0000","last_fullsized":"2024-09-22T09:54:21.329016+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.328852+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:00.573762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":1845,"num_write":1046,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.569437+0000","last_change":"2024-09-22T09:54:33.569365+0000","last_active":"2024-09-22T09:54:33.569437+0000","last_peered":"2024-09-22T09:54:33.569437+0000","last_clean":"2024-09-22T09:54:33.569437+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:54:33.569437+0000","last_undegraded":"2024-09-22T09:54:33.569437+0000","last_fullsized":"2024-09-22T09:54:33.569437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.569236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:24.238329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.916328+0000","last_change":"2024-09-22T09:54:33.916275+0000","last_active":"2024-09-22T09:54:33.916328+0000","last_peered":"2024-09-22T09:54:33.916328+0000","last_clean":"2024-09-22T09:54:33.916328+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:54:33.916328+0000","last_undegraded":"2024-09-22T09:54:33.916328+0000","last_fullsized":"2024-09-22T09:54:33.916328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.916178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:47.667923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'223","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.185409+0000","last_change":"2024-09-22T09:54:41.185335+0000","last_active":"2024-09-22T09:54:41.185409+0000","last_peered":"2024-09-22T09:54:41.185409+0000","last_clean":"2024-09-22T09:54:41.185409+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:54:41.185409+0000","last_undegraded":"2024-09-22T09:54:41.185409+0000","last_fullsized":"2024-09-22T09:54:41.185409+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.185242+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:52:21.839182+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'765","reported_seq":4654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.303774+0000","last_change":"2024-09-22T09:54:49.303774+0000","last_active":"2024-09-22T09:54:49.303774+0000","last_peered":"2024-09-22T09:54:49.303774+0000","last_clean":"2024-09-22T09:54:49.303774+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:49.303774+0000","last_undegraded":"2024-09-22T09:54:49.303774+0000","last_fullsized":"2024-09-22T09:54:49.303774+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'765","last_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_deep_scrub":"262'765","last_deep_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.303693+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:46.394231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'176","reported_seq":713,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.701555+0000","last_change":"2024-09-22T09:55:00.701555+0000","last_active":"2024-09-22T09:55:00.701555+0000","last_peered":"2024-09-22T09:55:00.701555+0000","last_clean":"2024-09-22T09:55:00.701555+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:55:00.701555+0000","last_undegraded":"2024-09-22T09:55:00.701555+0000","last_fullsized":"2024-09-22T09:55:00.701555+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-22T09:55:00.701432+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-22T09:55:00.701432+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.701432+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:03.000863+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.749272+0000","last_change":"2024-09-22T09:54:43.749272+0000","last_active":"2024-09-22T09:54:43.749272+0000","last_peered":"2024-09-22T09:54:43.749272+0000","last_clean":"2024-09-22T09:54:43.749272+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:54:43.749272+0000","last_undegraded":"2024-09-22T09:54:43.749272+0000","last_fullsized":"2024-09-22T09:54:43.749272+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.749180+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:20.977184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.930818+0000","last_change":"2024-09-22T09:54:26.930818+0000","last_active":"2024-09-22T09:54:26.930818+0000","last_peered":"2024-09-22T09:54:26.930818+0000","last_clean":"2024-09-22T09:54:26.930818+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:54:26.930818+0000","last_undegraded":"2024-09-22T09:54:26.930818+0000","last_fullsized":"2024-09-22T09:54:26.930818+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'170","last_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_deep_scrub":"262'170","last_deep_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.930623+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.742051+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.243823+0000","last_change":"2024-09-22T09:54:23.243823+0000","last_active":"2024-09-22T09:54:23.243823+0000","last_peered":"2024-09-22T09:54:23.243823+0000","last_clean":"2024-09-22T09:54:23.243823+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:54:23.243823+0000","last_undegraded":"2024-09-22T09:54:23.243823+0000","last_fullsized":"2024-09-22T09:54:23.243823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.243731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.724488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.554980+0000","last_change":"2024-09-22T09:54:42.554916+0000","last_active":"2024-09-22T09:54:42.554980+0000","last_peered":"2024-09-22T09:54:42.554980+0000","last_clean":"2024-09-22T09:54:42.554980+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:54:42.554980+0000","last_undegraded":"2024-09-22T09:54:42.554980+0000","last_fullsized":"2024-09-22T09:54:42.554980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.554834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:29.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'140","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.606515+0000","last_change":"2024-09-22T09:54:44.606454+0000","last_active":"2024-09-22T09:54:44.606515+0000","last_peered":"2024-09-22T09:54:44.606515+0000","last_clean":"2024-09-22T09:54:44.606515+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:54:44.606515+0000","last_undegraded":"2024-09-22T09:54:44.606515+0000","last_fullsized":"2024-09-22T09:54:44.606515+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.606361+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:44.675948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'756","reported_seq":2866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.720985+0000","last_change":"2024-09-22T09:54:56.720928+0000","last_active":"2024-09-22T09:54:56.720985+0000","last_peered":"2024-09-22T09:54:56.720985+0000","last_clean":"2024-09-22T09:54:56.720985+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:56.720985+0000","last_undegraded":"2024-09-22T09:54:56.720985+0000","last_fullsized":"2024-09-22T09:54:56.720985+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.720830+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:57.526171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.146261+0000","last_change":"2024-09-22T09:54:53.146261+0000","last_active":"2024-09-22T09:54:53.146261+0000","last_peered":"2024-09-22T09:54:53.146261+0000","last_clean":"2024-09-22T09:54:53.146261+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:54:53.146261+0000","last_undegraded":"2024-09-22T09:54:53.146261+0000","last_fullsized":"2024-09-22T09:54:53.146261+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.146161+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:03.242553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.737178+0000","last_change":"2024-09-22T09:54:24.737112+0000","last_active":"2024-09-22T09:54:24.737178+0000","last_peered":"2024-09-22T09:54:24.737178+0000","last_clean":"2024-09-22T09:54:24.737178+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:54:24.737178+0000","last_undegraded":"2024-09-22T09:54:24.737178+0000","last_fullsized":"2024-09-22T09:54:24.737178+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.737027+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:50.396120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'190","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.103347+0000","last_change":"2024-09-22T09:54:19.103347+0000","last_active":"2024-09-22T09:54:19.103347+0000","last_peered":"2024-09-22T09:54:19.103347+0000","last_clean":"2024-09-22T09:54:19.103347+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:54:19.103347+0000","last_undegraded":"2024-09-22T09:54:19.103347+0000","last_fullsized":"2024-09-22T09:54:19.103347+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.103240+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:24.385903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":406,"num_write":850,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.761018+0000","last_change":"2024-09-22T09:54:23.761018+0000","last_active":"2024-09-22T09:54:23.761018+0000","last_peered":"2024-09-22T09:54:23.761018+0000","last_clean":"2024-09-22T09:54:23.761018+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:54:23.761018+0000","last_undegraded":"2024-09-22T09:54:23.761018+0000","last_fullsized":"2024-09-22T09:54:23.761018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.760940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:58.487042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.826138+0000","last_change":"2024-09-22T09:54:40.826138+0000","last_active":"2024-09-22T09:54:40.826138+0000","last_peered":"2024-09-22T09:54:40.826138+0000","last_clean":"2024-09-22T09:54:40.826138+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:54:40.826138+0000","last_undegraded":"2024-09-22T09:54:40.826138+0000","last_fullsized":"2024-09-22T09:54:40.826138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.826044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:59.306569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'363","reported_seq":1107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.606097+0000","last_change":"2024-09-22T09:54:42.606035+0000","last_active":"2024-09-22T09:54:42.606097+0000","last_peered":"2024-09-22T09:54:42.606097+0000","last_clean":"2024-09-22T09:54:42.606097+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:42.606097+0000","last_undegraded":"2024-09-22T09:54:42.606097+0000","last_fullsized":"2024-09-22T09:54:42.606097+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'363","last_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_deep_scrub":"262'363","last_deep_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.605926+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:24.566627+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23842,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":535,"num_read_kb":775,"num_write":284,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.703400+0000","last_change":"2024-09-22T09:54:52.703279+0000","last_active":"2024-09-22T09:54:52.703400+0000","last_peered":"2024-09-22T09:54:52.703400+0000","last_clean":"2024-09-22T09:54:52.703400+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:54:52.703400+0000","last_undegraded":"2024-09-22T09:54:52.703400+0000","last_fullsized":"2024-09-22T09:54:52.703400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.703173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:09.004394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'94","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.340062+0000","last_change":"2024-09-22T09:54:53.340062+0000","last_active":"2024-09-22T09:54:53.340062+0000","last_peered":"2024-09-22T09:54:53.340062+0000","last_clean":"2024-09-22T09:54:53.340062+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:54:53.340062+0000","last_undegraded":"2024-09-22T09:54:53.340062+0000","last_fullsized":"2024-09-22T09:54:53.340062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.339953+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:01.903544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":694,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.322151+0000","last_change":"2024-09-22T09:55:02.322151+0000","last_active":"2024-09-22T09:55:02.322151+0000","last_peered":"2024-09-22T09:55:02.322151+0000","last_clean":"2024-09-22T09:55:02.322151+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:55:02.322151+0000","last_undegraded":"2024-09-22T09:55:02.322151+0000","last_fullsized":"2024-09-22T09:55:02.322151+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'128","last_scrub_stamp":"2024-09-22T09:55:02.322059+0000","last_deep_scrub":"262'128","last_deep_scrub_stamp":"2024-09-22T09:55:02.322059+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.322059+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:06.880923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.695358+0000","last_change":"2024-09-22T09:54:29.695304+0000","last_active":"2024-09-22T09:54:29.695358+0000","last_peered":"2024-09-22T09:54:29.695358+0000","last_clean":"2024-09-22T09:54:29.695358+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:54:29.695358+0000","last_undegraded":"2024-09-22T09:54:29.695358+0000","last_fullsized":"2024-09-22T09:54:29.695358+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.695223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:41.769762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'197","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.797555+0000","last_change":"2024-09-22T09:54:20.797488+0000","last_active":"2024-09-22T09:54:20.797555+0000","last_peered":"2024-09-22T09:54:20.797555+0000","last_clean":"2024-09-22T09:54:20.797555+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:54:20.797555+0000","last_undegraded":"2024-09-22T09:54:20.797555+0000","last_fullsized":"2024-09-22T09:54:20.797555+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.797355+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:31.306053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":56883,"num_write":855,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.214275+0000","last_change":"2024-09-22T09:54:35.214218+0000","last_active":"2024-09-22T09:54:35.214275+0000","last_peered":"2024-09-22T09:54:35.214275+0000","last_clean":"2024-09-22T09:54:35.214275+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:54:35.214275+0000","last_undegraded":"2024-09-22T09:54:35.214275+0000","last_fullsized":"2024-09-22T09:54:35.214275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.214127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:27.814976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'176","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.627965+0000","last_change":"2024-09-22T09:54:49.627965+0000","last_active":"2024-09-22T09:54:49.627965+0000","last_peered":"2024-09-22T09:54:49.627965+0000","last_clean":"2024-09-22T09:54:49.627965+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:54:49.627965+0000","last_undegraded":"2024-09-22T09:54:49.627965+0000","last_fullsized":"2024-09-22T09:54:49.627965+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.627852+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:21.906351+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":323,"num_write":134,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.691597+0000","last_change":"2024-09-22T09:54:54.691597+0000","last_active":"2024-09-22T09:54:54.691597+0000","last_peered":"2024-09-22T09:54:54.691597+0000","last_clean":"2024-09-22T09:54:54.691597+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:54:54.691597+0000","last_undegraded":"2024-09-22T09:54:54.691597+0000","last_fullsized":"2024-09-22T09:54:54.691597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.691502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:25.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'147","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.795542+0000","last_change":"2024-09-22T09:55:03.795542+0000","last_active":"2024-09-22T09:55:03.795542+0000","last_peered":"2024-09-22T09:55:03.795542+0000","last_clean":"2024-09-22T09:55:03.795542+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:55:03.795542+0000","last_undegraded":"2024-09-22T09:55:03.795542+0000","last_fullsized":"2024-09-22T09:55:03.795542+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:55:03.795458+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:55:03.795458+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.795458+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:50.152064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.256299+0000","last_change":"2024-09-22T09:54:30.256211+0000","last_active":"2024-09-22T09:54:30.256299+0000","last_peered":"2024-09-22T09:54:30.256299+0000","last_clean":"2024-09-22T09:54:30.256299+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:54:30.256299+0000","last_undegraded":"2024-09-22T09:54:30.256299+0000","last_fullsized":"2024-09-22T09:54:30.256299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.256110+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:21.124251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'226","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.531250+0000","last_change":"2024-09-22T09:54:29.531189+0000","last_active":"2024-09-22T09:54:29.531250+0000","last_peered":"2024-09-22T09:54:29.531250+0000","last_clean":"2024-09-22T09:54:29.531250+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:54:29.531250+0000","last_undegraded":"2024-09-22T09:54:29.531250+0000","last_fullsized":"2024-09-22T09:54:29.531250+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.531048+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:58.938306+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":50629,"num_write":1055,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.766423+0000","last_change":"2024-09-22T09:54:42.766423+0000","last_active":"2024-09-22T09:54:42.766423+0000","last_peered":"2024-09-22T09:54:42.766423+0000","last_clean":"2024-09-22T09:54:42.766423+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:54:42.766423+0000","last_undegraded":"2024-09-22T09:54:42.766423+0000","last_fullsized":"2024-09-22T09:54:42.766423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.766349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:21.722448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'56","reported_seq":577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.058832+0000","last_change":"2024-09-22T09:54:43.058832+0000","last_active":"2024-09-22T09:54:43.058832+0000","last_peered":"2024-09-22T09:54:43.058832+0000","last_clean":"2024-09-22T09:54:43.058832+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:54:43.058832+0000","last_undegraded":"2024-09-22T09:54:43.058832+0000","last_fullsized":"2024-09-22T09:54:43.058832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'56","last_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_deep_scrub":"262'56","last_deep_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.058746+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:58.206035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.568163+0000","last_change":"2024-09-22T09:54:48.568163+0000","last_active":"2024-09-22T09:54:48.568163+0000","last_peered":"2024-09-22T09:54:48.568163+0000","last_clean":"2024-09-22T09:54:48.568163+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:54:48.568163+0000","last_undegraded":"2024-09-22T09:54:48.568163+0000","last_fullsized":"2024-09-22T09:54:48.568163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.568064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:27.614483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'191","reported_seq":719,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.256425+0000","last_change":"2024-09-22T09:54:56.256359+0000","last_active":"2024-09-22T09:54:56.256425+0000","last_peered":"2024-09-22T09:54:56.256425+0000","last_clean":"2024-09-22T09:54:56.256425+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:54:56.256425+0000","last_undegraded":"2024-09-22T09:54:56.256425+0000","last_fullsized":"2024-09-22T09:54:56.256425+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.256268+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:51.889250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.804620+0000","last_change":"2024-09-22T09:54:30.804559+0000","last_active":"2024-09-22T09:54:30.804620+0000","last_peered":"2024-09-22T09:54:30.804620+0000","last_clean":"2024-09-22T09:54:30.804620+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:54:30.804620+0000","last_undegraded":"2024-09-22T09:54:30.804620+0000","last_fullsized":"2024-09-22T09:54:30.804620+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.804467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:02.621427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'206","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.611670+0000","last_change":"2024-09-22T09:54:24.611605+0000","last_active":"2024-09-22T09:54:24.611670+0000","last_peered":"2024-09-22T09:54:24.611670+0000","last_clean":"2024-09-22T09:54:24.611670+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:54:24.611670+0000","last_undegraded":"2024-09-22T09:54:24.611670+0000","last_fullsized":"2024-09-22T09:54:24.611670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.611501+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:30.061595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":559,"num_read_kb":27137,"num_write":994,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.609807+0000","last_change":"2024-09-22T09:54:40.609807+0000","last_active":"2024-09-22T09:54:40.609807+0000","last_peered":"2024-09-22T09:54:40.609807+0000","last_clean":"2024-09-22T09:54:40.609807+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:54:40.609807+0000","last_undegraded":"2024-09-22T09:54:40.609807+0000","last_fullsized":"2024-09-22T09:54:40.609807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.609720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:04.398179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'202","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.641002+0000","last_change":"2024-09-22T09:54:50.641002+0000","last_active":"2024-09-22T09:54:50.641002+0000","last_peered":"2024-09-22T09:54:50.641002+0000","last_clean":"2024-09-22T09:54:50.641002+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:54:50.641002+0000","last_undegraded":"2024-09-22T09:54:50.641002+0000","last_fullsized":"2024-09-22T09:54:50.641002+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.640907+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:17.725830+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":325,"num_write":146,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.951738+0000","last_change":"2024-09-22T09:54:40.951666+0000","last_active":"2024-09-22T09:54:40.951738+0000","last_peered":"2024-09-22T09:54:40.951738+0000","last_clean":"2024-09-22T09:54:40.951738+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:54:40.951738+0000","last_undegraded":"2024-09-22T09:54:40.951738+0000","last_fullsized":"2024-09-22T09:54:40.951738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.951575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:17.627570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'185","reported_seq":762,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.343566+0000","last_change":"2024-09-22T09:54:55.343493+0000","last_active":"2024-09-22T09:54:55.343566+0000","last_peered":"2024-09-22T09:54:55.343566+0000","last_clean":"2024-09-22T09:54:55.343566+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:54:55.343566+0000","last_undegraded":"2024-09-22T09:54:55.343566+0000","last_fullsized":"2024-09-22T09:54:55.343566+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.343408+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:52.216646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'174","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.801443+0000","last_change":"2024-09-22T09:54:36.801369+0000","last_active":"2024-09-22T09:54:36.801443+0000","last_peered":"2024-09-22T09:54:36.801443+0000","last_clean":"2024-09-22T09:54:36.801443+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:54:36.801443+0000","last_undegraded":"2024-09-22T09:54:36.801443+0000","last_fullsized":"2024-09-22T09:54:36.801443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.801284+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:30.780204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'205","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.092956+0000","last_change":"2024-09-22T09:54:23.092900+0000","last_active":"2024-09-22T09:54:23.092956+0000","last_peered":"2024-09-22T09:54:23.092956+0000","last_clean":"2024-09-22T09:54:23.092956+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:54:23.092956+0000","last_undegraded":"2024-09-22T09:54:23.092956+0000","last_fullsized":"2024-09-22T09:54:23.092956+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.092809+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:04.164807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":41854,"num_write":1021,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.914168+0000","last_change":"2024-09-22T09:54:35.914104+0000","last_active":"2024-09-22T09:54:35.914168+0000","last_peered":"2024-09-22T09:54:35.914168+0000","last_clean":"2024-09-22T09:54:35.914168+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:54:35.914168+0000","last_undegraded":"2024-09-22T09:54:35.914168+0000","last_fullsized":"2024-09-22T09:54:35.914168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.914016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:45.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'152","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.619933+0000","last_change":"2024-09-22T09:54:44.619933+0000","last_active":"2024-09-22T09:54:44.619933+0000","last_peered":"2024-09-22T09:54:44.619933+0000","last_clean":"2024-09-22T09:54:44.619933+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:54:44.619933+0000","last_undegraded":"2024-09-22T09:54:44.619933+0000","last_fullsized":"2024-09-22T09:54:44.619933+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'152","last_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_deep_scrub":"262'152","last_deep_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.619832+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:45.455510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":223,"num_write":104,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.156080+0000","last_change":"2024-09-22T09:54:49.156080+0000","last_active":"2024-09-22T09:54:49.156080+0000","last_peered":"2024-09-22T09:54:49.156080+0000","last_clean":"2024-09-22T09:54:49.156080+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:54:49.156080+0000","last_undegraded":"2024-09-22T09:54:49.156080+0000","last_fullsized":"2024-09-22T09:54:49.156080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.155977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:22.199690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.919348+0000","last_change":"2024-09-22T09:54:31.919258+0000","last_active":"2024-09-22T09:54:31.919348+0000","last_peered":"2024-09-22T09:54:31.919348+0000","last_clean":"2024-09-22T09:54:31.919348+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:54:31.919348+0000","last_undegraded":"2024-09-22T09:54:31.919348+0000","last_fullsized":"2024-09-22T09:54:31.919348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'88","last_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_deep_scrub":"262'88","last_deep_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.919161+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:25.614663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'205","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.829858+0000","last_change":"2024-09-22T09:54:23.829750+0000","last_active":"2024-09-22T09:54:23.829858+0000","last_peered":"2024-09-22T09:54:23.829858+0000","last_clean":"2024-09-22T09:54:23.829858+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:54:23.829858+0000","last_undegraded":"2024-09-22T09:54:23.829858+0000","last_fullsized":"2024-09-22T09:54:23.829858+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.829600+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:05.399205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":584,"num_read_kb":68522,"num_write":916,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.030334+0000","last_change":"2024-09-22T09:54:40.030334+0000","last_active":"2024-09-22T09:54:40.030334+0000","last_peered":"2024-09-22T09:54:40.030334+0000","last_clean":"2024-09-22T09:54:40.030334+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:54:40.030334+0000","last_undegraded":"2024-09-22T09:54:40.030334+0000","last_fullsized":"2024-09-22T09:54:40.030334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.030227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:27.501559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'240","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.184292+0000","last_change":"2024-09-22T09:54:38.184221+0000","last_active":"2024-09-22T09:54:38.184292+0000","last_peered":"2024-09-22T09:54:38.184292+0000","last_clean":"2024-09-22T09:54:38.184292+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:38.184292+0000","last_undegraded":"2024-09-22T09:54:38.184292+0000","last_fullsized":"2024-09-22T09:54:38.184292+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.184124+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:23:09.313158+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22939,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":353,"num_read_kb":545,"num_write":228,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.317500+0000","last_change":"2024-09-22T09:54:50.317446+0000","last_active":"2024-09-22T09:54:50.317500+0000","last_peered":"2024-09-22T09:54:50.317500+0000","last_clean":"2024-09-22T09:54:50.317500+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:54:50.317500+0000","last_undegraded":"2024-09-22T09:54:50.317500+0000","last_fullsized":"2024-09-22T09:54:50.317500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.317363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.217756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'196","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.724176+0000","last_change":"2024-09-22T09:55:01.724176+0000","last_active":"2024-09-22T09:55:01.724176+0000","last_peered":"2024-09-22T09:55:01.724176+0000","last_clean":"2024-09-22T09:55:01.724176+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:55:01.724176+0000","last_undegraded":"2024-09-22T09:55:01.724176+0000","last_fullsized":"2024-09-22T09:55:01.724176+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-22T09:55:01.724089+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-22T09:55:01.724089+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.724089+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:56.547358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.022554+0000","last_change":"2024-09-22T09:54:33.022554+0000","last_active":"2024-09-22T09:54:33.022554+0000","last_peered":"2024-09-22T09:54:33.022554+0000","last_clean":"2024-09-22T09:54:33.022554+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:54:33.022554+0000","last_undegraded":"2024-09-22T09:54:33.022554+0000","last_fullsized":"2024-09-22T09:54:33.022554+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.022460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:44.487313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'225","reported_seq":888,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.283104+0000","last_change":"2024-09-22T09:54:22.283055+0000","last_active":"2024-09-22T09:54:22.283104+0000","last_peered":"2024-09-22T09:54:22.283104+0000","last_clean":"2024-09-22T09:54:22.283104+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:54:22.283104+0000","last_undegraded":"2024-09-22T09:54:22.283104+0000","last_fullsized":"2024-09-22T09:54:22.283104+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'225","last_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_deep_scrub":"262'225","last_deep_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.282952+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:16:25.985099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5108,"num_write":1161,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.898808+0000","last_change":"2024-09-22T09:54:36.898739+0000","last_active":"2024-09-22T09:54:36.898808+0000","last_peered":"2024-09-22T09:54:36.898808+0000","last_clean":"2024-09-22T09:54:36.898808+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:54:36.898808+0000","last_undegraded":"2024-09-22T09:54:36.898808+0000","last_fullsized":"2024-09-22T09:54:36.898808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.898653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:53.057131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'214","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.603612+0000","last_change":"2024-09-22T09:54:46.603533+0000","last_active":"2024-09-22T09:54:46.603612+0000","last_peered":"2024-09-22T09:54:46.603612+0000","last_clean":"2024-09-22T09:54:46.603612+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:54:46.603612+0000","last_undegraded":"2024-09-22T09:54:46.603612+0000","last_fullsized":"2024-09-22T09:54:46.603612+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.603406+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:10.085025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":279,"num_read_kb":343,"num_write":184,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.145446+0000","last_change":"2024-09-22T09:54:43.145372+0000","last_active":"2024-09-22T09:54:43.145446+0000","last_peered":"2024-09-22T09:54:43.145446+0000","last_clean":"2024-09-22T09:54:43.145446+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:54:43.145446+0000","last_undegraded":"2024-09-22T09:54:43.145446+0000","last_fullsized":"2024-09-22T09:54:43.145446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:47.362163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'173","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.061065+0000","last_change":"2024-09-22T09:54:46.060996+0000","last_active":"2024-09-22T09:54:46.061065+0000","last_peered":"2024-09-22T09:54:46.061065+0000","last_clean":"2024-09-22T09:54:46.061065+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:54:46.061065+0000","last_undegraded":"2024-09-22T09:54:46.061065+0000","last_fullsized":"2024-09-22T09:54:46.061065+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.060901+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:32.950276+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.831015+0000","last_change":"2024-09-22T09:54:38.830960+0000","last_active":"2024-09-22T09:54:38.831015+0000","last_peered":"2024-09-22T09:54:38.831015+0000","last_clean":"2024-09-22T09:54:38.831015+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:54:38.831015+0000","last_undegraded":"2024-09-22T09:54:38.831015+0000","last_fullsized":"2024-09-22T09:54:38.831015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.830853+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:26.729478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'192","reported_seq":926,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.801551+0000","last_change":"2024-09-22T09:54:22.801488+0000","last_active":"2024-09-22T09:54:22.801551+0000","last_peered":"2024-09-22T09:54:22.801551+0000","last_clean":"2024-09-22T09:54:22.801551+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:54:22.801551+0000","last_undegraded":"2024-09-22T09:54:22.801551+0000","last_fullsized":"2024-09-22T09:54:22.801551+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'192","last_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_deep_scrub":"262'192","last_deep_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.801355+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:29.354984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1210,"num_read_kb":5814,"num_write":981,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.557269+0000","last_change":"2024-09-22T09:54:43.557207+0000","last_active":"2024-09-22T09:54:43.557269+0000","last_peered":"2024-09-22T09:54:43.557269+0000","last_clean":"2024-09-22T09:54:43.557269+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:54:43.557269+0000","last_undegraded":"2024-09-22T09:54:43.557269+0000","last_fullsized":"2024-09-22T09:54:43.557269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.557120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:55.802787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'165","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.681440+0000","last_change":"2024-09-22T09:54:51.681387+0000","last_active":"2024-09-22T09:54:51.681440+0000","last_peered":"2024-09-22T09:54:51.681440+0000","last_clean":"2024-09-22T09:54:51.681440+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:54:51.681440+0000","last_undegraded":"2024-09-22T09:54:51.681440+0000","last_fullsized":"2024-09-22T09:54:51.681440+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.681288+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.079311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":298,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.177280+0000","last_change":"2024-09-22T09:54:44.177280+0000","last_active":"2024-09-22T09:54:44.177280+0000","last_peered":"2024-09-22T09:54:44.177280+0000","last_clean":"2024-09-22T09:54:44.177280+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:54:44.177280+0000","last_undegraded":"2024-09-22T09:54:44.177280+0000","last_fullsized":"2024-09-22T09:54:44.177280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.177187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:19.025037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'118","reported_seq":621,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.318392+0000","last_change":"2024-09-22T09:54:54.318392+0000","last_active":"2024-09-22T09:54:54.318392+0000","last_peered":"2024-09-22T09:54:54.318392+0000","last_clean":"2024-09-22T09:54:54.318392+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:54.318392+0000","last_undegraded":"2024-09-22T09:54:54.318392+0000","last_fullsized":"2024-09-22T09:54:54.318392+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.318291+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:38.349114+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.691988+0000","last_change":"2024-09-22T09:54:25.691931+0000","last_active":"2024-09-22T09:54:25.691988+0000","last_peered":"2024-09-22T09:54:25.691988+0000","last_clean":"2024-09-22T09:54:25.691988+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:54:25.691988+0000","last_undegraded":"2024-09-22T09:54:25.691988+0000","last_fullsized":"2024-09-22T09:54:25.691988+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.691841+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.638310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'240","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.101189+0000","last_change":"2024-09-22T09:54:22.101130+0000","last_active":"2024-09-22T09:54:22.101189+0000","last_peered":"2024-09-22T09:54:22.101189+0000","last_clean":"2024-09-22T09:54:22.101189+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:54:22.101189+0000","last_undegraded":"2024-09-22T09:54:22.101189+0000","last_fullsized":"2024-09-22T09:54:22.101189+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.101055+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:06.230927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":123234,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.210365+0000","last_change":"2024-09-22T09:54:40.210304+0000","last_active":"2024-09-22T09:54:40.210365+0000","last_peered":"2024-09-22T09:54:40.210365+0000","last_clean":"2024-09-22T09:54:40.210365+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:54:40.210365+0000","last_undegraded":"2024-09-22T09:54:40.210365+0000","last_fullsized":"2024-09-22T09:54:40.210365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.210210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:43.908095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'128","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.603142+0000","last_change":"2024-09-22T09:54:48.603142+0000","last_active":"2024-09-22T09:54:48.603142+0000","last_peered":"2024-09-22T09:54:48.603142+0000","last_clean":"2024-09-22T09:54:48.603142+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:54:48.603142+0000","last_undegraded":"2024-09-22T09:54:48.603142+0000","last_fullsized":"2024-09-22T09:54:48.603142+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'128","last_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_deep_scrub":"262'128","last_deep_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.603050+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:49.371561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'759","reported_seq":4740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.959031+0000","last_change":"2024-09-22T09:54:42.958949+0000","last_active":"2024-09-22T09:54:42.959031+0000","last_peered":"2024-09-22T09:54:42.959031+0000","last_clean":"2024-09-22T09:54:42.959031+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:42.959031+0000","last_undegraded":"2024-09-22T09:54:42.959031+0000","last_fullsized":"2024-09-22T09:54:42.959031+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.958819+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:45.949669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'148","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.581940+0000","last_change":"2024-09-22T09:54:52.581940+0000","last_active":"2024-09-22T09:54:52.581940+0000","last_peered":"2024-09-22T09:54:52.581940+0000","last_clean":"2024-09-22T09:54:52.581940+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:54:52.581940+0000","last_undegraded":"2024-09-22T09:54:52.581940+0000","last_fullsized":"2024-09-22T09:54:52.581940+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.581848+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:34.153212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":725,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.678521+0000","last_change":"2024-09-22T09:54:32.678447+0000","last_active":"2024-09-22T09:54:32.678521+0000","last_peered":"2024-09-22T09:54:32.678521+0000","last_clean":"2024-09-22T09:54:32.678521+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:54:32.678521+0000","last_undegraded":"2024-09-22T09:54:32.678521+0000","last_fullsized":"2024-09-22T09:54:32.678521+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.678357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:18.763576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'293","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.668343+0000","last_change":"2024-09-22T09:54:22.668274+0000","last_active":"2024-09-22T09:54:22.668343+0000","last_peered":"2024-09-22T09:54:22.668343+0000","last_clean":"2024-09-22T09:54:22.668343+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:54:22.668343+0000","last_undegraded":"2024-09-22T09:54:22.668343+0000","last_fullsized":"2024-09-22T09:54:22.668343+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'293","last_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_deep_scrub":"262'293","last_deep_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.668200+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:57.525651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1304,"num_read_kb":50200,"num_write":1267,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"262'4","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.607268+0000","last_change":"2024-09-22T09:54:41.607211+0000","last_active":"2024-09-22T09:54:41.607268+0000","last_peered":"2024-09-22T09:54:41.607268+0000","last_clean":"2024-09-22T09:54:41.607268+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:41.607268+0000","last_undegraded":"2024-09-22T09:54:41.607268+0000","last_fullsized":"2024-09-22T09:54:41.607268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.607128+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:13.784197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'222","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.293943+0000","last_change":"2024-09-22T09:54:48.293890+0000","last_active":"2024-09-22T09:54:48.293943+0000","last_peered":"2024-09-22T09:54:48.293943+0000","last_clean":"2024-09-22T09:54:48.293943+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:54:48.293943+0000","last_undegraded":"2024-09-22T09:54:48.293943+0000","last_fullsized":"2024-09-22T09:54:48.293943+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.293771+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:35.851163+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6055,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":273,"num_read_kb":326,"num_write":162,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.123632+0000","last_change":"2024-09-22T09:54:50.123578+0000","last_active":"2024-09-22T09:54:50.123632+0000","last_peered":"2024-09-22T09:54:50.123632+0000","last_clean":"2024-09-22T09:54:50.123632+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:54:50.123632+0000","last_undegraded":"2024-09-22T09:54:50.123632+0000","last_fullsized":"2024-09-22T09:54:50.123632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.123483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:56.260363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'144","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.622400+0000","last_change":"2024-09-22T09:54:54.622339+0000","last_active":"2024-09-22T09:54:54.622400+0000","last_peered":"2024-09-22T09:54:54.622400+0000","last_clean":"2024-09-22T09:54:54.622400+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:54:54.622400+0000","last_undegraded":"2024-09-22T09:54:54.622400+0000","last_fullsized":"2024-09-22T09:54:54.622400+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'144","last_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_deep_scrub":"262'144","last_deep_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.622250+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:09.716918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.725728+0000","last_change":"2024-09-22T09:54:31.725674+0000","last_active":"2024-09-22T09:54:31.725728+0000","last_peered":"2024-09-22T09:54:31.725728+0000","last_clean":"2024-09-22T09:54:31.725728+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:54:31.725728+0000","last_undegraded":"2024-09-22T09:54:31.725728+0000","last_fullsized":"2024-09-22T09:54:31.725728+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.725590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:46.484791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'213","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.635369+0000","last_change":"2024-09-22T09:54:23.635302+0000","last_active":"2024-09-22T09:54:23.635369+0000","last_peered":"2024-09-22T09:54:23.635369+0000","last_clean":"2024-09-22T09:54:23.635369+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:54:23.635369+0000","last_undegraded":"2024-09-22T09:54:23.635369+0000","last_fullsized":"2024-09-22T09:54:23.635369+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.635178+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:34.216176+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26654,"num_write":910,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.259561+0000","last_change":"2024-09-22T09:54:43.259487+0000","last_active":"2024-09-22T09:54:43.259561+0000","last_peered":"2024-09-22T09:54:43.259561+0000","last_clean":"2024-09-22T09:54:43.259561+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:54:43.259561+0000","last_undegraded":"2024-09-22T09:54:43.259561+0000","last_fullsized":"2024-09-22T09:54:43.259561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.259390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:20.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'149","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.104170+0000","last_change":"2024-09-22T09:54:45.104115+0000","last_active":"2024-09-22T09:54:45.104170+0000","last_peered":"2024-09-22T09:54:45.104170+0000","last_clean":"2024-09-22T09:54:45.104170+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:54:45.104170+0000","last_undegraded":"2024-09-22T09:54:45.104170+0000","last_fullsized":"2024-09-22T09:54:45.104170+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.104013+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:03.942310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6811,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":273,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.046201+0000","last_change":"2024-09-22T09:54:45.046144+0000","last_active":"2024-09-22T09:54:45.046201+0000","last_peered":"2024-09-22T09:54:45.046201+0000","last_clean":"2024-09-22T09:54:45.046201+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:54:45.046201+0000","last_undegraded":"2024-09-22T09:54:45.046201+0000","last_fullsized":"2024-09-22T09:54:45.046201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.046060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:52:11.746875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'144","reported_seq":677,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.746262+0000","last_change":"2024-09-22T09:55:02.746262+0000","last_active":"2024-09-22T09:55:02.746262+0000","last_peered":"2024-09-22T09:55:02.746262+0000","last_clean":"2024-09-22T09:55:02.746262+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:55:02.746262+0000","last_undegraded":"2024-09-22T09:55:02.746262+0000","last_fullsized":"2024-09-22T09:55:02.746262+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'144","last_scrub_stamp":"2024-09-22T09:55:02.746156+0000","last_deep_scrub":"262'144","last_deep_scrub_stamp":"2024-09-22T09:55:02.746156+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.746156+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:55.455609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.772107+0000","last_change":"2024-09-22T09:54:35.772041+0000","last_active":"2024-09-22T09:54:35.772107+0000","last_peered":"2024-09-22T09:54:35.772107+0000","last_clean":"2024-09-22T09:54:35.772107+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:54:35.772107+0000","last_undegraded":"2024-09-22T09:54:35.772107+0000","last_fullsized":"2024-09-22T09:54:35.772107+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.771951+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:46.651125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'277","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.864381+0000","last_change":"2024-09-22T09:54:24.864311+0000","last_active":"2024-09-22T09:54:24.864381+0000","last_peered":"2024-09-22T09:54:24.864381+0000","last_clean":"2024-09-22T09:54:24.864381+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:54:24.864381+0000","last_undegraded":"2024-09-22T09:54:24.864381+0000","last_fullsized":"2024-09-22T09:54:24.864381+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.864187+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:28.585786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":745,"num_read_kb":35485,"num_write":1188,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.589608+0000","last_change":"2024-09-22T09:54:41.589523+0000","last_active":"2024-09-22T09:54:41.589608+0000","last_peered":"2024-09-22T09:54:41.589608+0000","last_clean":"2024-09-22T09:54:41.589608+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:54:41.589608+0000","last_undegraded":"2024-09-22T09:54:41.589608+0000","last_fullsized":"2024-09-22T09:54:41.589608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.589412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:53.383562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'117","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.656741+0000","last_change":"2024-09-22T09:54:53.656741+0000","last_active":"2024-09-22T09:54:53.656741+0000","last_peered":"2024-09-22T09:54:53.656741+0000","last_clean":"2024-09-22T09:54:53.656741+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:54:53.656741+0000","last_undegraded":"2024-09-22T09:54:53.656741+0000","last_fullsized":"2024-09-22T09:54:53.656741+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.656660+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:11.088340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":258,"num_write":80,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.625537+0000","last_change":"2024-09-22T09:54:50.625479+0000","last_active":"2024-09-22T09:54:50.625537+0000","last_peered":"2024-09-22T09:54:50.625537+0000","last_clean":"2024-09-22T09:54:50.625537+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:54:50.625537+0000","last_undegraded":"2024-09-22T09:54:50.625537+0000","last_fullsized":"2024-09-22T09:54:50.625537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.625391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:36.473029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'165","reported_seq":1642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.619056+0000","last_change":"2024-09-22T09:54:53.618972+0000","last_active":"2024-09-22T09:54:53.619056+0000","last_peered":"2024-09-22T09:54:53.619056+0000","last_clean":"2024-09-22T09:54:53.619056+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:54:53.619056+0000","last_undegraded":"2024-09-22T09:54:53.619056+0000","last_fullsized":"2024-09-22T09:54:53.619056+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.618875+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:04.804623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.687095+0000","last_change":"2024-09-22T09:54:30.687043+0000","last_active":"2024-09-22T09:54:30.687095+0000","last_peered":"2024-09-22T09:54:30.687095+0000","last_clean":"2024-09-22T09:54:30.687095+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:54:30.687095+0000","last_undegraded":"2024-09-22T09:54:30.687095+0000","last_fullsized":"2024-09-22T09:54:30.687095+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4461","last_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_deep_scrub":"262'4461","last_deep_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.686961+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:59.557234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'237","reported_seq":903,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.054726+0000","last_change":"2024-09-22T09:54:24.054638+0000","last_active":"2024-09-22T09:54:24.054726+0000","last_peered":"2024-09-22T09:54:24.054726+0000","last_clean":"2024-09-22T09:54:24.054726+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:54:24.054726+0000","last_undegraded":"2024-09-22T09:54:24.054726+0000","last_fullsized":"2024-09-22T09:54:24.054726+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.054495+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:26:50.248679+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":602,"num_read_kb":45002,"num_write":1097,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.198579+0000","last_change":"2024-09-22T09:54:37.198471+0000","last_active":"2024-09-22T09:54:37.198579+0000","last_peered":"2024-09-22T09:54:37.198579+0000","last_clean":"2024-09-22T09:54:37.198579+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:54:37.198579+0000","last_undegraded":"2024-09-22T09:54:37.198579+0000","last_fullsized":"2024-09-22T09:54:37.198579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.198370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:57.482827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'222","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.607437+0000","last_change":"2024-09-22T09:54:46.607378+0000","last_active":"2024-09-22T09:54:46.607437+0000","last_peered":"2024-09-22T09:54:46.607437+0000","last_clean":"2024-09-22T09:54:46.607437+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:54:46.607437+0000","last_undegraded":"2024-09-22T09:54:46.607437+0000","last_fullsized":"2024-09-22T09:54:46.607437+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.607285+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:00.061934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":792,"num_write":216,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.133185+0000","last_change":"2024-09-22T09:54:52.133089+0000","last_active":"2024-09-22T09:54:52.133185+0000","last_peered":"2024-09-22T09:54:52.133185+0000","last_clean":"2024-09-22T09:54:52.133185+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:54:52.133185+0000","last_undegraded":"2024-09-22T09:54:52.133185+0000","last_fullsized":"2024-09-22T09:54:52.133185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.132987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:10.463039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'129","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.608918+0000","last_change":"2024-09-22T09:54:53.608859+0000","last_active":"2024-09-22T09:54:53.608918+0000","last_peered":"2024-09-22T09:54:53.608918+0000","last_clean":"2024-09-22T09:54:53.608918+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:54:53.608918+0000","last_undegraded":"2024-09-22T09:54:53.608918+0000","last_fullsized":"2024-09-22T09:54:53.608918+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.608769+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:07.256774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.181260+0000","last_change":"2024-09-22T09:54:34.181260+0000","last_active":"2024-09-22T09:54:34.181260+0000","last_peered":"2024-09-22T09:54:34.181260+0000","last_clean":"2024-09-22T09:54:34.181260+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:54:34.181260+0000","last_undegraded":"2024-09-22T09:54:34.181260+0000","last_fullsized":"2024-09-22T09:54:34.181260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'179","last_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_deep_scrub":"262'179","last_deep_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.181177+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:28.301187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'198","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.782799+0000","last_change":"2024-09-22T09:54:24.782744+0000","last_active":"2024-09-22T09:54:24.782799+0000","last_peered":"2024-09-22T09:54:24.782799+0000","last_clean":"2024-09-22T09:54:24.782799+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:54:24.782799+0000","last_undegraded":"2024-09-22T09:54:24.782799+0000","last_fullsized":"2024-09-22T09:54:24.782799+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.782631+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:03:28.457706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":68297,"num_write":940,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":977,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.209160+0000","last_change":"2024-09-22T09:54:32.209160+0000","last_active":"2024-09-22T09:54:32.209160+0000","last_peered":"2024-09-22T09:54:32.209160+0000","last_clean":"2024-09-22T09:54:32.209160+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:54:32.209160+0000","last_undegraded":"2024-09-22T09:54:32.209160+0000","last_fullsized":"2024-09-22T09:54:32.209160+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.209076+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.157428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'194","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.679645+0000","last_change":"2024-09-22T09:54:24.679547+0000","last_active":"2024-09-22T09:54:24.679645+0000","last_peered":"2024-09-22T09:54:24.679645+0000","last_clean":"2024-09-22T09:54:24.679645+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:54:24.679645+0000","last_undegraded":"2024-09-22T09:54:24.679645+0000","last_fullsized":"2024-09-22T09:54:24.679645+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.679384+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:52.319029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":8670,"num_write":934,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.382536+0000","last_change":"2024-09-22T09:54:35.382536+0000","last_active":"2024-09-22T09:54:35.382536+0000","last_peered":"2024-09-22T09:54:35.382536+0000","last_clean":"2024-09-22T09:54:35.382536+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:54:35.382536+0000","last_undegraded":"2024-09-22T09:54:35.382536+0000","last_fullsized":"2024-09-22T09:54:35.382536+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.382442+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:41.378476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'197","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.543866+0000","last_change":"2024-09-22T09:54:26.543796+0000","last_active":"2024-09-22T09:54:26.543866+0000","last_peered":"2024-09-22T09:54:26.543866+0000","last_clean":"2024-09-22T09:54:26.543866+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:54:26.543866+0000","last_undegraded":"2024-09-22T09:54:26.543866+0000","last_fullsized":"2024-09-22T09:54:26.543866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.543655+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:59.656939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":611,"num_read_kb":542,"num_write":1015,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.195206+0000","last_change":"2024-09-22T09:54:33.195206+0000","last_active":"2024-09-22T09:54:33.195206+0000","last_peered":"2024-09-22T09:54:33.195206+0000","last_clean":"2024-09-22T09:54:33.195206+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:54:33.195206+0000","last_undegraded":"2024-09-22T09:54:33.195206+0000","last_fullsized":"2024-09-22T09:54:33.195206+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.195108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:04.521832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'205","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.083506+0000","last_change":"2024-09-22T09:54:25.083506+0000","last_active":"2024-09-22T09:54:25.083506+0000","last_peered":"2024-09-22T09:54:25.083506+0000","last_clean":"2024-09-22T09:54:25.083506+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:54:25.083506+0000","last_undegraded":"2024-09-22T09:54:25.083506+0000","last_fullsized":"2024-09-22T09:54:25.083506+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.083235+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:40.697324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":724,"num_read_kb":18552,"num_write":938,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.803183+0000","last_change":"2024-09-22T09:54:37.803183+0000","last_active":"2024-09-22T09:54:37.803183+0000","last_peered":"2024-09-22T09:54:37.803183+0000","last_clean":"2024-09-22T09:54:37.803183+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:54:37.803183+0000","last_undegraded":"2024-09-22T09:54:37.803183+0000","last_fullsized":"2024-09-22T09:54:37.803183+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.803092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:22.441183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'222","reported_seq":878,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.900669+0000","last_change":"2024-09-22T09:54:25.900669+0000","last_active":"2024-09-22T09:54:25.900669+0000","last_peered":"2024-09-22T09:54:25.900669+0000","last_clean":"2024-09-22T09:54:25.900669+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:54:25.900669+0000","last_undegraded":"2024-09-22T09:54:25.900669+0000","last_fullsized":"2024-09-22T09:54:25.900669+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.900557+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:40.029656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":30794,"num_write":966,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'220","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.668993+0000","last_change":"2024-09-22T09:54:33.668933+0000","last_active":"2024-09-22T09:54:33.668993+0000","last_peered":"2024-09-22T09:54:33.668993+0000","last_clean":"2024-09-22T09:54:33.668993+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:54:33.668993+0000","last_undegraded":"2024-09-22T09:54:33.668993+0000","last_fullsized":"2024-09-22T09:54:33.668993+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.668849+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:00.473679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'282","reported_seq":980,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.200420+0000","last_change":"2024-09-22T09:54:26.200420+0000","last_active":"2024-09-22T09:54:26.200420+0000","last_peered":"2024-09-22T09:54:26.200420+0000","last_clean":"2024-09-22T09:54:26.200420+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:54:26.200420+0000","last_undegraded":"2024-09-22T09:54:26.200420+0000","last_fullsized":"2024-09-22T09:54:26.200420+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.200277+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:20.326052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242911,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":757,"num_read_kb":37026,"num_write":1221,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.820421+0000","last_change":"2024-09-22T09:54:39.820348+0000","last_active":"2024-09-22T09:54:39.820421+0000","last_peered":"2024-09-22T09:54:39.820421+0000","last_clean":"2024-09-22T09:54:39.820421+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:54:39.820421+0000","last_undegraded":"2024-09-22T09:54:39.820421+0000","last_fullsized":"2024-09-22T09:54:39.820421+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.820264+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:38.159333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'210","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.829055+0000","last_change":"2024-09-22T09:54:25.829055+0000","last_active":"2024-09-22T09:54:25.829055+0000","last_peered":"2024-09-22T09:54:25.829055+0000","last_clean":"2024-09-22T09:54:25.829055+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:54:25.829055+0000","last_undegraded":"2024-09-22T09:54:25.829055+0000","last_fullsized":"2024-09-22T09:54:25.829055+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.828882+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:15.511659+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":7650,"num_write":1038,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886398+0000","last_change":"2024-09-22T09:54:32.886298+0000","last_active":"2024-09-22T09:54:32.886398+0000","last_peered":"2024-09-22T09:54:32.886398+0000","last_clean":"2024-09-22T09:54:32.886398+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:54:32.886398+0000","last_undegraded":"2024-09-22T09:54:32.886398+0000","last_fullsized":"2024-09-22T09:54:32.886398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886187+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:19.355885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'229","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.850468+0000","last_change":"2024-09-22T09:54:31.850468+0000","last_active":"2024-09-22T09:54:31.850468+0000","last_peered":"2024-09-22T09:54:31.850468+0000","last_clean":"2024-09-22T09:54:31.850468+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:54:31.850468+0000","last_undegraded":"2024-09-22T09:54:31.850468+0000","last_fullsized":"2024-09-22T09:54:31.850468+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.850380+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:23.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":20476,"num_write":1023,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.087299+0000","last_change":"2024-09-22T09:54:35.087235+0000","last_active":"2024-09-22T09:54:35.087299+0000","last_peered":"2024-09-22T09:54:35.087299+0000","last_clean":"2024-09-22T09:54:35.087299+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:54:35.087299+0000","last_undegraded":"2024-09-22T09:54:35.087299+0000","last_fullsized":"2024-09-22T09:54:35.087299+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.087135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:07.485045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'186","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.512435+0000","last_change":"2024-09-22T09:54:27.512435+0000","last_active":"2024-09-22T09:54:27.512435+0000","last_peered":"2024-09-22T09:54:27.512435+0000","last_clean":"2024-09-22T09:54:27.512435+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:54:27.512435+0000","last_undegraded":"2024-09-22T09:54:27.512435+0000","last_fullsized":"2024-09-22T09:54:27.512435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.512262+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:12.723891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":7230,"num_write":907,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.708613+0000","last_change":"2024-09-22T09:54:36.708533+0000","last_active":"2024-09-22T09:54:36.708613+0000","last_peered":"2024-09-22T09:54:36.708613+0000","last_clean":"2024-09-22T09:54:36.708613+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:54:36.708613+0000","last_undegraded":"2024-09-22T09:54:36.708613+0000","last_fullsized":"2024-09-22T09:54:36.708613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.708407+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:19.337819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'226","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.887055+0000","last_change":"2024-09-22T09:54:27.887055+0000","last_active":"2024-09-22T09:54:27.887055+0000","last_peered":"2024-09-22T09:54:27.887055+0000","last_clean":"2024-09-22T09:54:27.887055+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:54:27.887055+0000","last_undegraded":"2024-09-22T09:54:27.887055+0000","last_fullsized":"2024-09-22T09:54:27.887055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.886918+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:01.730176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1623,"num_read_kb":135465,"num_write":994,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'143","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.688731+0000","last_change":"2024-09-22T09:54:26.688731+0000","last_active":"2024-09-22T09:54:26.688731+0000","last_peered":"2024-09-22T09:54:26.688731+0000","last_clean":"2024-09-22T09:54:26.688731+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:54:26.688731+0000","last_undegraded":"2024-09-22T09:54:26.688731+0000","last_fullsized":"2024-09-22T09:54:26.688731+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.688639+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:53.157417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'180","reported_seq":793,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.510853+0000","last_change":"2024-09-22T09:54:28.510853+0000","last_active":"2024-09-22T09:54:28.510853+0000","last_peered":"2024-09-22T09:54:28.510853+0000","last_clean":"2024-09-22T09:54:28.510853+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:54:28.510853+0000","last_undegraded":"2024-09-22T09:54:28.510853+0000","last_fullsized":"2024-09-22T09:54:28.510853+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'180","last_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_deep_scrub":"262'180","last_deep_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.510744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.855576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170178,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":30385,"num_write":838,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.664254+0000","last_change":"2024-09-22T09:54:34.664254+0000","last_active":"2024-09-22T09:54:34.664254+0000","last_peered":"2024-09-22T09:54:34.664254+0000","last_clean":"2024-09-22T09:54:34.664254+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:54:34.664254+0000","last_undegraded":"2024-09-22T09:54:34.664254+0000","last_fullsized":"2024-09-22T09:54:34.664254+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.664136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:52.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.042434+0000","last_change":"2024-09-22T09:54:26.042434+0000","last_active":"2024-09-22T09:54:26.042434+0000","last_peered":"2024-09-22T09:54:26.042434+0000","last_clean":"2024-09-22T09:54:26.042434+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:54:26.042434+0000","last_undegraded":"2024-09-22T09:54:26.042434+0000","last_fullsized":"2024-09-22T09:54:26.042434+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.042281+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:00.923861+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":23430,"num_write":912,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.612459+0000","last_change":"2024-09-22T09:54:35.612459+0000","last_active":"2024-09-22T09:54:35.612459+0000","last_peered":"2024-09-22T09:54:35.612459+0000","last_clean":"2024-09-22T09:54:35.612459+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:54:35.612459+0000","last_undegraded":"2024-09-22T09:54:35.612459+0000","last_fullsized":"2024-09-22T09:54:35.612459+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'276","last_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_deep_scrub":"262'276","last_deep_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.612365+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:05.176874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'212","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.863062+0000","last_change":"2024-09-22T09:54:26.863062+0000","last_active":"2024-09-22T09:54:26.863062+0000","last_peered":"2024-09-22T09:54:26.863062+0000","last_clean":"2024-09-22T09:54:26.863062+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:54:26.863062+0000","last_undegraded":"2024-09-22T09:54:26.863062+0000","last_fullsized":"2024-09-22T09:54:26.863062+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.862976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:17.663525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":16539,"num_write":978,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.043413+0000","last_change":"2024-09-22T09:54:34.043413+0000","last_active":"2024-09-22T09:54:34.043413+0000","last_peered":"2024-09-22T09:54:34.043413+0000","last_clean":"2024-09-22T09:54:34.043413+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:54:34.043413+0000","last_undegraded":"2024-09-22T09:54:34.043413+0000","last_fullsized":"2024-09-22T09:54:34.043413+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.043310+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:36.199673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'199","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.591536+0000","last_change":"2024-09-22T09:54:32.591536+0000","last_active":"2024-09-22T09:54:32.591536+0000","last_peered":"2024-09-22T09:54:32.591536+0000","last_clean":"2024-09-22T09:54:32.591536+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:54:32.591536+0000","last_undegraded":"2024-09-22T09:54:32.591536+0000","last_fullsized":"2024-09-22T09:54:32.591536+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.591400+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:24.382819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":32145,"num_write":913,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.799963+0000","last_change":"2024-09-22T09:54:41.799963+0000","last_active":"2024-09-22T09:54:41.799963+0000","last_peered":"2024-09-22T09:54:41.799963+0000","last_clean":"2024-09-22T09:54:41.799963+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:54:41.799963+0000","last_undegraded":"2024-09-22T09:54:41.799963+0000","last_fullsized":"2024-09-22T09:54:41.799963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'91","last_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_deep_scrub":"262'91","last_deep_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.799878+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:39:52.935799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'203","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.684314+0000","last_change":"2024-09-22T09:54:27.684247+0000","last_active":"2024-09-22T09:54:27.684314+0000","last_peered":"2024-09-22T09:54:27.684314+0000","last_clean":"2024-09-22T09:54:27.684314+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:54:27.684314+0000","last_undegraded":"2024-09-22T09:54:27.684314+0000","last_fullsized":"2024-09-22T09:54:27.684314+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.684082+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:03.070485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493665,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":31835,"num_write":1011,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.613984+0000","last_change":"2024-09-22T09:54:34.613984+0000","last_active":"2024-09-22T09:54:34.613984+0000","last_peered":"2024-09-22T09:54:34.613984+0000","last_clean":"2024-09-22T09:54:34.613984+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:54:34.613984+0000","last_undegraded":"2024-09-22T09:54:34.613984+0000","last_fullsized":"2024-09-22T09:54:34.613984+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'154","last_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_deep_scrub":"262'154","last_deep_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.613865+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'227","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.479127+0000","last_change":"2024-09-22T09:54:29.479067+0000","last_active":"2024-09-22T09:54:29.479127+0000","last_peered":"2024-09-22T09:54:29.479127+0000","last_clean":"2024-09-22T09:54:29.479127+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:54:29.479127+0000","last_undegraded":"2024-09-22T09:54:29.479127+0000","last_fullsized":"2024-09-22T09:54:29.479127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.478897+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:08.606241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242963,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":33540,"num_write":1138,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'203","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.379662+0000","last_change":"2024-09-22T09:54:31.379607+0000","last_active":"2024-09-22T09:54:31.379662+0000","last_peered":"2024-09-22T09:54:31.379662+0000","last_clean":"2024-09-22T09:54:31.379662+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:54:31.379662+0000","last_undegraded":"2024-09-22T09:54:31.379662+0000","last_fullsized":"2024-09-22T09:54:31.379662+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.379436+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:11.349573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":478,"num_read_kb":16611,"num_write":909,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.056709+0000","last_change":"2024-09-22T09:54:36.056645+0000","last_active":"2024-09-22T09:54:36.056709+0000","last_peered":"2024-09-22T09:54:36.056709+0000","last_clean":"2024-09-22T09:54:36.056709+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:54:36.056709+0000","last_undegraded":"2024-09-22T09:54:36.056709+0000","last_fullsized":"2024-09-22T09:54:36.056709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.056545+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:56.184943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'230","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.226521+0000","last_change":"2024-09-22T09:54:25.226461+0000","last_active":"2024-09-22T09:54:25.226521+0000","last_peered":"2024-09-22T09:54:25.226521+0000","last_clean":"2024-09-22T09:54:25.226521+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:54:25.226521+0000","last_undegraded":"2024-09-22T09:54:25.226521+0000","last_fullsized":"2024-09-22T09:54:25.226521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'230","last_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_deep_scrub":"262'230","last_deep_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.226345+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:28.279869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":659,"num_read_kb":76384,"num_write":1027,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.389454+0000","last_change":"2024-09-22T09:54:37.389356+0000","last_active":"2024-09-22T09:54:37.389454+0000","last_peered":"2024-09-22T09:54:37.389454+0000","last_clean":"2024-09-22T09:54:37.389454+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:54:37.389454+0000","last_undegraded":"2024-09-22T09:54:37.389454+0000","last_fullsized":"2024-09-22T09:54:37.389454+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.389263+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:02.716245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1587,"ondisk_log_size":1587,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":372077,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":10012,"num_read_kb":12519,"num_write":7007,"num_write_kb":3209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710212,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1817,"ondisk_log_size":1817,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35500,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":105523402,"num_objects":166,"num_object_clones":0,"num_object_copies":664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42464,"num_read_kb":2399835,"num_write":63370,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142622720,"data_stored":142622720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":189640,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189064,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543029,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265880,"kb_used_data":22280,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94105960,"statfs":{"total":96636764160,"available":96364503040,"internally_reserved":0,"allocated":22814720,"data_stored":20815259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543029,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291592,"kb_used_data":21624,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94080248,"statfs":{"total":96636764160,"available":96338173952,"internally_reserved":0,"allocated":22142976,"data_stored":20214796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543031,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100912,"kb_used_data":19808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94270928,"statfs":{"total":96636764160,"available":96533430272,"internally_reserved":0,"allocated":20283392,"data_stored":18282616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543030,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138192,"kb_used_data":26496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94233648,"statfs":{"total":96636764160,"available":96495255552,"internally_reserved":0,"allocated":27131904,"data_stored":25227113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543029,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18263996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543033,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91232,"kb_used_data":19792,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280608,"statfs":{"total":96636764160,"available":96543342592,"internally_reserved":0,"allocated":20267008,"data_stored":18362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543029,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149548,"kb_used_data":19868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94222292,"statfs":{"total":96636764160,"available":96483627008,"internally_reserved":0,"allocated":20344832,"data_stored":18397529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543031,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261744,"kb_used_data":23712,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110096,"statfs":{"total":96636764160,"available":96368738304,"internally_reserved":0,"allocated":24281088,"data_stored":22309261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16138240,"data_stored":16138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":16105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":16003072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22970368,"data_stored":22970368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16023552,"data_stored":16023552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17956864,"data_stored":17956864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17965056,"data_stored":17965056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:55:23.650 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.650 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-22T09:01:10.480249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=1, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.651 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.652 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.652 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.652 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-22T09:20:11.832137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=20, tm_sec=11, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=9, tm_min=54, tm_sec=17, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T09:55:23.655 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T09:55:43.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T09:55:44.009 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-22T09:55:44.020 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-22T09:55:44.023 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":2470,"stamp":"2024-09-22T09:55:42.457755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106502740,"num_objects":492,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":190601,"num_read_kb":2910687,"num_write":128942,"num_write_kb":2504267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749425,"num_omap_keys":1788,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13183,"ondisk_log_size":13183,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1548568,"kb_used_data":173336,"kb_used_omap":12,"kb_used_meta":1375091,"kb_avail":753426152,"statfs":{"total":773094113280,"available":771508379648,"internally_reserved":0,"allocated":177496064,"data_stored":161872998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1408093745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005062"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.299256+0000","last_change":"2024-09-22T09:55:07.299206+0000","last_active":"2024-09-22T09:55:07.299256+0000","last_peered":"2024-09-22T09:55:07.299256+0000","last_clean":"2024-09-22T09:55:07.299256+0000","last_became_active":"2024-09-22T09:20:12.865157+0000","last_became_peered":"2024-09-22T09:20:12.865157+0000","last_unstale":"2024-09-22T09:55:07.299256+0000","last_undegraded":"2024-09-22T09:55:07.299256+0000","last_fullsized":"2024-09-22T09:55:07.299256+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:07.299125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:07.299125+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.299125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:15.995717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'8","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.318067+0000","last_change":"2024-09-22T09:55:03.318067+0000","last_active":"2024-09-22T09:55:03.318067+0000","last_peered":"2024-09-22T09:55:03.318067+0000","last_clean":"2024-09-22T09:55:03.318067+0000","last_became_active":"2024-09-22T09:01:11.513818+0000","last_became_peered":"2024-09-22T09:01:11.513818+0000","last_unstale":"2024-09-22T09:55:03.318067+0000","last_undegraded":"2024-09-22T09:55:03.318067+0000","last_fullsized":"2024-09-22T09:55:03.318067+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:55:03.317973+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:55:03.317973+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.317973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:33.605682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.704703+0000","last_change":"2024-09-22T09:55:11.704703+0000","last_active":"2024-09-22T09:55:11.704703+0000","last_peered":"2024-09-22T09:55:11.704703+0000","last_clean":"2024-09-22T09:55:11.704703+0000","last_became_active":"2024-09-22T09:01:07.463680+0000","last_became_peered":"2024-09-22T09:01:07.463680+0000","last_unstale":"2024-09-22T09:55:11.704703+0000","last_undegraded":"2024-09-22T09:55:11.704703+0000","last_fullsized":"2024-09-22T09:55:11.704703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.704595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.704595+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.704595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:25:18.273590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"262'17","reported_seq":111,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.287834+0000","last_change":"2024-09-22T09:55:06.287753+0000","last_active":"2024-09-22T09:55:06.287834+0000","last_peered":"2024-09-22T09:55:06.287834+0000","last_clean":"2024-09-22T09:55:06.287834+0000","last_became_active":"2024-09-22T08:57:04.403572+0000","last_became_peered":"2024-09-22T08:57:04.403572+0000","last_unstale":"2024-09-22T09:55:06.287834+0000","last_undegraded":"2024-09-22T09:55:06.287834+0000","last_fullsized":"2024-09-22T09:55:06.287834+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-22T09:55:06.287655+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-22T09:55:06.287655+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.287655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:54:03.789868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":65,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.602831+0000","last_change":"2024-09-22T09:54:50.602742+0000","last_active":"2024-09-22T09:54:50.602831+0000","last_peered":"2024-09-22T09:54:50.602831+0000","last_clean":"2024-09-22T09:54:50.602831+0000","last_became_active":"2024-09-22T09:20:12.873067+0000","last_became_peered":"2024-09-22T09:20:12.873067+0000","last_unstale":"2024-09-22T09:54:50.602831+0000","last_undegraded":"2024-09-22T09:54:50.602831+0000","last_fullsized":"2024-09-22T09:54:50.602831+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.602649+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.602649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:34.691467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"262'9","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.657204+0000","last_change":"2024-09-22T09:55:07.657204+0000","last_active":"2024-09-22T09:55:07.657204+0000","last_peered":"2024-09-22T09:55:07.657204+0000","last_clean":"2024-09-22T09:55:07.657204+0000","last_became_active":"2024-09-22T09:01:11.513049+0000","last_became_peered":"2024-09-22T09:01:11.513049+0000","last_unstale":"2024-09-22T09:55:07.657204+0000","last_undegraded":"2024-09-22T09:55:07.657204+0000","last_fullsized":"2024-09-22T09:55:07.657204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:07.657111+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:07.657111+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.657111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:35:05.008295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":18432,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.176703+0000","last_change":"2024-09-22T09:54:54.176703+0000","last_active":"2024-09-22T09:54:54.176703+0000","last_peered":"2024-09-22T09:54:54.176703+0000","last_clean":"2024-09-22T09:54:54.176703+0000","last_became_active":"2024-09-22T09:01:07.464779+0000","last_became_peered":"2024-09-22T09:01:07.464779+0000","last_unstale":"2024-09-22T09:54:54.176703+0000","last_undegraded":"2024-09-22T09:54:54.176703+0000","last_fullsized":"2024-09-22T09:54:54.176703+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:54.176615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.176615+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:28:35.381475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"262'13","reported_seq":105,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.653812+0000","last_change":"2024-09-22T09:54:42.653745+0000","last_active":"2024-09-22T09:54:42.653812+0000","last_peered":"2024-09-22T09:54:42.653812+0000","last_clean":"2024-09-22T09:54:42.653812+0000","last_became_active":"2024-09-22T08:57:04.396685+0000","last_became_peered":"2024-09-22T08:57:04.396685+0000","last_unstale":"2024-09-22T09:54:42.653812+0000","last_undegraded":"2024-09-22T09:54:42.653812+0000","last_fullsized":"2024-09-22T09:54:42.653812+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'13","last_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_deep_scrub":"262'13","last_deep_scrub_stamp":"2024-09-22T09:54:42.653671+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.653671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:29:37.734493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.078951+0000","last_change":"2024-09-22T09:54:59.078951+0000","last_active":"2024-09-22T09:54:59.078951+0000","last_peered":"2024-09-22T09:54:59.078951+0000","last_clean":"2024-09-22T09:54:59.078951+0000","last_became_active":"2024-09-22T09:20:12.865645+0000","last_became_peered":"2024-09-22T09:20:12.865645+0000","last_unstale":"2024-09-22T09:54:59.078951+0000","last_undegraded":"2024-09-22T09:54:59.078951+0000","last_fullsized":"2024-09-22T09:54:59.078951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.078866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.078866+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.078866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:10.325978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"259'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.386717+0000","last_change":"2024-09-22T09:55:14.386655+0000","last_active":"2024-09-22T09:55:14.386717+0000","last_peered":"2024-09-22T09:55:14.386717+0000","last_clean":"2024-09-22T09:55:14.386717+0000","last_became_active":"2024-09-22T09:01:11.517594+0000","last_became_peered":"2024-09-22T09:01:11.517594+0000","last_unstale":"2024-09-22T09:55:14.386717+0000","last_undegraded":"2024-09-22T09:55:14.386717+0000","last_fullsized":"2024-09-22T09:55:14.386717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-22T09:55:14.386562+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-22T09:55:14.386562+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.386562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:33.973994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'4","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.616342+0000","last_change":"2024-09-22T09:54:46.616284+0000","last_active":"2024-09-22T09:54:46.616342+0000","last_peered":"2024-09-22T09:54:46.616342+0000","last_clean":"2024-09-22T09:54:46.616342+0000","last_became_active":"2024-09-22T09:01:07.467360+0000","last_became_peered":"2024-09-22T09:01:07.467360+0000","last_unstale":"2024-09-22T09:54:46.616342+0000","last_undegraded":"2024-09-22T09:54:46.616342+0000","last_fullsized":"2024-09-22T09:54:46.616342+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:46.616197+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.616197+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:36:24.250059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":619,"num_write":4,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"262'35","reported_seq":163,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.312049+0000","last_change":"2024-09-22T09:55:00.312049+0000","last_active":"2024-09-22T09:55:00.312049+0000","last_peered":"2024-09-22T09:55:00.312049+0000","last_clean":"2024-09-22T09:55:00.312049+0000","last_became_active":"2024-09-22T08:57:04.400461+0000","last_became_peered":"2024-09-22T08:57:04.400461+0000","last_unstale":"2024-09-22T09:55:00.312049+0000","last_undegraded":"2024-09-22T09:55:00.312049+0000","last_fullsized":"2024-09-22T09:55:00.312049+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'35","last_scrub_stamp":"2024-09-22T09:55:00.311954+0000","last_deep_scrub":"262'35","last_deep_scrub_stamp":"2024-09-22T09:55:00.311954+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.311954+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:01.955525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":178,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:21.627503+0000","last_change":"2024-09-22T09:55:21.627503+0000","last_active":"2024-09-22T09:55:21.627503+0000","last_peered":"2024-09-22T09:55:21.627503+0000","last_clean":"2024-09-22T09:55:21.627503+0000","last_became_active":"2024-09-22T09:20:12.872101+0000","last_became_peered":"2024-09-22T09:20:12.872101+0000","last_unstale":"2024-09-22T09:55:21.627503+0000","last_undegraded":"2024-09-22T09:55:21.627503+0000","last_fullsized":"2024-09-22T09:55:21.627503+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:21.627404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:21.627404+0000","last_clean_scrub_stamp":"2024-09-22T09:55:21.627404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:40.517333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:22.630234+0000","last_change":"2024-09-22T09:55:22.630234+0000","last_active":"2024-09-22T09:55:22.630234+0000","last_peered":"2024-09-22T09:55:22.630234+0000","last_clean":"2024-09-22T09:55:22.630234+0000","last_became_active":"2024-09-22T09:01:11.519759+0000","last_became_peered":"2024-09-22T09:01:11.519759+0000","last_unstale":"2024-09-22T09:55:22.630234+0000","last_undegraded":"2024-09-22T09:55:22.630234+0000","last_fullsized":"2024-09-22T09:55:22.630234+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:22.630126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:22.630126+0000","last_clean_scrub_stamp":"2024-09-22T09:55:22.630126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:50:16.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.712793+0000","last_change":"2024-09-22T09:55:02.712729+0000","last_active":"2024-09-22T09:55:02.712793+0000","last_peered":"2024-09-22T09:55:02.712793+0000","last_clean":"2024-09-22T09:55:02.712793+0000","last_became_active":"2024-09-22T09:01:07.448705+0000","last_became_peered":"2024-09-22T09:01:07.448705+0000","last_unstale":"2024-09-22T09:55:02.712793+0000","last_undegraded":"2024-09-22T09:55:02.712793+0000","last_fullsized":"2024-09-22T09:55:02.712793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.712642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.712642+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.712642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:50:52.549386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"262'22","reported_seq":124,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.782015+0000","last_change":"2024-09-22T09:55:08.782015+0000","last_active":"2024-09-22T09:55:08.782015+0000","last_peered":"2024-09-22T09:55:08.782015+0000","last_clean":"2024-09-22T09:55:08.782015+0000","last_became_active":"2024-09-22T08:57:04.401052+0000","last_became_peered":"2024-09-22T08:57:04.401052+0000","last_unstale":"2024-09-22T09:55:08.782015+0000","last_undegraded":"2024-09-22T09:55:08.782015+0000","last_fullsized":"2024-09-22T09:55:08.782015+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'22","last_scrub_stamp":"2024-09-22T09:55:08.781930+0000","last_deep_scrub":"262'22","last_deep_scrub_stamp":"2024-09-22T09:55:08.781930+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.781930+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:40:29.623449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":98,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:25.561651+0000","last_change":"2024-09-22T09:55:25.561651+0000","last_active":"2024-09-22T09:55:25.561651+0000","last_peered":"2024-09-22T09:55:25.561651+0000","last_clean":"2024-09-22T09:55:25.561651+0000","last_became_active":"2024-09-22T09:20:12.868415+0000","last_became_peered":"2024-09-22T09:20:12.868415+0000","last_unstale":"2024-09-22T09:55:25.561651+0000","last_undegraded":"2024-09-22T09:55:25.561651+0000","last_fullsized":"2024-09-22T09:55:25.561651+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:25.561558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:25.561558+0000","last_clean_scrub_stamp":"2024-09-22T09:55:25.561558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:26.199781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"259'2","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.274507+0000","last_change":"2024-09-22T09:55:04.274507+0000","last_active":"2024-09-22T09:55:04.274507+0000","last_peered":"2024-09-22T09:55:04.274507+0000","last_clean":"2024-09-22T09:55:04.274507+0000","last_became_active":"2024-09-22T09:01:47.312343+0000","last_became_peered":"2024-09-22T09:01:47.312343+0000","last_unstale":"2024-09-22T09:55:04.274507+0000","last_undegraded":"2024-09-22T09:55:04.274507+0000","last_fullsized":"2024-09-22T09:55:04.274507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'2","last_scrub_stamp":"2024-09-22T09:55:04.274420+0000","last_deep_scrub":"259'2","last_deep_scrub_stamp":"2024-09-22T09:55:04.274420+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.274420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:08:34.645383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.260782+0000","last_change":"2024-09-22T09:55:09.260782+0000","last_active":"2024-09-22T09:55:09.260782+0000","last_peered":"2024-09-22T09:55:09.260782+0000","last_clean":"2024-09-22T09:55:09.260782+0000","last_became_active":"2024-09-22T09:01:07.460035+0000","last_became_peered":"2024-09-22T09:01:07.460035+0000","last_unstale":"2024-09-22T09:55:09.260782+0000","last_undegraded":"2024-09-22T09:55:09.260782+0000","last_fullsized":"2024-09-22T09:55:09.260782+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.260676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.260676+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.260676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:55:41.080885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"262'27","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.791950+0000","last_change":"2024-09-22T09:55:07.791950+0000","last_active":"2024-09-22T09:55:07.791950+0000","last_peered":"2024-09-22T09:55:07.791950+0000","last_clean":"2024-09-22T09:55:07.791950+0000","last_became_active":"2024-09-22T08:57:04.404021+0000","last_became_peered":"2024-09-22T08:57:04.404021+0000","last_unstale":"2024-09-22T09:55:07.791950+0000","last_undegraded":"2024-09-22T09:55:07.791950+0000","last_fullsized":"2024-09-22T09:55:07.791950+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-22T09:55:07.791862+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-22T09:55:07.791862+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.791862+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:29:20.525249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":128,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.346413+0000","last_change":"2024-09-22T09:55:02.346337+0000","last_active":"2024-09-22T09:55:02.346413+0000","last_peered":"2024-09-22T09:55:02.346413+0000","last_clean":"2024-09-22T09:55:02.346413+0000","last_became_active":"2024-09-22T09:20:12.868959+0000","last_became_peered":"2024-09-22T09:20:12.868959+0000","last_unstale":"2024-09-22T09:55:02.346413+0000","last_undegraded":"2024-09-22T09:55:02.346413+0000","last_fullsized":"2024-09-22T09:55:02.346413+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.346255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.346255+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.346255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:22.616932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'6","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.070429+0000","last_change":"2024-09-22T09:54:55.070429+0000","last_active":"2024-09-22T09:54:55.070429+0000","last_peered":"2024-09-22T09:54:55.070429+0000","last_clean":"2024-09-22T09:54:55.070429+0000","last_became_active":"2024-09-22T09:01:11.514248+0000","last_became_peered":"2024-09-22T09:01:11.514248+0000","last_unstale":"2024-09-22T09:54:55.070429+0000","last_undegraded":"2024-09-22T09:54:55.070429+0000","last_fullsized":"2024-09-22T09:54:55.070429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:55.070344+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.070344+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:57.666280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"259'6","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.657818+0000","last_change":"2024-09-22T09:55:00.657818+0000","last_active":"2024-09-22T09:55:00.657818+0000","last_peered":"2024-09-22T09:55:00.657818+0000","last_clean":"2024-09-22T09:55:00.657818+0000","last_became_active":"2024-09-22T09:01:07.454051+0000","last_became_peered":"2024-09-22T09:01:07.454051+0000","last_unstale":"2024-09-22T09:55:00.657818+0000","last_undegraded":"2024-09-22T09:55:00.657818+0000","last_fullsized":"2024-09-22T09:55:00.657818+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'6","last_scrub_stamp":"2024-09-22T09:55:00.657727+0000","last_deep_scrub":"259'6","last_deep_scrub_stamp":"2024-09-22T09:55:00.657727+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.657727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:51:12.801374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'70","reported_seq":269,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.114568+0000","last_change":"2024-09-22T09:54:51.114568+0000","last_active":"2024-09-22T09:54:51.114568+0000","last_peered":"2024-09-22T09:54:51.114568+0000","last_clean":"2024-09-22T09:54:51.114568+0000","last_became_active":"2024-09-22T08:57:04.395773+0000","last_became_peered":"2024-09-22T08:57:04.395773+0000","last_unstale":"2024-09-22T09:54:51.114568+0000","last_undegraded":"2024-09-22T09:54:51.114568+0000","last_fullsized":"2024-09-22T09:54:51.114568+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'70","last_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_deep_scrub":"262'70","last_deep_scrub_stamp":"2024-09-22T09:54:51.114477+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.114477+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:08:41.369972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":410,"num_write":144,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.633499+0000","last_change":"2024-09-22T09:55:16.633499+0000","last_active":"2024-09-22T09:55:16.633499+0000","last_peered":"2024-09-22T09:55:16.633499+0000","last_clean":"2024-09-22T09:55:16.633499+0000","last_became_active":"2024-09-22T09:20:12.874054+0000","last_became_peered":"2024-09-22T09:20:12.874054+0000","last_unstale":"2024-09-22T09:55:16.633499+0000","last_undegraded":"2024-09-22T09:55:16.633499+0000","last_fullsized":"2024-09-22T09:55:16.633499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:16.633418+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:16.633418+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.633418+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:38:44.345861+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'8","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.074052+0000","last_change":"2024-09-22T09:54:58.074052+0000","last_active":"2024-09-22T09:54:58.074052+0000","last_peered":"2024-09-22T09:54:58.074052+0000","last_clean":"2024-09-22T09:54:58.074052+0000","last_became_active":"2024-09-22T09:01:11.509263+0000","last_became_peered":"2024-09-22T09:01:11.509263+0000","last_unstale":"2024-09-22T09:54:58.074052+0000","last_undegraded":"2024-09-22T09:54:58.074052+0000","last_fullsized":"2024-09-22T09:54:58.074052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:58.073963+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:58.073963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.073963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:21.083891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"259'8","reported_seq":79,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.667417+0000","last_change":"2024-09-22T09:55:01.667417+0000","last_active":"2024-09-22T09:55:01.667417+0000","last_peered":"2024-09-22T09:55:01.667417+0000","last_clean":"2024-09-22T09:55:01.667417+0000","last_became_active":"2024-09-22T09:01:07.460346+0000","last_became_peered":"2024-09-22T09:01:07.460346+0000","last_unstale":"2024-09-22T09:55:01.667417+0000","last_undegraded":"2024-09-22T09:55:01.667417+0000","last_fullsized":"2024-09-22T09:55:01.667417+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-22T09:55:01.667319+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-22T09:55:01.667319+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.667319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:05.634286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'63","reported_seq":237,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.340004+0000","last_change":"2024-09-22T09:55:01.339941+0000","last_active":"2024-09-22T09:55:01.340004+0000","last_peered":"2024-09-22T09:55:01.340004+0000","last_clean":"2024-09-22T09:55:01.340004+0000","last_became_active":"2024-09-22T08:57:04.398922+0000","last_became_peered":"2024-09-22T08:57:04.398922+0000","last_unstale":"2024-09-22T09:55:01.340004+0000","last_undegraded":"2024-09-22T09:55:01.340004+0000","last_fullsized":"2024-09-22T09:55:01.340004+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'63","last_scrub_stamp":"2024-09-22T09:55:01.339847+0000","last_deep_scrub":"262'63","last_deep_scrub_stamp":"2024-09-22T09:55:01.339847+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.339847+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:31.790761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":507,"num_read_kb":346,"num_write":164,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:17.662659+0000","last_change":"2024-09-22T09:55:17.662659+0000","last_active":"2024-09-22T09:55:17.662659+0000","last_peered":"2024-09-22T09:55:17.662659+0000","last_clean":"2024-09-22T09:55:17.662659+0000","last_became_active":"2024-09-22T09:20:12.873668+0000","last_became_peered":"2024-09-22T09:20:12.873668+0000","last_unstale":"2024-09-22T09:55:17.662659+0000","last_undegraded":"2024-09-22T09:55:17.662659+0000","last_fullsized":"2024-09-22T09:55:17.662659+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:17.662566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:17.662566+0000","last_clean_scrub_stamp":"2024-09-22T09:55:17.662566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:33:01.810348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"259'3","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:18.710365+0000","last_change":"2024-09-22T09:55:18.710365+0000","last_active":"2024-09-22T09:55:18.710365+0000","last_peered":"2024-09-22T09:55:18.710365+0000","last_clean":"2024-09-22T09:55:18.710365+0000","last_became_active":"2024-09-22T09:01:11.519683+0000","last_became_peered":"2024-09-22T09:01:11.519683+0000","last_unstale":"2024-09-22T09:55:18.710365+0000","last_undegraded":"2024-09-22T09:55:18.710365+0000","last_fullsized":"2024-09-22T09:55:18.710365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:55:18.710256+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:55:18.710256+0000","last_clean_scrub_stamp":"2024-09-22T09:55:18.710256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:27:16.439872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.337960+0000","last_change":"2024-09-22T09:55:16.337960+0000","last_active":"2024-09-22T09:55:16.337960+0000","last_peered":"2024-09-22T09:55:16.337960+0000","last_clean":"2024-09-22T09:55:16.337960+0000","last_became_active":"2024-09-22T09:01:07.464951+0000","last_became_peered":"2024-09-22T09:01:07.464951+0000","last_unstale":"2024-09-22T09:55:16.337960+0000","last_undegraded":"2024-09-22T09:55:16.337960+0000","last_fullsized":"2024-09-22T09:55:16.337960+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:55:16.337858+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:55:16.337858+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.337858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:32:08.285786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"262'25","reported_seq":136,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.177622+0000","last_change":"2024-09-22T09:54:50.177569+0000","last_active":"2024-09-22T09:54:50.177622+0000","last_peered":"2024-09-22T09:54:50.177622+0000","last_clean":"2024-09-22T09:54:50.177622+0000","last_became_active":"2024-09-22T08:57:04.399799+0000","last_became_peered":"2024-09-22T08:57:04.399799+0000","last_unstale":"2024-09-22T09:54:50.177622+0000","last_undegraded":"2024-09-22T09:54:50.177622+0000","last_fullsized":"2024-09-22T09:54:50.177622+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'25","last_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_deep_scrub":"262'25","last_deep_scrub_stamp":"2024-09-22T09:54:50.177482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.177482+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:53:53.841646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":63,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.377245+0000","last_change":"2024-09-22T09:55:01.377182+0000","last_active":"2024-09-22T09:55:01.377245+0000","last_peered":"2024-09-22T09:55:01.377245+0000","last_clean":"2024-09-22T09:55:01.377245+0000","last_became_active":"2024-09-22T09:20:12.868573+0000","last_became_peered":"2024-09-22T09:20:12.868573+0000","last_unstale":"2024-09-22T09:55:01.377245+0000","last_undegraded":"2024-09-22T09:55:01.377245+0000","last_fullsized":"2024-09-22T09:55:01.377245+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:01.377097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:01.377097+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.377097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:18:02.041936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"259'8","reported_seq":69,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:17.692746+0000","last_change":"2024-09-22T09:55:17.692746+0000","last_active":"2024-09-22T09:55:17.692746+0000","last_peered":"2024-09-22T09:55:17.692746+0000","last_clean":"2024-09-22T09:55:17.692746+0000","last_became_active":"2024-09-22T09:01:11.521029+0000","last_became_peered":"2024-09-22T09:01:11.521029+0000","last_unstale":"2024-09-22T09:55:17.692746+0000","last_undegraded":"2024-09-22T09:55:17.692746+0000","last_fullsized":"2024-09-22T09:55:17.692746+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'8","last_scrub_stamp":"2024-09-22T09:55:17.692633+0000","last_deep_scrub":"259'8","last_deep_scrub_stamp":"2024-09-22T09:55:17.692633+0000","last_clean_scrub_stamp":"2024-09-22T09:55:17.692633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:32.343821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'3","reported_seq":65,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.294492+0000","last_change":"2024-09-22T09:55:01.294492+0000","last_active":"2024-09-22T09:55:01.294492+0000","last_peered":"2024-09-22T09:55:01.294492+0000","last_clean":"2024-09-22T09:55:01.294492+0000","last_became_active":"2024-09-22T09:01:07.458165+0000","last_became_peered":"2024-09-22T09:01:07.458165+0000","last_unstale":"2024-09-22T09:55:01.294492+0000","last_undegraded":"2024-09-22T09:55:01.294492+0000","last_fullsized":"2024-09-22T09:55:01.294492+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:01.294365+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:01.294365+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.294365+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:27:07.313318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"262'9","reported_seq":89,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.288712+0000","last_change":"2024-09-22T09:55:05.288619+0000","last_active":"2024-09-22T09:55:05.288712+0000","last_peered":"2024-09-22T09:55:05.288712+0000","last_clean":"2024-09-22T09:55:05.288712+0000","last_became_active":"2024-09-22T08:57:04.403402+0000","last_became_peered":"2024-09-22T08:57:04.403402+0000","last_unstale":"2024-09-22T09:55:05.288712+0000","last_undegraded":"2024-09-22T09:55:05.288712+0000","last_fullsized":"2024-09-22T09:55:05.288712+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:05.288488+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:05.288488+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.288488+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:19.865310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.623732+0000","last_change":"2024-09-22T09:54:49.623648+0000","last_active":"2024-09-22T09:54:49.623732+0000","last_peered":"2024-09-22T09:54:49.623732+0000","last_clean":"2024-09-22T09:54:49.623732+0000","last_became_active":"2024-09-22T09:20:12.860806+0000","last_became_peered":"2024-09-22T09:20:12.860806+0000","last_unstale":"2024-09-22T09:54:49.623732+0000","last_undegraded":"2024-09-22T09:54:49.623732+0000","last_fullsized":"2024-09-22T09:54:49.623732+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:49.623509+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.623509+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:10.004394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"262'3","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:16.670462+0000","last_change":"2024-09-22T09:55:16.670462+0000","last_active":"2024-09-22T09:55:16.670462+0000","last_peered":"2024-09-22T09:55:16.670462+0000","last_clean":"2024-09-22T09:55:16.670462+0000","last_became_active":"2024-09-22T09:01:11.518817+0000","last_became_peered":"2024-09-22T09:01:11.518817+0000","last_unstale":"2024-09-22T09:55:16.670462+0000","last_undegraded":"2024-09-22T09:55:16.670462+0000","last_fullsized":"2024-09-22T09:55:16.670462+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:16.670372+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:16.670372+0000","last_clean_scrub_stamp":"2024-09-22T09:55:16.670372+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:48.008633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'3","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.668017+0000","last_change":"2024-09-22T09:55:06.668017+0000","last_active":"2024-09-22T09:55:06.668017+0000","last_peered":"2024-09-22T09:55:06.668017+0000","last_clean":"2024-09-22T09:55:06.668017+0000","last_became_active":"2024-09-22T09:01:07.459277+0000","last_became_peered":"2024-09-22T09:01:07.459277+0000","last_unstale":"2024-09-22T09:55:06.668017+0000","last_undegraded":"2024-09-22T09:55:06.668017+0000","last_fullsized":"2024-09-22T09:55:06.668017+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:06.667915+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:06.667915+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.667915+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:43.559548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"262'13","reported_seq":106,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.769578+0000","last_change":"2024-09-22T09:55:06.769526+0000","last_active":"2024-09-22T09:55:06.769578+0000","last_peered":"2024-09-22T09:55:06.769578+0000","last_clean":"2024-09-22T09:55:06.769578+0000","last_became_active":"2024-09-22T08:57:04.403505+0000","last_became_peered":"2024-09-22T08:57:04.403505+0000","last_unstale":"2024-09-22T09:55:06.769578+0000","last_undegraded":"2024-09-22T09:55:06.769578+0000","last_fullsized":"2024-09-22T09:55:06.769578+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'13","last_scrub_stamp":"2024-09-22T09:55:06.769446+0000","last_deep_scrub":"262'13","last_deep_scrub_stamp":"2024-09-22T09:55:06.769446+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.769446+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:29.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":77,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.604877+0000","last_change":"2024-09-22T09:55:15.604877+0000","last_active":"2024-09-22T09:55:15.604877+0000","last_peered":"2024-09-22T09:55:15.604877+0000","last_clean":"2024-09-22T09:55:15.604877+0000","last_became_active":"2024-09-22T09:20:12.867799+0000","last_became_peered":"2024-09-22T09:20:12.867799+0000","last_unstale":"2024-09-22T09:55:15.604877+0000","last_undegraded":"2024-09-22T09:55:15.604877+0000","last_fullsized":"2024-09-22T09:55:15.604877+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.604790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.604790+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.604790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:15.463409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"259'5","reported_seq":68,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:19.668061+0000","last_change":"2024-09-22T09:55:19.668061+0000","last_active":"2024-09-22T09:55:19.668061+0000","last_peered":"2024-09-22T09:55:19.668061+0000","last_clean":"2024-09-22T09:55:19.668061+0000","last_became_active":"2024-09-22T09:01:11.518043+0000","last_became_peered":"2024-09-22T09:01:11.518043+0000","last_unstale":"2024-09-22T09:55:19.668061+0000","last_undegraded":"2024-09-22T09:55:19.668061+0000","last_fullsized":"2024-09-22T09:55:19.668061+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-22T09:55:19.667962+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-22T09:55:19.667962+0000","last_clean_scrub_stamp":"2024-09-22T09:55:19.667962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:19:56.981629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"262'6","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.619628+0000","last_change":"2024-09-22T09:54:45.619628+0000","last_active":"2024-09-22T09:54:45.619628+0000","last_peered":"2024-09-22T09:54:45.619628+0000","last_clean":"2024-09-22T09:54:45.619628+0000","last_became_active":"2024-09-22T09:01:07.465080+0000","last_became_peered":"2024-09-22T09:01:07.465080+0000","last_unstale":"2024-09-22T09:54:45.619628+0000","last_undegraded":"2024-09-22T09:54:45.619628+0000","last_fullsized":"2024-09-22T09:54:45.619628+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:45.619539+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.619539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:34:11.272533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"262'36","reported_seq":165,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.626578+0000","last_change":"2024-09-22T09:54:41.626473+0000","last_active":"2024-09-22T09:54:41.626578+0000","last_peered":"2024-09-22T09:54:41.626578+0000","last_clean":"2024-09-22T09:54:41.626578+0000","last_became_active":"2024-09-22T08:57:04.397575+0000","last_became_peered":"2024-09-22T08:57:04.397575+0000","last_unstale":"2024-09-22T09:54:41.626578+0000","last_undegraded":"2024-09-22T09:54:41.626578+0000","last_fullsized":"2024-09-22T09:54:41.626578+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'36","last_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_deep_scrub":"262'36","last_deep_scrub_stamp":"2024-09-22T09:54:41.626373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.626373+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:45.919725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":169,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.277450+0000","last_change":"2024-09-22T09:55:06.277388+0000","last_active":"2024-09-22T09:55:06.277450+0000","last_peered":"2024-09-22T09:55:06.277450+0000","last_clean":"2024-09-22T09:55:06.277450+0000","last_became_active":"2024-09-22T09:20:12.870905+0000","last_became_peered":"2024-09-22T09:20:12.870905+0000","last_unstale":"2024-09-22T09:55:06.277450+0000","last_undegraded":"2024-09-22T09:55:06.277450+0000","last_fullsized":"2024-09-22T09:55:06.277450+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:06.277298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:06.277298+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.277298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:08:26.628164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":53,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.647121+0000","last_change":"2024-09-22T09:55:05.647121+0000","last_active":"2024-09-22T09:55:05.647121+0000","last_peered":"2024-09-22T09:55:05.647121+0000","last_clean":"2024-09-22T09:55:05.647121+0000","last_became_active":"2024-09-22T09:01:11.510753+0000","last_became_peered":"2024-09-22T09:01:11.510753+0000","last_unstale":"2024-09-22T09:55:05.647121+0000","last_undegraded":"2024-09-22T09:55:05.647121+0000","last_fullsized":"2024-09-22T09:55:05.647121+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.647031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.647031+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.647031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:55:53.229021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'3","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.268332+0000","last_change":"2024-09-22T09:55:10.268332+0000","last_active":"2024-09-22T09:55:10.268332+0000","last_peered":"2024-09-22T09:55:10.268332+0000","last_clean":"2024-09-22T09:55:10.268332+0000","last_became_active":"2024-09-22T09:01:07.466379+0000","last_became_peered":"2024-09-22T09:01:07.466379+0000","last_unstale":"2024-09-22T09:55:10.268332+0000","last_undegraded":"2024-09-22T09:55:10.268332+0000","last_fullsized":"2024-09-22T09:55:10.268332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:10.268246+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:10.268246+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.268246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:24.677753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'21","reported_seq":125,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.570173+0000","last_change":"2024-09-22T09:54:59.570076+0000","last_active":"2024-09-22T09:54:59.570173+0000","last_peered":"2024-09-22T09:54:59.570173+0000","last_clean":"2024-09-22T09:54:59.570173+0000","last_became_active":"2024-09-22T08:57:04.398220+0000","last_became_peered":"2024-09-22T08:57:04.398220+0000","last_unstale":"2024-09-22T09:54:59.570173+0000","last_undegraded":"2024-09-22T09:54:59.570173+0000","last_fullsized":"2024-09-22T09:54:59.570173+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-22T09:54:59.569984+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-22T09:54:59.569984+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.569984+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:47.447204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":114,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:24.575079+0000","last_change":"2024-09-22T09:55:24.575079+0000","last_active":"2024-09-22T09:55:24.575079+0000","last_peered":"2024-09-22T09:55:24.575079+0000","last_clean":"2024-09-22T09:55:24.575079+0000","last_became_active":"2024-09-22T09:20:12.870187+0000","last_became_peered":"2024-09-22T09:20:12.870187+0000","last_unstale":"2024-09-22T09:55:24.575079+0000","last_undegraded":"2024-09-22T09:55:24.575079+0000","last_fullsized":"2024-09-22T09:55:24.575079+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:24.574980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:24.574980+0000","last_clean_scrub_stamp":"2024-09-22T09:55:24.574980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:59.616574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.321513+0000","last_change":"2024-09-22T09:54:59.321513+0000","last_active":"2024-09-22T09:54:59.321513+0000","last_peered":"2024-09-22T09:54:59.321513+0000","last_clean":"2024-09-22T09:54:59.321513+0000","last_became_active":"2024-09-22T09:01:11.517534+0000","last_became_peered":"2024-09-22T09:01:11.517534+0000","last_unstale":"2024-09-22T09:54:59.321513+0000","last_undegraded":"2024-09-22T09:54:59.321513+0000","last_fullsized":"2024-09-22T09:54:59.321513+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.321425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.321425+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.321425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:40.029186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.678602+0000","last_change":"2024-09-22T09:54:59.678602+0000","last_active":"2024-09-22T09:54:59.678602+0000","last_peered":"2024-09-22T09:54:59.678602+0000","last_clean":"2024-09-22T09:54:59.678602+0000","last_became_active":"2024-09-22T09:01:07.453284+0000","last_became_peered":"2024-09-22T09:01:07.453284+0000","last_unstale":"2024-09-22T09:54:59.678602+0000","last_undegraded":"2024-09-22T09:54:59.678602+0000","last_fullsized":"2024-09-22T09:54:59.678602+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:59.678522+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:59.678522+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.678522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:45.522871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"262'33","reported_seq":152,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.539903+0000","last_change":"2024-09-22T09:54:58.539835+0000","last_active":"2024-09-22T09:54:58.539903+0000","last_peered":"2024-09-22T09:54:58.539903+0000","last_clean":"2024-09-22T09:54:58.539903+0000","last_became_active":"2024-09-22T08:57:04.395536+0000","last_became_peered":"2024-09-22T08:57:04.395536+0000","last_unstale":"2024-09-22T09:54:58.539903+0000","last_undegraded":"2024-09-22T09:54:58.539903+0000","last_fullsized":"2024-09-22T09:54:58.539903+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'33","last_scrub_stamp":"2024-09-22T09:54:58.539747+0000","last_deep_scrub":"262'33","last_deep_scrub_stamp":"2024-09-22T09:54:58.539747+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.539747+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:34.870059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":159,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":35,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:19.383722+0000","last_change":"2024-09-22T09:55:19.383722+0000","last_active":"2024-09-22T09:55:19.383722+0000","last_peered":"2024-09-22T09:55:19.383722+0000","last_clean":"2024-09-22T09:55:19.383722+0000","last_became_active":"2024-09-22T09:20:12.876944+0000","last_became_peered":"2024-09-22T09:20:12.876944+0000","last_unstale":"2024-09-22T09:55:19.383722+0000","last_undegraded":"2024-09-22T09:55:19.383722+0000","last_fullsized":"2024-09-22T09:55:19.383722+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:19.383628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:19.383628+0000","last_clean_scrub_stamp":"2024-09-22T09:55:19.383628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:30:44.111442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.293206+0000","last_change":"2024-09-22T09:54:58.293206+0000","last_active":"2024-09-22T09:54:58.293206+0000","last_peered":"2024-09-22T09:54:58.293206+0000","last_clean":"2024-09-22T09:54:58.293206+0000","last_became_active":"2024-09-22T09:01:11.513639+0000","last_became_peered":"2024-09-22T09:01:11.513639+0000","last_unstale":"2024-09-22T09:54:58.293206+0000","last_undegraded":"2024-09-22T09:54:58.293206+0000","last_fullsized":"2024-09-22T09:54:58.293206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:58.293096+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:58.293096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.293096+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:38.665602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":60,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.751876+0000","last_change":"2024-09-22T09:55:09.751876+0000","last_active":"2024-09-22T09:55:09.751876+0000","last_peered":"2024-09-22T09:55:09.751876+0000","last_clean":"2024-09-22T09:55:09.751876+0000","last_became_active":"2024-09-22T09:01:07.462544+0000","last_became_peered":"2024-09-22T09:01:07.462544+0000","last_unstale":"2024-09-22T09:55:09.751876+0000","last_undegraded":"2024-09-22T09:55:09.751876+0000","last_fullsized":"2024-09-22T09:55:09.751876+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.751763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.751763+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.751763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:02.086449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'47","reported_seq":194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.307379+0000","last_change":"2024-09-22T09:54:58.307311+0000","last_active":"2024-09-22T09:54:58.307379+0000","last_peered":"2024-09-22T09:54:58.307379+0000","last_clean":"2024-09-22T09:54:58.307379+0000","last_became_active":"2024-09-22T08:57:04.400352+0000","last_became_peered":"2024-09-22T08:57:04.400352+0000","last_unstale":"2024-09-22T09:54:58.307379+0000","last_undegraded":"2024-09-22T09:54:58.307379+0000","last_fullsized":"2024-09-22T09:54:58.307379+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'47","last_scrub_stamp":"2024-09-22T09:54:58.307221+0000","last_deep_scrub":"262'47","last_deep_scrub_stamp":"2024-09-22T09:54:58.307221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.307221+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:12:53.602519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":115,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:18.343640+0000","last_change":"2024-09-22T09:55:18.343640+0000","last_active":"2024-09-22T09:55:18.343640+0000","last_peered":"2024-09-22T09:55:18.343640+0000","last_clean":"2024-09-22T09:55:18.343640+0000","last_became_active":"2024-09-22T09:20:12.876006+0000","last_became_peered":"2024-09-22T09:20:12.876006+0000","last_unstale":"2024-09-22T09:55:18.343640+0000","last_undegraded":"2024-09-22T09:55:18.343640+0000","last_fullsized":"2024-09-22T09:55:18.343640+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:18.343557+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:18.343557+0000","last_clean_scrub_stamp":"2024-09-22T09:55:18.343557+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:17.381717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":54,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.623610+0000","last_change":"2024-09-22T09:55:15.623610+0000","last_active":"2024-09-22T09:55:15.623610+0000","last_peered":"2024-09-22T09:55:15.623610+0000","last_clean":"2024-09-22T09:55:15.623610+0000","last_became_active":"2024-09-22T09:01:11.518140+0000","last_became_peered":"2024-09-22T09:01:11.518140+0000","last_unstale":"2024-09-22T09:55:15.623610+0000","last_undegraded":"2024-09-22T09:55:15.623610+0000","last_fullsized":"2024-09-22T09:55:15.623610+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.623519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.623519+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.623519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:40.661986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"259'3","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.085415+0000","last_change":"2024-09-22T09:54:52.085415+0000","last_active":"2024-09-22T09:54:52.085415+0000","last_peered":"2024-09-22T09:54:52.085415+0000","last_clean":"2024-09-22T09:54:52.085415+0000","last_became_active":"2024-09-22T09:01:07.462875+0000","last_became_peered":"2024-09-22T09:01:07.462875+0000","last_unstale":"2024-09-22T09:54:52.085415+0000","last_undegraded":"2024-09-22T09:54:52.085415+0000","last_fullsized":"2024-09-22T09:54:52.085415+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:52.085329+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.085329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:22:05.365422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"262'51","reported_seq":213,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.642374+0000","last_change":"2024-09-22T09:54:57.642309+0000","last_active":"2024-09-22T09:54:57.642374+0000","last_peered":"2024-09-22T09:54:57.642374+0000","last_clean":"2024-09-22T09:54:57.642374+0000","last_became_active":"2024-09-22T08:57:04.399626+0000","last_became_peered":"2024-09-22T08:57:04.399626+0000","last_unstale":"2024-09-22T09:54:57.642374+0000","last_undegraded":"2024-09-22T09:54:57.642374+0000","last_fullsized":"2024-09-22T09:54:57.642374+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'51","last_scrub_stamp":"2024-09-22T09:54:57.642220+0000","last_deep_scrub":"262'51","last_deep_scrub_stamp":"2024-09-22T09:54:57.642220+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.642220+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:25:56.012954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":307,"num_write":121,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"262'2","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:20.664672+0000","last_change":"2024-09-22T09:55:20.664672+0000","last_active":"2024-09-22T09:55:20.664672+0000","last_peered":"2024-09-22T09:55:20.664672+0000","last_clean":"2024-09-22T09:55:20.664672+0000","last_became_active":"2024-09-22T09:20:12.869939+0000","last_became_peered":"2024-09-22T09:20:12.869939+0000","last_unstale":"2024-09-22T09:55:20.664672+0000","last_undegraded":"2024-09-22T09:55:20.664672+0000","last_fullsized":"2024-09-22T09:55:20.664672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:20.664585+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:20.664585+0000","last_clean_scrub_stamp":"2024-09-22T09:55:20.664585+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:34.527721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"262'5","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.100718+0000","last_change":"2024-09-22T09:54:56.100718+0000","last_active":"2024-09-22T09:54:56.100718+0000","last_peered":"2024-09-22T09:54:56.100718+0000","last_clean":"2024-09-22T09:54:56.100718+0000","last_became_active":"2024-09-22T09:01:11.517025+0000","last_became_peered":"2024-09-22T09:01:11.517025+0000","last_unstale":"2024-09-22T09:54:56.100718+0000","last_undegraded":"2024-09-22T09:54:56.100718+0000","last_fullsized":"2024-09-22T09:54:56.100718+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:56.100608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.100608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:59:54.172117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"262'10","reported_seq":81,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.336348+0000","last_change":"2024-09-22T09:55:00.336348+0000","last_active":"2024-09-22T09:55:00.336348+0000","last_peered":"2024-09-22T09:55:00.336348+0000","last_clean":"2024-09-22T09:55:00.336348+0000","last_became_active":"2024-09-22T09:01:07.462745+0000","last_became_peered":"2024-09-22T09:01:07.462745+0000","last_unstale":"2024-09-22T09:55:00.336348+0000","last_undegraded":"2024-09-22T09:55:00.336348+0000","last_fullsized":"2024-09-22T09:55:00.336348+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-22T09:55:00.336266+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-22T09:55:00.336266+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.336266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:22:55.102546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16386,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'46","reported_seq":194,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.760782+0000","last_change":"2024-09-22T09:55:05.760681+0000","last_active":"2024-09-22T09:55:05.760782+0000","last_peered":"2024-09-22T09:55:05.760782+0000","last_clean":"2024-09-22T09:55:05.760782+0000","last_became_active":"2024-09-22T08:57:04.398081+0000","last_became_peered":"2024-09-22T08:57:04.398081+0000","last_unstale":"2024-09-22T09:55:05.760782+0000","last_undegraded":"2024-09-22T09:55:05.760782+0000","last_fullsized":"2024-09-22T09:55:05.760782+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'46","last_scrub_stamp":"2024-09-22T09:55:05.760577+0000","last_deep_scrub":"262'46","last_deep_scrub_stamp":"2024-09-22T09:55:05.760577+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.760577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:26:30.637051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":234,"num_write":117,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.611829+0000","last_change":"2024-09-22T09:54:48.611757+0000","last_active":"2024-09-22T09:54:48.611829+0000","last_peered":"2024-09-22T09:54:48.611829+0000","last_clean":"2024-09-22T09:54:48.611829+0000","last_became_active":"2024-09-22T09:20:12.858240+0000","last_became_peered":"2024-09-22T09:20:12.858240+0000","last_unstale":"2024-09-22T09:54:48.611829+0000","last_undegraded":"2024-09-22T09:54:48.611829+0000","last_fullsized":"2024-09-22T09:54:48.611829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.611658+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.611658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:25:49.681099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"259'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.669572+0000","last_change":"2024-09-22T09:55:14.669572+0000","last_active":"2024-09-22T09:55:14.669572+0000","last_peered":"2024-09-22T09:55:14.669572+0000","last_clean":"2024-09-22T09:55:14.669572+0000","last_became_active":"2024-09-22T09:01:11.518282+0000","last_became_peered":"2024-09-22T09:01:11.518282+0000","last_unstale":"2024-09-22T09:55:14.669572+0000","last_undegraded":"2024-09-22T09:55:14.669572+0000","last_fullsized":"2024-09-22T09:55:14.669572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:55:14.669474+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:55:14.669474+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.669474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:01:13.017990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.619158+0000","last_change":"2024-09-22T09:55:04.619103+0000","last_active":"2024-09-22T09:55:04.619158+0000","last_peered":"2024-09-22T09:55:04.619158+0000","last_clean":"2024-09-22T09:55:04.619158+0000","last_became_active":"2024-09-22T09:01:07.464615+0000","last_became_peered":"2024-09-22T09:01:07.464615+0000","last_unstale":"2024-09-22T09:55:04.619158+0000","last_undegraded":"2024-09-22T09:55:04.619158+0000","last_fullsized":"2024-09-22T09:55:04.619158+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.618987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.618987+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.618987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:17:32.215926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"262'71","reported_seq":263,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.720070+0000","last_change":"2024-09-22T09:55:10.720070+0000","last_active":"2024-09-22T09:55:10.720070+0000","last_peered":"2024-09-22T09:55:10.720070+0000","last_clean":"2024-09-22T09:55:10.720070+0000","last_became_active":"2024-09-22T08:57:04.406269+0000","last_became_peered":"2024-09-22T08:57:04.406269+0000","last_unstale":"2024-09-22T09:55:10.720070+0000","last_undegraded":"2024-09-22T09:55:10.720070+0000","last_fullsized":"2024-09-22T09:55:10.720070+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'71","last_scrub_stamp":"2024-09-22T09:55:10.719971+0000","last_deep_scrub":"262'71","last_deep_scrub_stamp":"2024-09-22T09:55:10.719971+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.719971+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:33:03.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":599,"num_read_kb":401,"num_write":168,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:10.645771+0000","last_change":"2024-09-22T09:55:10.645771+0000","last_active":"2024-09-22T09:55:10.645771+0000","last_peered":"2024-09-22T09:55:10.645771+0000","last_clean":"2024-09-22T09:55:10.645771+0000","last_became_active":"2024-09-22T09:20:12.872813+0000","last_became_peered":"2024-09-22T09:20:12.872813+0000","last_unstale":"2024-09-22T09:55:10.645771+0000","last_undegraded":"2024-09-22T09:55:10.645771+0000","last_fullsized":"2024-09-22T09:55:10.645771+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:10.645678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:10.645678+0000","last_clean_scrub_stamp":"2024-09-22T09:55:10.645678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:43:56.114444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.702586+0000","last_change":"2024-09-22T09:55:12.702586+0000","last_active":"2024-09-22T09:55:12.702586+0000","last_peered":"2024-09-22T09:55:12.702586+0000","last_clean":"2024-09-22T09:55:12.702586+0000","last_became_active":"2024-09-22T09:01:11.519638+0000","last_became_peered":"2024-09-22T09:01:11.519638+0000","last_unstale":"2024-09-22T09:55:12.702586+0000","last_undegraded":"2024-09-22T09:55:12.702586+0000","last_fullsized":"2024-09-22T09:55:12.702586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:12.702491+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:12.702491+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.702491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:45:33.715570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.590107+0000","last_change":"2024-09-22T09:54:44.590009+0000","last_active":"2024-09-22T09:54:44.590107+0000","last_peered":"2024-09-22T09:54:44.590107+0000","last_clean":"2024-09-22T09:54:44.590107+0000","last_became_active":"2024-09-22T09:01:07.463965+0000","last_became_peered":"2024-09-22T09:01:07.463965+0000","last_unstale":"2024-09-22T09:54:44.590107+0000","last_undegraded":"2024-09-22T09:54:44.590107+0000","last_fullsized":"2024-09-22T09:54:44.590107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.589913+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.589913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:52:27.637824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'16","reported_seq":114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.352926+0000","last_change":"2024-09-22T09:54:57.352830+0000","last_active":"2024-09-22T09:54:57.352926+0000","last_peered":"2024-09-22T09:54:57.352926+0000","last_clean":"2024-09-22T09:54:57.352926+0000","last_became_active":"2024-09-22T08:57:04.396237+0000","last_became_peered":"2024-09-22T08:57:04.396237+0000","last_unstale":"2024-09-22T09:54:57.352926+0000","last_undegraded":"2024-09-22T09:54:57.352926+0000","last_fullsized":"2024-09-22T09:54:57.352926+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-22T09:54:57.352681+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.352681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:17.910423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":95,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.060130+0000","last_change":"2024-09-22T09:54:57.060130+0000","last_active":"2024-09-22T09:54:57.060130+0000","last_peered":"2024-09-22T09:54:57.060130+0000","last_clean":"2024-09-22T09:54:57.060130+0000","last_became_active":"2024-09-22T09:20:12.868844+0000","last_became_peered":"2024-09-22T09:20:12.868844+0000","last_unstale":"2024-09-22T09:54:57.060130+0000","last_undegraded":"2024-09-22T09:54:57.060130+0000","last_fullsized":"2024-09-22T09:54:57.060130+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:57.060009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.060009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:37:35.936019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'8","reported_seq":66,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.261511+0000","last_change":"2024-09-22T09:54:57.261452+0000","last_active":"2024-09-22T09:54:57.261511+0000","last_peered":"2024-09-22T09:54:57.261511+0000","last_clean":"2024-09-22T09:54:57.261511+0000","last_became_active":"2024-09-22T09:01:11.518446+0000","last_became_peered":"2024-09-22T09:01:11.518446+0000","last_unstale":"2024-09-22T09:54:57.261511+0000","last_undegraded":"2024-09-22T09:54:57.261511+0000","last_fullsized":"2024-09-22T09:54:57.261511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:57.261350+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.261350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:48:28.814513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6192,"num_write":13,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.309762+0000","last_change":"2024-09-22T09:55:08.309762+0000","last_active":"2024-09-22T09:55:08.309762+0000","last_peered":"2024-09-22T09:55:08.309762+0000","last_clean":"2024-09-22T09:55:08.309762+0000","last_became_active":"2024-09-22T09:01:07.462471+0000","last_became_peered":"2024-09-22T09:01:07.462471+0000","last_unstale":"2024-09-22T09:55:08.309762+0000","last_undegraded":"2024-09-22T09:55:08.309762+0000","last_fullsized":"2024-09-22T09:55:08.309762+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:55:08.309660+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:55:08.309660+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.309660+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:33.849852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"259'7","reported_seq":90,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.080469+0000","last_change":"2024-09-22T09:54:50.080377+0000","last_active":"2024-09-22T09:54:50.080469+0000","last_peered":"2024-09-22T09:54:50.080469+0000","last_clean":"2024-09-22T09:54:50.080469+0000","last_became_active":"2024-09-22T08:57:04.395583+0000","last_became_peered":"2024-09-22T08:57:04.395583+0000","last_unstale":"2024-09-22T09:54:50.080469+0000","last_undegraded":"2024-09-22T09:54:50.080469+0000","last_fullsized":"2024-09-22T09:54:50.080469+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'7","last_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_deep_scrub":"259'7","last_deep_scrub_stamp":"2024-09-22T09:54:50.080269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.080269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:27:02.040573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.618885+0000","last_change":"2024-09-22T09:55:12.618885+0000","last_active":"2024-09-22T09:55:12.618885+0000","last_peered":"2024-09-22T09:55:12.618885+0000","last_clean":"2024-09-22T09:55:12.618885+0000","last_became_active":"2024-09-22T09:20:12.874427+0000","last_became_peered":"2024-09-22T09:20:12.874427+0000","last_unstale":"2024-09-22T09:55:12.618885+0000","last_undegraded":"2024-09-22T09:55:12.618885+0000","last_fullsized":"2024-09-22T09:55:12.618885+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:12.618799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:12.618799+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.618799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:01:35.106983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":55,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.715841+0000","last_change":"2024-09-22T09:55:13.715841+0000","last_active":"2024-09-22T09:55:13.715841+0000","last_peered":"2024-09-22T09:55:13.715841+0000","last_clean":"2024-09-22T09:55:13.715841+0000","last_became_active":"2024-09-22T09:01:11.511954+0000","last_became_peered":"2024-09-22T09:01:11.511954+0000","last_unstale":"2024-09-22T09:55:13.715841+0000","last_undegraded":"2024-09-22T09:55:13.715841+0000","last_fullsized":"2024-09-22T09:55:13.715841+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:13.715721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:13.715721+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.715721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:19:30.784820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'2","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.164412+0000","last_change":"2024-09-22T09:54:53.164358+0000","last_active":"2024-09-22T09:54:53.164412+0000","last_peered":"2024-09-22T09:54:53.164412+0000","last_clean":"2024-09-22T09:54:53.164412+0000","last_became_active":"2024-09-22T09:01:07.463602+0000","last_became_peered":"2024-09-22T09:01:07.463602+0000","last_unstale":"2024-09-22T09:54:53.164412+0000","last_undegraded":"2024-09-22T09:54:53.164412+0000","last_fullsized":"2024-09-22T09:54:53.164412+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:53.164249+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.164249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:06:04.104785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'26","reported_seq":133,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.589505+0000","last_change":"2024-09-22T09:54:40.589417+0000","last_active":"2024-09-22T09:54:40.589505+0000","last_peered":"2024-09-22T09:54:40.589505+0000","last_clean":"2024-09-22T09:54:40.589505+0000","last_became_active":"2024-09-22T08:57:04.397062+0000","last_became_peered":"2024-09-22T08:57:04.397062+0000","last_unstale":"2024-09-22T09:54:40.589505+0000","last_undegraded":"2024-09-22T09:54:40.589505+0000","last_fullsized":"2024-09-22T09:54:40.589505+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'26","last_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_deep_scrub":"262'26","last_deep_scrub_stamp":"2024-09-22T09:54:40.589282+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.589282+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:15.376697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":104,"num_write":85,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:23.604706+0000","last_change":"2024-09-22T09:55:23.604706+0000","last_active":"2024-09-22T09:55:23.604706+0000","last_peered":"2024-09-22T09:55:23.604706+0000","last_clean":"2024-09-22T09:55:23.604706+0000","last_became_active":"2024-09-22T09:20:12.868973+0000","last_became_peered":"2024-09-22T09:20:12.868973+0000","last_unstale":"2024-09-22T09:55:23.604706+0000","last_undegraded":"2024-09-22T09:55:23.604706+0000","last_fullsized":"2024-09-22T09:55:23.604706+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:23.604641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:23.604641+0000","last_clean_scrub_stamp":"2024-09-22T09:55:23.604641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:01:49.316790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'9","reported_seq":73,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:06.687681+0000","last_change":"2024-09-22T09:55:06.687612+0000","last_active":"2024-09-22T09:55:06.687681+0000","last_peered":"2024-09-22T09:55:06.687681+0000","last_clean":"2024-09-22T09:55:06.687681+0000","last_became_active":"2024-09-22T09:01:11.514626+0000","last_became_peered":"2024-09-22T09:01:11.514626+0000","last_unstale":"2024-09-22T09:55:06.687681+0000","last_undegraded":"2024-09-22T09:55:06.687681+0000","last_fullsized":"2024-09-22T09:55:06.687681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'9","last_scrub_stamp":"2024-09-22T09:55:06.687524+0000","last_deep_scrub":"262'9","last_deep_scrub_stamp":"2024-09-22T09:55:06.687524+0000","last_clean_scrub_stamp":"2024-09-22T09:55:06.687524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:05.525768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.261280+0000","last_change":"2024-09-22T09:55:04.261218+0000","last_active":"2024-09-22T09:55:04.261280+0000","last_peered":"2024-09-22T09:55:04.261280+0000","last_clean":"2024-09-22T09:55:04.261280+0000","last_became_active":"2024-09-22T09:01:07.461744+0000","last_became_peered":"2024-09-22T09:01:07.461744+0000","last_unstale":"2024-09-22T09:55:04.261280+0000","last_undegraded":"2024-09-22T09:55:04.261280+0000","last_fullsized":"2024-09-22T09:55:04.261280+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.261125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.261125+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.261125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:32:28.099874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"262'23","reported_seq":131,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.291060+0000","last_change":"2024-09-22T09:54:57.290995+0000","last_active":"2024-09-22T09:54:57.291060+0000","last_peered":"2024-09-22T09:54:57.291060+0000","last_clean":"2024-09-22T09:54:57.291060+0000","last_became_active":"2024-09-22T08:57:04.405083+0000","last_became_peered":"2024-09-22T08:57:04.405083+0000","last_unstale":"2024-09-22T09:54:57.291060+0000","last_undegraded":"2024-09-22T09:54:57.291060+0000","last_fullsized":"2024-09-22T09:54:57.291060+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:57.290907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.290907+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:00:20.219111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:14.570846+0000","last_change":"2024-09-22T09:55:14.570846+0000","last_active":"2024-09-22T09:55:14.570846+0000","last_peered":"2024-09-22T09:55:14.570846+0000","last_clean":"2024-09-22T09:55:14.570846+0000","last_became_active":"2024-09-22T09:20:12.874372+0000","last_became_peered":"2024-09-22T09:20:12.874372+0000","last_unstale":"2024-09-22T09:55:14.570846+0000","last_undegraded":"2024-09-22T09:55:14.570846+0000","last_fullsized":"2024-09-22T09:55:14.570846+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:14.570759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:14.570759+0000","last_clean_scrub_stamp":"2024-09-22T09:55:14.570759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:40:05.905833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.709152+0000","last_change":"2024-09-22T09:55:07.709091+0000","last_active":"2024-09-22T09:55:07.709152+0000","last_peered":"2024-09-22T09:55:07.709152+0000","last_clean":"2024-09-22T09:55:07.709152+0000","last_became_active":"2024-09-22T09:01:11.520148+0000","last_became_peered":"2024-09-22T09:01:11.520148+0000","last_unstale":"2024-09-22T09:55:07.709152+0000","last_undegraded":"2024-09-22T09:55:07.709152+0000","last_fullsized":"2024-09-22T09:55:07.709152+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:07.709010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:07.709010+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.709010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:05:39.663076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'5","reported_seq":71,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.141743+0000","last_change":"2024-09-22T09:54:52.141650+0000","last_active":"2024-09-22T09:54:52.141743+0000","last_peered":"2024-09-22T09:54:52.141743+0000","last_clean":"2024-09-22T09:54:52.141743+0000","last_became_active":"2024-09-22T09:01:07.462319+0000","last_became_peered":"2024-09-22T09:01:07.462319+0000","last_unstale":"2024-09-22T09:54:52.141743+0000","last_undegraded":"2024-09-22T09:54:52.141743+0000","last_fullsized":"2024-09-22T09:54:52.141743+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:52.141552+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.141552+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:05.815167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"259'16","reported_seq":114,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.636984+0000","last_change":"2024-09-22T09:54:55.636984+0000","last_active":"2024-09-22T09:54:55.636984+0000","last_peered":"2024-09-22T09:54:55.636984+0000","last_clean":"2024-09-22T09:54:55.636984+0000","last_became_active":"2024-09-22T08:57:04.395524+0000","last_became_peered":"2024-09-22T08:57:04.395524+0000","last_unstale":"2024-09-22T09:54:55.636984+0000","last_undegraded":"2024-09-22T09:54:55.636984+0000","last_fullsized":"2024-09-22T09:54:55.636984+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'16","last_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_deep_scrub":"259'16","last_deep_scrub_stamp":"2024-09-22T09:54:55.636899+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.636899+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:11:23.577414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":82,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"262'2","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.589500+0000","last_change":"2024-09-22T09:55:13.589500+0000","last_active":"2024-09-22T09:55:13.589500+0000","last_peered":"2024-09-22T09:55:13.589500+0000","last_clean":"2024-09-22T09:55:13.589500+0000","last_became_active":"2024-09-22T09:20:12.870038+0000","last_became_peered":"2024-09-22T09:20:12.870038+0000","last_unstale":"2024-09-22T09:55:13.589500+0000","last_undegraded":"2024-09-22T09:55:13.589500+0000","last_fullsized":"2024-09-22T09:55:13.589500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:13.589417+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:13.589417+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.589417+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:04.333745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"259'3","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.214054+0000","last_change":"2024-09-22T09:54:56.213978+0000","last_active":"2024-09-22T09:54:56.214054+0000","last_peered":"2024-09-22T09:54:56.214054+0000","last_clean":"2024-09-22T09:54:56.214054+0000","last_became_active":"2024-09-22T09:01:11.516045+0000","last_became_peered":"2024-09-22T09:01:11.516045+0000","last_unstale":"2024-09-22T09:54:56.214054+0000","last_undegraded":"2024-09-22T09:54:56.214054+0000","last_fullsized":"2024-09-22T09:54:56.214054+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:54:56.213880+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.213880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:48:10.951353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"262'14","reported_seq":94,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:07.275434+0000","last_change":"2024-09-22T09:55:07.275345+0000","last_active":"2024-09-22T09:55:07.275434+0000","last_peered":"2024-09-22T09:55:07.275434+0000","last_clean":"2024-09-22T09:55:07.275434+0000","last_became_active":"2024-09-22T09:01:07.460913+0000","last_became_peered":"2024-09-22T09:01:07.460913+0000","last_unstale":"2024-09-22T09:55:07.275434+0000","last_undegraded":"2024-09-22T09:55:07.275434+0000","last_fullsized":"2024-09-22T09:55:07.275434+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'14","last_scrub_stamp":"2024-09-22T09:55:07.275221+0000","last_deep_scrub":"262'14","last_deep_scrub_stamp":"2024-09-22T09:55:07.275221+0000","last_clean_scrub_stamp":"2024-09-22T09:55:07.275221+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:59:19.440545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32770,"num_write":29,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"262'53","reported_seq":218,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.795522+0000","last_change":"2024-09-22T09:55:04.795465+0000","last_active":"2024-09-22T09:55:04.795522+0000","last_peered":"2024-09-22T09:55:04.795522+0000","last_clean":"2024-09-22T09:55:04.795522+0000","last_became_active":"2024-09-22T08:57:04.399960+0000","last_became_peered":"2024-09-22T08:57:04.399960+0000","last_unstale":"2024-09-22T09:55:04.795522+0000","last_undegraded":"2024-09-22T09:55:04.795522+0000","last_fullsized":"2024-09-22T09:55:04.795522+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'53","last_scrub_stamp":"2024-09-22T09:55:04.795364+0000","last_deep_scrub":"262'53","last_deep_scrub_stamp":"2024-09-22T09:55:04.795364+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.795364+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:28:06.070986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":322,"num_write":127,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.307279+0000","last_change":"2024-09-22T09:55:11.307279+0000","last_active":"2024-09-22T09:55:11.307279+0000","last_peered":"2024-09-22T09:55:11.307279+0000","last_clean":"2024-09-22T09:55:11.307279+0000","last_became_active":"2024-09-22T09:20:12.876610+0000","last_became_peered":"2024-09-22T09:20:12.876610+0000","last_unstale":"2024-09-22T09:55:11.307279+0000","last_undegraded":"2024-09-22T09:55:11.307279+0000","last_fullsized":"2024-09-22T09:55:11.307279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.307177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.307177+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.307177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:30:39.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"262'2","reported_seq":59,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.683826+0000","last_change":"2024-09-22T09:55:08.683769+0000","last_active":"2024-09-22T09:55:08.683826+0000","last_peered":"2024-09-22T09:55:08.683826+0000","last_clean":"2024-09-22T09:55:08.683826+0000","last_became_active":"2024-09-22T09:01:11.513804+0000","last_became_peered":"2024-09-22T09:01:11.513804+0000","last_unstale":"2024-09-22T09:55:08.683826+0000","last_undegraded":"2024-09-22T09:55:08.683826+0000","last_fullsized":"2024-09-22T09:55:08.683826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:08.683683+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:08.683683+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.683683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:04:06.732852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.629130+0000","last_change":"2024-09-22T09:54:58.629056+0000","last_active":"2024-09-22T09:54:58.629130+0000","last_peered":"2024-09-22T09:54:58.629130+0000","last_clean":"2024-09-22T09:54:58.629130+0000","last_became_active":"2024-09-22T09:01:07.460372+0000","last_became_peered":"2024-09-22T09:01:07.460372+0000","last_unstale":"2024-09-22T09:54:58.629130+0000","last_undegraded":"2024-09-22T09:54:58.629130+0000","last_fullsized":"2024-09-22T09:54:58.629130+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:58.628948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:58.628948+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.628948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:05.510102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"262'6","reported_seq":83,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.044417+0000","last_change":"2024-09-22T09:54:48.044365+0000","last_active":"2024-09-22T09:54:48.044417+0000","last_peered":"2024-09-22T09:54:48.044417+0000","last_clean":"2024-09-22T09:54:48.044417+0000","last_became_active":"2024-09-22T08:57:04.394677+0000","last_became_peered":"2024-09-22T08:57:04.394677+0000","last_unstale":"2024-09-22T09:54:48.044417+0000","last_undegraded":"2024-09-22T09:54:48.044417+0000","last_fullsized":"2024-09-22T09:54:48.044417+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-22T09:54:48.044281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.044281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:08.840441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:09.639449+0000","last_change":"2024-09-22T09:55:09.639361+0000","last_active":"2024-09-22T09:55:09.639449+0000","last_peered":"2024-09-22T09:55:09.639449+0000","last_clean":"2024-09-22T09:55:09.639449+0000","last_became_active":"2024-09-22T09:20:12.874459+0000","last_became_peered":"2024-09-22T09:20:12.874459+0000","last_unstale":"2024-09-22T09:55:09.639449+0000","last_undegraded":"2024-09-22T09:55:09.639449+0000","last_fullsized":"2024-09-22T09:55:09.639449+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:09.639267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:09.639267+0000","last_clean_scrub_stamp":"2024-09-22T09:55:09.639267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:45.487261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:13.353881+0000","last_change":"2024-09-22T09:55:13.353791+0000","last_active":"2024-09-22T09:55:13.353881+0000","last_peered":"2024-09-22T09:55:13.353881+0000","last_clean":"2024-09-22T09:55:13.353881+0000","last_became_active":"2024-09-22T09:01:11.514346+0000","last_became_peered":"2024-09-22T09:01:11.514346+0000","last_unstale":"2024-09-22T09:55:13.353881+0000","last_undegraded":"2024-09-22T09:55:13.353881+0000","last_fullsized":"2024-09-22T09:55:13.353881+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:13.353650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:13.353650+0000","last_clean_scrub_stamp":"2024-09-22T09:55:13.353650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:44.560042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.584366+0000","last_change":"2024-09-22T09:55:02.584305+0000","last_active":"2024-09-22T09:55:02.584366+0000","last_peered":"2024-09-22T09:55:02.584366+0000","last_clean":"2024-09-22T09:55:02.584366+0000","last_became_active":"2024-09-22T09:01:07.459294+0000","last_became_peered":"2024-09-22T09:01:07.459294+0000","last_unstale":"2024-09-22T09:55:02.584366+0000","last_undegraded":"2024-09-22T09:55:02.584366+0000","last_fullsized":"2024-09-22T09:55:02.584366+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.584220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.584220+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.584220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:23:40.366252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'41","reported_seq":183,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.277118+0000","last_change":"2024-09-22T09:55:03.277070+0000","last_active":"2024-09-22T09:55:03.277118+0000","last_peered":"2024-09-22T09:55:03.277118+0000","last_clean":"2024-09-22T09:55:03.277118+0000","last_became_active":"2024-09-22T08:57:04.401462+0000","last_became_peered":"2024-09-22T08:57:04.401462+0000","last_unstale":"2024-09-22T09:55:03.277118+0000","last_undegraded":"2024-09-22T09:55:03.277118+0000","last_fullsized":"2024-09-22T09:55:03.277118+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'41","last_scrub_stamp":"2024-09-22T09:55:03.276991+0000","last_deep_scrub":"262'41","last_deep_scrub_stamp":"2024-09-22T09:55:03.276991+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.276991+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:16.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":341,"num_read_kb":223,"num_write":101,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.286959+0000","last_change":"2024-09-22T09:55:05.286881+0000","last_active":"2024-09-22T09:55:05.286959+0000","last_peered":"2024-09-22T09:55:05.286959+0000","last_clean":"2024-09-22T09:55:05.286959+0000","last_became_active":"2024-09-22T09:20:12.872805+0000","last_became_peered":"2024-09-22T09:20:12.872805+0000","last_unstale":"2024-09-22T09:55:05.286959+0000","last_undegraded":"2024-09-22T09:55:05.286959+0000","last_fullsized":"2024-09-22T09:55:05.286959+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.286778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.286778+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.286778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:59.955031+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:12.352474+0000","last_change":"2024-09-22T09:55:12.352402+0000","last_active":"2024-09-22T09:55:12.352474+0000","last_peered":"2024-09-22T09:55:12.352474+0000","last_clean":"2024-09-22T09:55:12.352474+0000","last_became_active":"2024-09-22T09:01:11.518123+0000","last_became_peered":"2024-09-22T09:01:11.518123+0000","last_unstale":"2024-09-22T09:55:12.352474+0000","last_undegraded":"2024-09-22T09:55:12.352474+0000","last_fullsized":"2024-09-22T09:55:12.352474+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:12.352316+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:12.352316+0000","last_clean_scrub_stamp":"2024-09-22T09:55:12.352316+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:48.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"262'3","reported_seq":70,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.616400+0000","last_change":"2024-09-22T09:54:43.616296+0000","last_active":"2024-09-22T09:54:43.616400+0000","last_peered":"2024-09-22T09:54:43.616400+0000","last_clean":"2024-09-22T09:54:43.616400+0000","last_became_active":"2024-09-22T09:01:07.464290+0000","last_became_peered":"2024-09-22T09:01:07.464290+0000","last_unstale":"2024-09-22T09:54:43.616400+0000","last_undegraded":"2024-09-22T09:54:43.616400+0000","last_fullsized":"2024-09-22T09:54:43.616400+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:43.616202+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.616202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:11:24.035439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"262'292","reported_seq":941,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.060411+0000","last_change":"2024-09-22T09:54:49.060358+0000","last_active":"2024-09-22T09:54:49.060411+0000","last_peered":"2024-09-22T09:54:49.060411+0000","last_clean":"2024-09-22T09:54:49.060411+0000","last_became_active":"2024-09-22T08:57:04.400305+0000","last_became_peered":"2024-09-22T08:57:04.400305+0000","last_unstale":"2024-09-22T09:54:49.060411+0000","last_undegraded":"2024-09-22T09:54:49.060411+0000","last_fullsized":"2024-09-22T09:54:49.060411+0000","mapping_epoch":249,"log_start":"259'200","ondisk_log_start":"259'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'292","last_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_deep_scrub":"262'292","last_deep_scrub_stamp":"2024-09-22T09:54:49.060271+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.060271+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:50:07.985627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2647,"num_read_kb":4298,"num_write":555,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.328898+0000","last_change":"2024-09-22T09:55:00.328898+0000","last_active":"2024-09-22T09:55:00.328898+0000","last_peered":"2024-09-22T09:55:00.328898+0000","last_clean":"2024-09-22T09:55:00.328898+0000","last_became_active":"2024-09-22T09:20:12.867137+0000","last_became_peered":"2024-09-22T09:20:12.867137+0000","last_unstale":"2024-09-22T09:55:00.328898+0000","last_undegraded":"2024-09-22T09:55:00.328898+0000","last_fullsized":"2024-09-22T09:55:00.328898+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:00.328795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:00.328795+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.328795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:04:22.344571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:05.650382+0000","last_change":"2024-09-22T09:55:05.650308+0000","last_active":"2024-09-22T09:55:05.650382+0000","last_peered":"2024-09-22T09:55:05.650382+0000","last_clean":"2024-09-22T09:55:05.650382+0000","last_became_active":"2024-09-22T09:01:11.504571+0000","last_became_peered":"2024-09-22T09:01:11.504571+0000","last_unstale":"2024-09-22T09:55:05.650382+0000","last_undegraded":"2024-09-22T09:55:05.650382+0000","last_fullsized":"2024-09-22T09:55:05.650382+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:05.650184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:05.650184+0000","last_clean_scrub_stamp":"2024-09-22T09:55:05.650184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:48:12.819372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":62,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.362086+0000","last_change":"2024-09-22T09:54:59.362009+0000","last_active":"2024-09-22T09:54:59.362086+0000","last_peered":"2024-09-22T09:54:59.362086+0000","last_clean":"2024-09-22T09:54:59.362086+0000","last_became_active":"2024-09-22T09:01:07.462426+0000","last_became_peered":"2024-09-22T09:01:07.462426+0000","last_unstale":"2024-09-22T09:54:59.362086+0000","last_undegraded":"2024-09-22T09:54:59.362086+0000","last_fullsized":"2024-09-22T09:54:59.362086+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.361928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.361928+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.361928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:45:22.741296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'8","reported_seq":90,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.632986+0000","last_change":"2024-09-22T09:54:56.632934+0000","last_active":"2024-09-22T09:54:56.632986+0000","last_peered":"2024-09-22T09:54:56.632986+0000","last_clean":"2024-09-22T09:54:56.632986+0000","last_became_active":"2024-09-22T08:57:04.401677+0000","last_became_peered":"2024-09-22T08:57:04.401677+0000","last_unstale":"2024-09-22T09:54:56.632986+0000","last_undegraded":"2024-09-22T09:54:56.632986+0000","last_fullsized":"2024-09-22T09:54:56.632986+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-22T09:54:56.632844+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.632844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:57:02.629215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:08.662345+0000","last_change":"2024-09-22T09:55:08.662294+0000","last_active":"2024-09-22T09:55:08.662345+0000","last_peered":"2024-09-22T09:55:08.662345+0000","last_clean":"2024-09-22T09:55:08.662345+0000","last_became_active":"2024-09-22T09:20:12.872395+0000","last_became_peered":"2024-09-22T09:20:12.872395+0000","last_unstale":"2024-09-22T09:55:08.662345+0000","last_undegraded":"2024-09-22T09:55:08.662345+0000","last_fullsized":"2024-09-22T09:55:08.662345+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:08.662190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:08.662190+0000","last_clean_scrub_stamp":"2024-09-22T09:55:08.662190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:38:26.825434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":56,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:04.670867+0000","last_change":"2024-09-22T09:55:04.670815+0000","last_active":"2024-09-22T09:55:04.670867+0000","last_peered":"2024-09-22T09:55:04.670867+0000","last_clean":"2024-09-22T09:55:04.670867+0000","last_became_active":"2024-09-22T09:01:11.514562+0000","last_became_peered":"2024-09-22T09:01:11.514562+0000","last_unstale":"2024-09-22T09:55:04.670867+0000","last_undegraded":"2024-09-22T09:55:04.670867+0000","last_fullsized":"2024-09-22T09:55:04.670867+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:04.670731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:04.670731+0000","last_clean_scrub_stamp":"2024-09-22T09:55:04.670731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:17:39.596218+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"259'3","reported_seq":67,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.620985+0000","last_change":"2024-09-22T09:55:03.620880+0000","last_active":"2024-09-22T09:55:03.620985+0000","last_peered":"2024-09-22T09:55:03.620985+0000","last_clean":"2024-09-22T09:55:03.620985+0000","last_became_active":"2024-09-22T09:01:07.464881+0000","last_became_peered":"2024-09-22T09:01:07.464881+0000","last_unstale":"2024-09-22T09:55:03.620985+0000","last_undegraded":"2024-09-22T09:55:03.620985+0000","last_fullsized":"2024-09-22T09:55:03.620985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'3","last_scrub_stamp":"2024-09-22T09:55:03.620774+0000","last_deep_scrub":"259'3","last_deep_scrub_stamp":"2024-09-22T09:55:03.620774+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.620774+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:12.908822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'27","reported_seq":139,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.195508+0000","last_change":"2024-09-22T09:54:48.195435+0000","last_active":"2024-09-22T09:54:48.195508+0000","last_peered":"2024-09-22T09:54:48.195508+0000","last_clean":"2024-09-22T09:54:48.195508+0000","last_became_active":"2024-09-22T08:57:04.397568+0000","last_became_peered":"2024-09-22T08:57:04.397568+0000","last_unstale":"2024-09-22T09:54:48.195508+0000","last_undegraded":"2024-09-22T09:54:48.195508+0000","last_fullsized":"2024-09-22T09:54:48.195508+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'27","last_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_deep_scrub":"262'27","last_deep_scrub_stamp":"2024-09-22T09:54:48.195335+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.195335+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:57:58.456901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":130,"num_write":69,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'2","reported_seq":39,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.591719+0000","last_change":"2024-09-22T09:54:47.591661+0000","last_active":"2024-09-22T09:54:47.591719+0000","last_peered":"2024-09-22T09:54:47.591719+0000","last_clean":"2024-09-22T09:54:47.591719+0000","last_became_active":"2024-09-22T09:20:12.867719+0000","last_became_peered":"2024-09-22T09:20:12.867719+0000","last_unstale":"2024-09-22T09:54:47.591719+0000","last_undegraded":"2024-09-22T09:54:47.591719+0000","last_fullsized":"2024-09-22T09:54:47.591719+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:47.591568+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.591568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:41:58.864458+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":57,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.176731+0000","last_change":"2024-09-22T09:54:55.176665+0000","last_active":"2024-09-22T09:54:55.176731+0000","last_peered":"2024-09-22T09:54:55.176731+0000","last_clean":"2024-09-22T09:54:55.176731+0000","last_became_active":"2024-09-22T09:01:11.515104+0000","last_became_peered":"2024-09-22T09:01:11.515104+0000","last_unstale":"2024-09-22T09:54:55.176731+0000","last_undegraded":"2024-09-22T09:54:55.176731+0000","last_fullsized":"2024-09-22T09:54:55.176731+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:55.176572+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.176572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:17:04.433248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":64,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.535153+0000","last_change":"2024-09-22T09:55:00.535098+0000","last_active":"2024-09-22T09:55:00.535153+0000","last_peered":"2024-09-22T09:55:00.535153+0000","last_clean":"2024-09-22T09:55:00.535153+0000","last_became_active":"2024-09-22T09:01:07.463784+0000","last_became_peered":"2024-09-22T09:01:07.463784+0000","last_unstale":"2024-09-22T09:55:00.535153+0000","last_undegraded":"2024-09-22T09:55:00.535153+0000","last_fullsized":"2024-09-22T09:55:00.535153+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:00.535014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:00.535014+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.535014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:48:34.862326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'32","reported_seq":155,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.327989+0000","last_change":"2024-09-22T09:54:58.327932+0000","last_active":"2024-09-22T09:54:58.327989+0000","last_peered":"2024-09-22T09:54:58.327989+0000","last_clean":"2024-09-22T09:54:58.327989+0000","last_became_active":"2024-09-22T08:57:04.399177+0000","last_became_peered":"2024-09-22T08:57:04.399177+0000","last_unstale":"2024-09-22T09:54:58.327989+0000","last_undegraded":"2024-09-22T09:54:58.327989+0000","last_fullsized":"2024-09-22T09:54:58.327989+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'32","last_scrub_stamp":"2024-09-22T09:54:58.327838+0000","last_deep_scrub":"262'32","last_deep_scrub_stamp":"2024-09-22T09:54:58.327838+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.327838+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:33:01.210523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":161,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:17.380996+0000","last_change":"2024-09-22T09:55:17.380996+0000","last_active":"2024-09-22T09:55:17.380996+0000","last_peered":"2024-09-22T09:55:17.380996+0000","last_clean":"2024-09-22T09:55:17.380996+0000","last_became_active":"2024-09-22T09:20:12.876592+0000","last_became_peered":"2024-09-22T09:20:12.876592+0000","last_unstale":"2024-09-22T09:55:17.380996+0000","last_undegraded":"2024-09-22T09:55:17.380996+0000","last_fullsized":"2024-09-22T09:55:17.380996+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:17.380887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:17.380887+0000","last_clean_scrub_stamp":"2024-09-22T09:55:17.380887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:20.264989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":58,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.280151+0000","last_change":"2024-09-22T09:55:02.280085+0000","last_active":"2024-09-22T09:55:02.280151+0000","last_peered":"2024-09-22T09:55:02.280151+0000","last_clean":"2024-09-22T09:55:02.280151+0000","last_became_active":"2024-09-22T09:01:11.511307+0000","last_became_peered":"2024-09-22T09:01:11.511307+0000","last_unstale":"2024-09-22T09:55:02.280151+0000","last_undegraded":"2024-09-22T09:55:02.280151+0000","last_fullsized":"2024-09-22T09:55:02.280151+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:02.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:02.279992+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:33:08.793662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.548013+0000","last_change":"2024-09-22T09:55:01.547937+0000","last_active":"2024-09-22T09:55:01.548013+0000","last_peered":"2024-09-22T09:55:01.548013+0000","last_clean":"2024-09-22T09:55:01.548013+0000","last_became_active":"2024-09-22T09:01:07.464585+0000","last_became_peered":"2024-09-22T09:01:07.464585+0000","last_unstale":"2024-09-22T09:55:01.548013+0000","last_undegraded":"2024-09-22T09:55:01.548013+0000","last_fullsized":"2024-09-22T09:55:01.548013+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:01.547815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:01.547815+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.547815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:21:05.332989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"262'23","reported_seq":134,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.591122+0000","last_change":"2024-09-22T09:54:54.591055+0000","last_active":"2024-09-22T09:54:54.591122+0000","last_peered":"2024-09-22T09:54:54.591122+0000","last_clean":"2024-09-22T09:54:54.591122+0000","last_became_active":"2024-09-22T08:57:04.398346+0000","last_became_peered":"2024-09-22T08:57:04.398346+0000","last_unstale":"2024-09-22T09:54:54.591122+0000","last_undegraded":"2024-09-22T09:54:54.591122+0000","last_fullsized":"2024-09-22T09:54:54.591122+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'23","last_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_deep_scrub":"262'23","last_deep_scrub_stamp":"2024-09-22T09:54:54.590974+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.590974+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:49.440381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":63,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:15.363520+0000","last_change":"2024-09-22T09:55:15.363463+0000","last_active":"2024-09-22T09:55:15.363520+0000","last_peered":"2024-09-22T09:55:15.363520+0000","last_clean":"2024-09-22T09:55:15.363520+0000","last_became_active":"2024-09-22T09:20:12.875389+0000","last_became_peered":"2024-09-22T09:20:12.875389+0000","last_unstale":"2024-09-22T09:55:15.363520+0000","last_undegraded":"2024-09-22T09:55:15.363520+0000","last_fullsized":"2024-09-22T09:55:15.363520+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:15.363367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:15.363367+0000","last_clean_scrub_stamp":"2024-09-22T09:55:15.363367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:45:09.064084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"259'5","reported_seq":72,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.070286+0000","last_change":"2024-09-22T09:54:53.070211+0000","last_active":"2024-09-22T09:54:53.070286+0000","last_peered":"2024-09-22T09:54:53.070286+0000","last_clean":"2024-09-22T09:54:53.070286+0000","last_became_active":"2024-09-22T09:01:11.522212+0000","last_became_peered":"2024-09-22T09:01:11.522212+0000","last_unstale":"2024-09-22T09:54:53.070286+0000","last_undegraded":"2024-09-22T09:54:53.070286+0000","last_fullsized":"2024-09-22T09:54:53.070286+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"259'5","last_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_deep_scrub":"259'5","last_deep_scrub_stamp":"2024-09-22T09:54:53.070103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.070103+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:56:14.514297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":63,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.159168+0000","last_change":"2024-09-22T09:54:51.159120+0000","last_active":"2024-09-22T09:54:51.159168+0000","last_peered":"2024-09-22T09:54:51.159168+0000","last_clean":"2024-09-22T09:54:51.159168+0000","last_became_active":"2024-09-22T09:01:07.463230+0000","last_became_peered":"2024-09-22T09:01:07.463230+0000","last_unstale":"2024-09-22T09:54:51.159168+0000","last_undegraded":"2024-09-22T09:54:51.159168+0000","last_fullsized":"2024-09-22T09:54:51.159168+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.159033+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.159033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:48.125155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'21","reported_seq":128,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.070094+0000","last_change":"2024-09-22T09:54:47.070001+0000","last_active":"2024-09-22T09:54:47.070094+0000","last_peered":"2024-09-22T09:54:47.070094+0000","last_clean":"2024-09-22T09:54:47.070094+0000","last_became_active":"2024-09-22T08:57:04.386112+0000","last_became_peered":"2024-09-22T08:57:04.386112+0000","last_unstale":"2024-09-22T09:54:47.070094+0000","last_undegraded":"2024-09-22T09:54:47.070094+0000","last_fullsized":"2024-09-22T09:54:47.070094+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'21","last_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_deep_scrub":"262'21","last_deep_scrub_stamp":"2024-09-22T09:54:47.069893+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.069893+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:47.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":113,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":37,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:11.661755+0000","last_change":"2024-09-22T09:55:11.661755+0000","last_active":"2024-09-22T09:55:11.661755+0000","last_peered":"2024-09-22T09:55:11.661755+0000","last_clean":"2024-09-22T09:55:11.661755+0000","last_became_active":"2024-09-22T09:20:12.876097+0000","last_became_peered":"2024-09-22T09:20:12.876097+0000","last_unstale":"2024-09-22T09:55:11.661755+0000","last_undegraded":"2024-09-22T09:55:11.661755+0000","last_fullsized":"2024-09-22T09:55:11.661755+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:55:11.661662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:55:11.661662+0000","last_clean_scrub_stamp":"2024-09-22T09:55:11.661662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:49:09.039844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":61,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.702388+0000","last_change":"2024-09-22T09:55:03.702323+0000","last_active":"2024-09-22T09:55:03.702388+0000","last_peered":"2024-09-22T09:55:03.702388+0000","last_clean":"2024-09-22T09:55:03.702388+0000","last_became_active":"2024-09-22T09:01:11.507820+0000","last_became_peered":"2024-09-22T09:01:11.507820+0000","last_unstale":"2024-09-22T09:55:03.702388+0000","last_undegraded":"2024-09-22T09:55:03.702388+0000","last_fullsized":"2024-09-22T09:55:03.702388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:55:03.702218+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:55:03.702218+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.702218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:20:57.125322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1142,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"262'10","reported_seq":86,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.043164+0000","last_change":"2024-09-22T09:54:54.043090+0000","last_active":"2024-09-22T09:54:54.043164+0000","last_peered":"2024-09-22T09:54:54.043164+0000","last_clean":"2024-09-22T09:54:54.043164+0000","last_became_active":"2024-09-22T09:01:07.457340+0000","last_became_peered":"2024-09-22T09:01:07.457340+0000","last_unstale":"2024-09-22T09:54:54.043164+0000","last_undegraded":"2024-09-22T09:54:54.043164+0000","last_fullsized":"2024-09-22T09:54:54.043164+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'10","last_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_deep_scrub":"262'10","last_deep_scrub_stamp":"2024-09-22T09:54:54.043004+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.043004+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:50.731747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25607,"num_write":10,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"262'64","reported_seq":247,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.583374+0000","last_change":"2024-09-22T09:54:57.583318+0000","last_active":"2024-09-22T09:54:57.583374+0000","last_peered":"2024-09-22T09:54:57.583374+0000","last_clean":"2024-09-22T09:54:57.583374+0000","last_became_active":"2024-09-22T08:57:04.395900+0000","last_became_peered":"2024-09-22T08:57:04.395900+0000","last_unstale":"2024-09-22T09:54:57.583374+0000","last_undegraded":"2024-09-22T09:54:57.583374+0000","last_fullsized":"2024-09-22T09:54:57.583374+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'64","last_scrub_stamp":"2024-09-22T09:54:57.583231+0000","last_deep_scrub":"262'64","last_deep_scrub_stamp":"2024-09-22T09:54:57.583231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.583231+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:39:18.335036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":514,"num_read_kb":337,"num_write":155,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"262'215","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.577167+0000","last_change":"2024-09-22T09:54:31.577099+0000","last_active":"2024-09-22T09:54:31.577167+0000","last_peered":"2024-09-22T09:54:31.577167+0000","last_clean":"2024-09-22T09:54:31.577167+0000","last_became_active":"2024-09-22T08:42:13.422320+0000","last_became_peered":"2024-09-22T08:42:13.422320+0000","last_unstale":"2024-09-22T09:54:31.577167+0000","last_undegraded":"2024-09-22T09:54:31.577167+0000","last_fullsized":"2024-09-22T09:54:31.577167+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'215","last_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_deep_scrub":"262'215","last_deep_scrub_stamp":"2024-09-22T09:54:31.576998+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.576998+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:44.998984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":13876,"num_write":999,"num_write_kb":39143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"262'142","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.412304+0000","last_change":"2024-09-22T09:54:38.412245+0000","last_active":"2024-09-22T09:54:38.412304+0000","last_peered":"2024-09-22T09:54:38.412304+0000","last_clean":"2024-09-22T09:54:38.412304+0000","last_became_active":"2024-09-22T08:42:15.430740+0000","last_became_peered":"2024-09-22T08:42:15.430740+0000","last_unstale":"2024-09-22T09:54:38.412304+0000","last_undegraded":"2024-09-22T09:54:38.412304+0000","last_fullsized":"2024-09-22T09:54:38.412304+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:38.412165+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.412165+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:34.712245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":556,"num_write":210,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"262'143","reported_seq":808,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.231089+0000","last_change":"2024-09-22T09:54:24.231015+0000","last_active":"2024-09-22T09:54:24.231089+0000","last_peered":"2024-09-22T09:54:24.231089+0000","last_clean":"2024-09-22T09:54:24.231089+0000","last_became_active":"2024-09-22T08:42:46.096343+0000","last_became_peered":"2024-09-22T08:42:46.096343+0000","last_unstale":"2024-09-22T09:54:24.231089+0000","last_undegraded":"2024-09-22T09:54:24.231089+0000","last_fullsized":"2024-09-22T09:54:24.231089+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:24.230885+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.230885+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:30:36.854502+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":432,"num_read_kb":103374,"num_write":683,"num_write_kb":46299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,4],"acting":[1,0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"262'77","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.607885+0000","last_change":"2024-09-22T09:54:37.607829+0000","last_active":"2024-09-22T09:54:37.607885+0000","last_peered":"2024-09-22T09:54:37.607885+0000","last_clean":"2024-09-22T09:54:37.607885+0000","last_became_active":"2024-09-22T08:42:15.435185+0000","last_became_peered":"2024-09-22T08:42:15.435185+0000","last_unstale":"2024-09-22T09:54:37.607885+0000","last_undegraded":"2024-09-22T09:54:37.607885+0000","last_fullsized":"2024-09-22T09:54:37.607885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'77","last_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_deep_scrub":"262'77","last_deep_scrub_stamp":"2024-09-22T09:54:37.607734+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.607734+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:08:59.160167+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":312,"num_write":113,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"262'209","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.013490+0000","last_change":"2024-09-22T09:54:28.013430+0000","last_active":"2024-09-22T09:54:28.013490+0000","last_peered":"2024-09-22T09:54:28.013490+0000","last_clean":"2024-09-22T09:54:28.013490+0000","last_became_active":"2024-09-22T08:42:13.406180+0000","last_became_peered":"2024-09-22T08:42:13.406180+0000","last_unstale":"2024-09-22T09:54:28.013490+0000","last_undegraded":"2024-09-22T09:54:28.013490+0000","last_fullsized":"2024-09-22T09:54:28.013490+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:28.013255+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.013255+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:30:24.596859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":502,"num_read_kb":4356,"num_write":984,"num_write_kb":17804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"262'190","reported_seq":816,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.677030+0000","last_change":"2024-09-22T09:54:37.676977+0000","last_active":"2024-09-22T09:54:37.677030+0000","last_peered":"2024-09-22T09:54:37.677030+0000","last_clean":"2024-09-22T09:54:37.677030+0000","last_became_active":"2024-09-22T08:42:15.422070+0000","last_became_peered":"2024-09-22T08:42:15.422070+0000","last_unstale":"2024-09-22T09:54:37.677030+0000","last_undegraded":"2024-09-22T09:54:37.677030+0000","last_fullsized":"2024-09-22T09:54:37.677030+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:37.676887+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.676887+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:57:21.391589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":835,"num_read_kb":685,"num_write":294,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"262'211","reported_seq":865,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.380352+0000","last_change":"2024-09-22T09:54:33.380352+0000","last_active":"2024-09-22T09:54:33.380352+0000","last_peered":"2024-09-22T09:54:33.380352+0000","last_clean":"2024-09-22T09:54:33.380352+0000","last_became_active":"2024-09-22T08:42:13.412167+0000","last_became_peered":"2024-09-22T08:42:13.412167+0000","last_unstale":"2024-09-22T09:54:33.380352+0000","last_undegraded":"2024-09-22T09:54:33.380352+0000","last_fullsized":"2024-09-22T09:54:33.380352+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:33.380242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.380242+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:52.978925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":600,"num_read_kb":1083,"num_write":1003,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"262'351","reported_seq":1026,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.063066+0000","last_change":"2024-09-22T09:54:37.063002+0000","last_active":"2024-09-22T09:54:37.063066+0000","last_peered":"2024-09-22T09:54:37.063066+0000","last_clean":"2024-09-22T09:54:37.063066+0000","last_became_active":"2024-09-22T08:42:15.432127+0000","last_became_peered":"2024-09-22T08:42:15.432127+0000","last_unstale":"2024-09-22T09:54:37.063066+0000","last_undegraded":"2024-09-22T09:54:37.063066+0000","last_fullsized":"2024-09-22T09:54:37.063066+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'351","last_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_deep_scrub":"262'351","last_deep_scrub_stamp":"2024-09-22T09:54:37.062905+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.062905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:31:49.568320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1548,"num_read_kb":1257,"num_write":562,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"262'204","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.546105+0000","last_change":"2024-09-22T09:54:28.546046+0000","last_active":"2024-09-22T09:54:28.546105+0000","last_peered":"2024-09-22T09:54:28.546105+0000","last_clean":"2024-09-22T09:54:28.546105+0000","last_became_active":"2024-09-22T08:42:13.413110+0000","last_became_peered":"2024-09-22T08:42:13.413110+0000","last_unstale":"2024-09-22T09:54:28.546105+0000","last_undegraded":"2024-09-22T09:54:28.546105+0000","last_fullsized":"2024-09-22T09:54:28.546105+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:28.545908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.545908+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:53:30.243289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":570,"num_read_kb":6282,"num_write":914,"num_write_kb":13894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"262'106","reported_seq":690,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.949036+0000","last_change":"2024-09-22T09:54:34.949036+0000","last_active":"2024-09-22T09:54:34.949036+0000","last_peered":"2024-09-22T09:54:34.949036+0000","last_clean":"2024-09-22T09:54:34.949036+0000","last_became_active":"2024-09-22T08:42:15.431325+0000","last_became_peered":"2024-09-22T08:42:15.431325+0000","last_unstale":"2024-09-22T09:54:34.949036+0000","last_undegraded":"2024-09-22T09:54:34.949036+0000","last_fullsized":"2024-09-22T09:54:34.949036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'106","last_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_deep_scrub":"262'106","last_deep_scrub_stamp":"2024-09-22T09:54:34.948920+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.948920+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:09:26.051361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":487,"num_read_kb":405,"num_write":165,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"262'218","reported_seq":877,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.423640+0000","last_change":"2024-09-22T09:54:30.423574+0000","last_active":"2024-09-22T09:54:30.423640+0000","last_peered":"2024-09-22T09:54:30.423640+0000","last_clean":"2024-09-22T09:54:30.423640+0000","last_became_active":"2024-09-22T08:42:13.405973+0000","last_became_peered":"2024-09-22T08:42:13.405973+0000","last_unstale":"2024-09-22T09:54:30.423640+0000","last_undegraded":"2024-09-22T09:54:30.423640+0000","last_fullsized":"2024-09-22T09:54:30.423640+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'218","last_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_deep_scrub":"262'218","last_deep_scrub_stamp":"2024-09-22T09:54:30.423472+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.423472+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:42.929221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":691,"num_read_kb":1734,"num_write":933,"num_write_kb":40231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"262'4554","reported_seq":5332,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.603059+0000","last_change":"2024-09-22T09:54:39.602965+0000","last_active":"2024-09-22T09:54:39.603059+0000","last_peered":"2024-09-22T09:54:39.603059+0000","last_clean":"2024-09-22T09:54:39.603059+0000","last_became_active":"2024-09-22T08:42:15.421675+0000","last_became_peered":"2024-09-22T08:42:15.421675+0000","last_unstale":"2024-09-22T09:54:39.603059+0000","last_undegraded":"2024-09-22T09:54:39.603059+0000","last_fullsized":"2024-09-22T09:54:39.603059+0000","mapping_epoch":26,"log_start":"262'4500","ondisk_log_start":"262'4500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4554","last_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_deep_scrub":"262'4554","last_deep_scrub_stamp":"2024-09-22T09:54:39.602864+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.602864+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":3000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:11:58.038441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18551,"num_read_kb":15557,"num_write":6861,"num_write_kb":3472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26027,"num_omap_keys":102,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"262'324","reported_seq":1036,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.569192+0000","last_change":"2024-09-22T09:54:30.569112+0000","last_active":"2024-09-22T09:54:30.569192+0000","last_peered":"2024-09-22T09:54:30.569192+0000","last_clean":"2024-09-22T09:54:30.569192+0000","last_became_active":"2024-09-22T08:42:13.413358+0000","last_became_peered":"2024-09-22T08:42:13.413358+0000","last_unstale":"2024-09-22T09:54:30.569192+0000","last_undegraded":"2024-09-22T09:54:30.569192+0000","last_fullsized":"2024-09-22T09:54:30.569192+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'324","last_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_deep_scrub":"262'324","last_deep_scrub_stamp":"2024-09-22T09:54:30.568978+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.568978+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:49:58.439696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":40392,"num_write":1278,"num_write_kb":42658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"262'118","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.338436+0000","last_change":"2024-09-22T09:54:40.338351+0000","last_active":"2024-09-22T09:54:40.338436+0000","last_peered":"2024-09-22T09:54:40.338436+0000","last_clean":"2024-09-22T09:54:40.338436+0000","last_became_active":"2024-09-22T08:42:15.435530+0000","last_became_peered":"2024-09-22T08:42:15.435530+0000","last_unstale":"2024-09-22T09:54:40.338436+0000","last_undegraded":"2024-09-22T09:54:40.338436+0000","last_fullsized":"2024-09-22T09:54:40.338436+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:40.338247+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.338247+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:47.134708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":446,"num_write":190,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"262'206","reported_seq":901,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.815019+0000","last_change":"2024-09-22T09:54:34.814919+0000","last_active":"2024-09-22T09:54:34.815019+0000","last_peered":"2024-09-22T09:54:34.815019+0000","last_clean":"2024-09-22T09:54:34.815019+0000","last_became_active":"2024-09-22T08:42:13.409237+0000","last_became_peered":"2024-09-22T08:42:13.409237+0000","last_unstale":"2024-09-22T09:54:34.815019+0000","last_undegraded":"2024-09-22T09:54:34.815019+0000","last_fullsized":"2024-09-22T09:54:34.815019+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:34.814749+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.814749+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:27.535584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":708,"num_read_kb":60138,"num_write":928,"num_write_kb":50016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"262'191","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.622485+0000","last_change":"2024-09-22T09:54:30.622414+0000","last_active":"2024-09-22T09:54:30.622485+0000","last_peered":"2024-09-22T09:54:30.622485+0000","last_clean":"2024-09-22T09:54:30.622485+0000","last_became_active":"2024-09-22T08:42:15.430522+0000","last_became_peered":"2024-09-22T08:42:15.430522+0000","last_unstale":"2024-09-22T09:54:30.622485+0000","last_undegraded":"2024-09-22T09:54:30.622485+0000","last_fullsized":"2024-09-22T09:54:30.622485+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:30.622328+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.622328+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:28.359393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":820,"num_read_kb":675,"num_write":268,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"262'172","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.679959+0000","last_change":"2024-09-22T09:54:35.679903+0000","last_active":"2024-09-22T09:54:35.679959+0000","last_peered":"2024-09-22T09:54:35.679959+0000","last_clean":"2024-09-22T09:54:35.679959+0000","last_became_active":"2024-09-22T08:42:15.422633+0000","last_became_peered":"2024-09-22T08:42:15.422633+0000","last_unstale":"2024-09-22T09:54:35.679959+0000","last_undegraded":"2024-09-22T09:54:35.679959+0000","last_fullsized":"2024-09-22T09:54:35.679959+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:35.679816+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.679816+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:58:37.331041+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":745,"num_read_kb":636,"num_write":280,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"262'216","reported_seq":858,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.502853+0000","last_change":"2024-09-22T09:54:27.502790+0000","last_active":"2024-09-22T09:54:27.502853+0000","last_peered":"2024-09-22T09:54:27.502853+0000","last_clean":"2024-09-22T09:54:27.502853+0000","last_became_active":"2024-09-22T08:42:13.422819+0000","last_became_peered":"2024-09-22T08:42:13.422819+0000","last_unstale":"2024-09-22T09:54:27.502853+0000","last_undegraded":"2024-09-22T09:54:27.502853+0000","last_fullsized":"2024-09-22T09:54:27.502853+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'216","last_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_deep_scrub":"262'216","last_deep_scrub_stamp":"2024-09-22T09:54:27.502656+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.502656+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:38:28.950343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":44934,"num_write":915,"num_write_kb":30452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"262'346","reported_seq":1060,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.573561+0000","last_change":"2024-09-22T09:54:36.573483+0000","last_active":"2024-09-22T09:54:36.573561+0000","last_peered":"2024-09-22T09:54:36.573561+0000","last_clean":"2024-09-22T09:54:36.573561+0000","last_became_active":"2024-09-22T08:42:15.436474+0000","last_became_peered":"2024-09-22T08:42:15.436474+0000","last_unstale":"2024-09-22T09:54:36.573561+0000","last_undegraded":"2024-09-22T09:54:36.573561+0000","last_fullsized":"2024-09-22T09:54:36.573561+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:36.573367+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.573367+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:53:13.195512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1702,"num_read_kb":1417,"num_write":634,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"262'137","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.908255+0000","last_change":"2024-09-22T09:54:27.908195+0000","last_active":"2024-09-22T09:54:27.908255+0000","last_peered":"2024-09-22T09:54:27.908255+0000","last_clean":"2024-09-22T09:54:27.908255+0000","last_became_active":"2024-09-22T08:42:13.394014+0000","last_became_peered":"2024-09-22T08:42:13.394014+0000","last_unstale":"2024-09-22T09:54:27.908255+0000","last_undegraded":"2024-09-22T09:54:27.908255+0000","last_fullsized":"2024-09-22T09:54:27.908255+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:27.908076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.908076+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:25:43.835693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":4340,"num_write":703,"num_write_kb":20287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"262'100","reported_seq":707,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.342805+0000","last_change":"2024-09-22T09:54:36.342751+0000","last_active":"2024-09-22T09:54:36.342805+0000","last_peered":"2024-09-22T09:54:36.342805+0000","last_clean":"2024-09-22T09:54:36.342805+0000","last_became_active":"2024-09-22T08:42:15.429273+0000","last_became_peered":"2024-09-22T08:42:15.429273+0000","last_unstale":"2024-09-22T09:54:36.342805+0000","last_undegraded":"2024-09-22T09:54:36.342805+0000","last_fullsized":"2024-09-22T09:54:36.342805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'100","last_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_deep_scrub":"262'100","last_deep_scrub_stamp":"2024-09-22T09:54:36.342669+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.342669+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:45:11.894761+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":438,"num_read_kb":372,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"262'200","reported_seq":845,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.931855+0000","last_change":"2024-09-22T09:54:28.931797+0000","last_active":"2024-09-22T09:54:28.931855+0000","last_peered":"2024-09-22T09:54:28.931855+0000","last_clean":"2024-09-22T09:54:28.931855+0000","last_became_active":"2024-09-22T08:42:46.094173+0000","last_became_peered":"2024-09-22T08:42:46.094173+0000","last_unstale":"2024-09-22T09:54:28.931855+0000","last_undegraded":"2024-09-22T09:54:28.931855+0000","last_fullsized":"2024-09-22T09:54:28.931855+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:28.931664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.931664+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:42:23.475431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":483,"num_read_kb":44793,"num_write":917,"num_write_kb":52890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,0,3],"acting":[6,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"262'263","reported_seq":906,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.645932+0000","last_change":"2024-09-22T09:54:28.645828+0000","last_active":"2024-09-22T09:54:28.645932+0000","last_peered":"2024-09-22T09:54:28.645932+0000","last_clean":"2024-09-22T09:54:28.645932+0000","last_became_active":"2024-09-22T08:42:15.433229+0000","last_became_peered":"2024-09-22T08:42:15.433229+0000","last_unstale":"2024-09-22T09:54:28.645932+0000","last_undegraded":"2024-09-22T09:54:28.645932+0000","last_fullsized":"2024-09-22T09:54:28.645932+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:28.645693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.645693+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:38:27.752376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1218,"num_read_kb":1000,"num_write":429,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"262'208","reported_seq":895,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.766157+0000","last_change":"2024-09-22T09:54:23.766105+0000","last_active":"2024-09-22T09:54:23.766157+0000","last_peered":"2024-09-22T09:54:23.766157+0000","last_clean":"2024-09-22T09:54:23.766157+0000","last_became_active":"2024-09-22T08:42:13.419072+0000","last_became_peered":"2024-09-22T08:42:13.419072+0000","last_unstale":"2024-09-22T09:54:23.766157+0000","last_undegraded":"2024-09-22T09:54:23.766157+0000","last_fullsized":"2024-09-22T09:54:23.766157+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'208","last_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_deep_scrub":"262'208","last_deep_scrub_stamp":"2024-09-22T09:54:23.765983+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.765983+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:24.208701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":639,"num_write":1016,"num_write_kb":23244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"262'336","reported_seq":985,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.625494+0000","last_change":"2024-09-22T09:54:29.625420+0000","last_active":"2024-09-22T09:54:29.625494+0000","last_peered":"2024-09-22T09:54:29.625494+0000","last_clean":"2024-09-22T09:54:29.625494+0000","last_became_active":"2024-09-22T08:42:15.431593+0000","last_became_peered":"2024-09-22T08:42:15.431593+0000","last_unstale":"2024-09-22T09:54:29.625494+0000","last_undegraded":"2024-09-22T09:54:29.625494+0000","last_fullsized":"2024-09-22T09:54:29.625494+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'336","last_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_deep_scrub":"262'336","last_deep_scrub_stamp":"2024-09-22T09:54:29.625322+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.625322+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:34:56.414721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1502,"num_read_kb":1236,"num_write":527,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"262'231","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.834864+0000","last_change":"2024-09-22T09:54:28.834762+0000","last_active":"2024-09-22T09:54:28.834864+0000","last_peered":"2024-09-22T09:54:28.834864+0000","last_clean":"2024-09-22T09:54:28.834864+0000","last_became_active":"2024-09-22T08:42:13.414310+0000","last_became_peered":"2024-09-22T08:42:13.414310+0000","last_unstale":"2024-09-22T09:54:28.834864+0000","last_undegraded":"2024-09-22T09:54:28.834864+0000","last_fullsized":"2024-09-22T09:54:28.834864+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:28.834665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.834665+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:01:27.131540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":35016,"num_write":919,"num_write_kb":53995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"262'68","reported_seq":654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.646773+0000","last_change":"2024-09-22T09:54:38.646721+0000","last_active":"2024-09-22T09:54:38.646773+0000","last_peered":"2024-09-22T09:54:38.646773+0000","last_clean":"2024-09-22T09:54:38.646773+0000","last_became_active":"2024-09-22T08:42:15.436650+0000","last_became_peered":"2024-09-22T08:42:15.436650+0000","last_unstale":"2024-09-22T09:54:38.646773+0000","last_undegraded":"2024-09-22T09:54:38.646773+0000","last_fullsized":"2024-09-22T09:54:38.646773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'68","last_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_deep_scrub":"262'68","last_deep_scrub_stamp":"2024-09-22T09:54:38.646631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.646631+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:19:11.600548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":314,"num_read_kb":268,"num_write":93,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"262'204","reported_seq":1076,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.044214+0000","last_change":"2024-09-22T09:54:27.044159+0000","last_active":"2024-09-22T09:54:27.044214+0000","last_peered":"2024-09-22T09:54:27.044214+0000","last_clean":"2024-09-22T09:54:27.044214+0000","last_became_active":"2024-09-22T08:42:13.419744+0000","last_became_peered":"2024-09-22T08:42:13.419744+0000","last_unstale":"2024-09-22T09:54:27.044214+0000","last_undegraded":"2024-09-22T09:54:27.044214+0000","last_fullsized":"2024-09-22T09:54:27.044214+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'204","last_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_deep_scrub":"262'204","last_deep_scrub_stamp":"2024-09-22T09:54:27.044042+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.044042+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:01:26.911985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1343,"num_read_kb":71433,"num_write":1020,"num_write_kb":42955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"262'129","reported_seq":648,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.611141+0000","last_change":"2024-09-22T09:54:55.611071+0000","last_active":"2024-09-22T09:54:55.611141+0000","last_peered":"2024-09-22T09:54:55.611141+0000","last_clean":"2024-09-22T09:54:55.611141+0000","last_became_active":"2024-09-22T08:42:23.524666+0000","last_became_peered":"2024-09-22T08:42:23.524666+0000","last_unstale":"2024-09-22T09:54:55.611141+0000","last_undegraded":"2024-09-22T09:54:55.611141+0000","last_fullsized":"2024-09-22T09:54:55.611141+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:55.610956+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.610956+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:34.518683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":190,"num_read_kb":182,"num_write":300,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"262'109","reported_seq":711,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886309+0000","last_change":"2024-09-22T09:54:32.886256+0000","last_active":"2024-09-22T09:54:32.886309+0000","last_peered":"2024-09-22T09:54:32.886309+0000","last_clean":"2024-09-22T09:54:32.886309+0000","last_became_active":"2024-09-22T08:42:15.440609+0000","last_became_peered":"2024-09-22T08:42:15.440609+0000","last_unstale":"2024-09-22T09:54:32.886309+0000","last_undegraded":"2024-09-22T09:54:32.886309+0000","last_fullsized":"2024-09-22T09:54:32.886309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'109","last_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_deep_scrub":"262'109","last_deep_scrub_stamp":"2024-09-22T09:54:32.886167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886167+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:30.226261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":496,"num_read_kb":417,"num_write":160,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"262'246","reported_seq":956,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.453792+0000","last_change":"2024-09-22T09:54:26.453733+0000","last_active":"2024-09-22T09:54:26.453792+0000","last_peered":"2024-09-22T09:54:26.453792+0000","last_clean":"2024-09-22T09:54:26.453792+0000","last_became_active":"2024-09-22T08:42:13.421371+0000","last_became_peered":"2024-09-22T08:42:13.421371+0000","last_unstale":"2024-09-22T09:54:26.453792+0000","last_undegraded":"2024-09-22T09:54:26.453792+0000","last_fullsized":"2024-09-22T09:54:26.453792+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:26.453584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.453584+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:12.566992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":724,"num_read_kb":75224,"num_write":1095,"num_write_kb":51081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.295856+0000","last_change":"2024-09-22T09:54:44.295796+0000","last_active":"2024-09-22T09:54:44.295856+0000","last_peered":"2024-09-22T09:54:44.295856+0000","last_clean":"2024-09-22T09:54:44.295856+0000","last_became_active":"2024-09-22T08:42:17.435750+0000","last_became_peered":"2024-09-22T08:42:17.435750+0000","last_unstale":"2024-09-22T09:54:44.295856+0000","last_undegraded":"2024-09-22T09:54:44.295856+0000","last_fullsized":"2024-09-22T09:54:44.295856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.295705+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.295705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:24:40.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"262'220","reported_seq":843,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.066941+0000","last_change":"2024-09-22T09:54:44.066889+0000","last_active":"2024-09-22T09:54:44.066941+0000","last_peered":"2024-09-22T09:54:44.066941+0000","last_clean":"2024-09-22T09:54:44.066941+0000","last_became_active":"2024-09-22T08:42:19.455291+0000","last_became_peered":"2024-09-22T08:42:19.455291+0000","last_unstale":"2024-09-22T09:54:44.066941+0000","last_undegraded":"2024-09-22T09:54:44.066941+0000","last_fullsized":"2024-09-22T09:54:44.066941+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:44.066792+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.066792+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:06.960949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11340,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":291,"num_read_kb":380,"num_write":172,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.570773+0000","last_change":"2024-09-22T09:54:51.570712+0000","last_active":"2024-09-22T09:54:51.570773+0000","last_peered":"2024-09-22T09:54:51.570773+0000","last_clean":"2024-09-22T09:54:51.570773+0000","last_became_active":"2024-09-22T08:42:21.476505+0000","last_became_peered":"2024-09-22T08:42:21.476505+0000","last_unstale":"2024-09-22T09:54:51.570773+0000","last_undegraded":"2024-09-22T09:54:51.570773+0000","last_fullsized":"2024-09-22T09:54:51.570773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.570620+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.570620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:59.625436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"262'143","reported_seq":662,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.367638+0000","last_change":"2024-09-22T09:54:56.367581+0000","last_active":"2024-09-22T09:54:56.367638+0000","last_peered":"2024-09-22T09:54:56.367638+0000","last_clean":"2024-09-22T09:54:56.367638+0000","last_became_active":"2024-09-22T08:42:23.525312+0000","last_became_peered":"2024-09-22T08:42:23.525312+0000","last_unstale":"2024-09-22T09:54:56.367638+0000","last_undegraded":"2024-09-22T09:54:56.367638+0000","last_fullsized":"2024-09-22T09:54:56.367638+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:56.367482+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.367482+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:02:19.773727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":239,"num_read_kb":218,"num_write":355,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"262'241","reported_seq":861,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.356729+0000","last_change":"2024-09-22T09:54:34.356652+0000","last_active":"2024-09-22T09:54:34.356729+0000","last_peered":"2024-09-22T09:54:34.356729+0000","last_clean":"2024-09-22T09:54:34.356729+0000","last_became_active":"2024-09-22T08:42:15.433475+0000","last_became_peered":"2024-09-22T08:42:15.433475+0000","last_unstale":"2024-09-22T09:54:34.356729+0000","last_undegraded":"2024-09-22T09:54:34.356729+0000","last_fullsized":"2024-09-22T09:54:34.356729+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'241","last_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_deep_scrub":"262'241","last_deep_scrub_stamp":"2024-09-22T09:54:34.356567+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.356567+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:26:12.922893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1049,"num_read_kb":844,"num_write":385,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"262'203","reported_seq":832,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.085670+0000","last_change":"2024-09-22T09:54:21.085625+0000","last_active":"2024-09-22T09:54:21.085670+0000","last_peered":"2024-09-22T09:54:21.085670+0000","last_clean":"2024-09-22T09:54:21.085670+0000","last_became_active":"2024-09-22T08:42:13.409559+0000","last_became_peered":"2024-09-22T08:42:13.409559+0000","last_unstale":"2024-09-22T09:54:21.085670+0000","last_undegraded":"2024-09-22T09:54:21.085670+0000","last_fullsized":"2024-09-22T09:54:21.085670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:21.085544+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.085544+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:19.372506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":43802,"num_write":911,"num_write_kb":35499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.706253+0000","last_change":"2024-09-22T09:54:44.706190+0000","last_active":"2024-09-22T09:54:44.706253+0000","last_peered":"2024-09-22T09:54:44.706253+0000","last_clean":"2024-09-22T09:54:44.706253+0000","last_became_active":"2024-09-22T08:42:17.437937+0000","last_became_peered":"2024-09-22T08:42:17.437937+0000","last_unstale":"2024-09-22T09:54:44.706253+0000","last_undegraded":"2024-09-22T09:54:44.706253+0000","last_fullsized":"2024-09-22T09:54:44.706253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.706103+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.706103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:13:02.288230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"262'102","reported_seq":646,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.613924+0000","last_change":"2024-09-22T09:54:47.613835+0000","last_active":"2024-09-22T09:54:47.613924+0000","last_peered":"2024-09-22T09:54:47.613924+0000","last_clean":"2024-09-22T09:54:47.613924+0000","last_became_active":"2024-09-22T08:42:19.453101+0000","last_became_peered":"2024-09-22T08:42:19.453101+0000","last_unstale":"2024-09-22T09:54:47.613924+0000","last_undegraded":"2024-09-22T09:54:47.613924+0000","last_fullsized":"2024-09-22T09:54:47.613924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'102","last_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_deep_scrub":"262'102","last_deep_scrub_stamp":"2024-09-22T09:54:47.613723+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.613723+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:41:07.426920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.610569+0000","last_change":"2024-09-22T09:54:51.610489+0000","last_active":"2024-09-22T09:54:51.610569+0000","last_peered":"2024-09-22T09:54:51.610569+0000","last_clean":"2024-09-22T09:54:51.610569+0000","last_became_active":"2024-09-22T08:42:21.479225+0000","last_became_peered":"2024-09-22T08:42:21.479225+0000","last_unstale":"2024-09-22T09:54:51.610569+0000","last_undegraded":"2024-09-22T09:54:51.610569+0000","last_fullsized":"2024-09-22T09:54:51.610569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:51.610373+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.610373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:47:03.585252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"262'112","reported_seq":623,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.186599+0000","last_change":"2024-09-22T09:54:54.186548+0000","last_active":"2024-09-22T09:54:54.186599+0000","last_peered":"2024-09-22T09:54:54.186599+0000","last_clean":"2024-09-22T09:54:54.186599+0000","last_became_active":"2024-09-22T08:42:23.524318+0000","last_became_peered":"2024-09-22T08:42:23.524318+0000","last_unstale":"2024-09-22T09:54:54.186599+0000","last_undegraded":"2024-09-22T09:54:54.186599+0000","last_fullsized":"2024-09-22T09:54:54.186599+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'112","last_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_deep_scrub":"262'112","last_deep_scrub_stamp":"2024-09-22T09:54:54.186462+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.186462+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:40.537153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":144,"num_read_kb":142,"num_write":241,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"262'133","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.045828+0000","last_change":"2024-09-22T09:54:31.045733+0000","last_active":"2024-09-22T09:54:31.045828+0000","last_peered":"2024-09-22T09:54:31.045828+0000","last_clean":"2024-09-22T09:54:31.045828+0000","last_became_active":"2024-09-22T08:42:15.431682+0000","last_became_peered":"2024-09-22T08:42:15.431682+0000","last_unstale":"2024-09-22T09:54:31.045828+0000","last_undegraded":"2024-09-22T09:54:31.045828+0000","last_fullsized":"2024-09-22T09:54:31.045828+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'133","last_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_deep_scrub":"262'133","last_deep_scrub_stamp":"2024-09-22T09:54:31.045630+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.045630+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:36:20.196950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":620,"num_read_kb":522,"num_write":190,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"262'246","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.640322+0000","last_change":"2024-09-22T09:54:21.640226+0000","last_active":"2024-09-22T09:54:21.640322+0000","last_peered":"2024-09-22T09:54:21.640322+0000","last_clean":"2024-09-22T09:54:21.640322+0000","last_became_active":"2024-09-22T08:42:46.096336+0000","last_became_peered":"2024-09-22T08:42:46.096336+0000","last_unstale":"2024-09-22T09:54:21.640322+0000","last_undegraded":"2024-09-22T09:54:21.640322+0000","last_fullsized":"2024-09-22T09:54:21.640322+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:21.640096+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.640096+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.038690+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":41488,"num_write":1122,"num_write_kb":51848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"262'5","reported_seq":984,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.691015+0000","last_change":"2024-09-22T09:54:45.690912+0000","last_active":"2024-09-22T09:54:45.691015+0000","last_peered":"2024-09-22T09:54:45.691015+0000","last_clean":"2024-09-22T09:54:45.691015+0000","last_became_active":"2024-09-22T08:42:17.436424+0000","last_became_peered":"2024-09-22T08:42:17.436424+0000","last_unstale":"2024-09-22T09:54:45.691015+0000","last_undegraded":"2024-09-22T09:54:45.691015+0000","last_fullsized":"2024-09-22T09:54:45.691015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-22T09:54:45.690818+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.690818+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:00:10.394599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"262'147","reported_seq":706,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.635381+0000","last_change":"2024-09-22T09:54:37.635267+0000","last_active":"2024-09-22T09:54:37.635381+0000","last_peered":"2024-09-22T09:54:37.635381+0000","last_clean":"2024-09-22T09:54:37.635381+0000","last_became_active":"2024-09-22T08:42:19.452943+0000","last_became_peered":"2024-09-22T08:42:19.452943+0000","last_unstale":"2024-09-22T09:54:37.635381+0000","last_undegraded":"2024-09-22T09:54:37.635381+0000","last_fullsized":"2024-09-22T09:54:37.635381+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:54:37.635149+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.635149+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:47:19.442915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":161,"num_write":112,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"262'747","reported_seq":2945,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.596952+0000","last_change":"2024-09-22T09:54:50.596897+0000","last_active":"2024-09-22T09:54:50.596952+0000","last_peered":"2024-09-22T09:54:50.596952+0000","last_clean":"2024-09-22T09:54:50.596952+0000","last_became_active":"2024-09-22T08:42:21.477091+0000","last_became_peered":"2024-09-22T08:42:21.477091+0000","last_unstale":"2024-09-22T09:54:50.596952+0000","last_undegraded":"2024-09-22T09:54:50.596952+0000","last_fullsized":"2024-09-22T09:54:50.596952+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'747","last_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_deep_scrub":"262'747","last_deep_scrub_stamp":"2024-09-22T09:54:50.596813+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.596813+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:15:33.365832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"262'220","reported_seq":1057,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.645529+0000","last_change":"2024-09-22T09:54:56.645439+0000","last_active":"2024-09-22T09:54:56.645529+0000","last_peered":"2024-09-22T09:54:56.645529+0000","last_clean":"2024-09-22T09:54:56.645529+0000","last_became_active":"2024-09-22T08:42:23.578125+0000","last_became_peered":"2024-09-22T08:42:23.578125+0000","last_unstale":"2024-09-22T09:54:56.645529+0000","last_undegraded":"2024-09-22T09:54:56.645529+0000","last_fullsized":"2024-09-22T09:54:56.645529+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:56.645339+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.645339+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:47:58.691212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":672,"num_read_kb":664,"num_write":478,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"262'126","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.841822+0000","last_change":"2024-09-22T09:54:33.841700+0000","last_active":"2024-09-22T09:54:33.841822+0000","last_peered":"2024-09-22T09:54:33.841822+0000","last_clean":"2024-09-22T09:54:33.841822+0000","last_became_active":"2024-09-22T08:42:15.435630+0000","last_became_peered":"2024-09-22T08:42:15.435630+0000","last_unstale":"2024-09-22T09:54:33.841822+0000","last_undegraded":"2024-09-22T09:54:33.841822+0000","last_fullsized":"2024-09-22T09:54:33.841822+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'126","last_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_deep_scrub":"262'126","last_deep_scrub_stamp":"2024-09-22T09:54:33.841584+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.841584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:42.546104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":532,"num_read_kb":432,"num_write":193,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"262'178","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.765183+0000","last_change":"2024-09-22T09:54:22.765090+0000","last_active":"2024-09-22T09:54:22.765183+0000","last_peered":"2024-09-22T09:54:22.765183+0000","last_clean":"2024-09-22T09:54:22.765183+0000","last_became_active":"2024-09-22T08:42:13.399973+0000","last_became_peered":"2024-09-22T08:42:13.399973+0000","last_unstale":"2024-09-22T09:54:22.765183+0000","last_undegraded":"2024-09-22T09:54:22.765183+0000","last_fullsized":"2024-09-22T09:54:22.765183+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'178","last_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_deep_scrub":"262'178","last_deep_scrub_stamp":"2024-09-22T09:54:22.764975+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.764975+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:48:45.588343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":541,"num_read_kb":49818,"num_write":846,"num_write_kb":44523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.314863+0000","last_change":"2024-09-22T09:54:41.314799+0000","last_active":"2024-09-22T09:54:41.314863+0000","last_peered":"2024-09-22T09:54:41.314863+0000","last_clean":"2024-09-22T09:54:41.314863+0000","last_became_active":"2024-09-22T08:42:17.435308+0000","last_became_peered":"2024-09-22T08:42:17.435308+0000","last_unstale":"2024-09-22T09:54:41.314863+0000","last_undegraded":"2024-09-22T09:54:41.314863+0000","last_fullsized":"2024-09-22T09:54:41.314863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.314713+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.314713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:29.075728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"262'155","reported_seq":740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.591755+0000","last_change":"2024-09-22T09:54:45.591689+0000","last_active":"2024-09-22T09:54:45.591755+0000","last_peered":"2024-09-22T09:54:45.591755+0000","last_clean":"2024-09-22T09:54:45.591755+0000","last_became_active":"2024-09-22T08:42:19.456253+0000","last_became_peered":"2024-09-22T08:42:19.456253+0000","last_unstale":"2024-09-22T09:54:45.591755+0000","last_undegraded":"2024-09-22T09:54:45.591755+0000","last_fullsized":"2024-09-22T09:54:45.591755+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:45.591608+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.591608+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:04.286884+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":274,"num_write":110,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"262'756","reported_seq":2410,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.693901+0000","last_change":"2024-09-22T09:54:55.693845+0000","last_active":"2024-09-22T09:54:55.693901+0000","last_peered":"2024-09-22T09:54:55.693901+0000","last_clean":"2024-09-22T09:54:55.693901+0000","last_became_active":"2024-09-22T08:42:21.478550+0000","last_became_peered":"2024-09-22T08:42:21.478550+0000","last_unstale":"2024-09-22T09:54:55.693901+0000","last_undegraded":"2024-09-22T09:54:55.693901+0000","last_fullsized":"2024-09-22T09:54:55.693901+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:55.693756+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.693756+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:39:43.607812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"262'123","reported_seq":755,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.420090+0000","last_change":"2024-09-22T09:54:32.420090+0000","last_active":"2024-09-22T09:54:32.420090+0000","last_peered":"2024-09-22T09:54:32.420090+0000","last_clean":"2024-09-22T09:54:32.420090+0000","last_became_active":"2024-09-22T08:42:15.434296+0000","last_became_peered":"2024-09-22T08:42:15.434296+0000","last_unstale":"2024-09-22T09:54:32.420090+0000","last_undegraded":"2024-09-22T09:54:32.420090+0000","last_fullsized":"2024-09-22T09:54:32.420090+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:32.419968+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.419968+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:15:58.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":449,"num_write":176,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"262'193","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.589508+0000","last_change":"2024-09-22T09:54:20.589426+0000","last_active":"2024-09-22T09:54:20.589508+0000","last_peered":"2024-09-22T09:54:20.589508+0000","last_clean":"2024-09-22T09:54:20.589508+0000","last_became_active":"2024-09-22T08:42:46.096401+0000","last_became_peered":"2024-09-22T08:42:46.096401+0000","last_unstale":"2024-09-22T09:54:20.589508+0000","last_undegraded":"2024-09-22T09:54:20.589508+0000","last_fullsized":"2024-09-22T09:54:20.589508+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:20.589319+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.589319+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:48:56.187304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":37265,"num_write":903,"num_write_kb":42009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,1],"acting":[2,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.612874+0000","last_change":"2024-09-22T09:54:39.612874+0000","last_active":"2024-09-22T09:54:39.612874+0000","last_peered":"2024-09-22T09:54:39.612874+0000","last_clean":"2024-09-22T09:54:39.612874+0000","last_became_active":"2024-09-22T08:42:17.428464+0000","last_became_peered":"2024-09-22T08:42:17.428464+0000","last_unstale":"2024-09-22T09:54:39.612874+0000","last_undegraded":"2024-09-22T09:54:39.612874+0000","last_fullsized":"2024-09-22T09:54:39.612874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.612789+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.612789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:28:31.057982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"262'261","reported_seq":908,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.270530+0000","last_change":"2024-09-22T09:54:45.270530+0000","last_active":"2024-09-22T09:54:45.270530+0000","last_peered":"2024-09-22T09:54:45.270530+0000","last_clean":"2024-09-22T09:54:45.270530+0000","last_became_active":"2024-09-22T08:42:19.452775+0000","last_became_peered":"2024-09-22T08:42:19.452775+0000","last_unstale":"2024-09-22T09:54:45.270530+0000","last_undegraded":"2024-09-22T09:54:45.270530+0000","last_fullsized":"2024-09-22T09:54:45.270530+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'261","last_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_deep_scrub":"262'261","last_deep_scrub_stamp":"2024-09-22T09:54:45.270420+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.270420+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:42.250477+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6788,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":355,"num_read_kb":422,"num_write":210,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.156730+0000","last_change":"2024-09-22T09:54:42.156730+0000","last_active":"2024-09-22T09:54:42.156730+0000","last_peered":"2024-09-22T09:54:42.156730+0000","last_clean":"2024-09-22T09:54:42.156730+0000","last_became_active":"2024-09-22T08:42:21.473611+0000","last_became_peered":"2024-09-22T08:42:21.473611+0000","last_unstale":"2024-09-22T09:54:42.156730+0000","last_undegraded":"2024-09-22T09:54:42.156730+0000","last_fullsized":"2024-09-22T09:54:42.156730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.156637+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.156637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:54:18.182730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'585","reported_seq":1417,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.319026+0000","last_change":"2024-09-22T09:54:51.318921+0000","last_active":"2024-09-22T09:54:51.319026+0000","last_peered":"2024-09-22T09:54:51.319026+0000","last_clean":"2024-09-22T09:54:51.319026+0000","last_became_active":"2024-09-22T08:42:23.524324+0000","last_became_peered":"2024-09-22T08:42:23.524324+0000","last_unstale":"2024-09-22T09:54:51.319026+0000","last_undegraded":"2024-09-22T09:54:51.319026+0000","last_fullsized":"2024-09-22T09:54:51.319026+0000","mapping_epoch":34,"log_start":"262'500","ondisk_log_start":"262'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'585","last_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_deep_scrub":"262'585","last_deep_scrub_stamp":"2024-09-22T09:54:51.318823+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.318823+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:09:14.774473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1388,"num_read_kb":1376,"num_write":1235,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"262'361","reported_seq":1004,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.714675+0000","last_change":"2024-09-22T09:54:25.714675+0000","last_active":"2024-09-22T09:54:25.714675+0000","last_peered":"2024-09-22T09:54:25.714675+0000","last_clean":"2024-09-22T09:54:25.714675+0000","last_became_active":"2024-09-22T08:42:15.437292+0000","last_became_peered":"2024-09-22T08:42:15.437292+0000","last_unstale":"2024-09-22T09:54:25.714675+0000","last_undegraded":"2024-09-22T09:54:25.714675+0000","last_fullsized":"2024-09-22T09:54:25.714675+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'361","last_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_deep_scrub":"262'361","last_deep_scrub_stamp":"2024-09-22T09:54:25.714587+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.714587+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:22:34.018478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1557,"num_read_kb":1229,"num_write":560,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"262'229","reported_seq":889,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.529569+0000","last_change":"2024-09-22T09:54:24.529569+0000","last_active":"2024-09-22T09:54:24.529569+0000","last_peered":"2024-09-22T09:54:24.529569+0000","last_clean":"2024-09-22T09:54:24.529569+0000","last_became_active":"2024-09-22T08:42:13.415163+0000","last_became_peered":"2024-09-22T08:42:13.415163+0000","last_unstale":"2024-09-22T09:54:24.529569+0000","last_undegraded":"2024-09-22T09:54:24.529569+0000","last_fullsized":"2024-09-22T09:54:24.529569+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:24.529439+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.529439+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:09:38.886184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":43078,"num_write":996,"num_write_kb":29962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.616335+0000","last_change":"2024-09-22T09:54:32.616335+0000","last_active":"2024-09-22T09:54:32.616335+0000","last_peered":"2024-09-22T09:54:32.616335+0000","last_clean":"2024-09-22T09:54:32.616335+0000","last_became_active":"2024-09-22T08:42:17.437532+0000","last_became_peered":"2024-09-22T08:42:17.437532+0000","last_unstale":"2024-09-22T09:54:32.616335+0000","last_undegraded":"2024-09-22T09:54:32.616335+0000","last_fullsized":"2024-09-22T09:54:32.616335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:32.616231+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.616231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:51:46.763351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"262'156","reported_seq":744,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.618841+0000","last_change":"2024-09-22T09:54:47.618841+0000","last_active":"2024-09-22T09:54:47.618841+0000","last_peered":"2024-09-22T09:54:47.618841+0000","last_clean":"2024-09-22T09:54:47.618841+0000","last_became_active":"2024-09-22T08:42:19.452753+0000","last_became_peered":"2024-09-22T08:42:19.452753+0000","last_unstale":"2024-09-22T09:54:47.618841+0000","last_undegraded":"2024-09-22T09:54:47.618841+0000","last_fullsized":"2024-09-22T09:54:47.618841+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'156","last_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_deep_scrub":"262'156","last_deep_scrub_stamp":"2024-09-22T09:54:47.618725+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.618725+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:25.667231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":192,"num_read_kb":232,"num_write":104,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.708854+0000","last_change":"2024-09-22T09:54:59.708854+0000","last_active":"2024-09-22T09:54:59.708854+0000","last_peered":"2024-09-22T09:54:59.708854+0000","last_clean":"2024-09-22T09:54:59.708854+0000","last_became_active":"2024-09-22T08:42:21.477705+0000","last_became_peered":"2024-09-22T08:42:21.477705+0000","last_unstale":"2024-09-22T09:54:59.708854+0000","last_undegraded":"2024-09-22T09:54:59.708854+0000","last_fullsized":"2024-09-22T09:54:59.708854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.708750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.708750+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.708750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:14:32.863560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"262'2546","reported_seq":4391,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.009419+0000","last_change":"2024-09-22T09:54:44.009360+0000","last_active":"2024-09-22T09:54:44.009419+0000","last_peered":"2024-09-22T09:54:44.009419+0000","last_clean":"2024-09-22T09:54:44.009419+0000","last_became_active":"2024-09-22T08:42:23.524890+0000","last_became_peered":"2024-09-22T08:42:23.524890+0000","last_unstale":"2024-09-22T09:54:44.009419+0000","last_undegraded":"2024-09-22T09:54:44.009419+0000","last_fullsized":"2024-09-22T09:54:44.009419+0000","mapping_epoch":34,"log_start":"262'2500","ondisk_log_start":"262'2500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2546","last_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_deep_scrub":"262'2546","last_deep_scrub_stamp":"2024-09-22T09:54:44.009269+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.009269+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":2500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:08:56.015174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6259,"num_read_kb":6250,"num_write":5139,"num_write_kb":1902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"262'595","reported_seq":1208,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.925826+0000","last_change":"2024-09-22T09:54:30.925826+0000","last_active":"2024-09-22T09:54:30.925826+0000","last_peered":"2024-09-22T09:54:30.925826+0000","last_clean":"2024-09-22T09:54:30.925826+0000","last_became_active":"2024-09-22T08:42:15.439218+0000","last_became_peered":"2024-09-22T08:42:15.439218+0000","last_unstale":"2024-09-22T09:54:30.925826+0000","last_undegraded":"2024-09-22T09:54:30.925826+0000","last_fullsized":"2024-09-22T09:54:30.925826+0000","mapping_epoch":26,"log_start":"259'500","ondisk_log_start":"259'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'595","last_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_deep_scrub":"262'595","last_deep_scrub_stamp":"2024-09-22T09:54:30.925742+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.925742+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:48:22.030833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6255,"num_read_kb":5768,"num_write":1097,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"262'249","reported_seq":902,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.496340+0000","last_change":"2024-09-22T09:54:25.496340+0000","last_active":"2024-09-22T09:54:25.496340+0000","last_peered":"2024-09-22T09:54:25.496340+0000","last_clean":"2024-09-22T09:54:25.496340+0000","last_became_active":"2024-09-22T08:42:13.421157+0000","last_became_peered":"2024-09-22T08:42:13.421157+0000","last_unstale":"2024-09-22T09:54:25.496340+0000","last_undegraded":"2024-09-22T09:54:25.496340+0000","last_fullsized":"2024-09-22T09:54:25.496340+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'249","last_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_deep_scrub":"262'249","last_deep_scrub_stamp":"2024-09-22T09:54:25.496221+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.496221+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:55:36.135437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":603,"num_read_kb":17581,"num_write":1026,"num_write_kb":41394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.594837+0000","last_change":"2024-09-22T09:54:34.594837+0000","last_active":"2024-09-22T09:54:34.594837+0000","last_peered":"2024-09-22T09:54:34.594837+0000","last_clean":"2024-09-22T09:54:34.594837+0000","last_became_active":"2024-09-22T08:42:17.437514+0000","last_became_peered":"2024-09-22T08:42:17.437514+0000","last_unstale":"2024-09-22T09:54:34.594837+0000","last_undegraded":"2024-09-22T09:54:34.594837+0000","last_fullsized":"2024-09-22T09:54:34.594837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:34.594730+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.594730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:46:44.826276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"262'205","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.614475+0000","last_change":"2024-09-22T09:54:47.614475+0000","last_active":"2024-09-22T09:54:47.614475+0000","last_peered":"2024-09-22T09:54:47.614475+0000","last_clean":"2024-09-22T09:54:47.614475+0000","last_became_active":"2024-09-22T08:42:19.455487+0000","last_became_peered":"2024-09-22T08:42:19.455487+0000","last_unstale":"2024-09-22T09:54:47.614475+0000","last_undegraded":"2024-09-22T09:54:47.614475+0000","last_fullsized":"2024-09-22T09:54:47.614475+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:47.614376+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.614376+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:22.763339+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6515,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":336,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"262'759","reported_seq":2733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.172282+0000","last_change":"2024-09-22T09:54:48.172282+0000","last_active":"2024-09-22T09:54:48.172282+0000","last_peered":"2024-09-22T09:54:48.172282+0000","last_clean":"2024-09-22T09:54:48.172282+0000","last_became_active":"2024-09-22T08:42:21.479748+0000","last_became_peered":"2024-09-22T08:42:21.479748+0000","last_unstale":"2024-09-22T09:54:48.172282+0000","last_undegraded":"2024-09-22T09:54:48.172282+0000","last_fullsized":"2024-09-22T09:54:48.172282+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:48.172190+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.172190+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:52:13.572393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'120","reported_seq":632,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.102960+0000","last_change":"2024-09-22T09:54:51.102960+0000","last_active":"2024-09-22T09:54:51.102960+0000","last_peered":"2024-09-22T09:54:51.102960+0000","last_clean":"2024-09-22T09:54:51.102960+0000","last_became_active":"2024-09-22T08:42:23.526971+0000","last_became_peered":"2024-09-22T08:42:23.526971+0000","last_unstale":"2024-09-22T09:54:51.102960+0000","last_undegraded":"2024-09-22T09:54:51.102960+0000","last_fullsized":"2024-09-22T09:54:51.102960+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:51.102863+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.102863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:28.997939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":152,"num_write":279,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"262'240","reported_seq":892,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.039780+0000","last_change":"2024-09-22T09:54:32.039780+0000","last_active":"2024-09-22T09:54:32.039780+0000","last_peered":"2024-09-22T09:54:32.039780+0000","last_clean":"2024-09-22T09:54:32.039780+0000","last_became_active":"2024-09-22T08:42:15.435045+0000","last_became_peered":"2024-09-22T08:42:15.435045+0000","last_unstale":"2024-09-22T09:54:32.039780+0000","last_undegraded":"2024-09-22T09:54:32.039780+0000","last_fullsized":"2024-09-22T09:54:32.039780+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:32.039644+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.039644+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:34:49.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1040,"num_read_kb":844,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"262'210","reported_seq":874,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.582258+0000","last_change":"2024-09-22T09:54:25.582258+0000","last_active":"2024-09-22T09:54:25.582258+0000","last_peered":"2024-09-22T09:54:25.582258+0000","last_clean":"2024-09-22T09:54:25.582258+0000","last_became_active":"2024-09-22T08:42:13.403093+0000","last_became_peered":"2024-09-22T08:42:13.403093+0000","last_unstale":"2024-09-22T09:54:25.582258+0000","last_undegraded":"2024-09-22T09:54:25.582258+0000","last_fullsized":"2024-09-22T09:54:25.582258+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.582157+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.582157+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:52:50.691745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":60855,"num_write":915,"num_write_kb":50287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.585259+0000","last_change":"2024-09-22T09:54:33.585259+0000","last_active":"2024-09-22T09:54:33.585259+0000","last_peered":"2024-09-22T09:54:33.585259+0000","last_clean":"2024-09-22T09:54:33.585259+0000","last_became_active":"2024-09-22T08:42:17.435503+0000","last_became_peered":"2024-09-22T08:42:17.435503+0000","last_unstale":"2024-09-22T09:54:33.585259+0000","last_undegraded":"2024-09-22T09:54:33.585259+0000","last_fullsized":"2024-09-22T09:54:33.585259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.585167+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.585167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:48.585700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"262'207","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.053559+0000","last_change":"2024-09-22T09:54:42.053559+0000","last_active":"2024-09-22T09:54:42.053559+0000","last_peered":"2024-09-22T09:54:42.053559+0000","last_clean":"2024-09-22T09:54:42.053559+0000","last_became_active":"2024-09-22T08:42:19.451697+0000","last_became_peered":"2024-09-22T08:42:19.451697+0000","last_unstale":"2024-09-22T09:54:42.053559+0000","last_undegraded":"2024-09-22T09:54:42.053559+0000","last_fullsized":"2024-09-22T09:54:42.053559+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:42.053464+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.053464+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:54:38.800886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":297,"num_read_kb":387,"num_write":144,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.595291+0000","last_change":"2024-09-22T09:54:38.595291+0000","last_active":"2024-09-22T09:54:38.595291+0000","last_peered":"2024-09-22T09:54:38.595291+0000","last_clean":"2024-09-22T09:54:38.595291+0000","last_became_active":"2024-09-22T08:42:21.478984+0000","last_became_peered":"2024-09-22T08:42:21.478984+0000","last_unstale":"2024-09-22T09:54:38.595291+0000","last_undegraded":"2024-09-22T09:54:38.595291+0000","last_fullsized":"2024-09-22T09:54:38.595291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.595189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.595189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:49:49.766642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"262'143","reported_seq":661,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.157662+0000","last_change":"2024-09-22T09:54:47.157662+0000","last_active":"2024-09-22T09:54:47.157662+0000","last_peered":"2024-09-22T09:54:47.157662+0000","last_clean":"2024-09-22T09:54:47.157662+0000","last_became_active":"2024-09-22T08:42:23.525053+0000","last_became_peered":"2024-09-22T08:42:23.525053+0000","last_unstale":"2024-09-22T09:54:47.157662+0000","last_undegraded":"2024-09-22T09:54:47.157662+0000","last_fullsized":"2024-09-22T09:54:47.157662+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:47.157571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.157571+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:24:55.768204+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":184,"num_write":331,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"262'113","reported_seq":709,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.695111+0000","last_change":"2024-09-22T09:54:26.695111+0000","last_active":"2024-09-22T09:54:26.695111+0000","last_peered":"2024-09-22T09:54:26.695111+0000","last_clean":"2024-09-22T09:54:26.695111+0000","last_became_active":"2024-09-22T08:42:15.430249+0000","last_became_peered":"2024-09-22T08:42:15.430249+0000","last_unstale":"2024-09-22T09:54:26.695111+0000","last_undegraded":"2024-09-22T09:54:26.695111+0000","last_fullsized":"2024-09-22T09:54:26.695111+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'113","last_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_deep_scrub":"262'113","last_deep_scrub_stamp":"2024-09-22T09:54:26.695015+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.695015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:53:37.239794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":170,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"262'366","reported_seq":1059,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.883932+0000","last_change":"2024-09-22T09:54:21.883932+0000","last_active":"2024-09-22T09:54:21.883932+0000","last_peered":"2024-09-22T09:54:21.883932+0000","last_clean":"2024-09-22T09:54:21.883932+0000","last_became_active":"2024-09-22T08:42:13.401384+0000","last_became_peered":"2024-09-22T08:42:13.401384+0000","last_unstale":"2024-09-22T09:54:21.883932+0000","last_undegraded":"2024-09-22T09:54:21.883932+0000","last_fullsized":"2024-09-22T09:54:21.883932+0000","mapping_epoch":24,"log_start":"262'300","ondisk_log_start":"262'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:21.883821+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.883821+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:34:21.748018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1019,"num_read_kb":7434,"num_write":1387,"num_write_kb":33972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.591498+0000","last_change":"2024-09-22T09:54:35.591498+0000","last_active":"2024-09-22T09:54:35.591498+0000","last_peered":"2024-09-22T09:54:35.591498+0000","last_clean":"2024-09-22T09:54:35.591498+0000","last_became_active":"2024-09-22T08:42:17.437850+0000","last_became_peered":"2024-09-22T08:42:17.437850+0000","last_unstale":"2024-09-22T09:54:35.591498+0000","last_undegraded":"2024-09-22T09:54:35.591498+0000","last_fullsized":"2024-09-22T09:54:35.591498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.591372+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.591372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:56:34.926025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"262'172","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.579674+0000","last_change":"2024-09-22T09:54:45.579674+0000","last_active":"2024-09-22T09:54:45.579674+0000","last_peered":"2024-09-22T09:54:45.579674+0000","last_clean":"2024-09-22T09:54:45.579674+0000","last_became_active":"2024-09-22T08:42:19.454649+0000","last_became_peered":"2024-09-22T08:42:19.454649+0000","last_unstale":"2024-09-22T09:54:45.579674+0000","last_undegraded":"2024-09-22T09:54:45.579674+0000","last_fullsized":"2024-09-22T09:54:45.579674+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'172","last_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_deep_scrub":"262'172","last_deep_scrub_stamp":"2024-09-22T09:54:45.579593+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.579593+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:10:11.237734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5433,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":270,"num_write":182,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:59.281353+0000","last_change":"2024-09-22T09:54:59.281353+0000","last_active":"2024-09-22T09:54:59.281353+0000","last_peered":"2024-09-22T09:54:59.281353+0000","last_clean":"2024-09-22T09:54:59.281353+0000","last_became_active":"2024-09-22T08:42:21.483035+0000","last_became_peered":"2024-09-22T08:42:21.483035+0000","last_unstale":"2024-09-22T09:54:59.281353+0000","last_undegraded":"2024-09-22T09:54:59.281353+0000","last_fullsized":"2024-09-22T09:54:59.281353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:59.281254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:59.281254+0000","last_clean_scrub_stamp":"2024-09-22T09:54:59.281254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:28:15.007520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"262'137","reported_seq":652,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:57.705175+0000","last_change":"2024-09-22T09:54:57.705175+0000","last_active":"2024-09-22T09:54:57.705175+0000","last_peered":"2024-09-22T09:54:57.705175+0000","last_clean":"2024-09-22T09:54:57.705175+0000","last_became_active":"2024-09-22T08:42:23.528117+0000","last_became_peered":"2024-09-22T08:42:23.528117+0000","last_unstale":"2024-09-22T09:54:57.705175+0000","last_undegraded":"2024-09-22T09:54:57.705175+0000","last_fullsized":"2024-09-22T09:54:57.705175+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:57.705083+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:57.705083+0000","last_clean_scrub_stamp":"2024-09-22T09:54:57.705083+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:04:47.471590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":192,"num_write":331,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"262'222","reported_seq":872,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.718751+0000","last_change":"2024-09-22T09:54:27.718751+0000","last_active":"2024-09-22T09:54:27.718751+0000","last_peered":"2024-09-22T09:54:27.718751+0000","last_clean":"2024-09-22T09:54:27.718751+0000","last_became_active":"2024-09-22T08:42:15.429285+0000","last_became_peered":"2024-09-22T08:42:15.429285+0000","last_unstale":"2024-09-22T09:54:27.718751+0000","last_undegraded":"2024-09-22T09:54:27.718751+0000","last_fullsized":"2024-09-22T09:54:27.718751+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:27.718664+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.718664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:52.332290+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":993,"num_read_kb":824,"num_write":348,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"262'237","reported_seq":935,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.813127+0000","last_change":"2024-09-22T09:54:21.813127+0000","last_active":"2024-09-22T09:54:21.813127+0000","last_peered":"2024-09-22T09:54:21.813127+0000","last_clean":"2024-09-22T09:54:21.813127+0000","last_became_active":"2024-09-22T08:42:13.403218+0000","last_became_peered":"2024-09-22T08:42:13.403218+0000","last_unstale":"2024-09-22T09:54:21.813127+0000","last_undegraded":"2024-09-22T09:54:21.813127+0000","last_fullsized":"2024-09-22T09:54:21.813127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:21.812963+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.812963+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:16:20.379997+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242950,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":767,"num_read_kb":42930,"num_write":1126,"num_write_kb":53904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.200568+0000","last_change":"2024-09-22T09:54:36.200568+0000","last_active":"2024-09-22T09:54:36.200568+0000","last_peered":"2024-09-22T09:54:36.200568+0000","last_clean":"2024-09-22T09:54:36.200568+0000","last_became_active":"2024-09-22T08:42:17.436356+0000","last_became_peered":"2024-09-22T08:42:17.436356+0000","last_unstale":"2024-09-22T09:54:36.200568+0000","last_undegraded":"2024-09-22T09:54:36.200568+0000","last_fullsized":"2024-09-22T09:54:36.200568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.200478+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.200478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:55:14.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"262'199","reported_seq":812,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.623404+0000","last_change":"2024-09-22T09:54:36.623404+0000","last_active":"2024-09-22T09:54:36.623404+0000","last_peered":"2024-09-22T09:54:36.623404+0000","last_clean":"2024-09-22T09:54:36.623404+0000","last_became_active":"2024-09-22T08:42:19.451328+0000","last_became_peered":"2024-09-22T08:42:19.451328+0000","last_unstale":"2024-09-22T09:54:36.623404+0000","last_undegraded":"2024-09-22T09:54:36.623404+0000","last_fullsized":"2024-09-22T09:54:36.623404+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:36.623296+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.623296+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:27.880579+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4459,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"262'722","reported_seq":2504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.636408+0000","last_change":"2024-09-22T09:54:39.636408+0000","last_active":"2024-09-22T09:54:39.636408+0000","last_peered":"2024-09-22T09:54:39.636408+0000","last_clean":"2024-09-22T09:54:39.636408+0000","last_became_active":"2024-09-22T08:42:21.477422+0000","last_became_peered":"2024-09-22T08:42:21.477422+0000","last_unstale":"2024-09-22T09:54:39.636408+0000","last_undegraded":"2024-09-22T09:54:39.636408+0000","last_fullsized":"2024-09-22T09:54:39.636408+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'722","last_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_deep_scrub":"262'722","last_deep_scrub_stamp":"2024-09-22T09:54:39.636312+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.636312+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:53:26.968453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"262'142","reported_seq":651,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.217701+0000","last_change":"2024-09-22T09:54:45.217597+0000","last_active":"2024-09-22T09:54:45.217701+0000","last_peered":"2024-09-22T09:54:45.217701+0000","last_clean":"2024-09-22T09:54:45.217701+0000","last_became_active":"2024-09-22T08:42:23.526566+0000","last_became_peered":"2024-09-22T08:42:23.526566+0000","last_unstale":"2024-09-22T09:54:45.217701+0000","last_undegraded":"2024-09-22T09:54:45.217701+0000","last_fullsized":"2024-09-22T09:54:45.217701+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:45.217484+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.217484+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:33.960189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":174,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"262'123","reported_seq":731,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.702387+0000","last_change":"2024-09-22T09:54:28.702387+0000","last_active":"2024-09-22T09:54:28.702387+0000","last_peered":"2024-09-22T09:54:28.702387+0000","last_clean":"2024-09-22T09:54:28.702387+0000","last_became_active":"2024-09-22T08:42:15.434323+0000","last_became_peered":"2024-09-22T08:42:15.434323+0000","last_unstale":"2024-09-22T09:54:28.702387+0000","last_undegraded":"2024-09-22T09:54:28.702387+0000","last_fullsized":"2024-09-22T09:54:28.702387+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:28.702304+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.702304+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:11.348442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":572,"num_read_kb":480,"num_write":184,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"262'258","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.856222+0000","last_change":"2024-09-22T09:54:22.856222+0000","last_active":"2024-09-22T09:54:22.856222+0000","last_peered":"2024-09-22T09:54:22.856222+0000","last_clean":"2024-09-22T09:54:22.856222+0000","last_became_active":"2024-09-22T08:42:46.164703+0000","last_became_peered":"2024-09-22T08:42:46.164703+0000","last_unstale":"2024-09-22T09:54:22.856222+0000","last_undegraded":"2024-09-22T09:54:22.856222+0000","last_fullsized":"2024-09-22T09:54:22.856222+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'258","last_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_deep_scrub":"262'258","last_deep_scrub_stamp":"2024-09-22T09:54:22.856126+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.856126+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:25:10.632167+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1203,"num_read_kb":6055,"num_write":1103,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,1],"acting":[3,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"262'4","reported_seq":1463,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.292562+0000","last_change":"2024-09-22T09:54:42.292562+0000","last_active":"2024-09-22T09:54:42.292562+0000","last_peered":"2024-09-22T09:54:42.292562+0000","last_clean":"2024-09-22T09:54:42.292562+0000","last_became_active":"2024-09-22T08:42:17.432706+0000","last_became_peered":"2024-09-22T08:42:17.432706+0000","last_unstale":"2024-09-22T09:54:42.292562+0000","last_undegraded":"2024-09-22T09:54:42.292562+0000","last_fullsized":"2024-09-22T09:54:42.292562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:42.292452+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.292452+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:27:15.247545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"262'137","reported_seq":680,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.616883+0000","last_change":"2024-09-22T09:54:48.616883+0000","last_active":"2024-09-22T09:54:48.616883+0000","last_peered":"2024-09-22T09:54:48.616883+0000","last_clean":"2024-09-22T09:54:48.616883+0000","last_became_active":"2024-09-22T08:42:19.456802+0000","last_became_peered":"2024-09-22T08:42:19.456802+0000","last_unstale":"2024-09-22T09:54:48.616883+0000","last_undegraded":"2024-09-22T09:54:48.616883+0000","last_fullsized":"2024-09-22T09:54:48.616883+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:48.616758+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.616758+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:33.434488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"262'757","reported_seq":2739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.965816+0000","last_change":"2024-09-22T09:54:39.965816+0000","last_active":"2024-09-22T09:54:39.965816+0000","last_peered":"2024-09-22T09:54:39.965816+0000","last_clean":"2024-09-22T09:54:39.965816+0000","last_became_active":"2024-09-22T08:42:21.478993+0000","last_became_peered":"2024-09-22T08:42:21.478993+0000","last_unstale":"2024-09-22T09:54:39.965816+0000","last_undegraded":"2024-09-22T09:54:39.965816+0000","last_fullsized":"2024-09-22T09:54:39.965816+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'757","last_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_deep_scrub":"262'757","last_deep_scrub_stamp":"2024-09-22T09:54:39.965733+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.965733+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:11:52.549736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'120","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.624201+0000","last_change":"2024-09-22T09:54:52.624151+0000","last_active":"2024-09-22T09:54:52.624201+0000","last_peered":"2024-09-22T09:54:52.624201+0000","last_clean":"2024-09-22T09:54:52.624201+0000","last_became_active":"2024-09-22T08:42:23.526639+0000","last_became_peered":"2024-09-22T08:42:23.526639+0000","last_unstale":"2024-09-22T09:54:52.624201+0000","last_undegraded":"2024-09-22T09:54:52.624201+0000","last_fullsized":"2024-09-22T09:54:52.624201+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'120","last_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_deep_scrub":"262'120","last_deep_scrub_stamp":"2024-09-22T09:54:52.624066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.624066+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:03:54.701435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":129,"num_write":277,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"262'4209","reported_seq":4838,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.222747+0000","last_change":"2024-09-22T09:54:31.222655+0000","last_active":"2024-09-22T09:54:31.222747+0000","last_peered":"2024-09-22T09:54:31.222747+0000","last_clean":"2024-09-22T09:54:31.222747+0000","last_became_active":"2024-09-22T08:42:15.433919+0000","last_became_peered":"2024-09-22T08:42:15.433919+0000","last_unstale":"2024-09-22T09:54:31.222747+0000","last_undegraded":"2024-09-22T09:54:31.222747+0000","last_fullsized":"2024-09-22T09:54:31.222747+0000","mapping_epoch":26,"log_start":"262'4100","ondisk_log_start":"262'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4209","last_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_deep_scrub":"262'4209","last_deep_scrub_stamp":"2024-09-22T09:54:31.222546+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.222546+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":3000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:03.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16893,"num_read_kb":14163,"num_write":6315,"num_write_kb":3159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"262'188","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.824881+0000","last_change":"2024-09-22T09:54:29.824881+0000","last_active":"2024-09-22T09:54:29.824881+0000","last_peered":"2024-09-22T09:54:29.824881+0000","last_clean":"2024-09-22T09:54:29.824881+0000","last_became_active":"2024-09-22T08:42:13.402949+0000","last_became_peered":"2024-09-22T08:42:13.402949+0000","last_unstale":"2024-09-22T09:54:29.824881+0000","last_undegraded":"2024-09-22T09:54:29.824881+0000","last_fullsized":"2024-09-22T09:54:29.824881+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'188","last_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_deep_scrub":"262'188","last_deep_scrub_stamp":"2024-09-22T09:54:29.824757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.824757+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:11:54.380784+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":707,"num_read_kb":142631,"num_write":847,"num_write_kb":40935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.595584+0000","last_change":"2024-09-22T09:54:40.595584+0000","last_active":"2024-09-22T09:54:40.595584+0000","last_peered":"2024-09-22T09:54:40.595584+0000","last_clean":"2024-09-22T09:54:40.595584+0000","last_became_active":"2024-09-22T08:42:17.427744+0000","last_became_peered":"2024-09-22T08:42:17.427744+0000","last_unstale":"2024-09-22T09:54:40.595584+0000","last_undegraded":"2024-09-22T09:54:40.595584+0000","last_fullsized":"2024-09-22T09:54:40.595584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.595487+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.595487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:16:01.540605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"262'231","reported_seq":869,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.313887+0000","last_change":"2024-09-22T09:54:47.313887+0000","last_active":"2024-09-22T09:54:47.313887+0000","last_peered":"2024-09-22T09:54:47.313887+0000","last_clean":"2024-09-22T09:54:47.313887+0000","last_became_active":"2024-09-22T08:42:19.459499+0000","last_became_peered":"2024-09-22T08:42:19.459499+0000","last_unstale":"2024-09-22T09:54:47.313887+0000","last_undegraded":"2024-09-22T09:54:47.313887+0000","last_fullsized":"2024-09-22T09:54:47.313887+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'231","last_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_deep_scrub":"262'231","last_deep_scrub_stamp":"2024-09-22T09:54:47.313763+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.313763+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:24.558381+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4397,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":186,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.924774+0000","last_change":"2024-09-22T09:54:38.924774+0000","last_active":"2024-09-22T09:54:38.924774+0000","last_peered":"2024-09-22T09:54:38.924774+0000","last_clean":"2024-09-22T09:54:38.924774+0000","last_became_active":"2024-09-22T08:42:21.480768+0000","last_became_peered":"2024-09-22T08:42:21.480768+0000","last_unstale":"2024-09-22T09:54:38.924774+0000","last_undegraded":"2024-09-22T09:54:38.924774+0000","last_fullsized":"2024-09-22T09:54:38.924774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.924672+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.924672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:45.017694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"262'134","reported_seq":665,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.173283+0000","last_change":"2024-09-22T09:54:46.173214+0000","last_active":"2024-09-22T09:54:46.173283+0000","last_peered":"2024-09-22T09:54:46.173283+0000","last_clean":"2024-09-22T09:54:46.173283+0000","last_became_active":"2024-09-22T08:42:23.528741+0000","last_became_peered":"2024-09-22T08:42:23.528741+0000","last_unstale":"2024-09-22T09:54:46.173283+0000","last_undegraded":"2024-09-22T09:54:46.173283+0000","last_fullsized":"2024-09-22T09:54:46.173283+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:46.173116+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.173116+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:14.836807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":238,"num_write":310,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"262'325","reported_seq":1035,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.953838+0000","last_change":"2024-09-22T09:54:29.953765+0000","last_active":"2024-09-22T09:54:29.953838+0000","last_peered":"2024-09-22T09:54:29.953838+0000","last_clean":"2024-09-22T09:54:29.953838+0000","last_became_active":"2024-09-22T08:42:15.433952+0000","last_became_peered":"2024-09-22T08:42:15.433952+0000","last_unstale":"2024-09-22T09:54:29.953838+0000","last_undegraded":"2024-09-22T09:54:29.953838+0000","last_fullsized":"2024-09-22T09:54:29.953838+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'325","last_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_deep_scrub":"262'325","last_deep_scrub_stamp":"2024-09-22T09:54:29.953655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.953655+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:45:28.167803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1523,"num_read_kb":1268,"num_write":548,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"262'74","reported_seq":628,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.574870+0000","last_change":"2024-09-22T09:54:22.574870+0000","last_active":"2024-09-22T09:54:22.574870+0000","last_peered":"2024-09-22T09:54:22.574870+0000","last_clean":"2024-09-22T09:54:22.574870+0000","last_became_active":"2024-09-22T08:41:54.773789+0000","last_became_peered":"2024-09-22T08:41:54.773789+0000","last_unstale":"2024-09-22T09:54:22.574870+0000","last_undegraded":"2024-09-22T09:54:22.574870+0000","last_fullsized":"2024-09-22T09:54:22.574870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'74","last_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_deep_scrub":"262'74","last_deep_scrub_stamp":"2024-09-22T09:54:22.574784+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.574784+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:39:51.565048+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"262'2","reported_seq":539,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.531626+0000","last_change":"2024-09-22T09:54:22.531543+0000","last_active":"2024-09-22T09:54:22.531626+0000","last_peered":"2024-09-22T09:54:22.531626+0000","last_clean":"2024-09-22T09:54:22.531626+0000","last_became_active":"2024-09-22T08:42:00.237203+0000","last_became_peered":"2024-09-22T08:42:00.237203+0000","last_unstale":"2024-09-22T09:54:22.531626+0000","last_undegraded":"2024-09-22T09:54:22.531626+0000","last_fullsized":"2024-09-22T09:54:22.531626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:22.531426+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.531426+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:56:15.733698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046609499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"262'265","reported_seq":929,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.914127+0000","last_change":"2024-09-22T09:54:20.914080+0000","last_active":"2024-09-22T09:54:20.914127+0000","last_peered":"2024-09-22T09:54:20.914127+0000","last_clean":"2024-09-22T09:54:20.914127+0000","last_became_active":"2024-09-22T08:42:46.093156+0000","last_became_peered":"2024-09-22T08:42:46.093156+0000","last_unstale":"2024-09-22T09:54:20.914127+0000","last_undegraded":"2024-09-22T09:54:20.914127+0000","last_fullsized":"2024-09-22T09:54:20.914127+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'265","last_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_deep_scrub":"262'265","last_deep_scrub_stamp":"2024-09-22T09:54:20.913993+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.913993+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:10:34.016179+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":19734,"num_write":1091,"num_write_kb":42569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.605708+0000","last_change":"2024-09-22T09:54:38.605619+0000","last_active":"2024-09-22T09:54:38.605708+0000","last_peered":"2024-09-22T09:54:38.605708+0000","last_clean":"2024-09-22T09:54:38.605708+0000","last_became_active":"2024-09-22T08:42:17.430700+0000","last_became_peered":"2024-09-22T08:42:17.430700+0000","last_unstale":"2024-09-22T09:54:38.605708+0000","last_undegraded":"2024-09-22T09:54:38.605708+0000","last_fullsized":"2024-09-22T09:54:38.605708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.605481+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.605481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:30:27.706887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"262'328","reported_seq":1049,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.305495+0000","last_change":"2024-09-22T09:54:46.305495+0000","last_active":"2024-09-22T09:54:46.305495+0000","last_peered":"2024-09-22T09:54:46.305495+0000","last_clean":"2024-09-22T09:54:46.305495+0000","last_became_active":"2024-09-22T08:42:19.458145+0000","last_became_peered":"2024-09-22T08:42:19.458145+0000","last_unstale":"2024-09-22T09:54:46.305495+0000","last_undegraded":"2024-09-22T09:54:46.305495+0000","last_fullsized":"2024-09-22T09:54:46.305495+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'328","last_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_deep_scrub":"262'328","last_deep_scrub_stamp":"2024-09-22T09:54:46.305404+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.305404+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:41.226802+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":739,"num_write":494,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89468,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:47.187781+0000","last_change":"2024-09-22T09:54:47.187781+0000","last_active":"2024-09-22T09:54:47.187781+0000","last_peered":"2024-09-22T09:54:47.187781+0000","last_clean":"2024-09-22T09:54:47.187781+0000","last_became_active":"2024-09-22T08:42:21.476227+0000","last_became_peered":"2024-09-22T08:42:21.476227+0000","last_unstale":"2024-09-22T09:54:47.187781+0000","last_undegraded":"2024-09-22T09:54:47.187781+0000","last_fullsized":"2024-09-22T09:54:47.187781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:47.187615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:47.187615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:35:06.531153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"262'207","reported_seq":923,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.999122+0000","last_change":"2024-09-22T09:54:41.999122+0000","last_active":"2024-09-22T09:54:41.999122+0000","last_peered":"2024-09-22T09:54:41.999122+0000","last_clean":"2024-09-22T09:54:41.999122+0000","last_became_active":"2024-09-22T08:42:23.527671+0000","last_became_peered":"2024-09-22T08:42:23.527671+0000","last_unstale":"2024-09-22T09:54:41.999122+0000","last_undegraded":"2024-09-22T09:54:41.999122+0000","last_fullsized":"2024-09-22T09:54:41.999122+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'207","last_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_deep_scrub":"262'207","last_deep_scrub_stamp":"2024-09-22T09:54:41.999009+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.999009+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:23.532488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":500,"num_write":442,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"262'137","reported_seq":770,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.023195+0000","last_change":"2024-09-22T09:54:30.023195+0000","last_active":"2024-09-22T09:54:30.023195+0000","last_peered":"2024-09-22T09:54:30.023195+0000","last_clean":"2024-09-22T09:54:30.023195+0000","last_became_active":"2024-09-22T08:42:46.096035+0000","last_became_peered":"2024-09-22T08:42:46.096035+0000","last_unstale":"2024-09-22T09:54:30.023195+0000","last_undegraded":"2024-09-22T09:54:30.023195+0000","last_fullsized":"2024-09-22T09:54:30.023195+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'137","last_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_deep_scrub":"262'137","last_deep_scrub_stamp":"2024-09-22T09:54:30.023101+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.023101+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:48.412441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":647,"num_read_kb":571,"num_write":212,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.540005+0000","last_change":"2024-09-22T09:54:23.540005+0000","last_active":"2024-09-22T09:54:23.540005+0000","last_peered":"2024-09-22T09:54:23.540005+0000","last_clean":"2024-09-22T09:54:23.540005+0000","last_became_active":"2024-09-22T08:42:00.236622+0000","last_became_peered":"2024-09-22T08:42:00.236622+0000","last_unstale":"2024-09-22T09:54:23.540005+0000","last_undegraded":"2024-09-22T09:54:23.540005+0000","last_fullsized":"2024-09-22T09:54:23.540005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.539900+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:38.423290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041650200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"262'211","reported_seq":921,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.137380+0000","last_change":"2024-09-22T09:54:20.137314+0000","last_active":"2024-09-22T09:54:20.137380+0000","last_peered":"2024-09-22T09:54:20.137380+0000","last_clean":"2024-09-22T09:54:20.137380+0000","last_became_active":"2024-09-22T08:42:13.420482+0000","last_became_peered":"2024-09-22T08:42:13.420482+0000","last_unstale":"2024-09-22T09:54:20.137380+0000","last_undegraded":"2024-09-22T09:54:20.137380+0000","last_fullsized":"2024-09-22T09:54:20.137380+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'211","last_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_deep_scrub":"262'211","last_deep_scrub_stamp":"2024-09-22T09:54:20.137215+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.137215+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:07:24.795199+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":801,"num_read_kb":134895,"num_write":909,"num_write_kb":37297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.376894+0000","last_change":"2024-09-22T09:54:39.376894+0000","last_active":"2024-09-22T09:54:39.376894+0000","last_peered":"2024-09-22T09:54:39.376894+0000","last_clean":"2024-09-22T09:54:39.376894+0000","last_became_active":"2024-09-22T08:42:17.440558+0000","last_became_peered":"2024-09-22T08:42:17.440558+0000","last_unstale":"2024-09-22T09:54:39.376894+0000","last_undegraded":"2024-09-22T09:54:39.376894+0000","last_fullsized":"2024-09-22T09:54:39.376894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.376795+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.376795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:57.132187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"262'907","reported_seq":2728,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.170136+0000","last_change":"2024-09-22T09:54:39.170075+0000","last_active":"2024-09-22T09:54:39.170136+0000","last_peered":"2024-09-22T09:54:39.170136+0000","last_clean":"2024-09-22T09:54:39.170136+0000","last_became_active":"2024-09-22T08:42:19.454583+0000","last_became_peered":"2024-09-22T08:42:19.454583+0000","last_unstale":"2024-09-22T09:54:39.170136+0000","last_undegraded":"2024-09-22T09:54:39.170136+0000","last_fullsized":"2024-09-22T09:54:39.170136+0000","mapping_epoch":30,"log_start":"262'801","ondisk_log_start":"262'801","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'907","last_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_deep_scrub":"262'907","last_deep_scrub_stamp":"2024-09-22T09:54:39.169979+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.169979+0000","objects_scrubbed":11,"log_size":106,"log_dups_size":801,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:29:07.079705+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22457,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1275,"num_read_kb":1494,"num_write":384,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.587796+0000","last_change":"2024-09-22T09:54:49.587719+0000","last_active":"2024-09-22T09:54:49.587796+0000","last_peered":"2024-09-22T09:54:49.587796+0000","last_clean":"2024-09-22T09:54:49.587796+0000","last_became_active":"2024-09-22T08:42:21.476088+0000","last_became_peered":"2024-09-22T08:42:21.476088+0000","last_unstale":"2024-09-22T09:54:49.587796+0000","last_undegraded":"2024-09-22T09:54:49.587796+0000","last_fullsized":"2024-09-22T09:54:49.587796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.587615+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.587615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:43.905843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"262'236","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.203000+0000","last_change":"2024-09-22T09:54:49.203000+0000","last_active":"2024-09-22T09:54:49.203000+0000","last_peered":"2024-09-22T09:54:49.203000+0000","last_clean":"2024-09-22T09:54:49.203000+0000","last_became_active":"2024-09-22T08:42:23.576525+0000","last_became_peered":"2024-09-22T08:42:23.576525+0000","last_unstale":"2024-09-22T09:54:49.203000+0000","last_undegraded":"2024-09-22T09:54:49.203000+0000","last_fullsized":"2024-09-22T09:54:49.203000+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'236","last_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_deep_scrub":"262'236","last_deep_scrub_stamp":"2024-09-22T09:54:49.202908+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.202908+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:44:40.344451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":408,"num_read_kb":398,"num_write":524,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"262'339","reported_seq":948,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.238536+0000","last_change":"2024-09-22T09:54:29.238536+0000","last_active":"2024-09-22T09:54:29.238536+0000","last_peered":"2024-09-22T09:54:29.238536+0000","last_clean":"2024-09-22T09:54:29.238536+0000","last_became_active":"2024-09-22T08:42:15.437348+0000","last_became_peered":"2024-09-22T08:42:15.437348+0000","last_unstale":"2024-09-22T09:54:29.238536+0000","last_undegraded":"2024-09-22T09:54:29.238536+0000","last_fullsized":"2024-09-22T09:54:29.238536+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'339","last_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_deep_scrub":"262'339","last_deep_scrub_stamp":"2024-09-22T09:54:29.238430+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.238430+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:57:59.458064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1476,"num_read_kb":1171,"num_write":584,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.606871+0000","last_change":"2024-09-22T09:54:19.606824+0000","last_active":"2024-09-22T09:54:19.606871+0000","last_peered":"2024-09-22T09:54:19.606871+0000","last_clean":"2024-09-22T09:54:19.606871+0000","last_became_active":"2024-09-22T08:42:00.258384+0000","last_became_peered":"2024-09-22T08:42:00.258384+0000","last_unstale":"2024-09-22T09:54:19.606871+0000","last_undegraded":"2024-09-22T09:54:19.606871+0000","last_fullsized":"2024-09-22T09:54:19.606871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:19.606739+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.606739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:55:03.649270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046859000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"262'200","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.372421+0000","last_change":"2024-09-22T09:54:19.372330+0000","last_active":"2024-09-22T09:54:19.372421+0000","last_peered":"2024-09-22T09:54:19.372421+0000","last_clean":"2024-09-22T09:54:19.372421+0000","last_became_active":"2024-09-22T08:42:13.407141+0000","last_became_peered":"2024-09-22T08:42:13.407141+0000","last_unstale":"2024-09-22T09:54:19.372421+0000","last_undegraded":"2024-09-22T09:54:19.372421+0000","last_fullsized":"2024-09-22T09:54:19.372421+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'200","last_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_deep_scrub":"262'200","last_deep_scrub_stamp":"2024-09-22T09:54:19.372130+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.372130+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:34:08.243681+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485786,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":19334,"num_write":886,"num_write_kb":44633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"262'2","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.607748+0000","last_change":"2024-09-22T09:54:31.607748+0000","last_active":"2024-09-22T09:54:31.607748+0000","last_peered":"2024-09-22T09:54:31.607748+0000","last_clean":"2024-09-22T09:54:31.607748+0000","last_became_active":"2024-09-22T08:42:17.436192+0000","last_became_peered":"2024-09-22T08:42:17.436192+0000","last_unstale":"2024-09-22T09:54:31.607748+0000","last_undegraded":"2024-09-22T09:54:31.607748+0000","last_fullsized":"2024-09-22T09:54:31.607748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:31.607665+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.607665+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:35:32.805386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"262'291","reported_seq":1716,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.628286+0000","last_change":"2024-09-22T09:54:43.628229+0000","last_active":"2024-09-22T09:54:43.628286+0000","last_peered":"2024-09-22T09:54:43.628286+0000","last_clean":"2024-09-22T09:54:43.628286+0000","last_became_active":"2024-09-22T08:42:19.458110+0000","last_became_peered":"2024-09-22T08:42:19.458110+0000","last_unstale":"2024-09-22T09:54:43.628286+0000","last_undegraded":"2024-09-22T09:54:43.628286+0000","last_fullsized":"2024-09-22T09:54:43.628286+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'291","last_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_deep_scrub":"262'291","last_deep_scrub_stamp":"2024-09-22T09:54:43.628119+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.628119+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:18.536067+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":265,"num_read_kb":255,"num_write":245,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.148754+0000","last_change":"2024-09-22T09:54:46.148605+0000","last_active":"2024-09-22T09:54:46.148754+0000","last_peered":"2024-09-22T09:54:46.148754+0000","last_clean":"2024-09-22T09:54:46.148754+0000","last_became_active":"2024-09-22T08:42:21.478750+0000","last_became_peered":"2024-09-22T08:42:21.478750+0000","last_unstale":"2024-09-22T09:54:46.148754+0000","last_undegraded":"2024-09-22T09:54:46.148754+0000","last_fullsized":"2024-09-22T09:54:46.148754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:46.148415+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.148415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:39:12.701927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"262'246","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:58.724548+0000","last_change":"2024-09-22T09:54:58.724548+0000","last_active":"2024-09-22T09:54:58.724548+0000","last_peered":"2024-09-22T09:54:58.724548+0000","last_clean":"2024-09-22T09:54:58.724548+0000","last_became_active":"2024-09-22T08:42:23.527867+0000","last_became_peered":"2024-09-22T08:42:23.527867+0000","last_unstale":"2024-09-22T09:54:58.724548+0000","last_undegraded":"2024-09-22T09:54:58.724548+0000","last_fullsized":"2024-09-22T09:54:58.724548+0000","mapping_epoch":34,"log_start":"262'200","ondisk_log_start":"262'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'246","last_scrub_stamp":"2024-09-22T09:54:58.724436+0000","last_deep_scrub":"262'246","last_deep_scrub_stamp":"2024-09-22T09:54:58.724436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:58.724436+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:08.461250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":519,"num_write":514,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"262'155","reported_seq":786,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.185742+0000","last_change":"2024-09-22T09:54:27.185684+0000","last_active":"2024-09-22T09:54:27.185742+0000","last_peered":"2024-09-22T09:54:27.185742+0000","last_clean":"2024-09-22T09:54:27.185742+0000","last_became_active":"2024-09-22T08:42:15.430404+0000","last_became_peered":"2024-09-22T08:42:15.430404+0000","last_unstale":"2024-09-22T09:54:27.185742+0000","last_undegraded":"2024-09-22T09:54:27.185742+0000","last_fullsized":"2024-09-22T09:54:27.185742+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:27.185594+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.185594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:13:47.880015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":713,"num_read_kb":598,"num_write":232,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"262'3","reported_seq":540,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.532921+0000","last_change":"2024-09-22T09:54:21.532865+0000","last_active":"2024-09-22T09:54:21.532921+0000","last_peered":"2024-09-22T09:54:21.532921+0000","last_clean":"2024-09-22T09:54:21.532921+0000","last_became_active":"2024-09-22T08:42:00.235799+0000","last_became_peered":"2024-09-22T08:42:00.235799+0000","last_unstale":"2024-09-22T09:54:21.532921+0000","last_undegraded":"2024-09-22T09:54:21.532921+0000","last_fullsized":"2024-09-22T09:54:21.532921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-22T09:54:21.532772+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.532772+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:51.708829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00092603399999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"262'227","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.819371+0000","last_change":"2024-09-22T09:54:21.819318+0000","last_active":"2024-09-22T09:54:21.819371+0000","last_peered":"2024-09-22T09:54:21.819371+0000","last_clean":"2024-09-22T09:54:21.819371+0000","last_became_active":"2024-09-22T08:42:13.416402+0000","last_became_peered":"2024-09-22T08:42:13.416402+0000","last_unstale":"2024-09-22T09:54:21.819371+0000","last_undegraded":"2024-09-22T09:54:21.819371+0000","last_fullsized":"2024-09-22T09:54:21.819371+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:21.819178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.819178+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:16.182021+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":44921,"num_write":1103,"num_write_kb":17618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.025988+0000","last_change":"2024-09-22T09:54:39.025877+0000","last_active":"2024-09-22T09:54:39.025988+0000","last_peered":"2024-09-22T09:54:39.025988+0000","last_clean":"2024-09-22T09:54:39.025988+0000","last_became_active":"2024-09-22T08:42:17.436845+0000","last_became_peered":"2024-09-22T08:42:17.436845+0000","last_unstale":"2024-09-22T09:54:39.025988+0000","last_undegraded":"2024-09-22T09:54:39.025988+0000","last_fullsized":"2024-09-22T09:54:39.025988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:39.025757+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.025757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:38:02.089422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"262'165","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.654289+0000","last_change":"2024-09-22T09:54:46.654289+0000","last_active":"2024-09-22T09:54:46.654289+0000","last_peered":"2024-09-22T09:54:46.654289+0000","last_clean":"2024-09-22T09:54:46.654289+0000","last_became_active":"2024-09-22T08:42:19.456081+0000","last_became_peered":"2024-09-22T08:42:19.456081+0000","last_unstale":"2024-09-22T09:54:46.654289+0000","last_undegraded":"2024-09-22T09:54:46.654289+0000","last_fullsized":"2024-09-22T09:54:46.654289+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:46.654189+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.654189+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:30:59.224861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":144,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.933152+0000","last_change":"2024-09-22T09:54:37.933152+0000","last_active":"2024-09-22T09:54:37.933152+0000","last_peered":"2024-09-22T09:54:37.933152+0000","last_clean":"2024-09-22T09:54:37.933152+0000","last_became_active":"2024-09-22T08:42:21.479497+0000","last_became_peered":"2024-09-22T08:42:21.479497+0000","last_unstale":"2024-09-22T09:54:37.933152+0000","last_undegraded":"2024-09-22T09:54:37.933152+0000","last_fullsized":"2024-09-22T09:54:37.933152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:37.933066+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.933066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:48:08.133408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"262'123","reported_seq":683,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.305658+0000","last_change":"2024-09-22T09:54:52.305658+0000","last_active":"2024-09-22T09:54:52.305658+0000","last_peered":"2024-09-22T09:54:52.305658+0000","last_clean":"2024-09-22T09:54:52.305658+0000","last_became_active":"2024-09-22T08:42:23.526776+0000","last_became_peered":"2024-09-22T08:42:23.526776+0000","last_unstale":"2024-09-22T09:54:52.305658+0000","last_undegraded":"2024-09-22T09:54:52.305658+0000","last_fullsized":"2024-09-22T09:54:52.305658+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'123","last_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_deep_scrub":"262'123","last_deep_scrub_stamp":"2024-09-22T09:54:52.305571+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.305571+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:00.676431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":250,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"262'257","reported_seq":940,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.192712+0000","last_change":"2024-09-22T09:54:28.192606+0000","last_active":"2024-09-22T09:54:28.192712+0000","last_peered":"2024-09-22T09:54:28.192712+0000","last_clean":"2024-09-22T09:54:28.192712+0000","last_became_active":"2024-09-22T08:42:15.437336+0000","last_became_peered":"2024-09-22T08:42:15.437336+0000","last_unstale":"2024-09-22T09:54:28.192712+0000","last_undegraded":"2024-09-22T09:54:28.192712+0000","last_fullsized":"2024-09-22T09:54:28.192712+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'257","last_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_deep_scrub":"262'257","last_deep_scrub_stamp":"2024-09-22T09:54:28.192506+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.192506+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:02:18.079606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1099,"num_read_kb":913,"num_write":374,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"262'191","reported_seq":828,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.574433+0000","last_change":"2024-09-22T09:54:23.574375+0000","last_active":"2024-09-22T09:54:23.574433+0000","last_peered":"2024-09-22T09:54:23.574433+0000","last_clean":"2024-09-22T09:54:23.574433+0000","last_became_active":"2024-09-22T08:42:13.405535+0000","last_became_peered":"2024-09-22T08:42:13.405535+0000","last_unstale":"2024-09-22T09:54:23.574433+0000","last_undegraded":"2024-09-22T09:54:23.574433+0000","last_fullsized":"2024-09-22T09:54:23.574433+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:23.574287+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.574287+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:41:15.794001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":36411,"num_write":937,"num_write_kb":22238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.371305+0000","last_change":"2024-09-22T09:54:20.371252+0000","last_active":"2024-09-22T09:54:20.371305+0000","last_peered":"2024-09-22T09:54:20.371305+0000","last_clean":"2024-09-22T09:54:20.371305+0000","last_became_active":"2024-09-22T08:42:00.258080+0000","last_became_peered":"2024-09-22T08:42:00.258080+0000","last_unstale":"2024-09-22T09:54:20.371305+0000","last_undegraded":"2024-09-22T09:54:20.371305+0000","last_fullsized":"2024-09-22T09:54:20.371305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:20.371182+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:51.950137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056034300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.048496+0000","last_change":"2024-09-22T09:54:38.048408+0000","last_active":"2024-09-22T09:54:38.048496+0000","last_peered":"2024-09-22T09:54:38.048496+0000","last_clean":"2024-09-22T09:54:38.048496+0000","last_became_active":"2024-09-22T08:42:17.435802+0000","last_became_peered":"2024-09-22T08:42:17.435802+0000","last_unstale":"2024-09-22T09:54:38.048496+0000","last_undegraded":"2024-09-22T09:54:38.048496+0000","last_fullsized":"2024-09-22T09:54:38.048496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:38.048305+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.048305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:37:53.382564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"262'366","reported_seq":1062,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.076719+0000","last_change":"2024-09-22T09:54:41.076719+0000","last_active":"2024-09-22T09:54:41.076719+0000","last_peered":"2024-09-22T09:54:41.076719+0000","last_clean":"2024-09-22T09:54:41.076719+0000","last_became_active":"2024-09-22T08:42:19.456265+0000","last_became_peered":"2024-09-22T08:42:19.456265+0000","last_unstale":"2024-09-22T09:54:41.076719+0000","last_undegraded":"2024-09-22T09:54:41.076719+0000","last_fullsized":"2024-09-22T09:54:41.076719+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'366","last_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_deep_scrub":"262'366","last_deep_scrub_stamp":"2024-09-22T09:54:41.076609+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.076609+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:40.553978+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18381,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1194,"num_read_kb":1339,"num_write":1770,"num_write_kb":1581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535730,"num_omap_keys":1208,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.632222+0000","last_change":"2024-09-22T09:54:49.632165+0000","last_active":"2024-09-22T09:54:49.632222+0000","last_peered":"2024-09-22T09:54:49.632222+0000","last_clean":"2024-09-22T09:54:49.632222+0000","last_became_active":"2024-09-22T08:42:21.481293+0000","last_became_peered":"2024-09-22T08:42:21.481293+0000","last_unstale":"2024-09-22T09:54:49.632222+0000","last_undegraded":"2024-09-22T09:54:49.632222+0000","last_fullsized":"2024-09-22T09:54:49.632222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.632078+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.632078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:31:50.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"262'155","reported_seq":673,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.236268+0000","last_change":"2024-09-22T09:54:55.236268+0000","last_active":"2024-09-22T09:54:55.236268+0000","last_peered":"2024-09-22T09:54:55.236268+0000","last_clean":"2024-09-22T09:54:55.236268+0000","last_became_active":"2024-09-22T08:42:23.578007+0000","last_became_peered":"2024-09-22T08:42:23.578007+0000","last_unstale":"2024-09-22T09:54:55.236268+0000","last_undegraded":"2024-09-22T09:54:55.236268+0000","last_fullsized":"2024-09-22T09:54:55.236268+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'155","last_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_deep_scrub":"262'155","last_deep_scrub_stamp":"2024-09-22T09:54:55.236153+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.236153+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:00.942710+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":367,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"262'138","reported_seq":715,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.996886+0000","last_change":"2024-09-22T09:54:28.996833+0000","last_active":"2024-09-22T09:54:28.996886+0000","last_peered":"2024-09-22T09:54:28.996886+0000","last_clean":"2024-09-22T09:54:28.996886+0000","last_became_active":"2024-09-22T08:42:15.425681+0000","last_became_peered":"2024-09-22T08:42:15.425681+0000","last_unstale":"2024-09-22T09:54:28.996886+0000","last_undegraded":"2024-09-22T09:54:28.996886+0000","last_fullsized":"2024-09-22T09:54:28.996886+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'138","last_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_deep_scrub":"262'138","last_deep_scrub_stamp":"2024-09-22T09:54:28.996744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.996744+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:52.537525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":600,"num_read_kb":489,"num_write":222,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"262'220","reported_seq":846,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:21.329016+0000","last_change":"2024-09-22T09:54:21.328955+0000","last_active":"2024-09-22T09:54:21.329016+0000","last_peered":"2024-09-22T09:54:21.329016+0000","last_clean":"2024-09-22T09:54:21.329016+0000","last_became_active":"2024-09-22T08:42:13.421119+0000","last_became_peered":"2024-09-22T08:42:13.421119+0000","last_unstale":"2024-09-22T09:54:21.329016+0000","last_undegraded":"2024-09-22T09:54:21.329016+0000","last_fullsized":"2024-09-22T09:54:21.329016+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:21.328852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:21.328852+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:00:00.573762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":1845,"num_write":1046,"num_write_kb":12399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.569437+0000","last_change":"2024-09-22T09:54:33.569365+0000","last_active":"2024-09-22T09:54:33.569437+0000","last_peered":"2024-09-22T09:54:33.569437+0000","last_clean":"2024-09-22T09:54:33.569437+0000","last_became_active":"2024-09-22T08:42:00.257984+0000","last_became_peered":"2024-09-22T08:42:00.257984+0000","last_unstale":"2024-09-22T09:54:33.569437+0000","last_undegraded":"2024-09-22T09:54:33.569437+0000","last_fullsized":"2024-09-22T09:54:33.569437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.569236+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.569236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:28:24.238329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044796099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.916328+0000","last_change":"2024-09-22T09:54:33.916275+0000","last_active":"2024-09-22T09:54:33.916328+0000","last_peered":"2024-09-22T09:54:33.916328+0000","last_clean":"2024-09-22T09:54:33.916328+0000","last_became_active":"2024-09-22T08:42:17.435749+0000","last_became_peered":"2024-09-22T08:42:17.435749+0000","last_unstale":"2024-09-22T09:54:33.916328+0000","last_undegraded":"2024-09-22T09:54:33.916328+0000","last_fullsized":"2024-09-22T09:54:33.916328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:33.916178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.916178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:29:47.667923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"262'223","reported_seq":817,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.185409+0000","last_change":"2024-09-22T09:54:41.185335+0000","last_active":"2024-09-22T09:54:41.185409+0000","last_peered":"2024-09-22T09:54:41.185409+0000","last_clean":"2024-09-22T09:54:41.185409+0000","last_became_active":"2024-09-22T08:42:19.456525+0000","last_became_peered":"2024-09-22T08:42:19.456525+0000","last_unstale":"2024-09-22T09:54:41.185409+0000","last_undegraded":"2024-09-22T09:54:41.185409+0000","last_fullsized":"2024-09-22T09:54:41.185409+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'223","last_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_deep_scrub":"262'223","last_deep_scrub_stamp":"2024-09-22T09:54:41.185242+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.185242+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:52:21.839182+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":268,"num_read_kb":257,"num_write":184,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"262'765","reported_seq":4654,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.303774+0000","last_change":"2024-09-22T09:54:49.303774+0000","last_active":"2024-09-22T09:54:49.303774+0000","last_peered":"2024-09-22T09:54:49.303774+0000","last_clean":"2024-09-22T09:54:49.303774+0000","last_became_active":"2024-09-22T08:42:21.480936+0000","last_became_peered":"2024-09-22T08:42:21.480936+0000","last_unstale":"2024-09-22T09:54:49.303774+0000","last_undegraded":"2024-09-22T09:54:49.303774+0000","last_fullsized":"2024-09-22T09:54:49.303774+0000","mapping_epoch":32,"log_start":"262'701","ondisk_log_start":"262'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'765","last_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_deep_scrub":"262'765","last_deep_scrub_stamp":"2024-09-22T09:54:49.303693+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.303693+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:46.394231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"262'176","reported_seq":713,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:00.701555+0000","last_change":"2024-09-22T09:55:00.701555+0000","last_active":"2024-09-22T09:55:00.701555+0000","last_peered":"2024-09-22T09:55:00.701555+0000","last_clean":"2024-09-22T09:55:00.701555+0000","last_became_active":"2024-09-22T08:42:23.576664+0000","last_became_peered":"2024-09-22T08:42:23.576664+0000","last_unstale":"2024-09-22T09:55:00.701555+0000","last_undegraded":"2024-09-22T09:55:00.701555+0000","last_fullsized":"2024-09-22T09:55:00.701555+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-22T09:55:00.701432+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-22T09:55:00.701432+0000","last_clean_scrub_stamp":"2024-09-22T09:55:00.701432+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:09:03.000863+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":260,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"262'173","reported_seq":804,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.749272+0000","last_change":"2024-09-22T09:54:43.749272+0000","last_active":"2024-09-22T09:54:43.749272+0000","last_peered":"2024-09-22T09:54:43.749272+0000","last_clean":"2024-09-22T09:54:43.749272+0000","last_became_active":"2024-09-22T08:42:15.435639+0000","last_became_peered":"2024-09-22T08:42:15.435639+0000","last_unstale":"2024-09-22T09:54:43.749272+0000","last_undegraded":"2024-09-22T09:54:43.749272+0000","last_fullsized":"2024-09-22T09:54:43.749272+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:43.749180+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.749180+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:32:20.977184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":803,"num_read_kb":667,"num_write":284,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"262'170","reported_seq":789,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.930818+0000","last_change":"2024-09-22T09:54:26.930818+0000","last_active":"2024-09-22T09:54:26.930818+0000","last_peered":"2024-09-22T09:54:26.930818+0000","last_clean":"2024-09-22T09:54:26.930818+0000","last_became_active":"2024-09-22T08:42:13.414191+0000","last_became_peered":"2024-09-22T08:42:13.414191+0000","last_unstale":"2024-09-22T09:54:26.930818+0000","last_undegraded":"2024-09-22T09:54:26.930818+0000","last_fullsized":"2024-09-22T09:54:26.930818+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'170","last_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_deep_scrub":"262'170","last_deep_scrub_stamp":"2024-09-22T09:54:26.930623+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.930623+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:59:40.742051+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":9645,"num_write":894,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.243823+0000","last_change":"2024-09-22T09:54:23.243823+0000","last_active":"2024-09-22T09:54:23.243823+0000","last_peered":"2024-09-22T09:54:23.243823+0000","last_clean":"2024-09-22T09:54:23.243823+0000","last_became_active":"2024-09-22T08:42:00.240593+0000","last_became_peered":"2024-09-22T08:42:00.240593+0000","last_unstale":"2024-09-22T09:54:23.243823+0000","last_undegraded":"2024-09-22T09:54:23.243823+0000","last_fullsized":"2024-09-22T09:54:23.243823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.243731+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.243731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:22:46.724488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059082500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.554980+0000","last_change":"2024-09-22T09:54:42.554916+0000","last_active":"2024-09-22T09:54:42.554980+0000","last_peered":"2024-09-22T09:54:42.554980+0000","last_clean":"2024-09-22T09:54:42.554980+0000","last_became_active":"2024-09-22T08:42:17.440487+0000","last_became_peered":"2024-09-22T08:42:17.440487+0000","last_unstale":"2024-09-22T09:54:42.554980+0000","last_undegraded":"2024-09-22T09:54:42.554980+0000","last_fullsized":"2024-09-22T09:54:42.554980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.554834+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.554834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:34:29.469660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"262'140","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.606515+0000","last_change":"2024-09-22T09:54:44.606454+0000","last_active":"2024-09-22T09:54:44.606515+0000","last_peered":"2024-09-22T09:54:44.606515+0000","last_clean":"2024-09-22T09:54:44.606515+0000","last_became_active":"2024-09-22T08:42:19.457104+0000","last_became_peered":"2024-09-22T08:42:19.457104+0000","last_unstale":"2024-09-22T09:54:44.606515+0000","last_undegraded":"2024-09-22T09:54:44.606515+0000","last_fullsized":"2024-09-22T09:54:44.606515+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'140","last_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_deep_scrub":"262'140","last_deep_scrub_stamp":"2024-09-22T09:54:44.606361+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.606361+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:22:44.675948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":162,"num_write":114,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"262'756","reported_seq":2866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.720985+0000","last_change":"2024-09-22T09:54:56.720928+0000","last_active":"2024-09-22T09:54:56.720985+0000","last_peered":"2024-09-22T09:54:56.720985+0000","last_clean":"2024-09-22T09:54:56.720985+0000","last_became_active":"2024-09-22T08:42:21.477818+0000","last_became_peered":"2024-09-22T08:42:21.477818+0000","last_unstale":"2024-09-22T09:54:56.720985+0000","last_undegraded":"2024-09-22T09:54:56.720985+0000","last_fullsized":"2024-09-22T09:54:56.720985+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'756","last_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_deep_scrub":"262'756","last_deep_scrub_stamp":"2024-09-22T09:54:56.720830+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.720830+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:57.526171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"262'151","reported_seq":660,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.146261+0000","last_change":"2024-09-22T09:54:53.146261+0000","last_active":"2024-09-22T09:54:53.146261+0000","last_peered":"2024-09-22T09:54:53.146261+0000","last_clean":"2024-09-22T09:54:53.146261+0000","last_became_active":"2024-09-22T08:42:23.524823+0000","last_became_peered":"2024-09-22T08:42:23.524823+0000","last_unstale":"2024-09-22T09:54:53.146261+0000","last_undegraded":"2024-09-22T09:54:53.146261+0000","last_fullsized":"2024-09-22T09:54:53.146261+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'151","last_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_deep_scrub":"262'151","last_deep_scrub_stamp":"2024-09-22T09:54:53.146161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.146161+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:43:03.242553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":324,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"262'205","reported_seq":851,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.737178+0000","last_change":"2024-09-22T09:54:24.737112+0000","last_active":"2024-09-22T09:54:24.737178+0000","last_peered":"2024-09-22T09:54:24.737178+0000","last_clean":"2024-09-22T09:54:24.737178+0000","last_became_active":"2024-09-22T08:42:15.425788+0000","last_became_peered":"2024-09-22T08:42:15.425788+0000","last_unstale":"2024-09-22T09:54:24.737178+0000","last_undegraded":"2024-09-22T09:54:24.737178+0000","last_fullsized":"2024-09-22T09:54:24.737178+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:24.737027+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.737027+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:57:50.396120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":771,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"262'190","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:19.103347+0000","last_change":"2024-09-22T09:54:19.103347+0000","last_active":"2024-09-22T09:54:19.103347+0000","last_peered":"2024-09-22T09:54:19.103347+0000","last_clean":"2024-09-22T09:54:19.103347+0000","last_became_active":"2024-09-22T08:42:13.412331+0000","last_became_peered":"2024-09-22T08:42:13.412331+0000","last_unstale":"2024-09-22T09:54:19.103347+0000","last_undegraded":"2024-09-22T09:54:19.103347+0000","last_fullsized":"2024-09-22T09:54:19.103347+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'190","last_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_deep_scrub":"262'190","last_deep_scrub_stamp":"2024-09-22T09:54:19.103240+0000","last_clean_scrub_stamp":"2024-09-22T09:54:19.103240+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:35:24.385903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":461,"num_read_kb":406,"num_write":850,"num_write_kb":26587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.761018+0000","last_change":"2024-09-22T09:54:23.761018+0000","last_active":"2024-09-22T09:54:23.761018+0000","last_peered":"2024-09-22T09:54:23.761018+0000","last_clean":"2024-09-22T09:54:23.761018+0000","last_became_active":"2024-09-22T08:42:00.242690+0000","last_became_peered":"2024-09-22T08:42:00.242690+0000","last_unstale":"2024-09-22T09:54:23.761018+0000","last_undegraded":"2024-09-22T09:54:23.761018+0000","last_fullsized":"2024-09-22T09:54:23.761018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:23.760940+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.760940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:48:58.487042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042576300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":511,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.826138+0000","last_change":"2024-09-22T09:54:40.826138+0000","last_active":"2024-09-22T09:54:40.826138+0000","last_peered":"2024-09-22T09:54:40.826138+0000","last_clean":"2024-09-22T09:54:40.826138+0000","last_became_active":"2024-09-22T08:42:17.440305+0000","last_became_peered":"2024-09-22T08:42:17.440305+0000","last_unstale":"2024-09-22T09:54:40.826138+0000","last_undegraded":"2024-09-22T09:54:40.826138+0000","last_fullsized":"2024-09-22T09:54:40.826138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.826044+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.826044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:59.306569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"262'363","reported_seq":1107,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.606097+0000","last_change":"2024-09-22T09:54:42.606035+0000","last_active":"2024-09-22T09:54:42.606097+0000","last_peered":"2024-09-22T09:54:42.606097+0000","last_clean":"2024-09-22T09:54:42.606097+0000","last_became_active":"2024-09-22T08:42:19.455148+0000","last_became_peered":"2024-09-22T08:42:19.455148+0000","last_unstale":"2024-09-22T09:54:42.606097+0000","last_undegraded":"2024-09-22T09:54:42.606097+0000","last_fullsized":"2024-09-22T09:54:42.606097+0000","mapping_epoch":30,"log_start":"262'300","ondisk_log_start":"262'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'363","last_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_deep_scrub":"262'363","last_deep_scrub_stamp":"2024-09-22T09:54:42.605926+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.605926+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:18:24.566627+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23842,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":535,"num_read_kb":775,"num_write":284,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":502,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.703400+0000","last_change":"2024-09-22T09:54:52.703279+0000","last_active":"2024-09-22T09:54:52.703400+0000","last_peered":"2024-09-22T09:54:52.703400+0000","last_clean":"2024-09-22T09:54:52.703400+0000","last_became_active":"2024-09-22T08:42:21.481003+0000","last_became_peered":"2024-09-22T08:42:21.481003+0000","last_unstale":"2024-09-22T09:54:52.703400+0000","last_undegraded":"2024-09-22T09:54:52.703400+0000","last_fullsized":"2024-09-22T09:54:52.703400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.703173+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.703173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:54:09.004394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"262'94","reported_seq":601,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.340062+0000","last_change":"2024-09-22T09:54:53.340062+0000","last_active":"2024-09-22T09:54:53.340062+0000","last_peered":"2024-09-22T09:54:53.340062+0000","last_clean":"2024-09-22T09:54:53.340062+0000","last_became_active":"2024-09-22T08:42:23.527788+0000","last_became_peered":"2024-09-22T08:42:23.527788+0000","last_unstale":"2024-09-22T09:54:53.340062+0000","last_undegraded":"2024-09-22T09:54:53.340062+0000","last_fullsized":"2024-09-22T09:54:53.340062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'94","last_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_deep_scrub":"262'94","last_deep_scrub_stamp":"2024-09-22T09:54:53.339953+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.339953+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:20:01.903544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":230,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"262'128","reported_seq":695,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.322210+0000","last_change":"2024-09-22T09:55:02.322151+0000","last_active":"2024-09-22T09:55:02.322210+0000","last_peered":"2024-09-22T09:55:02.322210+0000","last_clean":"2024-09-22T09:55:02.322210+0000","last_became_active":"2024-09-22T08:42:23.527789+0000","last_became_peered":"2024-09-22T08:42:23.527789+0000","last_unstale":"2024-09-22T09:55:02.322210+0000","last_undegraded":"2024-09-22T09:55:02.322210+0000","last_fullsized":"2024-09-22T09:55:02.322210+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'128","last_scrub_stamp":"2024-09-22T09:55:02.322059+0000","last_deep_scrub":"262'128","last_deep_scrub_stamp":"2024-09-22T09:55:02.322059+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.322059+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:06.880923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"262'226","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.695358+0000","last_change":"2024-09-22T09:54:29.695304+0000","last_active":"2024-09-22T09:54:29.695358+0000","last_peered":"2024-09-22T09:54:29.695358+0000","last_clean":"2024-09-22T09:54:29.695358+0000","last_became_active":"2024-09-22T08:42:15.426163+0000","last_became_peered":"2024-09-22T08:42:15.426163+0000","last_unstale":"2024-09-22T09:54:29.695358+0000","last_undegraded":"2024-09-22T09:54:29.695358+0000","last_fullsized":"2024-09-22T09:54:29.695358+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.695223+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.695223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:21:41.769762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1014,"num_read_kb":835,"num_write":336,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"262'197","reported_seq":850,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:20.797555+0000","last_change":"2024-09-22T09:54:20.797488+0000","last_active":"2024-09-22T09:54:20.797555+0000","last_peered":"2024-09-22T09:54:20.797555+0000","last_clean":"2024-09-22T09:54:20.797555+0000","last_became_active":"2024-09-22T08:42:13.417625+0000","last_became_peered":"2024-09-22T08:42:13.417625+0000","last_unstale":"2024-09-22T09:54:20.797555+0000","last_undegraded":"2024-09-22T09:54:20.797555+0000","last_fullsized":"2024-09-22T09:54:20.797555+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:20.797355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:20.797355+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:24:31.306053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":56883,"num_write":855,"num_write_kb":35960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.214275+0000","last_change":"2024-09-22T09:54:35.214218+0000","last_active":"2024-09-22T09:54:35.214275+0000","last_peered":"2024-09-22T09:54:35.214275+0000","last_clean":"2024-09-22T09:54:35.214275+0000","last_became_active":"2024-09-22T08:42:17.434205+0000","last_became_peered":"2024-09-22T08:42:17.434205+0000","last_unstale":"2024-09-22T09:54:35.214275+0000","last_undegraded":"2024-09-22T09:54:35.214275+0000","last_fullsized":"2024-09-22T09:54:35.214275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.214127+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.214127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:16:27.814976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"262'176","reported_seq":771,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.627965+0000","last_change":"2024-09-22T09:54:49.627965+0000","last_active":"2024-09-22T09:54:49.627965+0000","last_peered":"2024-09-22T09:54:49.627965+0000","last_clean":"2024-09-22T09:54:49.627965+0000","last_became_active":"2024-09-22T08:42:19.458865+0000","last_became_peered":"2024-09-22T08:42:19.458865+0000","last_unstale":"2024-09-22T09:54:49.627965+0000","last_undegraded":"2024-09-22T09:54:49.627965+0000","last_fullsized":"2024-09-22T09:54:49.627965+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'176","last_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_deep_scrub":"262'176","last_deep_scrub_stamp":"2024-09-22T09:54:49.627852+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.627852+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:21.906351+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6262,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":323,"num_write":134,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.691597+0000","last_change":"2024-09-22T09:54:54.691597+0000","last_active":"2024-09-22T09:54:54.691597+0000","last_peered":"2024-09-22T09:54:54.691597+0000","last_clean":"2024-09-22T09:54:54.691597+0000","last_became_active":"2024-09-22T08:42:21.479213+0000","last_became_peered":"2024-09-22T08:42:21.479213+0000","last_unstale":"2024-09-22T09:54:54.691597+0000","last_undegraded":"2024-09-22T09:54:54.691597+0000","last_fullsized":"2024-09-22T09:54:54.691597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:54.691502+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.691502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:25.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'147","reported_seq":659,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:03.795542+0000","last_change":"2024-09-22T09:55:03.795542+0000","last_active":"2024-09-22T09:55:03.795542+0000","last_peered":"2024-09-22T09:55:03.795542+0000","last_clean":"2024-09-22T09:55:03.795542+0000","last_became_active":"2024-09-22T08:42:23.527943+0000","last_became_peered":"2024-09-22T08:42:23.527943+0000","last_unstale":"2024-09-22T09:55:03.795542+0000","last_undegraded":"2024-09-22T09:55:03.795542+0000","last_fullsized":"2024-09-22T09:55:03.795542+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'147","last_scrub_stamp":"2024-09-22T09:55:03.795458+0000","last_deep_scrub":"262'147","last_deep_scrub_stamp":"2024-09-22T09:55:03.795458+0000","last_clean_scrub_stamp":"2024-09-22T09:55:03.795458+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:23:50.152064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":192,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"262'90","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.256299+0000","last_change":"2024-09-22T09:54:30.256211+0000","last_active":"2024-09-22T09:54:30.256299+0000","last_peered":"2024-09-22T09:54:30.256299+0000","last_clean":"2024-09-22T09:54:30.256299+0000","last_became_active":"2024-09-22T08:42:15.435033+0000","last_became_peered":"2024-09-22T08:42:15.435033+0000","last_unstale":"2024-09-22T09:54:30.256299+0000","last_undegraded":"2024-09-22T09:54:30.256299+0000","last_fullsized":"2024-09-22T09:54:30.256299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:30.256110+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.256110+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:43:21.124251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":410,"num_read_kb":341,"num_write":125,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"262'226","reported_seq":871,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.531250+0000","last_change":"2024-09-22T09:54:29.531189+0000","last_active":"2024-09-22T09:54:29.531250+0000","last_peered":"2024-09-22T09:54:29.531250+0000","last_clean":"2024-09-22T09:54:29.531250+0000","last_became_active":"2024-09-22T08:42:13.414550+0000","last_became_peered":"2024-09-22T08:42:13.414550+0000","last_unstale":"2024-09-22T09:54:29.531250+0000","last_undegraded":"2024-09-22T09:54:29.531250+0000","last_fullsized":"2024-09-22T09:54:29.531250+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:29.531048+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.531048+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:58.938306+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":592,"num_read_kb":50629,"num_write":1055,"num_write_kb":33716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.766423+0000","last_change":"2024-09-22T09:54:42.766423+0000","last_active":"2024-09-22T09:54:42.766423+0000","last_peered":"2024-09-22T09:54:42.766423+0000","last_clean":"2024-09-22T09:54:42.766423+0000","last_became_active":"2024-09-22T08:42:17.440186+0000","last_became_peered":"2024-09-22T08:42:17.440186+0000","last_unstale":"2024-09-22T09:54:42.766423+0000","last_undegraded":"2024-09-22T09:54:42.766423+0000","last_fullsized":"2024-09-22T09:54:42.766423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:42.766349+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.766349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:27:21.722448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"262'56","reported_seq":577,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.058832+0000","last_change":"2024-09-22T09:54:43.058832+0000","last_active":"2024-09-22T09:54:43.058832+0000","last_peered":"2024-09-22T09:54:43.058832+0000","last_clean":"2024-09-22T09:54:43.058832+0000","last_became_active":"2024-09-22T08:42:19.455967+0000","last_became_peered":"2024-09-22T08:42:19.455967+0000","last_unstale":"2024-09-22T09:54:43.058832+0000","last_undegraded":"2024-09-22T09:54:43.058832+0000","last_fullsized":"2024-09-22T09:54:43.058832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'56","last_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_deep_scrub":"262'56","last_deep_scrub_stamp":"2024-09-22T09:54:43.058746+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.058746+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:54:58.206035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":49,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.568163+0000","last_change":"2024-09-22T09:54:48.568163+0000","last_active":"2024-09-22T09:54:48.568163+0000","last_peered":"2024-09-22T09:54:48.568163+0000","last_clean":"2024-09-22T09:54:48.568163+0000","last_became_active":"2024-09-22T08:42:21.476455+0000","last_became_peered":"2024-09-22T08:42:21.476455+0000","last_unstale":"2024-09-22T09:54:48.568163+0000","last_undegraded":"2024-09-22T09:54:48.568163+0000","last_fullsized":"2024-09-22T09:54:48.568163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:48.568064+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.568064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:35:27.614483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"262'191","reported_seq":719,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:56.256425+0000","last_change":"2024-09-22T09:54:56.256359+0000","last_active":"2024-09-22T09:54:56.256425+0000","last_peered":"2024-09-22T09:54:56.256425+0000","last_clean":"2024-09-22T09:54:56.256425+0000","last_became_active":"2024-09-22T08:42:23.526088+0000","last_became_peered":"2024-09-22T08:42:23.526088+0000","last_unstale":"2024-09-22T09:54:56.256425+0000","last_undegraded":"2024-09-22T09:54:56.256425+0000","last_fullsized":"2024-09-22T09:54:56.256425+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'191","last_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_deep_scrub":"262'191","last_deep_scrub_stamp":"2024-09-22T09:54:56.256268+0000","last_clean_scrub_stamp":"2024-09-22T09:54:56.256268+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:51.889250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":609,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":307,"num_read_kb":306,"num_write":427,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"262'202","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.804620+0000","last_change":"2024-09-22T09:54:30.804559+0000","last_active":"2024-09-22T09:54:30.804620+0000","last_peered":"2024-09-22T09:54:30.804620+0000","last_clean":"2024-09-22T09:54:30.804620+0000","last_became_active":"2024-09-22T08:42:15.438094+0000","last_became_peered":"2024-09-22T08:42:15.438094+0000","last_unstale":"2024-09-22T09:54:30.804620+0000","last_undegraded":"2024-09-22T09:54:30.804620+0000","last_fullsized":"2024-09-22T09:54:30.804620+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:30.804467+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.804467+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:58:02.621427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":778,"num_write":297,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"262'206","reported_seq":854,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.611670+0000","last_change":"2024-09-22T09:54:24.611605+0000","last_active":"2024-09-22T09:54:24.611670+0000","last_peered":"2024-09-22T09:54:24.611670+0000","last_clean":"2024-09-22T09:54:24.611670+0000","last_became_active":"2024-09-22T08:42:13.412248+0000","last_became_peered":"2024-09-22T08:42:13.412248+0000","last_unstale":"2024-09-22T09:54:24.611670+0000","last_undegraded":"2024-09-22T09:54:24.611670+0000","last_fullsized":"2024-09-22T09:54:24.611670+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'206","last_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_deep_scrub":"262'206","last_deep_scrub_stamp":"2024-09-22T09:54:24.611501+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.611501+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:02:30.061595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":559,"num_read_kb":27137,"num_write":994,"num_write_kb":34279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":505,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.609807+0000","last_change":"2024-09-22T09:54:40.609807+0000","last_active":"2024-09-22T09:54:40.609807+0000","last_peered":"2024-09-22T09:54:40.609807+0000","last_clean":"2024-09-22T09:54:40.609807+0000","last_became_active":"2024-09-22T08:42:17.430160+0000","last_became_peered":"2024-09-22T08:42:17.430160+0000","last_unstale":"2024-09-22T09:54:40.609807+0000","last_undegraded":"2024-09-22T09:54:40.609807+0000","last_fullsized":"2024-09-22T09:54:40.609807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.609720+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.609720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:04:04.398179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"262'202","reported_seq":813,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.641002+0000","last_change":"2024-09-22T09:54:50.641002+0000","last_active":"2024-09-22T09:54:50.641002+0000","last_peered":"2024-09-22T09:54:50.641002+0000","last_clean":"2024-09-22T09:54:50.641002+0000","last_became_active":"2024-09-22T08:42:19.459345+0000","last_became_peered":"2024-09-22T08:42:19.459345+0000","last_unstale":"2024-09-22T09:54:50.641002+0000","last_undegraded":"2024-09-22T09:54:50.641002+0000","last_fullsized":"2024-09-22T09:54:50.641002+0000","mapping_epoch":30,"log_start":"259'100","ondisk_log_start":"259'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'202","last_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_deep_scrub":"262'202","last_deep_scrub_stamp":"2024-09-22T09:54:50.640907+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.640907+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:17.725830+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":259,"num_read_kb":325,"num_write":146,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.951738+0000","last_change":"2024-09-22T09:54:40.951666+0000","last_active":"2024-09-22T09:54:40.951738+0000","last_peered":"2024-09-22T09:54:40.951738+0000","last_clean":"2024-09-22T09:54:40.951738+0000","last_became_active":"2024-09-22T08:42:21.479147+0000","last_became_peered":"2024-09-22T08:42:21.479147+0000","last_unstale":"2024-09-22T09:54:40.951738+0000","last_undegraded":"2024-09-22T09:54:40.951738+0000","last_fullsized":"2024-09-22T09:54:40.951738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.951575+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.951575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:17.627570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"262'185","reported_seq":762,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:55.343566+0000","last_change":"2024-09-22T09:54:55.343493+0000","last_active":"2024-09-22T09:54:55.343566+0000","last_peered":"2024-09-22T09:54:55.343566+0000","last_clean":"2024-09-22T09:54:55.343566+0000","last_became_active":"2024-09-22T08:42:23.527339+0000","last_became_peered":"2024-09-22T08:42:23.527339+0000","last_unstale":"2024-09-22T09:54:55.343566+0000","last_undegraded":"2024-09-22T09:54:55.343566+0000","last_fullsized":"2024-09-22T09:54:55.343566+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:55.343408+0000","last_clean_scrub_stamp":"2024-09-22T09:54:55.343408+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:00:52.216646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":479,"num_read_kb":420,"num_write":450,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"262'174","reported_seq":802,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.801443+0000","last_change":"2024-09-22T09:54:36.801369+0000","last_active":"2024-09-22T09:54:36.801443+0000","last_peered":"2024-09-22T09:54:36.801443+0000","last_clean":"2024-09-22T09:54:36.801443+0000","last_became_active":"2024-09-22T08:42:15.440372+0000","last_became_peered":"2024-09-22T08:42:15.440372+0000","last_unstale":"2024-09-22T09:54:36.801443+0000","last_undegraded":"2024-09-22T09:54:36.801443+0000","last_fullsized":"2024-09-22T09:54:36.801443+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'174","last_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_deep_scrub":"262'174","last_deep_scrub_stamp":"2024-09-22T09:54:36.801284+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.801284+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:42:30.780204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":765,"num_read_kb":631,"num_write":251,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"262'205","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.092956+0000","last_change":"2024-09-22T09:54:23.092900+0000","last_active":"2024-09-22T09:54:23.092956+0000","last_peered":"2024-09-22T09:54:23.092956+0000","last_clean":"2024-09-22T09:54:23.092956+0000","last_became_active":"2024-09-22T08:42:13.421176+0000","last_became_peered":"2024-09-22T08:42:13.421176+0000","last_unstale":"2024-09-22T09:54:23.092956+0000","last_undegraded":"2024-09-22T09:54:23.092956+0000","last_fullsized":"2024-09-22T09:54:23.092956+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.092809+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.092809+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:04:04.164807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":41854,"num_write":1021,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.914168+0000","last_change":"2024-09-22T09:54:35.914104+0000","last_active":"2024-09-22T09:54:35.914168+0000","last_peered":"2024-09-22T09:54:35.914168+0000","last_clean":"2024-09-22T09:54:35.914168+0000","last_became_active":"2024-09-22T08:42:17.427619+0000","last_became_peered":"2024-09-22T08:42:17.427619+0000","last_unstale":"2024-09-22T09:54:35.914168+0000","last_undegraded":"2024-09-22T09:54:35.914168+0000","last_fullsized":"2024-09-22T09:54:35.914168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:35.914016+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.914016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:02:45.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"262'152","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.619933+0000","last_change":"2024-09-22T09:54:44.619933+0000","last_active":"2024-09-22T09:54:44.619933+0000","last_peered":"2024-09-22T09:54:44.619933+0000","last_clean":"2024-09-22T09:54:44.619933+0000","last_became_active":"2024-09-22T08:42:19.452827+0000","last_became_peered":"2024-09-22T08:42:19.452827+0000","last_unstale":"2024-09-22T09:54:44.619933+0000","last_undegraded":"2024-09-22T09:54:44.619933+0000","last_fullsized":"2024-09-22T09:54:44.619933+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'152","last_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_deep_scrub":"262'152","last_deep_scrub_stamp":"2024-09-22T09:54:44.619832+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.619832+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:45.455510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5436,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":223,"num_write":104,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":501,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:49.156080+0000","last_change":"2024-09-22T09:54:49.156080+0000","last_active":"2024-09-22T09:54:49.156080+0000","last_peered":"2024-09-22T09:54:49.156080+0000","last_clean":"2024-09-22T09:54:49.156080+0000","last_became_active":"2024-09-22T08:42:21.474947+0000","last_became_peered":"2024-09-22T08:42:21.474947+0000","last_unstale":"2024-09-22T09:54:49.156080+0000","last_undegraded":"2024-09-22T09:54:49.156080+0000","last_fullsized":"2024-09-22T09:54:49.156080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:49.155977+0000","last_clean_scrub_stamp":"2024-09-22T09:54:49.155977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:30:22.199690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"262'88","reported_seq":667,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.919348+0000","last_change":"2024-09-22T09:54:31.919258+0000","last_active":"2024-09-22T09:54:31.919348+0000","last_peered":"2024-09-22T09:54:31.919348+0000","last_clean":"2024-09-22T09:54:31.919348+0000","last_became_active":"2024-09-22T08:42:15.431116+0000","last_became_peered":"2024-09-22T08:42:15.431116+0000","last_unstale":"2024-09-22T09:54:31.919348+0000","last_undegraded":"2024-09-22T09:54:31.919348+0000","last_fullsized":"2024-09-22T09:54:31.919348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'88","last_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_deep_scrub":"262'88","last_deep_scrub_stamp":"2024-09-22T09:54:31.919161+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.919161+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:04:25.614663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":401,"num_read_kb":333,"num_write":132,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"262'205","reported_seq":862,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.829858+0000","last_change":"2024-09-22T09:54:23.829750+0000","last_active":"2024-09-22T09:54:23.829858+0000","last_peered":"2024-09-22T09:54:23.829858+0000","last_clean":"2024-09-22T09:54:23.829858+0000","last_became_active":"2024-09-22T08:42:13.403203+0000","last_became_peered":"2024-09-22T08:42:13.403203+0000","last_unstale":"2024-09-22T09:54:23.829858+0000","last_undegraded":"2024-09-22T09:54:23.829858+0000","last_fullsized":"2024-09-22T09:54:23.829858+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:23.829600+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.829600+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:18:05.399205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":584,"num_read_kb":68522,"num_write":916,"num_write_kb":45250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.030334+0000","last_change":"2024-09-22T09:54:40.030334+0000","last_active":"2024-09-22T09:54:40.030334+0000","last_peered":"2024-09-22T09:54:40.030334+0000","last_clean":"2024-09-22T09:54:40.030334+0000","last_became_active":"2024-09-22T08:42:17.437827+0000","last_became_peered":"2024-09-22T08:42:17.437827+0000","last_unstale":"2024-09-22T09:54:40.030334+0000","last_undegraded":"2024-09-22T09:54:40.030334+0000","last_fullsized":"2024-09-22T09:54:40.030334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.030227+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.030227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:34:27.501559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"262'240","reported_seq":886,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.184292+0000","last_change":"2024-09-22T09:54:38.184221+0000","last_active":"2024-09-22T09:54:38.184292+0000","last_peered":"2024-09-22T09:54:38.184292+0000","last_clean":"2024-09-22T09:54:38.184292+0000","last_became_active":"2024-09-22T08:42:19.454555+0000","last_became_peered":"2024-09-22T08:42:19.454555+0000","last_unstale":"2024-09-22T09:54:38.184292+0000","last_undegraded":"2024-09-22T09:54:38.184292+0000","last_fullsized":"2024-09-22T09:54:38.184292+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:38.184124+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.184124+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:23:09.313158+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22939,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":353,"num_read_kb":545,"num_write":228,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.317500+0000","last_change":"2024-09-22T09:54:50.317446+0000","last_active":"2024-09-22T09:54:50.317500+0000","last_peered":"2024-09-22T09:54:50.317500+0000","last_clean":"2024-09-22T09:54:50.317500+0000","last_became_active":"2024-09-22T08:42:21.482178+0000","last_became_peered":"2024-09-22T08:42:21.482178+0000","last_unstale":"2024-09-22T09:54:50.317500+0000","last_undegraded":"2024-09-22T09:54:50.317500+0000","last_fullsized":"2024-09-22T09:54:50.317500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.317363+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.317363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:01.217756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"262'196","reported_seq":705,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:01.724176+0000","last_change":"2024-09-22T09:55:01.724176+0000","last_active":"2024-09-22T09:55:01.724176+0000","last_peered":"2024-09-22T09:55:01.724176+0000","last_clean":"2024-09-22T09:55:01.724176+0000","last_became_active":"2024-09-22T08:42:23.577612+0000","last_became_peered":"2024-09-22T08:42:23.577612+0000","last_unstale":"2024-09-22T09:55:01.724176+0000","last_undegraded":"2024-09-22T09:55:01.724176+0000","last_fullsized":"2024-09-22T09:55:01.724176+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'196","last_scrub_stamp":"2024-09-22T09:55:01.724089+0000","last_deep_scrub":"262'196","last_deep_scrub_stamp":"2024-09-22T09:55:01.724089+0000","last_clean_scrub_stamp":"2024-09-22T09:55:01.724089+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:39:56.547358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":262,"num_read_kb":273,"num_write":467,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"262'142","reported_seq":735,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.022554+0000","last_change":"2024-09-22T09:54:33.022554+0000","last_active":"2024-09-22T09:54:33.022554+0000","last_peered":"2024-09-22T09:54:33.022554+0000","last_clean":"2024-09-22T09:54:33.022554+0000","last_became_active":"2024-09-22T08:42:15.426859+0000","last_became_peered":"2024-09-22T08:42:15.426859+0000","last_unstale":"2024-09-22T09:54:33.022554+0000","last_undegraded":"2024-09-22T09:54:33.022554+0000","last_fullsized":"2024-09-22T09:54:33.022554+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'142","last_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_deep_scrub":"262'142","last_deep_scrub_stamp":"2024-09-22T09:54:33.022460+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.022460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:53:44.487313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":526,"num_write":234,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"262'225","reported_seq":888,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.283104+0000","last_change":"2024-09-22T09:54:22.283055+0000","last_active":"2024-09-22T09:54:22.283104+0000","last_peered":"2024-09-22T09:54:22.283104+0000","last_clean":"2024-09-22T09:54:22.283104+0000","last_became_active":"2024-09-22T08:42:13.408243+0000","last_became_peered":"2024-09-22T08:42:13.408243+0000","last_unstale":"2024-09-22T09:54:22.283104+0000","last_undegraded":"2024-09-22T09:54:22.283104+0000","last_fullsized":"2024-09-22T09:54:22.283104+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'225","last_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_deep_scrub":"262'225","last_deep_scrub_stamp":"2024-09-22T09:54:22.282952+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.282952+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:16:25.985099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5108,"num_write":1161,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.898808+0000","last_change":"2024-09-22T09:54:36.898739+0000","last_active":"2024-09-22T09:54:36.898808+0000","last_peered":"2024-09-22T09:54:36.898808+0000","last_clean":"2024-09-22T09:54:36.898808+0000","last_became_active":"2024-09-22T08:42:17.432608+0000","last_became_peered":"2024-09-22T08:42:17.432608+0000","last_unstale":"2024-09-22T09:54:36.898808+0000","last_undegraded":"2024-09-22T09:54:36.898808+0000","last_fullsized":"2024-09-22T09:54:36.898808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:36.898653+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.898653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:01:53.057131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"262'214","reported_seq":822,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.603612+0000","last_change":"2024-09-22T09:54:46.603533+0000","last_active":"2024-09-22T09:54:46.603612+0000","last_peered":"2024-09-22T09:54:46.603612+0000","last_clean":"2024-09-22T09:54:46.603612+0000","last_became_active":"2024-09-22T08:42:19.454071+0000","last_became_peered":"2024-09-22T08:42:19.454071+0000","last_unstale":"2024-09-22T09:54:46.603612+0000","last_undegraded":"2024-09-22T09:54:46.603612+0000","last_fullsized":"2024-09-22T09:54:46.603612+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'214","last_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_deep_scrub":"262'214","last_deep_scrub_stamp":"2024-09-22T09:54:46.603406+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.603406+0000","objects_scrubbed":8,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:18:10.085025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":279,"num_read_kb":343,"num_write":184,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.145446+0000","last_change":"2024-09-22T09:54:43.145372+0000","last_active":"2024-09-22T09:54:43.145446+0000","last_peered":"2024-09-22T09:54:43.145446+0000","last_clean":"2024-09-22T09:54:43.145446+0000","last_became_active":"2024-09-22T08:42:21.476322+0000","last_became_peered":"2024-09-22T08:42:21.476322+0000","last_unstale":"2024-09-22T09:54:43.145446+0000","last_undegraded":"2024-09-22T09:54:43.145446+0000","last_fullsized":"2024-09-22T09:54:43.145446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.145290+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:18:47.362163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"262'173","reported_seq":693,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.061065+0000","last_change":"2024-09-22T09:54:46.060996+0000","last_active":"2024-09-22T09:54:46.061065+0000","last_peered":"2024-09-22T09:54:46.061065+0000","last_clean":"2024-09-22T09:54:46.061065+0000","last_became_active":"2024-09-22T08:42:23.524064+0000","last_became_peered":"2024-09-22T08:42:23.524064+0000","last_unstale":"2024-09-22T09:54:46.061065+0000","last_undegraded":"2024-09-22T09:54:46.061065+0000","last_fullsized":"2024-09-22T09:54:46.061065+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'173","last_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_deep_scrub":"262'173","last_deep_scrub_stamp":"2024-09-22T09:54:46.060901+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.060901+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:31:32.950276+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1641,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":478,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"262'105","reported_seq":733,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:38.831015+0000","last_change":"2024-09-22T09:54:38.830960+0000","last_active":"2024-09-22T09:54:38.831015+0000","last_peered":"2024-09-22T09:54:38.831015+0000","last_clean":"2024-09-22T09:54:38.831015+0000","last_became_active":"2024-09-22T08:42:15.440784+0000","last_became_peered":"2024-09-22T08:42:15.440784+0000","last_unstale":"2024-09-22T09:54:38.831015+0000","last_undegraded":"2024-09-22T09:54:38.831015+0000","last_fullsized":"2024-09-22T09:54:38.831015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'105","last_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_deep_scrub":"262'105","last_deep_scrub_stamp":"2024-09-22T09:54:38.830853+0000","last_clean_scrub_stamp":"2024-09-22T09:54:38.830853+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:26.729478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":431,"num_write":155,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"262'192","reported_seq":926,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.801551+0000","last_change":"2024-09-22T09:54:22.801488+0000","last_active":"2024-09-22T09:54:22.801551+0000","last_peered":"2024-09-22T09:54:22.801551+0000","last_clean":"2024-09-22T09:54:22.801551+0000","last_became_active":"2024-09-22T08:42:13.403008+0000","last_became_peered":"2024-09-22T08:42:13.403008+0000","last_unstale":"2024-09-22T09:54:22.801551+0000","last_undegraded":"2024-09-22T09:54:22.801551+0000","last_fullsized":"2024-09-22T09:54:22.801551+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'192","last_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_deep_scrub":"262'192","last_deep_scrub_stamp":"2024-09-22T09:54:22.801355+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.801355+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:29.354984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1210,"num_read_kb":5814,"num_write":981,"num_write_kb":19673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.557269+0000","last_change":"2024-09-22T09:54:43.557207+0000","last_active":"2024-09-22T09:54:43.557269+0000","last_peered":"2024-09-22T09:54:43.557269+0000","last_clean":"2024-09-22T09:54:43.557269+0000","last_became_active":"2024-09-22T08:42:17.435194+0000","last_became_peered":"2024-09-22T08:42:17.435194+0000","last_unstale":"2024-09-22T09:54:43.557269+0000","last_undegraded":"2024-09-22T09:54:43.557269+0000","last_fullsized":"2024-09-22T09:54:43.557269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.557120+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.557120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:12:55.802787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"262'165","reported_seq":764,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:51.681440+0000","last_change":"2024-09-22T09:54:51.681387+0000","last_active":"2024-09-22T09:54:51.681440+0000","last_peered":"2024-09-22T09:54:51.681440+0000","last_clean":"2024-09-22T09:54:51.681440+0000","last_became_active":"2024-09-22T08:42:19.458020+0000","last_became_peered":"2024-09-22T08:42:19.458020+0000","last_unstale":"2024-09-22T09:54:51.681440+0000","last_undegraded":"2024-09-22T09:54:51.681440+0000","last_fullsized":"2024-09-22T09:54:51.681440+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:51.681288+0000","last_clean_scrub_stamp":"2024-09-22T09:54:51.681288+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:26:17.079311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":298,"num_write":120,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:44.177280+0000","last_change":"2024-09-22T09:54:44.177280+0000","last_active":"2024-09-22T09:54:44.177280+0000","last_peered":"2024-09-22T09:54:44.177280+0000","last_clean":"2024-09-22T09:54:44.177280+0000","last_became_active":"2024-09-22T08:42:21.482010+0000","last_became_peered":"2024-09-22T08:42:21.482010+0000","last_unstale":"2024-09-22T09:54:44.177280+0000","last_undegraded":"2024-09-22T09:54:44.177280+0000","last_fullsized":"2024-09-22T09:54:44.177280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:44.177187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:44.177187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:34:19.025037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"262'118","reported_seq":621,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.318392+0000","last_change":"2024-09-22T09:54:54.318392+0000","last_active":"2024-09-22T09:54:54.318392+0000","last_peered":"2024-09-22T09:54:54.318392+0000","last_clean":"2024-09-22T09:54:54.318392+0000","last_became_active":"2024-09-22T08:42:23.523960+0000","last_became_peered":"2024-09-22T08:42:23.523960+0000","last_unstale":"2024-09-22T09:54:54.318392+0000","last_undegraded":"2024-09-22T09:54:54.318392+0000","last_fullsized":"2024-09-22T09:54:54.318392+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'118","last_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_deep_scrub":"262'118","last_deep_scrub_stamp":"2024-09-22T09:54:54.318291+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.318291+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:21:38.349114+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":136,"num_read_kb":129,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"262'263","reported_seq":876,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.691988+0000","last_change":"2024-09-22T09:54:25.691931+0000","last_active":"2024-09-22T09:54:25.691988+0000","last_peered":"2024-09-22T09:54:25.691988+0000","last_clean":"2024-09-22T09:54:25.691988+0000","last_became_active":"2024-09-22T08:42:15.435543+0000","last_became_peered":"2024-09-22T08:42:15.435543+0000","last_unstale":"2024-09-22T09:54:25.691988+0000","last_undegraded":"2024-09-22T09:54:25.691988+0000","last_fullsized":"2024-09-22T09:54:25.691988+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'263","last_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_deep_scrub":"262'263","last_deep_scrub_stamp":"2024-09-22T09:54:25.691841+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.691841+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:44:51.638310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1110,"num_read_kb":915,"num_write":377,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"262'240","reported_seq":936,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.101189+0000","last_change":"2024-09-22T09:54:22.101130+0000","last_active":"2024-09-22T09:54:22.101189+0000","last_peered":"2024-09-22T09:54:22.101189+0000","last_clean":"2024-09-22T09:54:22.101189+0000","last_became_active":"2024-09-22T08:42:13.413385+0000","last_became_peered":"2024-09-22T08:42:13.413385+0000","last_unstale":"2024-09-22T09:54:22.101189+0000","last_undegraded":"2024-09-22T09:54:22.101189+0000","last_fullsized":"2024-09-22T09:54:22.101189+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'240","last_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_deep_scrub":"262'240","last_deep_scrub_stamp":"2024-09-22T09:54:22.101055+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.101055+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:14:06.230927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":757,"num_read_kb":123234,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:40.210365+0000","last_change":"2024-09-22T09:54:40.210304+0000","last_active":"2024-09-22T09:54:40.210365+0000","last_peered":"2024-09-22T09:54:40.210365+0000","last_clean":"2024-09-22T09:54:40.210365+0000","last_became_active":"2024-09-22T08:42:17.435455+0000","last_became_peered":"2024-09-22T08:42:17.435455+0000","last_unstale":"2024-09-22T09:54:40.210365+0000","last_undegraded":"2024-09-22T09:54:40.210365+0000","last_fullsized":"2024-09-22T09:54:40.210365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:40.210210+0000","last_clean_scrub_stamp":"2024-09-22T09:54:40.210210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:10:43.908095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"262'128","reported_seq":678,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.603142+0000","last_change":"2024-09-22T09:54:48.603142+0000","last_active":"2024-09-22T09:54:48.603142+0000","last_peered":"2024-09-22T09:54:48.603142+0000","last_clean":"2024-09-22T09:54:48.603142+0000","last_became_active":"2024-09-22T08:42:19.452804+0000","last_became_peered":"2024-09-22T08:42:19.452804+0000","last_unstale":"2024-09-22T09:54:48.603142+0000","last_undegraded":"2024-09-22T09:54:48.603142+0000","last_fullsized":"2024-09-22T09:54:48.603142+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'128","last_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_deep_scrub":"262'128","last_deep_scrub_stamp":"2024-09-22T09:54:48.603050+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.603050+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:49.371561+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":160,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"262'759","reported_seq":4740,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:42.959031+0000","last_change":"2024-09-22T09:54:42.958949+0000","last_active":"2024-09-22T09:54:42.959031+0000","last_peered":"2024-09-22T09:54:42.959031+0000","last_clean":"2024-09-22T09:54:42.959031+0000","last_became_active":"2024-09-22T08:42:21.478572+0000","last_became_peered":"2024-09-22T08:42:21.478572+0000","last_unstale":"2024-09-22T09:54:42.959031+0000","last_undegraded":"2024-09-22T09:54:42.959031+0000","last_fullsized":"2024-09-22T09:54:42.959031+0000","mapping_epoch":32,"log_start":"262'700","ondisk_log_start":"262'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'759","last_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_deep_scrub":"262'759","last_deep_scrub_stamp":"2024-09-22T09:54:42.958819+0000","last_clean_scrub_stamp":"2024-09-22T09:54:42.958819+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:41:45.949669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"262'148","reported_seq":653,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.581940+0000","last_change":"2024-09-22T09:54:52.581940+0000","last_active":"2024-09-22T09:54:52.581940+0000","last_peered":"2024-09-22T09:54:52.581940+0000","last_clean":"2024-09-22T09:54:52.581940+0000","last_became_active":"2024-09-22T08:42:23.527947+0000","last_became_peered":"2024-09-22T08:42:23.527947+0000","last_unstale":"2024-09-22T09:54:52.581940+0000","last_undegraded":"2024-09-22T09:54:52.581940+0000","last_fullsized":"2024-09-22T09:54:52.581940+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'148","last_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_deep_scrub":"262'148","last_deep_scrub_stamp":"2024-09-22T09:54:52.581848+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.581848+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:57:34.153212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":172,"num_write":336,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"262'134","reported_seq":725,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.678521+0000","last_change":"2024-09-22T09:54:32.678447+0000","last_active":"2024-09-22T09:54:32.678521+0000","last_peered":"2024-09-22T09:54:32.678521+0000","last_clean":"2024-09-22T09:54:32.678521+0000","last_became_active":"2024-09-22T08:42:46.084479+0000","last_became_peered":"2024-09-22T08:42:46.084479+0000","last_unstale":"2024-09-22T09:54:32.678521+0000","last_undegraded":"2024-09-22T09:54:32.678521+0000","last_fullsized":"2024-09-22T09:54:32.678521+0000","mapping_epoch":37,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'134","last_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_deep_scrub":"262'134","last_deep_scrub_stamp":"2024-09-22T09:54:32.678357+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.678357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:09:18.763576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":479,"num_write":221,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"262'293","reported_seq":1034,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:22.668343+0000","last_change":"2024-09-22T09:54:22.668274+0000","last_active":"2024-09-22T09:54:22.668343+0000","last_peered":"2024-09-22T09:54:22.668343+0000","last_clean":"2024-09-22T09:54:22.668343+0000","last_became_active":"2024-09-22T08:42:46.086246+0000","last_became_peered":"2024-09-22T08:42:46.086246+0000","last_unstale":"2024-09-22T09:54:22.668343+0000","last_undegraded":"2024-09-22T09:54:22.668343+0000","last_fullsized":"2024-09-22T09:54:22.668343+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'293","last_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_deep_scrub":"262'293","last_deep_scrub_stamp":"2024-09-22T09:54:22.668200+0000","last_clean_scrub_stamp":"2024-09-22T09:54:22.668200+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:57.525651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1304,"num_read_kb":50200,"num_write":1267,"num_write_kb":15693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"262'4","reported_seq":983,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.607268+0000","last_change":"2024-09-22T09:54:41.607211+0000","last_active":"2024-09-22T09:54:41.607268+0000","last_peered":"2024-09-22T09:54:41.607268+0000","last_clean":"2024-09-22T09:54:41.607268+0000","last_became_active":"2024-09-22T08:42:17.430217+0000","last_became_peered":"2024-09-22T08:42:17.430217+0000","last_unstale":"2024-09-22T09:54:41.607268+0000","last_undegraded":"2024-09-22T09:54:41.607268+0000","last_fullsized":"2024-09-22T09:54:41.607268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-22T09:54:41.607128+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.607128+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:13.784197+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"262'222","reported_seq":834,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:48.293943+0000","last_change":"2024-09-22T09:54:48.293890+0000","last_active":"2024-09-22T09:54:48.293943+0000","last_peered":"2024-09-22T09:54:48.293943+0000","last_clean":"2024-09-22T09:54:48.293943+0000","last_became_active":"2024-09-22T08:42:19.455252+0000","last_became_peered":"2024-09-22T08:42:19.455252+0000","last_unstale":"2024-09-22T09:54:48.293943+0000","last_undegraded":"2024-09-22T09:54:48.293943+0000","last_fullsized":"2024-09-22T09:54:48.293943+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:48.293771+0000","last_clean_scrub_stamp":"2024-09-22T09:54:48.293771+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:52:35.851163+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6055,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":273,"num_read_kb":326,"num_write":162,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.123632+0000","last_change":"2024-09-22T09:54:50.123578+0000","last_active":"2024-09-22T09:54:50.123632+0000","last_peered":"2024-09-22T09:54:50.123632+0000","last_clean":"2024-09-22T09:54:50.123632+0000","last_became_active":"2024-09-22T08:42:21.476451+0000","last_became_peered":"2024-09-22T08:42:21.476451+0000","last_unstale":"2024-09-22T09:54:50.123632+0000","last_undegraded":"2024-09-22T09:54:50.123632+0000","last_fullsized":"2024-09-22T09:54:50.123632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.123483+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.123483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:42:56.260363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"262'144","reported_seq":679,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:54.622400+0000","last_change":"2024-09-22T09:54:54.622339+0000","last_active":"2024-09-22T09:54:54.622400+0000","last_peered":"2024-09-22T09:54:54.622400+0000","last_clean":"2024-09-22T09:54:54.622400+0000","last_became_active":"2024-09-22T08:42:23.516862+0000","last_became_peered":"2024-09-22T08:42:23.516862+0000","last_unstale":"2024-09-22T09:54:54.622400+0000","last_undegraded":"2024-09-22T09:54:54.622400+0000","last_fullsized":"2024-09-22T09:54:54.622400+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'144","last_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_deep_scrub":"262'144","last_deep_scrub_stamp":"2024-09-22T09:54:54.622250+0000","last_clean_scrub_stamp":"2024-09-22T09:54:54.622250+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:09.716918+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":237,"num_write":325,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"262'146","reported_seq":772,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.725728+0000","last_change":"2024-09-22T09:54:31.725674+0000","last_active":"2024-09-22T09:54:31.725728+0000","last_peered":"2024-09-22T09:54:31.725728+0000","last_clean":"2024-09-22T09:54:31.725728+0000","last_became_active":"2024-09-22T08:42:15.431246+0000","last_became_peered":"2024-09-22T08:42:15.431246+0000","last_unstale":"2024-09-22T09:54:31.725728+0000","last_undegraded":"2024-09-22T09:54:31.725728+0000","last_fullsized":"2024-09-22T09:54:31.725728+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:31.725590+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.725590+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:07:46.484791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":671,"num_read_kb":557,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"262'213","reported_seq":819,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:23.635369+0000","last_change":"2024-09-22T09:54:23.635302+0000","last_active":"2024-09-22T09:54:23.635369+0000","last_peered":"2024-09-22T09:54:23.635369+0000","last_clean":"2024-09-22T09:54:23.635369+0000","last_became_active":"2024-09-22T08:42:46.088140+0000","last_became_peered":"2024-09-22T08:42:46.088140+0000","last_unstale":"2024-09-22T09:54:23.635369+0000","last_undegraded":"2024-09-22T09:54:23.635369+0000","last_fullsized":"2024-09-22T09:54:23.635369+0000","mapping_epoch":37,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'213","last_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_deep_scrub":"262'213","last_deep_scrub_stamp":"2024-09-22T09:54:23.635178+0000","last_clean_scrub_stamp":"2024-09-22T09:54:23.635178+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:51:34.216176+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":26654,"num_write":910,"num_write_kb":25227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:43.259561+0000","last_change":"2024-09-22T09:54:43.259487+0000","last_active":"2024-09-22T09:54:43.259561+0000","last_peered":"2024-09-22T09:54:43.259561+0000","last_clean":"2024-09-22T09:54:43.259561+0000","last_became_active":"2024-09-22T08:42:17.434515+0000","last_became_peered":"2024-09-22T08:42:17.434515+0000","last_unstale":"2024-09-22T09:54:43.259561+0000","last_undegraded":"2024-09-22T09:54:43.259561+0000","last_fullsized":"2024-09-22T09:54:43.259561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:43.259390+0000","last_clean_scrub_stamp":"2024-09-22T09:54:43.259390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:24:20.533974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"262'149","reported_seq":738,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.104170+0000","last_change":"2024-09-22T09:54:45.104115+0000","last_active":"2024-09-22T09:54:45.104170+0000","last_peered":"2024-09-22T09:54:45.104170+0000","last_clean":"2024-09-22T09:54:45.104170+0000","last_became_active":"2024-09-22T08:42:19.455318+0000","last_became_peered":"2024-09-22T08:42:19.455318+0000","last_unstale":"2024-09-22T09:54:45.104170+0000","last_undegraded":"2024-09-22T09:54:45.104170+0000","last_fullsized":"2024-09-22T09:54:45.104170+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'149","last_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_deep_scrub":"262'149","last_deep_scrub_stamp":"2024-09-22T09:54:45.104013+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.104013+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:06:03.942310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6811,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":273,"num_write":110,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:45.046201+0000","last_change":"2024-09-22T09:54:45.046144+0000","last_active":"2024-09-22T09:54:45.046201+0000","last_peered":"2024-09-22T09:54:45.046201+0000","last_clean":"2024-09-22T09:54:45.046201+0000","last_became_active":"2024-09-22T08:42:21.476639+0000","last_became_peered":"2024-09-22T08:42:21.476639+0000","last_unstale":"2024-09-22T09:54:45.046201+0000","last_undegraded":"2024-09-22T09:54:45.046201+0000","last_fullsized":"2024-09-22T09:54:45.046201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:45.046060+0000","last_clean_scrub_stamp":"2024-09-22T09:54:45.046060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:52:11.746875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"262'144","reported_seq":677,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:55:02.746262+0000","last_change":"2024-09-22T09:55:02.746262+0000","last_active":"2024-09-22T09:55:02.746262+0000","last_peered":"2024-09-22T09:55:02.746262+0000","last_clean":"2024-09-22T09:55:02.746262+0000","last_became_active":"2024-09-22T08:42:23.577660+0000","last_became_peered":"2024-09-22T08:42:23.577660+0000","last_unstale":"2024-09-22T09:55:02.746262+0000","last_undegraded":"2024-09-22T09:55:02.746262+0000","last_fullsized":"2024-09-22T09:55:02.746262+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'144","last_scrub_stamp":"2024-09-22T09:55:02.746156+0000","last_deep_scrub":"262'144","last_deep_scrub_stamp":"2024-09-22T09:55:02.746156+0000","last_clean_scrub_stamp":"2024-09-22T09:55:02.746156+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:55.455609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":259,"num_read_kb":248,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"262'209","reported_seq":891,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.772107+0000","last_change":"2024-09-22T09:54:35.772041+0000","last_active":"2024-09-22T09:54:35.772107+0000","last_peered":"2024-09-22T09:54:35.772107+0000","last_clean":"2024-09-22T09:54:35.772107+0000","last_became_active":"2024-09-22T08:42:15.438001+0000","last_became_peered":"2024-09-22T08:42:15.438001+0000","last_unstale":"2024-09-22T09:54:35.772107+0000","last_undegraded":"2024-09-22T09:54:35.772107+0000","last_fullsized":"2024-09-22T09:54:35.772107+0000","mapping_epoch":26,"log_start":"38'100","ondisk_log_start":"38'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'209","last_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_deep_scrub":"262'209","last_deep_scrub_stamp":"2024-09-22T09:54:35.771951+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.771951+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:46.651125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1175,"num_read_kb":1069,"num_write":344,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"262'277","reported_seq":959,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.864381+0000","last_change":"2024-09-22T09:54:24.864311+0000","last_active":"2024-09-22T09:54:24.864381+0000","last_peered":"2024-09-22T09:54:24.864381+0000","last_clean":"2024-09-22T09:54:24.864381+0000","last_became_active":"2024-09-22T08:42:13.403877+0000","last_became_peered":"2024-09-22T08:42:13.403877+0000","last_unstale":"2024-09-22T09:54:24.864381+0000","last_undegraded":"2024-09-22T09:54:24.864381+0000","last_fullsized":"2024-09-22T09:54:24.864381+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'277","last_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_deep_scrub":"262'277","last_deep_scrub_stamp":"2024-09-22T09:54:24.864187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.864187+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:28.585786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":745,"num_read_kb":35485,"num_write":1188,"num_write_kb":44404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.589608+0000","last_change":"2024-09-22T09:54:41.589523+0000","last_active":"2024-09-22T09:54:41.589608+0000","last_peered":"2024-09-22T09:54:41.589608+0000","last_clean":"2024-09-22T09:54:41.589608+0000","last_became_active":"2024-09-22T08:42:17.428356+0000","last_became_peered":"2024-09-22T08:42:17.428356+0000","last_unstale":"2024-09-22T09:54:41.589608+0000","last_undegraded":"2024-09-22T09:54:41.589608+0000","last_fullsized":"2024-09-22T09:54:41.589608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:41.589412+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.589412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:53.383562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"262'117","reported_seq":686,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.656741+0000","last_change":"2024-09-22T09:54:53.656741+0000","last_active":"2024-09-22T09:54:53.656741+0000","last_peered":"2024-09-22T09:54:53.656741+0000","last_clean":"2024-09-22T09:54:53.656741+0000","last_became_active":"2024-09-22T08:42:19.453436+0000","last_became_peered":"2024-09-22T08:42:19.453436+0000","last_unstale":"2024-09-22T09:54:53.656741+0000","last_undegraded":"2024-09-22T09:54:53.656741+0000","last_fullsized":"2024-09-22T09:54:53.656741+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'117","last_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_deep_scrub":"262'117","last_deep_scrub_stamp":"2024-09-22T09:54:53.656660+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.656660+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:38:11.088340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13207,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":258,"num_write":80,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:50.625537+0000","last_change":"2024-09-22T09:54:50.625479+0000","last_active":"2024-09-22T09:54:50.625537+0000","last_peered":"2024-09-22T09:54:50.625537+0000","last_clean":"2024-09-22T09:54:50.625537+0000","last_became_active":"2024-09-22T08:42:21.477869+0000","last_became_peered":"2024-09-22T08:42:21.477869+0000","last_unstale":"2024-09-22T09:54:50.625537+0000","last_undegraded":"2024-09-22T09:54:50.625537+0000","last_fullsized":"2024-09-22T09:54:50.625537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:50.625391+0000","last_clean_scrub_stamp":"2024-09-22T09:54:50.625391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:00:36.473029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"262'165","reported_seq":1642,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.619056+0000","last_change":"2024-09-22T09:54:53.618972+0000","last_active":"2024-09-22T09:54:53.619056+0000","last_peered":"2024-09-22T09:54:53.619056+0000","last_clean":"2024-09-22T09:54:53.619056+0000","last_became_active":"2024-09-22T08:42:23.525837+0000","last_became_peered":"2024-09-22T08:42:23.525837+0000","last_unstale":"2024-09-22T09:54:53.619056+0000","last_undegraded":"2024-09-22T09:54:53.619056+0000","last_fullsized":"2024-09-22T09:54:53.619056+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'165","last_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_deep_scrub":"262'165","last_deep_scrub_stamp":"2024-09-22T09:54:53.618875+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.618875+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:54:04.804623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1228,"num_read_kb":1217,"num_write":378,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"262'4461","reported_seq":5266,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:30.687095+0000","last_change":"2024-09-22T09:54:30.687043+0000","last_active":"2024-09-22T09:54:30.687095+0000","last_peered":"2024-09-22T09:54:30.687095+0000","last_clean":"2024-09-22T09:54:30.687095+0000","last_became_active":"2024-09-22T08:42:15.427718+0000","last_became_peered":"2024-09-22T08:42:15.427718+0000","last_unstale":"2024-09-22T09:54:30.687095+0000","last_undegraded":"2024-09-22T09:54:30.687095+0000","last_fullsized":"2024-09-22T09:54:30.687095+0000","mapping_epoch":26,"log_start":"262'4400","ondisk_log_start":"262'4400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4461","last_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_deep_scrub":"262'4461","last_deep_scrub_stamp":"2024-09-22T09:54:30.686961+0000","last_clean_scrub_stamp":"2024-09-22T09:54:30.686961+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":3000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:15:59.557234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18278,"num_read_kb":15385,"num_write":6811,"num_write_kb":3522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"262'237","reported_seq":903,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.054726+0000","last_change":"2024-09-22T09:54:24.054638+0000","last_active":"2024-09-22T09:54:24.054726+0000","last_peered":"2024-09-22T09:54:24.054726+0000","last_clean":"2024-09-22T09:54:24.054726+0000","last_became_active":"2024-09-22T08:42:13.422398+0000","last_became_peered":"2024-09-22T08:42:13.422398+0000","last_unstale":"2024-09-22T09:54:24.054726+0000","last_undegraded":"2024-09-22T09:54:24.054726+0000","last_fullsized":"2024-09-22T09:54:24.054726+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'237","last_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_deep_scrub":"262'237","last_deep_scrub_stamp":"2024-09-22T09:54:24.054495+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.054495+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:26:50.248679+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":602,"num_read_kb":45002,"num_write":1097,"num_write_kb":53174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"262'2","reported_seq":507,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.198579+0000","last_change":"2024-09-22T09:54:37.198471+0000","last_active":"2024-09-22T09:54:37.198579+0000","last_peered":"2024-09-22T09:54:37.198579+0000","last_clean":"2024-09-22T09:54:37.198579+0000","last_became_active":"2024-09-22T08:42:17.443472+0000","last_became_peered":"2024-09-22T08:42:17.443472+0000","last_unstale":"2024-09-22T09:54:37.198579+0000","last_undegraded":"2024-09-22T09:54:37.198579+0000","last_fullsized":"2024-09-22T09:54:37.198579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-22T09:54:37.198370+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.198370+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:31:57.482827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"262'222","reported_seq":826,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:46.607437+0000","last_change":"2024-09-22T09:54:46.607378+0000","last_active":"2024-09-22T09:54:46.607437+0000","last_peered":"2024-09-22T09:54:46.607437+0000","last_clean":"2024-09-22T09:54:46.607437+0000","last_became_active":"2024-09-22T08:42:19.453663+0000","last_became_peered":"2024-09-22T08:42:19.453663+0000","last_unstale":"2024-09-22T09:54:46.607437+0000","last_undegraded":"2024-09-22T09:54:46.607437+0000","last_fullsized":"2024-09-22T09:54:46.607437+0000","mapping_epoch":30,"log_start":"262'200","ondisk_log_start":"262'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:46.607285+0000","last_clean_scrub_stamp":"2024-09-22T09:54:46.607285+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:33:00.061934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":792,"num_write":216,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:52.133185+0000","last_change":"2024-09-22T09:54:52.133089+0000","last_active":"2024-09-22T09:54:52.133185+0000","last_peered":"2024-09-22T09:54:52.133185+0000","last_clean":"2024-09-22T09:54:52.133185+0000","last_became_active":"2024-09-22T08:42:21.477106+0000","last_became_peered":"2024-09-22T08:42:21.477106+0000","last_unstale":"2024-09-22T09:54:52.133185+0000","last_undegraded":"2024-09-22T09:54:52.133185+0000","last_fullsized":"2024-09-22T09:54:52.133185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T09:54:52.132987+0000","last_clean_scrub_stamp":"2024-09-22T09:54:52.132987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:51:10.463039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"262'129","reported_seq":645,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:53.608918+0000","last_change":"2024-09-22T09:54:53.608859+0000","last_active":"2024-09-22T09:54:53.608918+0000","last_peered":"2024-09-22T09:54:53.608918+0000","last_clean":"2024-09-22T09:54:53.608918+0000","last_became_active":"2024-09-22T08:42:23.526837+0000","last_became_peered":"2024-09-22T08:42:23.526837+0000","last_unstale":"2024-09-22T09:54:53.608918+0000","last_undegraded":"2024-09-22T09:54:53.608918+0000","last_fullsized":"2024-09-22T09:54:53.608918+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'129","last_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_deep_scrub":"262'129","last_deep_scrub_stamp":"2024-09-22T09:54:53.608769+0000","last_clean_scrub_stamp":"2024-09-22T09:54:53.608769+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:13:07.256774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":183,"num_write":298,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"262'179","reported_seq":815,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.181260+0000","last_change":"2024-09-22T09:54:34.181260+0000","last_active":"2024-09-22T09:54:34.181260+0000","last_peered":"2024-09-22T09:54:34.181260+0000","last_clean":"2024-09-22T09:54:34.181260+0000","last_became_active":"2024-09-22T08:42:15.436379+0000","last_became_peered":"2024-09-22T08:42:15.436379+0000","last_unstale":"2024-09-22T09:54:34.181260+0000","last_undegraded":"2024-09-22T09:54:34.181260+0000","last_fullsized":"2024-09-22T09:54:34.181260+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'179","last_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_deep_scrub":"262'179","last_deep_scrub_stamp":"2024-09-22T09:54:34.181177+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.181177+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:16:28.301187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":797,"num_read_kb":658,"num_write":260,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"262'198","reported_seq":860,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.782799+0000","last_change":"2024-09-22T09:54:24.782744+0000","last_active":"2024-09-22T09:54:24.782799+0000","last_peered":"2024-09-22T09:54:24.782799+0000","last_clean":"2024-09-22T09:54:24.782799+0000","last_became_active":"2024-09-22T08:42:13.410872+0000","last_became_peered":"2024-09-22T08:42:13.410872+0000","last_unstale":"2024-09-22T09:54:24.782799+0000","last_undegraded":"2024-09-22T09:54:24.782799+0000","last_fullsized":"2024-09-22T09:54:24.782799+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'198","last_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_deep_scrub":"262'198","last_deep_scrub_stamp":"2024-09-22T09:54:24.782631+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.782631+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:03:28.457706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":68297,"num_write":940,"num_write_kb":36940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"262'346","reported_seq":977,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.209160+0000","last_change":"2024-09-22T09:54:32.209160+0000","last_active":"2024-09-22T09:54:32.209160+0000","last_peered":"2024-09-22T09:54:32.209160+0000","last_clean":"2024-09-22T09:54:32.209160+0000","last_became_active":"2024-09-22T08:42:15.434363+0000","last_became_peered":"2024-09-22T08:42:15.434363+0000","last_unstale":"2024-09-22T09:54:32.209160+0000","last_undegraded":"2024-09-22T09:54:32.209160+0000","last_fullsized":"2024-09-22T09:54:32.209160+0000","mapping_epoch":26,"log_start":"262'300","ondisk_log_start":"262'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'346","last_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_deep_scrub":"262'346","last_deep_scrub_stamp":"2024-09-22T09:54:32.209076+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.209076+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:05:53.157428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1478,"num_read_kb":1181,"num_write":559,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"262'194","reported_seq":829,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:24.679645+0000","last_change":"2024-09-22T09:54:24.679547+0000","last_active":"2024-09-22T09:54:24.679645+0000","last_peered":"2024-09-22T09:54:24.679645+0000","last_clean":"2024-09-22T09:54:24.679645+0000","last_became_active":"2024-09-22T08:42:13.389971+0000","last_became_peered":"2024-09-22T08:42:13.389971+0000","last_unstale":"2024-09-22T09:54:24.679645+0000","last_undegraded":"2024-09-22T09:54:24.679645+0000","last_fullsized":"2024-09-22T09:54:24.679645+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'194","last_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_deep_scrub":"262'194","last_deep_scrub_stamp":"2024-09-22T09:54:24.679384+0000","last_clean_scrub_stamp":"2024-09-22T09:54:24.679384+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:50:52.319029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":546,"num_read_kb":8670,"num_write":934,"num_write_kb":20331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"262'146","reported_seq":739,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.382536+0000","last_change":"2024-09-22T09:54:35.382536+0000","last_active":"2024-09-22T09:54:35.382536+0000","last_peered":"2024-09-22T09:54:35.382536+0000","last_clean":"2024-09-22T09:54:35.382536+0000","last_became_active":"2024-09-22T08:42:15.434484+0000","last_became_peered":"2024-09-22T08:42:15.434484+0000","last_unstale":"2024-09-22T09:54:35.382536+0000","last_undegraded":"2024-09-22T09:54:35.382536+0000","last_fullsized":"2024-09-22T09:54:35.382536+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'146","last_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_deep_scrub":"262'146","last_deep_scrub_stamp":"2024-09-22T09:54:35.382442+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.382442+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:38:41.378476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":618,"num_read_kb":505,"num_write":206,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"262'197","reported_seq":831,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.543866+0000","last_change":"2024-09-22T09:54:26.543796+0000","last_active":"2024-09-22T09:54:26.543866+0000","last_peered":"2024-09-22T09:54:26.543866+0000","last_clean":"2024-09-22T09:54:26.543866+0000","last_became_active":"2024-09-22T08:42:13.404639+0000","last_became_peered":"2024-09-22T08:42:13.404639+0000","last_unstale":"2024-09-22T09:54:26.543866+0000","last_undegraded":"2024-09-22T09:54:26.543866+0000","last_fullsized":"2024-09-22T09:54:26.543866+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'197","last_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_deep_scrub":"262'197","last_deep_scrub_stamp":"2024-09-22T09:54:26.543655+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.543655+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:07:59.656939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":611,"num_read_kb":542,"num_write":1015,"num_write_kb":9820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"262'132","reported_seq":747,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.195206+0000","last_change":"2024-09-22T09:54:33.195206+0000","last_active":"2024-09-22T09:54:33.195206+0000","last_peered":"2024-09-22T09:54:33.195206+0000","last_clean":"2024-09-22T09:54:33.195206+0000","last_became_active":"2024-09-22T08:42:15.431391+0000","last_became_peered":"2024-09-22T08:42:15.431391+0000","last_unstale":"2024-09-22T09:54:33.195206+0000","last_undegraded":"2024-09-22T09:54:33.195206+0000","last_fullsized":"2024-09-22T09:54:33.195206+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'132","last_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_deep_scrub":"262'132","last_deep_scrub_stamp":"2024-09-22T09:54:33.195108+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.195108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:38:04.521832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":495,"num_write":216,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"262'205","reported_seq":867,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.083625+0000","last_change":"2024-09-22T09:54:25.083506+0000","last_active":"2024-09-22T09:54:25.083625+0000","last_peered":"2024-09-22T09:54:25.083625+0000","last_clean":"2024-09-22T09:54:25.083625+0000","last_became_active":"2024-09-22T08:42:13.414477+0000","last_became_peered":"2024-09-22T08:42:13.414477+0000","last_unstale":"2024-09-22T09:54:25.083625+0000","last_undegraded":"2024-09-22T09:54:25.083625+0000","last_fullsized":"2024-09-22T09:54:25.083625+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'205","last_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_deep_scrub":"262'205","last_deep_scrub_stamp":"2024-09-22T09:54:25.083235+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.083235+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:40.697324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":724,"num_read_kb":18552,"num_write":938,"num_write_kb":35052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"262'221","reported_seq":844,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.803251+0000","last_change":"2024-09-22T09:54:37.803183+0000","last_active":"2024-09-22T09:54:37.803251+0000","last_peered":"2024-09-22T09:54:37.803251+0000","last_clean":"2024-09-22T09:54:37.803251+0000","last_became_active":"2024-09-22T08:42:15.436059+0000","last_became_peered":"2024-09-22T08:42:15.436059+0000","last_unstale":"2024-09-22T09:54:37.803251+0000","last_undegraded":"2024-09-22T09:54:37.803251+0000","last_fullsized":"2024-09-22T09:54:37.803251+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'221","last_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_deep_scrub":"262'221","last_deep_scrub_stamp":"2024-09-22T09:54:37.803092+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.803092+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:42:22.441183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":941,"num_read_kb":763,"num_write":356,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"262'222","reported_seq":878,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.900669+0000","last_change":"2024-09-22T09:54:25.900669+0000","last_active":"2024-09-22T09:54:25.900669+0000","last_peered":"2024-09-22T09:54:25.900669+0000","last_clean":"2024-09-22T09:54:25.900669+0000","last_became_active":"2024-09-22T08:42:13.404828+0000","last_became_peered":"2024-09-22T08:42:13.404828+0000","last_unstale":"2024-09-22T09:54:25.900669+0000","last_undegraded":"2024-09-22T09:54:25.900669+0000","last_fullsized":"2024-09-22T09:54:25.900669+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'222","last_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_deep_scrub":"262'222","last_deep_scrub_stamp":"2024-09-22T09:54:25.900557+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.900557+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:03:40.029656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":690,"num_read_kb":30794,"num_write":966,"num_write_kb":19993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"262'220","reported_seq":870,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:33.668993+0000","last_change":"2024-09-22T09:54:33.668933+0000","last_active":"2024-09-22T09:54:33.668993+0000","last_peered":"2024-09-22T09:54:33.668993+0000","last_clean":"2024-09-22T09:54:33.668993+0000","last_became_active":"2024-09-22T08:42:15.433481+0000","last_became_peered":"2024-09-22T08:42:15.433481+0000","last_unstale":"2024-09-22T09:54:33.668993+0000","last_undegraded":"2024-09-22T09:54:33.668993+0000","last_fullsized":"2024-09-22T09:54:33.668993+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'220","last_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_deep_scrub":"262'220","last_deep_scrub_stamp":"2024-09-22T09:54:33.668849+0000","last_clean_scrub_stamp":"2024-09-22T09:54:33.668849+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:40:00.473679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":955,"num_read_kb":782,"num_write":336,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"262'282","reported_seq":980,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.200420+0000","last_change":"2024-09-22T09:54:26.200420+0000","last_active":"2024-09-22T09:54:26.200420+0000","last_peered":"2024-09-22T09:54:26.200420+0000","last_clean":"2024-09-22T09:54:26.200420+0000","last_became_active":"2024-09-22T08:42:13.421572+0000","last_became_peered":"2024-09-22T08:42:13.421572+0000","last_unstale":"2024-09-22T09:54:26.200420+0000","last_undegraded":"2024-09-22T09:54:26.200420+0000","last_fullsized":"2024-09-22T09:54:26.200420+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'282","last_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_deep_scrub":"262'282","last_deep_scrub_stamp":"2024-09-22T09:54:26.200277+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.200277+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:40:20.326052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242911,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":757,"num_read_kb":37026,"num_write":1221,"num_write_kb":37586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"262'185","reported_seq":794,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:39.820421+0000","last_change":"2024-09-22T09:54:39.820348+0000","last_active":"2024-09-22T09:54:39.820421+0000","last_peered":"2024-09-22T09:54:39.820421+0000","last_clean":"2024-09-22T09:54:39.820421+0000","last_became_active":"2024-09-22T08:42:15.440599+0000","last_became_peered":"2024-09-22T08:42:15.440599+0000","last_unstale":"2024-09-22T09:54:39.820421+0000","last_undegraded":"2024-09-22T09:54:39.820421+0000","last_fullsized":"2024-09-22T09:54:39.820421+0000","mapping_epoch":26,"log_start":"259'100","ondisk_log_start":"259'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'185","last_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_deep_scrub":"262'185","last_deep_scrub_stamp":"2024-09-22T09:54:39.820264+0000","last_clean_scrub_stamp":"2024-09-22T09:54:39.820264+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:10:38.159333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":630,"num_write":275,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"262'210","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.829055+0000","last_change":"2024-09-22T09:54:25.829055+0000","last_active":"2024-09-22T09:54:25.829055+0000","last_peered":"2024-09-22T09:54:25.829055+0000","last_clean":"2024-09-22T09:54:25.829055+0000","last_became_active":"2024-09-22T08:42:13.407412+0000","last_became_peered":"2024-09-22T08:42:13.407412+0000","last_unstale":"2024-09-22T09:54:25.829055+0000","last_undegraded":"2024-09-22T09:54:25.829055+0000","last_fullsized":"2024-09-22T09:54:25.829055+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'210","last_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_deep_scrub":"262'210","last_deep_scrub_stamp":"2024-09-22T09:54:25.828882+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.828882+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:51:15.511659+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242895,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":7650,"num_write":1038,"num_write_kb":28304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'60","reported_seq":641,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.886398+0000","last_change":"2024-09-22T09:54:32.886298+0000","last_active":"2024-09-22T09:54:32.886398+0000","last_peered":"2024-09-22T09:54:32.886398+0000","last_clean":"2024-09-22T09:54:32.886398+0000","last_became_active":"2024-09-22T08:42:15.428685+0000","last_became_peered":"2024-09-22T08:42:15.428685+0000","last_unstale":"2024-09-22T09:54:32.886398+0000","last_undegraded":"2024-09-22T09:54:32.886398+0000","last_fullsized":"2024-09-22T09:54:32.886398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'60","last_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_deep_scrub":"262'60","last_deep_scrub_stamp":"2024-09-22T09:54:32.886187+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.886187+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:06:19.355885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":248,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"262'229","reported_seq":866,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.850468+0000","last_change":"2024-09-22T09:54:31.850468+0000","last_active":"2024-09-22T09:54:31.850468+0000","last_peered":"2024-09-22T09:54:31.850468+0000","last_clean":"2024-09-22T09:54:31.850468+0000","last_became_active":"2024-09-22T08:42:13.415446+0000","last_became_peered":"2024-09-22T08:42:13.415446+0000","last_unstale":"2024-09-22T09:54:31.850468+0000","last_undegraded":"2024-09-22T09:54:31.850468+0000","last_fullsized":"2024-09-22T09:54:31.850468+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'229","last_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_deep_scrub":"262'229","last_deep_scrub_stamp":"2024-09-22T09:54:31.850380+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.850380+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:59:23.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":20476,"num_write":1023,"num_write_kb":65398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"262'232","reported_seq":904,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.087299+0000","last_change":"2024-09-22T09:54:35.087235+0000","last_active":"2024-09-22T09:54:35.087299+0000","last_peered":"2024-09-22T09:54:35.087299+0000","last_clean":"2024-09-22T09:54:35.087299+0000","last_became_active":"2024-09-22T08:42:15.440329+0000","last_became_peered":"2024-09-22T08:42:15.440329+0000","last_unstale":"2024-09-22T09:54:35.087299+0000","last_undegraded":"2024-09-22T09:54:35.087299+0000","last_fullsized":"2024-09-22T09:54:35.087299+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'232","last_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_deep_scrub":"262'232","last_deep_scrub_stamp":"2024-09-22T09:54:35.087135+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.087135+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:46:07.485045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1033,"num_read_kb":857,"num_write":349,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"262'186","reported_seq":800,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.512435+0000","last_change":"2024-09-22T09:54:27.512435+0000","last_active":"2024-09-22T09:54:27.512435+0000","last_peered":"2024-09-22T09:54:27.512435+0000","last_clean":"2024-09-22T09:54:27.512435+0000","last_became_active":"2024-09-22T08:42:13.408968+0000","last_became_peered":"2024-09-22T08:42:13.408968+0000","last_unstale":"2024-09-22T09:54:27.512435+0000","last_undegraded":"2024-09-22T09:54:27.512435+0000","last_fullsized":"2024-09-22T09:54:27.512435+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:27.512262+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.512262+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:46:12.723891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":7230,"num_write":907,"num_write_kb":22380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"262'90","reported_seq":668,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.708613+0000","last_change":"2024-09-22T09:54:36.708533+0000","last_active":"2024-09-22T09:54:36.708613+0000","last_peered":"2024-09-22T09:54:36.708613+0000","last_clean":"2024-09-22T09:54:36.708613+0000","last_became_active":"2024-09-22T08:42:15.427841+0000","last_became_peered":"2024-09-22T08:42:15.427841+0000","last_unstale":"2024-09-22T09:54:36.708613+0000","last_undegraded":"2024-09-22T09:54:36.708613+0000","last_fullsized":"2024-09-22T09:54:36.708613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'90","last_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_deep_scrub":"262'90","last_deep_scrub_stamp":"2024-09-22T09:54:36.708407+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.708407+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:32:19.337819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":312,"num_write":148,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"262'226","reported_seq":1056,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.887055+0000","last_change":"2024-09-22T09:54:27.887055+0000","last_active":"2024-09-22T09:54:27.887055+0000","last_peered":"2024-09-22T09:54:27.887055+0000","last_clean":"2024-09-22T09:54:27.887055+0000","last_became_active":"2024-09-22T08:42:13.407371+0000","last_became_peered":"2024-09-22T08:42:13.407371+0000","last_unstale":"2024-09-22T09:54:27.887055+0000","last_undegraded":"2024-09-22T09:54:27.887055+0000","last_fullsized":"2024-09-22T09:54:27.887055+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'226","last_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_deep_scrub":"262'226","last_deep_scrub_stamp":"2024-09-22T09:54:27.886918+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.886918+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T19:02:01.730176+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485773,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1623,"num_read_kb":135465,"num_write":994,"num_write_kb":35050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"262'143","reported_seq":742,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.688731+0000","last_change":"2024-09-22T09:54:26.688731+0000","last_active":"2024-09-22T09:54:26.688731+0000","last_peered":"2024-09-22T09:54:26.688731+0000","last_clean":"2024-09-22T09:54:26.688731+0000","last_became_active":"2024-09-22T08:42:15.433374+0000","last_became_peered":"2024-09-22T08:42:15.433374+0000","last_unstale":"2024-09-22T09:54:26.688731+0000","last_undegraded":"2024-09-22T09:54:26.688731+0000","last_fullsized":"2024-09-22T09:54:26.688731+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'143","last_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_deep_scrub":"262'143","last_deep_scrub_stamp":"2024-09-22T09:54:26.688639+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.688639+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:36:53.157417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":604,"num_read_kb":500,"num_write":207,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"262'180","reported_seq":793,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:28.510853+0000","last_change":"2024-09-22T09:54:28.510853+0000","last_active":"2024-09-22T09:54:28.510853+0000","last_peered":"2024-09-22T09:54:28.510853+0000","last_clean":"2024-09-22T09:54:28.510853+0000","last_became_active":"2024-09-22T08:42:13.395156+0000","last_became_peered":"2024-09-22T08:42:13.395156+0000","last_unstale":"2024-09-22T09:54:28.510853+0000","last_undegraded":"2024-09-22T09:54:28.510853+0000","last_fullsized":"2024-09-22T09:54:28.510853+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'180","last_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_deep_scrub":"262'180","last_deep_scrub_stamp":"2024-09-22T09:54:28.510744+0000","last_clean_scrub_stamp":"2024-09-22T09:54:28.510744+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T15:06:03.855576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170178,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":436,"num_read_kb":30385,"num_write":838,"num_write_kb":33422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"262'111","reported_seq":704,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.664254+0000","last_change":"2024-09-22T09:54:34.664254+0000","last_active":"2024-09-22T09:54:34.664254+0000","last_peered":"2024-09-22T09:54:34.664254+0000","last_clean":"2024-09-22T09:54:34.664254+0000","last_became_active":"2024-09-22T08:42:15.428385+0000","last_became_peered":"2024-09-22T08:42:15.428385+0000","last_unstale":"2024-09-22T09:54:34.664254+0000","last_undegraded":"2024-09-22T09:54:34.664254+0000","last_fullsized":"2024-09-22T09:54:34.664254+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'111","last_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_deep_scrub":"262'111","last_deep_scrub_stamp":"2024-09-22T09:54:34.664136+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.664136+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T18:40:52.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":412,"num_write":189,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"262'193","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.042434+0000","last_change":"2024-09-22T09:54:26.042434+0000","last_active":"2024-09-22T09:54:26.042434+0000","last_peered":"2024-09-22T09:54:26.042434+0000","last_clean":"2024-09-22T09:54:26.042434+0000","last_became_active":"2024-09-22T08:42:13.405229+0000","last_became_peered":"2024-09-22T08:42:13.405229+0000","last_unstale":"2024-09-22T09:54:26.042434+0000","last_undegraded":"2024-09-22T09:54:26.042434+0000","last_fullsized":"2024-09-22T09:54:26.042434+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'193","last_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_deep_scrub":"262'193","last_deep_scrub_stamp":"2024-09-22T09:54:26.042281+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.042281+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T16:39:00.923861+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242893,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":23430,"num_write":912,"num_write_kb":33694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"262'276","reported_seq":894,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:35.612459+0000","last_change":"2024-09-22T09:54:35.612459+0000","last_active":"2024-09-22T09:54:35.612459+0000","last_peered":"2024-09-22T09:54:35.612459+0000","last_clean":"2024-09-22T09:54:35.612459+0000","last_became_active":"2024-09-22T08:42:15.438138+0000","last_became_peered":"2024-09-22T08:42:15.438138+0000","last_unstale":"2024-09-22T09:54:35.612459+0000","last_undegraded":"2024-09-22T09:54:35.612459+0000","last_fullsized":"2024-09-22T09:54:35.612459+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'276","last_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_deep_scrub":"262'276","last_deep_scrub_stamp":"2024-09-22T09:54:35.612365+0000","last_clean_scrub_stamp":"2024-09-22T09:54:35.612365+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:42:05.176874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":970,"num_write":455,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"262'212","reported_seq":841,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:26.863062+0000","last_change":"2024-09-22T09:54:26.863062+0000","last_active":"2024-09-22T09:54:26.863062+0000","last_peered":"2024-09-22T09:54:26.863062+0000","last_clean":"2024-09-22T09:54:26.863062+0000","last_became_active":"2024-09-22T08:42:13.405721+0000","last_became_peered":"2024-09-22T08:42:13.405721+0000","last_unstale":"2024-09-22T09:54:26.863062+0000","last_undegraded":"2024-09-22T09:54:26.863062+0000","last_fullsized":"2024-09-22T09:54:26.863062+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'212","last_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_deep_scrub":"262'212","last_deep_scrub_stamp":"2024-09-22T09:54:26.862976+0000","last_clean_scrub_stamp":"2024-09-22T09:54:26.862976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:17.663525+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":16539,"num_write":978,"num_write_kb":26113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"262'186","reported_seq":849,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.043413+0000","last_change":"2024-09-22T09:54:34.043413+0000","last_active":"2024-09-22T09:54:34.043413+0000","last_peered":"2024-09-22T09:54:34.043413+0000","last_clean":"2024-09-22T09:54:34.043413+0000","last_became_active":"2024-09-22T08:42:15.435066+0000","last_became_peered":"2024-09-22T08:42:15.435066+0000","last_unstale":"2024-09-22T09:54:34.043413+0000","last_undegraded":"2024-09-22T09:54:34.043413+0000","last_fullsized":"2024-09-22T09:54:34.043413+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'186","last_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_deep_scrub":"262'186","last_deep_scrub_stamp":"2024-09-22T09:54:34.043310+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.043310+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:07:36.199673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":859,"num_read_kb":714,"num_write":296,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"262'199","reported_seq":839,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:32.591536+0000","last_change":"2024-09-22T09:54:32.591536+0000","last_active":"2024-09-22T09:54:32.591536+0000","last_peered":"2024-09-22T09:54:32.591536+0000","last_clean":"2024-09-22T09:54:32.591536+0000","last_became_active":"2024-09-22T08:42:13.416069+0000","last_became_peered":"2024-09-22T08:42:13.416069+0000","last_unstale":"2024-09-22T09:54:32.591536+0000","last_undegraded":"2024-09-22T09:54:32.591536+0000","last_fullsized":"2024-09-22T09:54:32.591536+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'199","last_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_deep_scrub":"262'199","last_deep_scrub_stamp":"2024-09-22T09:54:32.591400+0000","last_clean_scrub_stamp":"2024-09-22T09:54:32.591400+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:08:24.382819+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":514,"num_read_kb":32145,"num_write":913,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"262'91","reported_seq":675,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:41.799963+0000","last_change":"2024-09-22T09:54:41.799963+0000","last_active":"2024-09-22T09:54:41.799963+0000","last_peered":"2024-09-22T09:54:41.799963+0000","last_clean":"2024-09-22T09:54:41.799963+0000","last_became_active":"2024-09-22T08:42:15.436546+0000","last_became_peered":"2024-09-22T08:42:15.436546+0000","last_unstale":"2024-09-22T09:54:41.799963+0000","last_undegraded":"2024-09-22T09:54:41.799963+0000","last_fullsized":"2024-09-22T09:54:41.799963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'91","last_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_deep_scrub":"262'91","last_deep_scrub_stamp":"2024-09-22T09:54:41.799878+0000","last_clean_scrub_stamp":"2024-09-22T09:54:41.799878+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T21:39:52.935799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":407,"num_read_kb":339,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"262'203","reported_seq":837,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:27.684314+0000","last_change":"2024-09-22T09:54:27.684247+0000","last_active":"2024-09-22T09:54:27.684314+0000","last_peered":"2024-09-22T09:54:27.684314+0000","last_clean":"2024-09-22T09:54:27.684314+0000","last_became_active":"2024-09-22T08:42:13.399777+0000","last_became_peered":"2024-09-22T08:42:13.399777+0000","last_unstale":"2024-09-22T09:54:27.684314+0000","last_undegraded":"2024-09-22T09:54:27.684314+0000","last_fullsized":"2024-09-22T09:54:27.684314+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:27.684082+0000","last_clean_scrub_stamp":"2024-09-22T09:54:27.684082+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:12:03.070485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493665,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":31835,"num_write":1011,"num_write_kb":36116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"262'154","reported_seq":777,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:34.613984+0000","last_change":"2024-09-22T09:54:34.613984+0000","last_active":"2024-09-22T09:54:34.613984+0000","last_peered":"2024-09-22T09:54:34.613984+0000","last_clean":"2024-09-22T09:54:34.613984+0000","last_became_active":"2024-09-22T08:42:15.433033+0000","last_became_peered":"2024-09-22T08:42:15.433033+0000","last_unstale":"2024-09-22T09:54:34.613984+0000","last_undegraded":"2024-09-22T09:54:34.613984+0000","last_fullsized":"2024-09-22T09:54:34.613984+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'154","last_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_deep_scrub":"262'154","last_deep_scrub_stamp":"2024-09-22T09:54:34.613865+0000","last_clean_scrub_stamp":"2024-09-22T09:54:34.613865+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T20:44:15.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":582,"num_write":237,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"262'227","reported_seq":896,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:29.479127+0000","last_change":"2024-09-22T09:54:29.479067+0000","last_active":"2024-09-22T09:54:29.479127+0000","last_peered":"2024-09-22T09:54:29.479127+0000","last_clean":"2024-09-22T09:54:29.479127+0000","last_became_active":"2024-09-22T08:42:13.416610+0000","last_became_peered":"2024-09-22T08:42:13.416610+0000","last_unstale":"2024-09-22T09:54:29.479127+0000","last_undegraded":"2024-09-22T09:54:29.479127+0000","last_fullsized":"2024-09-22T09:54:29.479127+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'227","last_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_deep_scrub":"262'227","last_deep_scrub_stamp":"2024-09-22T09:54:29.478897+0000","last_clean_scrub_stamp":"2024-09-22T09:54:29.478897+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:00:08.606241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242963,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":665,"num_read_kb":33540,"num_write":1138,"num_write_kb":54441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"262'203","reported_seq":820,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:31.379662+0000","last_change":"2024-09-22T09:54:31.379607+0000","last_active":"2024-09-22T09:54:31.379662+0000","last_peered":"2024-09-22T09:54:31.379662+0000","last_clean":"2024-09-22T09:54:31.379662+0000","last_became_active":"2024-09-22T08:42:13.413705+0000","last_became_peered":"2024-09-22T08:42:13.413705+0000","last_unstale":"2024-09-22T09:54:31.379662+0000","last_undegraded":"2024-09-22T09:54:31.379662+0000","last_fullsized":"2024-09-22T09:54:31.379662+0000","mapping_epoch":24,"log_start":"262'100","ondisk_log_start":"262'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'203","last_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_deep_scrub":"262'203","last_deep_scrub_stamp":"2024-09-22T09:54:31.379436+0000","last_clean_scrub_stamp":"2024-09-22T09:54:31.379436+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T17:44:11.349573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":478,"num_read_kb":16611,"num_write":909,"num_write_kb":42549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"262'168","reported_seq":781,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:36.056709+0000","last_change":"2024-09-22T09:54:36.056645+0000","last_active":"2024-09-22T09:54:36.056709+0000","last_peered":"2024-09-22T09:54:36.056709+0000","last_clean":"2024-09-22T09:54:36.056709+0000","last_became_active":"2024-09-22T08:42:15.431652+0000","last_became_peered":"2024-09-22T08:42:15.431652+0000","last_unstale":"2024-09-22T09:54:36.056709+0000","last_undegraded":"2024-09-22T09:54:36.056709+0000","last_fullsized":"2024-09-22T09:54:36.056709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:36.056545+0000","last_clean_scrub_stamp":"2024-09-22T09:54:36.056545+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T14:37:56.184943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":758,"num_read_kb":643,"num_write":268,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"262'230","reported_seq":910,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:25.226521+0000","last_change":"2024-09-22T09:54:25.226461+0000","last_active":"2024-09-22T09:54:25.226521+0000","last_peered":"2024-09-22T09:54:25.226521+0000","last_clean":"2024-09-22T09:54:25.226521+0000","last_became_active":"2024-09-22T08:42:13.421610+0000","last_became_peered":"2024-09-22T08:42:13.421610+0000","last_unstale":"2024-09-22T09:54:25.226521+0000","last_undegraded":"2024-09-22T09:54:25.226521+0000","last_fullsized":"2024-09-22T09:54:25.226521+0000","mapping_epoch":24,"log_start":"262'200","ondisk_log_start":"262'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'230","last_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_deep_scrub":"262'230","last_deep_scrub_stamp":"2024-09-22T09:54:25.226345+0000","last_clean_scrub_stamp":"2024-09-22T09:54:25.226345+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:28.279869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":659,"num_read_kb":76384,"num_write":1027,"num_write_kb":27775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"262'168","reported_seq":821,"reported_epoch":262,"state":"active+clean","last_fresh":"2024-09-22T09:54:37.389454+0000","last_change":"2024-09-22T09:54:37.389356+0000","last_active":"2024-09-22T09:54:37.389454+0000","last_peered":"2024-09-22T09:54:37.389454+0000","last_clean":"2024-09-22T09:54:37.389454+0000","last_became_active":"2024-09-22T08:42:15.432357+0000","last_became_peered":"2024-09-22T08:42:15.432357+0000","last_unstale":"2024-09-22T09:54:37.389454+0000","last_undegraded":"2024-09-22T09:54:37.389454+0000","last_fullsized":"2024-09-22T09:54:37.389454+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'168","last_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_deep_scrub":"262'168","last_deep_scrub_stamp":"2024-09-22T09:54:37.389263+0000","last_clean_scrub_stamp":"2024-09-22T09:54:37.389263+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:02.716245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":707,"num_write":271,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10247,"num_read_kb":9368,"num_write":2975,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1054,"ondisk_log_size":1054,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":16418,"num_read_kb":16094,"num_write":17075,"num_write_kb":4990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1587,"ondisk_log_size":1587,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":372077,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":10012,"num_read_kb":12519,"num_write":7007,"num_write_kb":3209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710212,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1817,"ondisk_log_size":1817,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108714,"num_read_kb":91243,"num_write":38058,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35500,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3786,"ondisk_log_size":3786,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":105523402,"num_objects":166,"num_object_clones":0,"num_object_copies":664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42464,"num_read_kb":2399835,"num_write":63370,"num_write_kb":2212897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142622720,"data_stored":142622720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4215,"ondisk_log_size":4215,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":189640,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":189064,"num_write":158,"num_write_kb":130688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543033,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265880,"kb_used_data":22280,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94105960,"statfs":{"total":96636764160,"available":96364503040,"internally_reserved":0,"allocated":22814720,"data_stored":20815259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":249428426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543033,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291592,"kb_used_data":21624,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94080248,"statfs":{"total":96636764160,"available":96338173952,"internally_reserved":0,"allocated":22142976,"data_stored":20214796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543035,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100912,"kb_used_data":19808,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94270928,"statfs":{"total":96636764160,"available":96533430272,"internally_reserved":0,"allocated":20283392,"data_stored":18282616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543034,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138192,"kb_used_data":26496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94233648,"statfs":{"total":96636764160,"available":96495255552,"internally_reserved":0,"allocated":27131904,"data_stored":25227113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543033,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249468,"kb_used_data":19756,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122372,"statfs":{"total":96636764160,"available":96381308928,"internally_reserved":0,"allocated":20230144,"data_stored":18263996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543037,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91232,"kb_used_data":19792,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280608,"statfs":{"total":96636764160,"available":96543342592,"internally_reserved":0,"allocated":20267008,"data_stored":18362428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543033,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149548,"kb_used_data":19868,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94222292,"statfs":{"total":96636764160,"available":96483627008,"internally_reserved":0,"allocated":20344832,"data_stored":18397529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543035,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261744,"kb_used_data":23712,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110096,"statfs":{"total":96636764160,"available":96368738304,"internally_reserved":0,"allocated":24281088,"data_stored":22309261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19460096,"data_stored":19460096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16138240,"data_stored":16138240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":16105472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":16003072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22970368,"data_stored":22970368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16023552,"data_stored":16023552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17956864,"data_stored":17956864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17965056,"data_stored":17965056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T09:55:44.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T09:55:44.391 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T09:55:44.391 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T09:55:44.391 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T09:55:44.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.448 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T09:55:44.448 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T09:55:44.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.490 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T09:55:44.490 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T09:55:44.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.543 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T09:55:44.543 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T09:55:44.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.584 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T09:55:44.585 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-22T09:55:44.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.636 INFO:tasks.ceph.osd.4:Stopped 2024-09-22T09:55:44.636 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-22T09:55:44.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.676 INFO:tasks.ceph.osd.5:Stopped 2024-09-22T09:55:44.677 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-22T09:55:44.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.723 INFO:tasks.ceph.osd.6:Stopped 2024-09-22T09:55:44.724 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-22T09:55:44.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.781 INFO:tasks.ceph.osd.7:Stopped 2024-09-22T09:55:44.781 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T09:55:44.781 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-22T09:55:44.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.809 INFO:tasks.ceph.mgr.y:Stopped 2024-09-22T09:55:44.809 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T09:55:44.809 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.837 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T09:55:44.837 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T09:55:44.837 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T09:55:44.837 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.866 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T09:55:44.867 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-22T09:55:44.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.920 INFO:tasks.ceph.mon.c:Stopped 2024-09-22T09:55:44.920 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-22T09:55:44.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T09:55:44.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-22T09:55:44.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-22T09:55:44.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-22T09:55:44.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-22T09:55:44.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-22T09:55:44.934 INFO:tasks.ceph.mon.b:Stopped 2024-09-22T09:55:44.934 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T09:55:44.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-22T09:55:45.004 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:55:45.004 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T09:55:45.253 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:55:45.253 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T09:55:45.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:55:45.347 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T09:55:45.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:55:45.434 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T09:55:45.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:55:45.528 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-22T09:55:45.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:55:45.723 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-22T09:55:45.815 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:55:45.816 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-22T09:55:45.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:55:45.895 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-22T09:55:45.970 INFO:tasks.ceph:Archiving mon data... 2024-09-22T09:55:45.971 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/data/mon.a.tgz 2024-09-22T09:55:45.972 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-22T09:55:46.002 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.Uj6cbVY3Wu 2024-09-22T09:55:46.003 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Uj6cbVY3Wu 2024-09-22T09:55:46.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.Uj6cbVY3Wu 2024-09-22T09:55:46.324 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.Uj6cbVY3Wu is 518KB 2024-09-22T09:55:46.420 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.Uj6cbVY3Wu 2024-09-22T09:55:46.450 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/data/mon.c.tgz 2024-09-22T09:55:46.450 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-22T09:55:46.519 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.70LN4UYwGN 2024-09-22T09:55:46.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.70LN4UYwGN 2024-09-22T09:55:46.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.70LN4UYwGN 2024-09-22T09:55:46.836 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.70LN4UYwGN is 539KB 2024-09-22T09:55:46.933 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.70LN4UYwGN 2024-09-22T09:55:46.962 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/data/mon.b.tgz 2024-09-22T09:55:46.962 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-22T09:55:46.994 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.9bQlQWRB1d 2024-09-22T09:55:46.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9bQlQWRB1d 2024-09-22T09:55:47.467 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.9bQlQWRB1d 2024-09-22T09:55:47.577 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.9bQlQWRB1d is 539KB 2024-09-22T09:55:47.674 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.9bQlQWRB1d 2024-09-22T09:55:47.703 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T09:55:47.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T09:55:47.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T09:55:47.901 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T09:55:47.929 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T09:55:47.930 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T09:55:47.931 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi039/crash 2024-09-22T09:55:47.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T09:55:47.973 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi117/crash 2024-09-22T09:55:47.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T09:55:48.011 INFO:tasks.ceph:Compressing logs... 2024-09-22T09:55:48.011 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T09:55:48.017 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38674.log 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89171.log 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159272.log 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38674.log.gz 2024-09-22T09:55:48.057 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.89171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89171.log.gz 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.159272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158682.log 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159272.log.gz 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.57988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56810.log 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.158682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141596.log 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.158682.log.gz 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.56810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161649.log 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.56810.log.gz 2024-09-22T09:55:48.058 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.141596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90349.log 2024-09-22T09:55:48.099 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-09-22T09:55:48.099 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-22T09:55:48.099 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-09-22T09:55:48.099 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32799.log: /var/log/ceph/ceph-osd.7.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-09-22T09:55:48.099 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32711.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32887.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32711.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32711.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32887.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.32887.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32755.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32607.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32755.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32843.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32607.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32843.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32843.log.gz 2024-09-22T09:55:48.100 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T09:55:48.101 INFO:teuthology.orchestra.run.smithi117.stderr: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T09:55:48.101 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T09:55:48.101 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-09-22T09:55:48.101 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-22T09:55:48.101 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.32933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-09-22T09:55:48.102 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T09:55:48.146 INFO:teuthology.orchestra.run.smithi117.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T09:55:48.163 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26708.log 2024-09-22T09:55:48.163 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.161649.log: /var/log/ceph/ceph-client.admin.90349.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.161649.log.gz 2024-09-22T09:55:48.163 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2024-09-22T09:55:48.163 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.90349.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61542.log 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.tmp-client.admin.26708.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.141596.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26708.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.46064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184441.log 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr: 82.6%/var/log/ceph/ceph-client.admin.61542.log: -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113909.log 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr: 49.3% -- replaced with /var/log/ceph/ceph-client.admin.61542.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.184441.log: /var/log/ceph/ceph-client.admin.109197.log 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.184441.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.113909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152792.log 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.109197.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.113909.log.gz 2024-09-22T09:55:48.164 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188744.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109197.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.152792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167375.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.152792.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81514.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188744.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.167375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149254.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.81514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62130.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.81514.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.167375.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.149254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39490.log 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.149254.log.gz 2024-09-22T09:55:48.165 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153970.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.62130.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74947.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39490.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.153970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39170.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.153970.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.74947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40654.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.74947.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105663.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39170.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83870.log 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40654.log.gz 2024-09-22T09:55:48.166 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.105663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48444.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105663.log.gz 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.83870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89760.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83870.log.gz 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188060.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.48444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48444.log.gz 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.89760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97417.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102718.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188060.log.gz 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.97417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188014.log 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.102718.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.97417.log.gz 2024-09-22T09:55:48.167 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149843.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102718.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89760.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169746.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188014.log: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.188014.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.149843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191452.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.169746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76504.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191452.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169746.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191452.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61861.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118621.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.76504.log: /var/log/ceph/ceph-client.admin.61861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40566.log 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.149843.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.61861.log.gz 2024-09-22T09:55:48.168 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.118621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157504.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.118621.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132759.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40566.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.157504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126279.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157504.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188793.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.132759.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132759.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.126279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191176.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126279.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188793.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.188793.log.gz 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65905.log 2024-09-22T09:55:48.169 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191176.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.76504.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135706.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.65905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162286.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.135706.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.135706.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.162286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125690.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.162286.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82103.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.125690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41889.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.125690.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.82103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39162.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.82103.log.gz 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.41889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123923.log 2024-09-22T09:55:48.170 INFO:teuthology.orchestra.run.smithi039.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.41889.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39162.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.123923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98595.log 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.123923.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39166.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.0.43101.log 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.98595.log: gzip -5 81.5% -- replaced with /var/log/ceph/ceph-client.admin.98595.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.131581.log 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.43101.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43101.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108608.log 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.131581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50872.log 93.0% -- replaced with /var/log/ceph/ceph-client.admin.65905.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131581.log.gz 2024-09-22T09:55:48.171 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.108608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47831.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108608.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39909.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.50872.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.47831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70240.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.47831.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39909.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39909.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.139829.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.70240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92116.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.139829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70904.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.92116.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.139829.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92116.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72580.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.70904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191038.log 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.70904.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.72580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40108.log 83.9% -- replaced with /var/log/ceph/ceph-client.admin.72580.log.gz 2024-09-22T09:55:48.172 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191038.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126868.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40108.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40108.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.82692.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.126868.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70240.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43704.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.82692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68383.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: 80.5%/var/log/ceph/ceph-client.0.43704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61654.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82692.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43704.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.68383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108019.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.126868.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.61654.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.163464.log 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.61654.log.gz 2024-09-22T09:55:48.173 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.108019.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.40610.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108019.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.163464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38820.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.163464.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.40610.log: -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: /var/log/ceph/ceph-client.0.44307.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38820.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.68383.log.gzgzip 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.138062.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189488.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.44307.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44307.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.138062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53817.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.189488.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138062.log.gz 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162238.log 2024-09-22T09:55:48.174 INFO:teuthology.orchestra.run.smithi039.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.189488.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172936.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.53817.log: /var/log/ceph/ceph-client.admin.162238.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.53817.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162238.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39884.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.172936.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.191268.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188696.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39884.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172936.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124512.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191268.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.188696.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85048.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188696.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.124512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112142.log 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.124512.log.gz 2024-09-22T09:55:48.175 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.85048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188084.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.85048.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.112142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77979.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.112142.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.188084.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.146898.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.77979.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.188084.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109786.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.77979.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.146898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116265.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.109786.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.146898.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192095.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.109786.log.gz 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.116265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191866.log 2024-09-22T09:55:48.176 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.192095.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.116265.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192095.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169138.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55584.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191866.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.169138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61940.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.55584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183832.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.55584.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.61940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191636.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.169138.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61940.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.183832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164053.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191636.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.183832.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191636.log.gz 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75725.log 2024-09-22T09:55:48.177 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164101.log 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.164053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164053.log.gz 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.75725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.75725.log.gz 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.164101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39538.log 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.46653.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164101.log.gz 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85637.log 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59214.log 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39538.log.gz 2024-09-22T09:55:48.178 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.85637.log: /var/log/ceph/ceph-client.admin.59214.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.85637.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111553.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.59214.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192005.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.111553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188036.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.111553.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.192005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38912.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192005.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133937.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188036.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183223.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.133937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144542.log 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.133937.log.gz 2024-09-22T09:55:48.179 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132170.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.183223.log: /var/log/ceph/ceph-client.admin.144542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191130.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.144542.log.gz 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183223.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.132170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91527.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132170.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191130.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.91527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190946.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91527.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.49057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33218.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180787.log 2024-09-22T09:55:48.180 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.190946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190946.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.33218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176524.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33218.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104485.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.180787.log: /var/log/ceph/ceph-client.0.176524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.180787.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176524.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.104485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65286.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50235.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.104485.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74356.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.65286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93294.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.74356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138651.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 82.2%/var/log/ceph/ceph-client.admin.93294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76435.log 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74356.log.gz 2024-09-22T09:55:48.181 INFO:teuthology.orchestra.run.smithi039.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.93294.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.138651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60392.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.138651.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.76435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120977.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: 49.0% -- replaced with /var/log/ceph/ceph-client.admin.76435.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.60392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139240.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.60392.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.120977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62728.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.139240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162875.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62728.log: 82.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.139240.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39167.log 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.62728.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.162875.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.162875.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.120977.log.gz 2024-09-22T09:55:48.182 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39167.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39167.log.gz 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105074.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.65286.log.gz 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66525.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78569.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.105074.log: /var/log/ceph/ceph-client.admin.66525.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105074.log.gz 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99773.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.78569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115676.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.78569.log.gz 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.99773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191498.log 2024-09-22T09:55:48.183 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.115676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69002.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99773.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115676.log.gz/var/log/ceph/ceph-client.admin.191498.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191498.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.66525.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69621.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.69002.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154559.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.69621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103896.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.154559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100362.log 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.154559.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.103896.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69002.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103896.log.gz 2024-09-22T09:55:48.184 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191590.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69621.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.100362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136884.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.100362.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191590.log: /var/log/ceph/ceph-client.admin.136884.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165279.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191590.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: 85.0%/var/log/ceph/ceph-client.admin.39161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191544.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136884.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182005.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.165279.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.165279.log.gz 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148665.log 2024-09-22T09:55:48.185 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191544.log: /var/log/ceph/ceph-client.0.182005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191360.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.182005.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191544.log.gz/var/log/ceph/ceph-client.admin.148665.log: 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107430.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.148665.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164077.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191360.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.107430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162262.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.107430.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.164077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122156.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164077.log.gz 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.162262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39539.log 2024-09-22T09:55:48.186 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162262.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.122156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127457.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122156.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187424.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39539.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.127457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53228.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.127457.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.187424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159882.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.187424.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.53228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40677.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.53228.log.gz 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40154.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.159882.log: /var/log/ceph/ceph-client.0.40677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96828.log 2024-09-22T09:55:48.187 INFO:teuthology.orchestra.run.smithi039.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.159882.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:gzip/var/log/ceph/ceph-client.admin.40154.log: -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.191912.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40154.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.96828.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.96828.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40677.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191406.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191912.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99184.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191406.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73175.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.99184.log: gzip -5 --verbose 81.1% -- replaced with /var/log/ceph/ceph-client.admin.99184.log.gz 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr: -- /var/log/ceph/ceph-client.admin.50848.log 2024-09-22T09:55:48.188 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.73175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50848.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125101.log 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73175.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188674.log 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.125101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191314.log 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188674.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125101.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- 24.6% -- replaced with /var/log/ceph/ceph-client.admin.188674.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr: /var/log/ceph/ceph-client.admin.101540.log 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191314.log.gz 2024-09-22T09:55:48.189 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62068.log 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.101540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62840.log 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.101540.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62068.log: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.62068.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188720.log 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134528.log 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.62840.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188720.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90938.log 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.134528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133348.log 81.1% -- replaced with /var/log/ceph/ceph-client.admin.134528.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.90938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86226.log 81.2% -- replaced with /var/log/ceph/ceph-client.admin.90938.log.gz 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.190 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.133348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118032.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.86226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59166.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86226.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.118032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160471.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.118032.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.133348.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130992.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.59166.log: /var/log/ceph/ceph-client.admin.160471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110964.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.160471.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.130992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59166.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130992.log.gz 2024-09-22T09:55:48.191 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.110964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167983.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110964.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38866.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: /var/log/ceph/ceph-client.admin.87993.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.167983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80925.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.87993.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.167983.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191774.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.87993.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.80925.log: gzip -5 --verbose -- 81.4% -- replaced with /var/log/ceph/ceph-client.admin.80925.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: /var/log/ceph/ceph-client.admin.155148.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191774.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120388.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.155148.log: gzip -5 --verbose -- 81.4% -- replaced with /var/log/ceph/ceph-client.admin.155148.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: /var/log/ceph/ceph-mon.a.log 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.120388.log: gzip 82.3% -- replaced with /var/log/ceph/ceph-client.admin.120388.log.gz 2024-09-22T09:55:48.192 INFO:teuthology.orchestra.run.smithi039.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58577.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39881.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.58577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.58577.log.gz 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39881.log.gz 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93883.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145720.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161060.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.93883.log: /var/log/ceph/ceph-client.admin.145720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145131.log 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7%/var/log/ceph/ceph-client.admin.161060.log: -- replaced with /var/log/ceph/ceph-client.admin.93883.log.gz 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.161060.log.gz 2024-09-22T09:55:48.193 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79158.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.145131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128046.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145131.log.gz 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145720.log.gz 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.79158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50824.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79158.log.gz 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.128046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122745.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.128046.log.gz 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.50824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50824.log.gz 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114498.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.122745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56786.log 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.114498.log: gzip 81.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.122745.log.gz --verbose 2024-09-22T09:55:48.194 INFO:teuthology.orchestra.run.smithi039.stderr: -- /var/log/ceph/ceph-client.admin.119799.log 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 86.8% -- replaced with /var/log/ceph/ceph-client.admin.114498.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr: --verbose -- /var/log/ceph/ceph-client.admin.151614.log 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.119799.log: /var/log/ceph/ceph-client.admin.56786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48468.log 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119799.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.151614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56786.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39890.log 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.48468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143953.log 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39890.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180178.log 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.151614.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39890.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.143953.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.143953.log.gz 2024-09-22T09:55:48.195 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112731.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.180178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123334.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.180178.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.112731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153381.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.123334.log: /var/log/ceph/ceph-client.admin.33125.log: 0.0% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.123334.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.112731.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.153381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173544.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152203.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.173544.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173544.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153381.log.gz 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142185.log 2024-09-22T09:55:48.196 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.152203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172328.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.152203.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.142185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190181.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 81.6%/var/log/ceph/ceph-client.admin.172328.log: -- replaced with /var/log/ceph/ceph-client.admin.142185.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172328.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129225.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.190181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39873.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.129225.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.129225.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 90.6%/var/log/ceph/ceph-client.admin.39873.log: -- replaced with /var/log/ceph/ceph-client.0.190181.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39873.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61290.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59190.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 62.6% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.61290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77113.log 2024-09-22T09:55:48.197 INFO:teuthology.orchestra.run.smithi039.stderr: 59.2%/var/log/ceph/ceph-client.admin.59190.log: -- replaced with /var/log/ceph/ceph-client.admin.61290.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59190.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52639.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117443.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.77113.log: /var/log/ceph/ceph-client.admin.52639.log: 79.9% -- replaced with /var/log/ceph/ceph-client.0.77113.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.52639.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73765.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142774.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.73765.log: /var/log/ceph/ceph-client.admin.117443.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.73765.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117443.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164690.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.142774.log: /var/log/ceph/ceph-client.admin.164690.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.142774.log.gz 2024-09-22T09:55:48.198 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2024-09-22T09:55:48.199 INFO:teuthology.orchestra.run.smithi039.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164690.log.gz 2024-09-22T09:55:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-09-22T09:55:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2024-09-22T09:55:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158093.log 2024-09-22T09:55:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2024-09-22T09:55:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155737.log 2024-09-22T09:55:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.158093.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.158093.log.gz 2024-09-22T09:55:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86815.log 2024-09-22T09:55:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.155737.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.155737.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62004.log 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.86815.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86815.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100951.log 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49646.log 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.100951.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62004.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146309.log 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.49646.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.49646.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64048.log 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.146309.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146309.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-22T09:55:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.64048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121566.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.64048.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151021.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.121566.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121566.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177742.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.151021.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.151021.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.100951.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113320.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.177742.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.177742.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115087.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.113320.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.113320.log.gz 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188769.log 2024-09-22T09:55:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.115087.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.115087.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128636.log 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.188769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188769.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75116.log 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.128636.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.128636.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83281.log 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.75116.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.75116.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67145.log 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.83281.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83281.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177133.log 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.67145.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67145.log.gz 2024-09-22T09:55:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.177133.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.177133.log.gz 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191682.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186835.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz/var/log/ceph/ceph-client.admin.191682.log: 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191682.log.gz 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39163.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.186835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39160.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.186835.log.gz 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39163.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57399.log 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:55:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39160.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143364.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.57399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62664.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.57399.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.143364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94472.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.62664.log: 87.0% 19.9% -- replaced with /var/log/ceph/ceph-client.admin.143364.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62664.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48420.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.94472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156915.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94472.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.48420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39540.log 2024-09-22T09:55:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.156915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63429.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.156915.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39540.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174668.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191820.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.174668.log: /var/log/ceph/ceph-client.admin.63429.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.174668.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191820.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59803.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.47242.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40478.log 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.59803.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.59803.log.gz 2024-09-22T09:55:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79747.log 2024-09-22T09:55:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40478.log.gz 2024-09-22T09:55:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67764.log 2024-09-22T09:55:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.79747.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.79747.log.gz 2024-09-22T09:55:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.67764.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.63429.log.gz 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96239.log 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.40522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191728.log 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.96239.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.96239.log.gz 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191084.log 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191728.log.gz 2024-09-22T09:55:48.236 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56762.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191084.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.56762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56762.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181396.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135117.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.181396.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181396.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54406.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.135117.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.135117.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192051.log 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.54406.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.54406.log.gz 2024-09-22T09:55:48.237 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84459.log 2024-09-22T09:55:48.238 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.192051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192051.log.gz 2024-09-22T09:55:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156326.log 2024-09-22T09:55:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.84459.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84459.log.gz 2024-09-22T09:55:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39457.log 2024-09-22T09:55:48.239 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.156326.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.156326.log.gz 2024-09-22T09:55:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103307.log 2024-09-22T09:55:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39457.log.gz 2024-09-22T09:55:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92705.log 2024-09-22T09:55:48.240 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.103307.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103307.log.gz 2024-09-22T09:55:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159293.log 2024-09-22T09:55:48.241 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.92705.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.92705.log.gz 2024-09-22T09:55:48.242 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178351.log 2024-09-22T09:55:48.242 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.159293.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.159293.log.gz 2024-09-22T09:55:48.243 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191959.log 2024-09-22T09:55:48.243 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.178351.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.178351.log.gz 2024-09-22T09:55:48.244 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110375.log 2024-09-22T09:55:48.244 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191959.log.gz 2024-09-22T09:55:48.244 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95061.log 2024-09-22T09:55:48.245 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.110375.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.110375.log.gz 2024-09-22T09:55:48.246 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147487.log 2024-09-22T09:55:48.255 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.95061.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95061.log.gz 2024-09-22T09:55:48.255 INFO:teuthology.orchestra.run.smithi039.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.67764.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88582.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.147487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171720.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147487.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.88582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141007.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.171720.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.88582.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42498.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171720.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.141007.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.42498.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.141007.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42498.log.gz 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170962.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175276.log 2024-09-22T09:55:48.256 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.170962.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170962.log.gz 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.175276.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.175276.log.gz 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182614.log 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129814.log 2024-09-22T09:55:48.257 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.182614.log: 83.5% -- replaced with /var/log/ceph/ceph-client.0.182614.log.gz 2024-09-22T09:55:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179569.log 2024-09-22T09:55:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.129814.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129814.log.gz 2024-09-22T09:55:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80336.log 2024-09-22T09:55:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.179569.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.179569.log.gz 2024-09-22T09:55:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106252.log 2024-09-22T09:55:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.80336.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80336.log.gz 2024-09-22T09:55:48.261 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119210.log 2024-09-22T09:55:48.262 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.106252.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.106252.log.gz 2024-09-22T09:55:48.263 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137473.log 2024-09-22T09:55:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.119210.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.119210.log.gz 2024-09-22T09:55:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87404.log 2024-09-22T09:55:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.137473.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137473.log.gz 2024-09-22T09:55:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102129.log 2024-09-22T09:55:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.87404.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.87404.log.gz 2024-09-22T09:55:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41286.log 2024-09-22T09:55:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.102129.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102129.log.gz 2024-09-22T09:55:48.268 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130403.log 2024-09-22T09:55:48.269 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.41286.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41286.log.gz 2024-09-22T09:55:48.269 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54995.log 2024-09-22T09:55:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.130403.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.130403.log.gz 2024-09-22T09:55:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140418.log 2024-09-22T09:55:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.54995.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.54995.log.gz 2024-09-22T09:55:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39908.log 2024-09-22T09:55:48.273 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.140418.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140418.log.gz 2024-09-22T09:55:48.273 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38572.log 2024-09-22T09:55:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39908.log.gz 2024-09-22T09:55:48.274 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136295.log 2024-09-22T09:55:48.275 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.38572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38572.log.gz 2024-09-22T09:55:48.275 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106841.log 2024-09-22T09:55:48.276 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.136295.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136295.log.gz 2024-09-22T09:55:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150432.log 2024-09-22T09:55:48.277 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.106841.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.106841.log.gz 2024-09-22T09:55:48.278 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185050.log 2024-09-22T09:55:48.279 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.150432.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.150432.log.gz 2024-09-22T09:55:48.279 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95650.log 2024-09-22T09:55:48.280 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.185050.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.185050.log.gz 2024-09-22T09:55:48.281 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148076.log 2024-09-22T09:55:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.95650.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95650.log.gz 2024-09-22T09:55:48.282 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166725.log 2024-09-22T09:55:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.148076.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.148076.log.gz 2024-09-22T09:55:48.283 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39751.log 2024-09-22T09:55:48.284 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.166725.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.166725.log.gz 2024-09-22T09:55:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185659.log 2024-09-22T09:55:48.285 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39751.log.gz 2024-09-22T09:55:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51461.log 2024-09-22T09:55:48.286 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.185659.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.185659.log.gz 2024-09-22T09:55:48.287 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190992.log 2024-09-22T09:55:48.288 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.51461.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.51461.log.gz 2024-09-22T09:55:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116854.log 2024-09-22T09:55:48.289 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.190992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190992.log.gz 2024-09-22T09:55:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175915.log 2024-09-22T09:55:48.290 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.116854.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116854.log.gz 2024-09-22T09:55:48.291 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39172.log 2024-09-22T09:55:48.291 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.175915.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.175915.log.gz 2024-09-22T09:55:48.292 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64667.log 2024-09-22T09:55:48.292 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39172.log.gz 2024-09-22T09:55:48.293 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T09:55:48.300 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.64667.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.64667.log.gz 2024-09-22T09:55:48.301 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52050.log 2024-09-22T09:55:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191222.log 2024-09-22T09:55:48.319 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.52050.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.52050.log.gz 2024-09-22T09:55:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71991.log 2024-09-22T09:55:48.327 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.191222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191222.log.gz 2024-09-22T09:55:48.339 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178960.log 2024-09-22T09:55:48.340 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.71991.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.71991.log.gz 2024-09-22T09:55:48.347 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98006.log 2024-09-22T09:55:48.356 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.0.178960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170354.log 2024-09-22T09:55:48.359 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.98006.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.178960.log.gz 2024-09-22T09:55:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56173.log 2024-09-22T09:55:48.370 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.170354.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.98006.log.gz 2024-09-22T09:55:48.373 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39888.log 2024-09-22T09:55:48.377 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.56173.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170354.log.gz 2024-09-22T09:55:48.386 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.39888.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.56173.log.gz 2024-09-22T09:55:48.395 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39888.log.gz 2024-09-22T09:55:48.871 INFO:teuthology.orchestra.run.smithi039.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-22T09:55:49.336 INFO:teuthology.orchestra.run.smithi117.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-22T09:55:49.481 INFO:teuthology.orchestra.run.smithi039.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-22T09:55:49.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-22T09:55:49.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-22T09:55:49.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-22T09:55:49.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-22T09:55:49.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-22T09:55:50.968 INFO:teuthology.orchestra.run.smithi039.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T09:55:52.409 INFO:teuthology.orchestra.run.smithi039.stderr: 92.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-22T09:55:55.111 INFO:teuthology.orchestra.run.smithi039.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T09:55:55.922 INFO:teuthology.orchestra.run.smithi117.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-22T09:55:56.957 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-22T09:55:57.387 INFO:teuthology.orchestra.run.smithi039.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T09:55:57.651 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-22T09:56:02.627 INFO:teuthology.orchestra.run.smithi039.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T09:56:06.204 INFO:teuthology.orchestra.run.smithi117.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-22T09:56:06.206 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-22T09:56:06.206 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m18.126s 2024-09-22T09:56:06.206 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m44.028s 2024-09-22T09:56:06.206 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m1.585s 2024-09-22T09:56:09.422 INFO:teuthology.orchestra.run.smithi039.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T09:56:09.424 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-22T09:56:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m21.380s 2024-09-22T09:56:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m59.411s 2024-09-22T09:56:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m2.101s 2024-09-22T09:56:09.425 INFO:tasks.ceph:Archiving logs... 2024-09-22T09:56:09.425 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi039/log 2024-09-22T09:56:09.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T09:56:17.097 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi117/log 2024-09-22T09:56:17.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T09:56:22.991 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T09:56:23.002 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T09:56:23.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T09:56:23.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T09:56:23.103 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T09:56:23.115 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T09:56:23.115 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T09:56:23.118 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T09:56:23.150 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-22T09:56:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 7 377 103 +33us[+5514ns] +/- 39ms 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -533us[ -533us] +/- 55ms 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 36 +524us[ +524us] +/- 87ms 2024-09-22T09:56:23.154 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T09:56:23.155 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T09:56:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-22T09:56:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +79us[ +73us] +/- 40ms 2024-09-22T09:56:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -471us[ -471us] +/- 55ms 2024-09-22T09:56:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +546us[ +540us] +/- 87ms 2024-09-22T09:56:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T09:56:23.156 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T09:56:23.166 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T09:56:23.166 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T09:56:23.178 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T09:56:23.282 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T09:56:23.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T09:56:23.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:56:23.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T09:56:23.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:56:23.448 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T09:56:23.458 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T09:56:23.469 INFO:teuthology.task.internal:Duration was 4923.505177 seconds 2024-09-22T09:56:23.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T09:56:23.483 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T09:56:23.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T09:56:23.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T09:56:23.541 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T09:56:23.541 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T09:56:23.790 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T09:56:23.791 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-22T09:56:23.791 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T09:56:23.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-22T09:56:23.825 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T09:56:23.867 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T09:56:23.867 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T09:56:23.870 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T09:56:23.946 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T09:56:23.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T09:56:23.951 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T09:56:24.100 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T09:56:24.113 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T09:56:24.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T09:56:24.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T09:56:24.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T09:56:24.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:56:24.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:56:24.243 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-22T09:56:24.269 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-22T09:56:24.321 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:56:24.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:56:24.350 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T09:56:24.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T09:56:24.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T09:56:24.401 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T09:56:24.402 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi039 2024-09-22T09:56:24.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T09:56:24.452 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-09-22_06:37:27-rgw-wip-skoduri-cloud-restore-distro-default-smithi/7915073/remote/smithi117 2024-09-22T09:56:24.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T09:56:24.497 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T09:56:24.497 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T09:56:24.500 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T09:56:24.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T09:56:24.575 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T09:56:24.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T09:56:24.586 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T09:56:24.586 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T09:56:24.589 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T09:56:24.616 INFO:teuthology.orchestra.run.smithi039.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 09:56 /home/ubuntu/cephtest 2024-09-22T09:56:24.630 INFO:teuthology.orchestra.run.smithi117.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 09:56 /home/ubuntu/cephtest 2024-09-22T09:56:24.631 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T09:56:24.643 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T09:56:24.674 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4923.505176782608 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-09-22T09:56:24.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T09:56:24.758 INFO:teuthology.run:pass